Skip Duplicates with SQL*Loader [message #72305] |
Fri, 09 May 2003 03:42 |
Scott Ford
Messages: 1 Registered: May 2003
|
Junior Member |
|
|
Hello!
Any help would be very much appreciated -
I have a file with exact duplicate records and I just want to skip then during a load.
(Using 'distinct' in my extract makes the query perform like a dog. I don't want to load all the duplicates then weed them out because it's 3GB of data compared to 300MB).
Many thanks,
Scott
|
|
|
Re: Skip Duplicates with SQL*Loader [message #72328 is a reply to message #72305] |
Sat, 17 May 2003 16:11 |
LevR
Messages: 1 Registered: May 2003
|
Junior Member |
|
|
I had the same problem. To fix it intermediate file "list.txt" was used in control. Option "-u" for sort does the job:
sort -u list_orig.txt > list.txt
sqlldr db/pswrd@instance control=control.ctl
|
|
|