Re: Extracting large volumes of data from oracle to flat files - Poor Performance

Hi,

Just for the test try Chyfo (www.ispirer.com/products). This is data export and migration tool. On our system it exports 1M rows per minute. Using it you will find a bottleneck (SQLPlus or network/DB).

Best regards, Dmitry.

"mark" <mark_knisely_at_yahoo.com> wrote in message news:8d852b26.0111211025.62ca1e49_at_posting.google.com...
> We are working on a data mart and we need to extract large
> volumes of transactional data from the source system (also
> Oracle DB) to flat files. We then use SQL Loader with the
> direct option to load the data into our staging tables. While
> the Load performs very well (less than 10 minutes to load 4
> million records), the extract is Extremely slow. The method we
> are currently using for the extract is an sql script (SQL Plus)
> spooling to a comma separated flat file. For 4 million records,
> the process is taking ~4+ hours to complete. We moved to a dual
> processor machine and that didn't make any difference - in fact,
> both CPU remain over 90% idle while the extract is running. Is
> there a more effective than SQL Plus to extact data to a flat
> file?
Received on Thu Nov 22 2001 - 09:02:50 CST