resultset.next() bottleneck-Problem [message #195579] |
Fri, 29 September 2006 09:28 |
ohaider
Messages: 1 Registered: September 2006
|
Junior Member |
|
|
Hello,
I got a problem with a big database.
We got a table with more the 6.000.000 lines and 250 fields. We are reading the data from java over the jdbc-driver. The problem is we have to get the data from the db very fast and the bottleneck is the resultset.next() for the next resultset. We tried to accelerate it by using several threads getting data from the resultset.next() but there was no improvement.
Since there is the possibility to set the fetchSize of the statements (what seems to work if I have a look at the ip-communication) is there also a possibility to get this prefetched data fast or in a parallel way?
Thank you very much
Oliver
|
|
|
Re: resultset.next() bottleneck-Problem [message #195668 is a reply to message #195579] |
Sat, 30 September 2006 15:16 |
mchadder
Messages: 224 Registered: May 2005 Location: UK
|
Senior Member |
|
|
Hello there.
Well, the obvious thing to ask firstly is how much data are you fetching from this 6 million row table into your java process? And, what do you then do with the data in terms of subsequent processing?
Rgds
|
|
|