streams for warehousing [message #75735] |
Tue, 24 August 2004 08:52  |
john b.
Messages: 4 Registered: January 2001
|
Junior Member |
|
|
this is a newbie question:
- we have a large warehouse that we want to replicate around the world.
- we need to replicate *large* tables, which have regular *large* volume data loads. can streams handle millions of batch updates?
- what are others experiences using streams for this kind of application on 9i? i hear 9205 is much more stable. opinions?
any wisdom welcome.
john
|
|
|
Re: streams for warehousing [message #75736 is a reply to message #75735] |
Tue, 24 August 2004 10:57   |
andy
Messages: 92 Registered: December 1999
|
Member |
|
|
You might consider Ixion IxPropagator for this type of application. It sounds like you have the type of environment that is well suited for it.
You can visit the website: www.ixionsoftware.com
|
|
|
Re: streams for warehousing [message #75737 is a reply to message #75736] |
Thu, 26 August 2004 10:41   |
Ed Grimm
Messages: 1 Registered: August 2004
|
Junior Member |
|
|
I am not sure what you categorize by large tables. At our site we have tables averaging 60million rows each, with the largest tables averaging around 200 million rows. We are processing on the average around 400-700 transactions per minute. Streams doesnt fall behind and consistenly maintains around a 2.5 second lag from time of creation at the source till time of commit at the target. We are planning to 'hub' out the streams to other sites which need different subsets of the schema.
We are operating on sun-servers running the 64bit version of Oracle Enterprise Server. We are currently running at 9.2.0.4(with the streams mega-patch) and are planning to upgrade to 9.2.0.5 in either september or october this year.
Hope it addresses your concerns.
Ed Grimm
BridgePoint, Inc.
|
|
|
|
Re: streams for warehousing [message #75739 is a reply to message #75737] |
Fri, 27 August 2004 06:44   |
andy
Messages: 92 Registered: December 1999
|
Member |
|
|
Well, not to brag, but IxPropagator replicates at up to 8000 TPS. It really depends on the environment. We have a client with tables that contain tens of millions of rows (although that doesn't really matter as much as how many inserts/updates/deletes they are processing when it comes to performance) and they are running 16 CPU boxes (HP) with 8 gig of ram. Typical replication rates are about 2000 rows per second (not transactions, but rows). Most of our clients are financial services, brokerage, or telecommunications companies that have to move a lot of data.
I have yet to see anything that really compares to IxPropagator, from a replication performance perspective.
|
|
|
Re: streams for warehousing [message #75740 is a reply to message #75737] |
Fri, 27 August 2004 12:11  |
john b.
Messages: 4 Registered: January 2001
|
Junior Member |
|
|
thanks ed.
if we also wanted to use streams to do
snapshots of data into development environments
to refresh, would that be a problem? does it
only stream data?
we may want to replicate a production table for testing, let people destructively test against it, then truncate & refresh again.
has anyone used oracle streams for this?
thanks, john
|
|
|