Rac and loading flat files [message #381413] |
Fri, 16 January 2009 15:39 ![Go to next message Go to next message](/forum/theme/orafaq/images/down.png) |
oakstream
Messages: 3 Registered: January 2009
|
Junior Member |
|
|
Hello,
We are moving our database from a single instance to a 2 node RAC system on Solaris 10 and not sure how to handle the loading of flat files that get delivered to our file system.
In our previous system we had 2 seperate database servers which both received input files and both database servers loaded the data. This loaded to lots of inconsistencies, however, provided for redundant data in case of a failure.
We envision 1 node handing the loading using the job scheduler and services and the other node performing queries and other tasks. But the second node needs to be able to process/access the files if node 1 goes down and vice versa. (picking up where the other left off)
The issue we have is that how can Node 2 access the files if needed and pick up where the other left off. I'm wondering if a clustered file system would work? Such as OCFS? We could also send redundant files to both nodes, however, Node 2 wouldn't know where Node 1 left off in the load process? And not sure how to manage this. I would prefer to "share" the file system if possible thru clustering or (would NFS work?). I'm only thinking shared because then both nodes could tell where the other left off because it would just go to the inbound directory and look for files?
I'm not looking for details here, just a high level architecture. Any help would be appreciated.
|
|
|
|
|
Re: Rac and loading flat files [message #381421 is a reply to message #381413] |
Fri, 16 January 2009 18:29 ![Go to previous message Go to previous message](/forum/theme/orafaq/images/up.png) ![Go to next message Go to next message](/forum/theme/orafaq/images/down.png) |
oakstream
Messages: 3 Registered: January 2009
|
Junior Member |
|
|
Thanks for responding.
My issue is not with Oracle data files but with input data files that will be loaded into Oracle (sales records). Files get delivered into a directory such as /input and I need the Rac instances to process these files. (Load them into the database).
With an NFS mount, Can I have both instances read and write into the NFS mounted file system concurrently?... or do I need something like a clustered file system for these files...or would this even work?
The other option is to send files to RAC1 and duplicate files to RAC2. Just use RAC1 to process all the files and if it goes down then RAC2 can pickup. My problem is that when RAC2 picks up it will have all the files in the directory (including files that were already loaded with RAC1). So I will need to put some logic in to maintain the file system as well as delete or not load files that were previously loaded.
|
|
|
|
Re: Rac and loading flat files [message #381426 is a reply to message #381421] |
Fri, 16 January 2009 20:06 ![Go to previous message Go to previous message](/forum/theme/orafaq/images/up.png) ![Go to next message Go to next message](/forum/theme/orafaq/images/down.png) |
![](/forum/images/custom_avatars/42800.jpg) |
Mahesh Rajendran
Messages: 10708 Registered: March 2002 Location: oracleDocoVille
|
Senior Member Account Moderator |
|
|
Quote: |
The other option is to send files to RAC1 and duplicate files to RAC2. Just use RAC1 to process all the files and if it goes down then RAC2 can pickup.
|
As BlackSwan indicated, You have totally misunderstood how RAC works. There are NO TWO databases. Only two instances.
Both RAC1 and RAC2 will talk to the same database. Period.
If RAC1 goes down, RAC2 will serve the data from database.
>>but with input data files that will be loaded into Oracle (sales records).
That is what I am talking about.
>>With an NFS mount, Can I have both instances read and write into the NFS mounted file system concurrently?
Yes. I use it all the time. Look in TAF options.
You can use any supported cluster file system also.
But i would keep it away from the filesystem used by database.
[Updated on: Fri, 16 January 2009 20:13] Report message to a moderator
|
|
|
|