ASM Grid Infrastructure voting files not found any more

I messed up my ASM diskstring, after this and a reboot my cssd's do not start, because they can't find the voting files any more. Now one node is fencing, the other one just attempts to restart the CSSD frequently.

How can I reconfigure the device name mask for the cssd (or the ASM disk string - if it helps), to allow it to find its voting files in the right way?

Thank you very much, any help is greatly appreciated!

Martin Klier

Here the corresponding part of the ocssd log file. I think the crucial part is:

2011-07-11 09:36:45.976: [ CSSD][3997759248]clssnmvDiskCreate: Found a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c169e000002334dfebb44
in the discovery queue which appears to be the same physical device as the newly discovered disk /dev/disk/by-id/ASMOCW2. Rejecting both these files

It does repeat that for all three disks bearing the voting file copies. => bad

2011-07-11 09:36:45.975: [ CSSD][3997759248]clssnmvDiskVerify: discovered a potential voting file
2011-07-11 09:36:45.975: [ SKGFD][3997759248]Handle 0x88e450 from lib :UFS:: for disk :/dev/disk/by-id/ASMOCW2:

2011-07-11 09:36:45.976: [ CSSD][3997759248]clssnmFindVF: found VF by vdin in the discovered queue
2011-07-11 09:36:45.976: [ CSSD][3997759248]clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(/dev/disk/by-id/scsi-360080e5000
1c169e000002334dfebb44|[7903ab4c-10b84f92-bfec4e33-5fb310fb]), found(/dev/disk/by-id/ASMOCW2|[7903ab4c-10b84f92-bfec4e33-5fb310fb]) 2011-07-11 09:36:45.976: [ CSSD][3997759248]clssnmvDiskCreate: Found a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c169e000002334dfebb44 in the discovery queu
e which appears to be the same physical device as the newly discovered disk /dev/disk/by-id/ASMOCW2. Rejecting both these files 2011-07-11 09:36:45.976: [ CSSD][3997759248]clssnmvDiskDestroy: removing the voting disk /dev/disk/by-id/ASMOCW2 2011-07-11 09:36:45.976: [ SKGFD][3997759248]Lib :UFS:: closing handle 0x88e450 for disk :/dev/disk/by-id/ASMOCW2:

2011-07-11 09:36:45.976: [ CSSD][3997759248]clssnmvDiskVerify: discovered a potential voting file
2011-07-11 09:36:45.976: [ SKGFD][3997759248]Handle 0x88dab0 from lib :UFS:: for disk :/dev/disk/by-id/ASMOCW3:

2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmFindVF: found VF by vdin in the discovered queue
2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(/dev/disk/by-id/scsi-360080e5000
1c1726000003374e01867c|[70ccc4d5-e1d94f7d-bface149-7b3d8e5f]), found(/dev/disk/by-id/ASMOCW3|[70ccc4d5-e1d94f7d-bface149-7b3d8e5f]) 2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskCreate: Found a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c1726000003374e01867c in the discovery queu
e which appears to be the same physical device as the newly discovered disk /dev/disk/by-id/ASMOCW3. Rejecting both these files 2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskDestroy: removing the voting disk /dev/disk/by-id/ASMOCW3 2011-07-11 09:36:45.977: [ SKGFD][3997759248]Lib :UFS:: closing handle 0x88dab0 for disk :/dev/disk/by-id/ASMOCW3:

2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskVerify: discovered a potential voting file
2011-07-11 09:36:45.977: [ SKGFD][3997759248]Handle 0x88dab0 from lib :UFS:: for disk :/dev/disk/by-id/ASMOCW1:

2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmFindVF: found VF by vdin in the discovered queue
2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(/dev/disk/by-id/scsi-360080e5000
1c1726000002a54dfebb58|[416b1bc2-1f764f0f-bfc1430b-8e447d30]), found(/dev/disk/by-id/ASMOCW1|[416b1bc2-1f764f0f-bfc1430b-8e447d30]) 2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskCreate: Found a duplicate voting file
/dev/disk/by-id/scsi-360080e50001c1726000002a54dfebb58 in the discovery queu
e which appears to be the same physical device as the newly discovered disk /dev/disk/by-id/ASMOCW1. Rejecting both these files 2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskDestroy: removing the voting disk /dev/disk/by-id/ASMOCW1 2011-07-11 09:36:45.977: [ SKGFD][3997759248]Lib :UFS:: closing handle 0x88dab0 for disk :/dev/disk/by-id/ASMOCW1:

2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskVerify: Successful discovery of 3 disks
2011-07-11 09:36:45.977: [
CSSD][3997759248]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2011-07-11 09:36:45.977: [
CSSD][3997759248]clssnmCompleteVFDiscovery: Completing voting file discovery 2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskStateChange: state from discovered to deconfigured disk
/dev/disk/by-id/scsi-360080e50001c1726000002a54dfebb58
2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskStateChange: state from discovered to deconfigured disk
/dev/disk/by-id/scsi-360080e50001c1726000003374e01867c
2011-07-11 09:36:45.977: [ CSSD][3997759248]clssnmvDiskStateChange: state from discovered to deconfigured disk
/dev/disk/by-id/scsi-360080e50001c169e000002334dfebb44
2011-07-11 09:36:45.977: [
CSSD][3997759248]clssnmvVerifyCommittedConfigVFs: Insufficient voting files found, found 0 of 3 configured, needed 2 voting files 2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting file 0, id 416b1bc2-1f764f0f-bfc1430b-8e447d30 not found 2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting file 1, id 7903ab4c-10b84f92-bfec4e33-5fb310fb not found 2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00020:)clssnmvVerifyCommittedConfigVFs: voting file 2, id 70ccc4d5-e1d94f7d-bface149-7b3d8e5f not found 2011-07-11 09:36:45.977: [ CSSD][3997759248]ASSERT clssnm1.c 3141 2011-07-11 09:36:45.977: [
CSSD][3997759248](:CSSNM00021:)clssnmCompleteVFDiscovery: Found 0 voting files, but 2 are required. Terminating due to insufficient configure d voting files

--
Usn's IT Blog for Linux, Oracle, Asterisk
http://www.usn-it.de

--
http://www.freelists.org/webpage/oracle-l