Home -> Usenet -> c.d.o.server -> 10g clusterware causes reboots

10g clusterware causes reboots

From: The Derfer <derf109_at_gmail.com>
Date: Mon, 13 Apr 2009 13:01:49 -0700 (PDT)
Message-ID: <5efdf9b3-8793-4bb1-bf60-bc5861b7a2f1_at_y33g2000prg.googlegroups.com> 





I have Linux (OEL5.2) running 10g clusterware on 2 nodes.
OCFS2 is running as well, with a SAN-based OCFS2 filesystem
mounted on both hosts (written to by only one until the other fails
over).



When I reboot one host, the ethernet interface eth0:2 appears on the
other, assuming the VIP of the downed host.
But then when that host comes back up, the 2nd host reboots
itself outright.   Has  anyone seen this behavior in either
clusterware or OCFS2 before?  Oracle engineers claim it's
OCFS2 doing this but I'm not sure.   Why would wither host
reboot at all without me doing the rebooting?



Some lines from dmesg on the first host:



Apr  8 12:04:35 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 12:04:38 node1 kernel: o2net: no longer connected to node node2


(num 1) at 10.156.90.62:7777



Apr  8 12:04:41 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 12:05:08 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 12:05:13 node1 kernel: (3606,0):dlm_send_proxy_ast_msg:457
ERROR: status = -107


Apr  8 12:05:13 node1 kernel: (3606,0):dlm_flush_asts:584 ERROR:
status = -107


Apr  8 12:05:13 node1 kernel: (3606,0):dlm_send_proxy_ast_msg:457
ERROR: status = -107


Apr  8 12:05:13 node1 kernel: (3606,0):dlm_flush_asts:584 ERROR:
status = -107


Apr  8 12:05:13 node1 kernel: (3606,0):dlm_send_proxy_ast_msg:457
ERROR: status = -107


Apr  8 12:05:13 node1 kernel: (3606,0):dlm_flush_asts:584 ERROR:
status = -107


Apr  8 12:05:38 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 12:05:47 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 12:05:49 node1 kernel: 0000:00:04.0: eth3: Link is Up 10 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 12:05:49 node1 kernel: 0000:00:04.0: eth3: 10/100 speed:
disabling TSO


Apr  8 12:06:06 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 12:06:08 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 12:06:08 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 12:06:38 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 12:06:48 node1 kernel: (3591,1):ocfs2_dlm_eviction_cb:98 device


(120,1): dlm has evicted node 1



Apr  8 12:06:48 node1 kernel: (14161,1):dlm_get_lock_resource:839

3930352DB2134782B730C44078E58F29:M000000000000000000001957f095b1: at


least one node (1) to recover before lock mastery can begin
Apr  8 12:06:49 node1 kernel: (14161,1):dlm_get_lock_resource:893

3930352DB2134782B730C44078E58F29:M000000000000000000001957f095b1: at


least one node (1) to recover before lock mastery can begin
Apr  8 12:06:50 node1 kernel: (3607,1):dlm_get_lock_resource:839
3930352DB2134782B730C44078E58F29:$RECOVERY: at least one node (1) to
recover before lock mastery can begin


Apr  8 12:06:50 node1 kernel: (3607,1):dlm_get_lock_resource:873
3930352DB2134782B730C44078E58F29: recovery map is not empty, but must
master $RECOVERY lock now


Apr  8 12:06:50 node1 kernel: (3607,1):dlm_do_recovery:524 (3607) Node
0 is the Recovery Master for the Dead Node 1 for Domain
3930352DB2134782B730C44078E58F29


Apr  8 12:07:00 node1 kernel: (14161,1):ocfs2_replay_journal:1076
Recovering node 1 from slot 1 on device (120,1)
Apr  8 12:07:02 node1 kernel: kjournald starting.  Commit interval 5
seconds


Apr  8 12:07:35 node1 sshd[14480]: Accepted password for fbaker from
10.156.20.20 port 48972 ssh2


Apr  8 12:08:25 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 12:08:27 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 12:08:44 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 12:08:46 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 12:08:57 node1 kernel: o2net: accepted connection from node
node2 (num 1) at 10.156.90.62:7777


Apr  8 12:09:01 node1 kernel: ocfs2_dlm: Node 1 joins domain
3930352DB2134782B730C44078E58F29


Apr  8 12:09:01 node1 kernel: ocfs2_dlm: Nodes in domain


("3930352DB2134782B730C44078E58F29"): 0 1

Apr  8 13:47:46 node1 sshd[17710]: Accepted password for btsvetko from
10.156.20.20 port 50015 ssh2


Apr  8 13:55:50 node1 sshd[20717]: Failed password for dmaki from
10.156.20.20 port 50108 ssh2


Apr  8 13:55:58 node1 sshd[20717]: Accepted password for dmaki from
10.156.20.20 port 50108 ssh2


Apr  8 13:55:58 node1 sshd[20808]: subsystem request for sftp
Apr  8 13:57:20 node1 sshd[21307]: Accepted password for dmaki from
10.156.20.20 port 50124 ssh2


Apr  8 14:20:11 node1 kernel: bnx2: eth0: using MSI
Apr  8 14:20:11 node1 kernel: ADDRCONF(NETDEV_UP): eth0: link is not
ready


Apr  8 14:20:14 node1 kernel: bnx2: eth0 NIC Copper Link is Up, 1000
Mbps full duplex, receive & transmit flow control ON
Apr  8 14:20:14 node1 kernel: ADDRCONF(NETDEV_CHANGE): eth0: link
becomes ready


Apr  8 14:20:15 node1 kernel: ADDRCONF(NETDEV_UP): eth3: link is not
ready


Apr  8 14:20:16 node1 kernel: o2net: no longer connected to node node2


(num 1) at 10.156.90.62:7777



Apr  8 14:20:17 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 14:20:17 node1 kernel: ADDRCONF(NETDEV_CHANGE): eth3: link
becomes ready


Apr  8 14:20:46 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 14:21:14 node1 kernel: (3606,2):dlm_send_proxy_ast_msg:457
ERROR: status = -107


Apr  8 14:21:14 node1 kernel: (3606,2):dlm_flush_asts:584 ERROR:
status = -107


Apr  8 14:21:14 node1 kernel: (3606,2):dlm_send_proxy_ast_msg:457
ERROR: status = -107


Apr  8 14:21:14 node1 kernel: (3606,2):dlm_flush_asts:584 ERROR:
status = -107


Apr  8 14:21:14 node1 kernel: (3606,2):dlm_send_proxy_ast_msg:457
ERROR: status = -107


Apr  8 14:21:14 node1 kernel: (3606,2):dlm_flush_asts:584 ERROR:
status = -107


Apr  8 14:21:16 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 14:21:20 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 14:21:22 node1 kernel: 0000:00:04.0: eth3: Link is Up 10 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 14:21:22 node1 kernel: 0000:00:04.0: eth3: 10/100 speed:
disabling TSO


Apr  8 14:21:40 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 14:21:42 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 14:21:46 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 14:22:16 node1 kernel: (3485,0):o2net_connect_expired:1637
ERROR: no connection established with node 1 after 30.0 seconds,
giving up and returning errors.


Apr  8 14:22:22 node1 kernel: (3591,1):ocfs2_dlm_eviction_cb:98 device


(120,1): dlm has evicted node 1



Apr  8 14:22:22 node1 kernel: (30933,1):ocfs2_replay_journal:1076
Recovering node 1 from slot 1 on device (120,1)
Apr  8 14:22:23 node1 kernel: kjournald starting.  Commit interval 5
seconds


Apr  8 14:22:23 node1 kernel: (3603,1):dlm_get_lock_resource:839

3930352DB2134782B730C44078E58F29:M000000000000000000000d57f095b1: at


least one node (1) to recover before lock mastery can begin
Apr  8 14:22:24 node1 kernel: (3603,1):dlm_get_lock_resource:893

3930352DB2134782B730C44078E58F29:M000000000000000000000d57f095b1: at


least one node (1) to recover before lock mastery can begin
Apr  8 14:22:25 node1 kernel: (3607,1):dlm_get_lock_resource:839
3930352DB2134782B730C44078E58F29:$RECOVERY: at least one node (1) to
recover before lock mastery can begin


Apr  8 14:22:25 node1 kernel: (3607,1):dlm_get_lock_resource:873
3930352DB2134782B730C44078E58F29: recovery map is not empty, but must
master $RECOVERY lock now


Apr  8 14:22:25 node1 kernel: (3607,1):dlm_do_recovery:524 (3607) Node
0 is the Recovery Master for the Dead Node 1 for Domain
3930352DB2134782B730C44078E58F29


Apr  8 14:23:59 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 14:24:01 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 14:24:17 node1 kernel: 0000:00:04.0: eth3: Link is Down
Apr  8 14:24:19 node1 kernel: 0000:00:04.0: eth3: Link is Up 1000 Mbps
Full Duplex, Flow Control: RX/TX


Apr  8 14:24:30 node1 kernel: o2net: accepted connection from node
node2 (num 1) at 10.156.90.62:7777


Apr  8 14:24:34 node1 kernel: ocfs2_dlm: Node 1 joins domain
3930352DB2134782B730C44078E58F29


Apr  8 14:24:34 node1 kernel: ocfs2_dlm: Nodes in domain


("3930352DB2134782B730C44078E58F29"): 0 1

Apr  8 14:26:01 node1 sshd[32356]: Accepted password for fbaker from
10.156.20.20 port 50752 ssh2


Apr  8 15:21:27 node1 sshd[19725]: Accepted password for fbaker from
10.156.20.20 port 51383 ssh2


Apr  8 15:24:52 node1 kernel: ocfs2_hb_ctl[21047]: segfault at

0000000000000000 rip 0000000000428fa0 rsp 00007fff77c60688 error 4


Apr  8 15:24:52 node1 kernel: ocfs2: Unmounting device (120,1) on


(node 0)


Apr  8 15:24:53 node1 xinetd[3676]: Exiting...
Apr  8 15:24:56 node1 ntpd[3694]: ntpd exiting on signal 15
Apr  8 15:24:56 node1 rpc.statd[3421]: Caught signal 15, un-


registering and exiting.


Apr  8 15:24:56 node1 portmap[21164]: connect from 127.0.0.1 to unset


(status): request from unprivileged port


Apr  8 15:24:57 node1 auditd[3036]: The audit daemon is exiting.
Apr  8 15:24:57 node1 kernel: printk: 233 messages suppressed.
Apr  8 15:24:57 node1 kernel: audit(1239218697.229:9819): audit_pid=0


old=3036 by auid=4294967295

Apr  8 15:24:57 node1 kernel: Kernel logging (proc) stopped.
Apr  8 15:24:57 node1 kernel: Kernel log daemon terminating.
Apr  8 15:24:58 node1 exiting on signal 15
Apr  8 15:26:58 node1 syslogd 1.4.1: restart.
Apr  8 15:26:58 node1 kernel: klogd 1.4.1, log source = /proc/kmsg


started.


Apr  8 15:26:58 node1 kernel: Linux version 2.6.18-92.el5


(mockbuild_at_ca-build15.us.oracle.com) (gcc version 4.1.2 20071124 (Red

Hat 4.1.2-41)) #1 SMP Fri May 23 23:40:43 EDT 2008

Apr  8 15:26:58 node1 kernel: Command line: ro root=LABEL=/ rhgb quiet
Apr  8 15:26:58 node1 kernel: BIOS-provided physical RAM map:
Apr  8 15:26:58 node1 kernel:  BIOS-e820: 0000000000000000 -


00000000000a0000 (usable)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 0000000000100000 -
00000000cfb50000 (usable)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 00000000cfb50000 -
00000000cfb66000 (reserved)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 00000000cfb66000 -
00000000cfb85c00 (ACPI data)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 00000000cfb85c00 -
00000000d0000000 (reserved)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 00000000e0000000 -
00000000f0000000 (reserved)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 00000000fe000000 -
0000000100000000 (reserved)


Apr  8 15:26:58 node1 kernel:  BIOS-e820: 0000000100000000 -
0000000130000000 (usable)

Apr  8 15:26:58 node1 kernel: DMI 2.5 present.
Apr  8 15:26:58 node1 rpc.statd[3348]: Version 1.0.9 Starting
Apr  8 15:26:58 node1 modprobe: FATAL: Module ocfs2_stackglue not


found.


Apr  8 15:26:59 node1 kernel: No NUMA configuration found
Apr  8 15:26:59 node1 kernel: Faking a node at

0000000000000000-0000000130000000




Apr  8 15:26:59 node1 kernel: Bootmem setup node 0

0000000000000000-0000000130000000




Apr  8 15:26:59 node1 kernel: Memory for crash kernel (0x0 to 0x0)
notwithin permissible range

Apr  8 15:26:59 node1 kernel: disabling kdump
Apr  8 15:26:59 node1 kernel: ACPI: PM-Timer IO Port: 0x808
Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id


[0x00] enabled)


Apr  8 15:26:59 node1 kernel: Processor #0 7:7 APIC version 20
Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id
[0x02] enabled)


Apr  8 15:26:59 node1 kernel: Processor #2 7:7 APIC version 20
Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id
[0x01] enabled)


Apr  8 15:26:59 node1 kernel: Processor #1 7:7 APIC version 20
Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id
[0x03] enabled)


Apr  8 15:26:59 node1 kernel: Processor #3 7:7 APIC version 20
Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id
[0x14] disabled)


Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id
[0x15] disabled)


Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id
[0x16] disabled)


Apr  8 15:26:59 node1 kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id
[0x17] disabled)


Apr  8 15:26:59 node1 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high edge
lint[0x1])


Apr  8 15:26:59 node1 kernel: ACPI: IOAPIC (id[0x04] address
[0xfec00000] gsi_base[0])


Apr  8 15:26:59 node1 kernel: IOAPIC[0]: apic_id 4, version 32,
address 0xfec00000, GSI 0-23


Apr  8 15:26:59 node1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0
global_irq 2 dfl dfl)


Apr  8 15:26:59 node1 EV_AGENT[3437]: Line Not Parsed, Line#108
search /user root - Application and revision : _at_(#) libraid++ Revision
6.26.2.0.2 for Linux on 12/5/2007 8:12:01, Error Origination:
EV_ConfigInfoFileManager::_parseConfigfile()
Apr  8 15:26:59 node1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9
global_irq 9 high level)


Apr  8 15:26:59 node1 kernel: Setting APIC routing to physical flat
Apr  8 15:27:00 node1 kernel: ACPI: HPET id: 0x8086a201 base:
0xfed00000


Apr  8 15:27:00 node1 kernel: Using ACPI (MADT) for SMP configuration
information


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000000a0000 -
0000000000100000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000cfb50000 -
00000000cfb66000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000cfb66000 -
00000000cfb85000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000cfb85000 -
00000000cfb86000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000cfb86000 -
00000000d0000000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000d0000000 -
00000000e0000000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000e0000000 -
00000000f0000000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000f0000000 -
00000000fe000000


Apr  8 15:27:00 node1 kernel: Nosave address range: 00000000fe000000 -
0000000100000000


Apr  8 15:27:00 node1 kernel: Allocating PCI resources starting at
d1000000 (gap: d0000000:10000000)

Apr  8 15:27:00 node1 kernel: SMP: Allowing 8 CPUs, 4 hotplug CPUs
Apr  8 15:27:00 node1 kernel: Built 1 zonelists.  Total pages: 1029006
Apr  8 15:27:00 node1 kernel: Kernel command line: ro root=LABEL=/


rhgb quiet


Apr  8 15:27:00 node1 kernel: Initializing CPU#0
Apr  8 15:27:00 node1 kernel: PID hash table entries: 4096 (order: 12,
32768 bytes)


Apr  8 15:27:00 node1 kernel: Console: colour VGA+ 80x25
Apr  8 15:27:00 node1 kernel: Dentry cache hash table entries: 524288


(order: 10, 4194304 bytes)



Apr  8 15:27:00 node1 kernel: Inode-cache hash table entries: 262144


(order: 9, 2097152 bytes)



Apr  8 15:27:00 node1 kernel: Checking aperture...
Apr  8 15:27:00 node1 kernel: PCI-DMA: Using software bounce buffering
for IO (SWIOTLB)


Apr  8 15:27:00 node1 kernel: Placing software IO TLB between
0x165d000 - 0x565d000


Apr  8 15:27:00 node1 kernel: Memory: 4040256k/4980736k available


(2457k kernel code, 148864k reserved, 1246k data, 196k init)

Apr  8 15:27:00 node1 kernel: Calibrating delay using timer specific
routine.. 5989.09 BogoMIPS (lpj=2994549)

Apr  8 15:27:00 node1 kernel: Security Framework v1.0.0 initialized
Apr  8 15:27:00 node1 kernel: SELinux:  Initializing.
Apr  8 15:27:00 node1 kernel: selinux_register_security:  Registering


secondary module capability

Apr  8 15:27:00 node1 kernel: Capability LSM initialized as secondary
Apr  8 15:27:01 node1 kernel: Mount-cache hash table entries: 256
Apr  8 15:27:01 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Apr  8 15:27:01 node1 kernel: CPU: L2 cache: 6144K
Apr  8 15:27:01 node1 kernel: using mwait in idle threads.
Apr  8 15:27:01 node1 kernel: CPU: Physical Processor ID: 0
Apr  8 15:27:01 node1 kernel: CPU: Processor Core ID: 0
Apr  8 15:27:01 node1 kernel: CPU0: Thermal monitoring enabled (TM1)
Apr  8 15:27:01 node1 kernel: SMP alternatives: switching to UP code
Apr  8 15:27:01 node1 kernel: ACPI: Core revision 20060707
Apr  8 15:27:01 node1 kernel: Using local APIC timer interrupts.
Apr  8 15:27:01 node1 kernel: result 20781505
Apr  8 15:27:01 node1 kernel: Detected 20.781 MHz APIC timer.
Apr  8 15:27:01 node1 kernel: SMP alternatives: switching to SMP code
Apr  8 15:27:01 node1 Navisphere Agent[3437]: Agent initializing with


pid 3437

Apr  8 15:27:01 node1 kernel: Booting processor 1/4 APIC 0x2
Apr  8 15:27:01 node1 kernel: Initializing CPU#1
Apr  8 15:27:01 node1 kernel: Calibrating delay using timer specific


routine.. 5985.00 BogoMIPS (lpj=2992504)

Apr  8 15:27:01 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Apr  8 15:27:01 node1 kernel: CPU: L2 cache: 6144K
Apr  8 15:27:01 node1 kernel: CPU: Physical Processor ID: 0
Apr  8 15:27:01 node1 kernel: CPU: Processor Core ID: 2
Apr  8 15:27:01 node1 kernel: CPU1: Thermal monitoring enabled (TM2)
Apr  8 15:27:01 node1 kernel: Intel(R) Xeon(R) CPU           E5450  _at_


3.00GHz stepping 06


Apr  8 15:27:01 node1 kernel: CPU 1: Syncing TSC to CPU 0.
Apr  8 15:27:01 node1 kernel: CPU 1: synchronized TSC with CPU 0 (last
diff -2071 cycles, maxerr 594 cycles)

Apr  8 15:27:01 node1 kernel: SMP alternatives: switching to SMP code
Apr  8 15:27:01 node1 kernel: Booting processor 2/4 APIC 0x1
Apr  8 15:27:01 node1 kernel: Initializing CPU#2
Apr  8 15:27:02 node1 kernel: Calibrating delay using timer specific


routine.. 5984.25 BogoMIPS (lpj=2992127)

Apr  8 15:27:02 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Apr  8 15:27:02 node1 kernel: CPU: L2 cache: 6144K
Apr  8 15:27:02 node1 kernel: CPU: Physical Processor ID: 0
Apr  8 15:27:02 node1 kernel: CPU: Processor Core ID: 1
Apr  8 15:27:02 node1 kernel: CPU2: Thermal monitoring enabled (TM2)
Apr  8 15:27:02 node1 kernel: Intel(R) Xeon(R) CPU           E5450  _at_


3.00GHz stepping 06


Apr  8 15:27:02 node1 kernel: CPU 2: Syncing TSC to CPU 0.
Apr  8 15:27:02 node1 kernel: CPU 2: synchronized TSC with CPU 0 (last
diff -2056 cycles, maxerr 594 cycles)

Apr  8 15:27:02 node1 kernel: SMP alternatives: switching to SMP code
Apr  8 15:27:02 node1 kernel: Booting processor 3/4 APIC 0x3
Apr  8 15:27:02 node1 kernel: Initializing CPU#3
Apr  8 15:27:02 node1 kernel: Calibrating delay using timer specific


routine.. 5985.00 BogoMIPS (lpj=2992504)
Apr  8 15:27:02 node1 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Apr  8 15:27:02 node1 EV_AGENT[3493]: Agent daemon process created,
pid 3493

Apr  8 15:27:02 node1 kernel: CPU: L2 cache: 6144K
Apr  8 15:27:02 node1 EV_AGENT[3493]: Agent has started up.
Apr  8 15:27:02 node1 kernel: CPU: Physical Processor ID: 0
Apr  8 15:27:02 node1 kernel: CPU: Processor Core ID: 3
Apr  8 15:27:02 node1 kernel: CPU3: Thermal monitoring enabled (TM2)
Apr  8 15:27:02 node1 kernel: Intel(R) Xeon(R) CPU           E5450  _at_


3.00GHz stepping 06


Apr  8 15:27:02 node1 kernel: CPU 3: Syncing TSC to CPU 0.
Apr  8 15:27:02 node1 kernel: CPU 3: synchronized TSC with CPU 0 (last
diff -2052 cycles, maxerr 594 cycles)

Apr  8 15:27:02 node1 kernel: Brought up 4 CPUs
Apr  8 15:27:02 node1 kernel: testing NMI watchdog ... OK.
Apr  8 15:27:02 node1 kernel: time.c: Using 14.318180 MHz WALL HPET


GTOD HPET timer.

Apr  8 15:27:02 node1 kernel: time.c: Detected 2992.536 MHz processor.
Apr  8 15:27:03 node1 kernel: migration_cost=18,3689
Apr  8 15:27:03 node1 kernel: checking if image is initramfs... it is
Apr  8 15:27:03 node1 kernel: Freeing initrd memory: 2970k freed
Apr  8 15:27:03 node1 kernel: NET: Registered protocol family 16
Apr  8 15:27:03 node1 kernel: No dock devices found.
Apr  8 15:27:03 node1 kernel: ACPI: bus type pci registered
Apr  8 15:27:03 node1 kernel: PCI: Using MMCONFIG at e0000000
Apr  8 15:27:03 node1 kernel: PCI: Buses that can't use MMCONFIG will


use type 1 PCI conf access.

Apr  8 15:27:03 node1 kernel: ACPI: Interpreter enabled
Apr  8 15:27:03 node1 kernel: ACPI: Using IOAPIC for interrupt routing
Apr  8 15:27:03 node1 kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
Apr  8 15:27:03 node1 kernel: PCI: Dell PowerEdge 1950 detected,


enabling pci=bfsort.


Apr  8 15:27:03 node1 kernel: PCI: Ignoring BAR0-3 of IDE controller
0000:00:1f.1


Apr  8 15:27:03 node1 kernel: PCI: Transparent bridge - 0000:00:1e.0
Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK00] (IRQs 3
4 5 *6 7 10 11 12)


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK01] (IRQs 3
4 *5 6 7 10 11 12)


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK02] (IRQs 3
4 5 6 7 10 11 12) *0, disabled.


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK03] (IRQs 3
4 5 6 7 10 *11 12)


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK04] (IRQs 3
4 5 6 7 *10 11 12)


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK05] (IRQs 3
4 5 6 7 10 *11 12)


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK06] (IRQs 3
4 5 6 7 10 11 12) *0, disabled.


Apr  8 15:27:04 node1 kernel: ACPI: PCI Interrupt Link [LK07] (IRQs 3
4 5 6 7 10 11 12) *0, disabled.


Apr  8 15:27:04 node1 kernel: Linux Plug and Play Support v0.97 (c)
Adam Belay

Apr  8 15:27:04 node1 kernel: pnp: PnP ACPI init
Apr  8 15:27:04 node1 kernel: pnp: PnP ACPI: found 12 devices
Apr  8 15:27:04 node1 kernel: usbcore: registered new driver usbfs
Apr  8 15:27:04 node1 kernel: usbcore: registered new driver hub
Apr  8 15:27:04 node1 kernel: PCI: Using ACPI for IRQ routing
Apr  8 15:27:04 node1 kernel: PCI: If a device doesn't work, try


"pci=routeirq".  If it helps, post a report

Apr  8 15:27:04 node1 kernel: NetLabel: Initializing
Apr  8 15:27:04 node1 kernel: NetLabel:  domain hash size = 128
Apr  8 15:27:04 node1 kernel: NetLabel:  protocols = UNLABELED CIPSOv4
Apr  8 15:27:04 node1 kernel: NetLabel:  unlabeled traffic allowed by


default


Apr  8 15:27:04 node1 kernel: hpet0: at MMIO 0xfed00000 (virtual
0xffffffffff5fe000), IRQs 2, 8, 0

Apr  8 15:27:04 node1 kernel: hpet0: 3 64-bit timers, 14318180 Hz
Apr  8 15:27:04 node1 kernel: PCI-GART: No AMD northbridge found.
Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x800-0x87f


could not be reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x880-0x8bf has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x8c0-0x8df has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x8e0-0x8e3 has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0x900-0x900 has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0xc00-0xc7f has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0xca0-0xca7 has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:08: ioport range 0xca9-0xcab has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:09: ioport range 0xca8-0xca8 has
been reserved


Apr  8 15:27:04 node1 kernel: pnp: 00:09: ioport range 0xcac-0xcac has
been reserved

Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:06:00.0
Apr  8 15:27:05 node1 kernel:   IO window: disabled.
Apr  8 15:27:05 node1 kernel:   MEM window: f4000000-f7ffffff
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:05:00.0
Apr  8 15:27:05 node1 kernel:   IO window: disabled.
Apr  8 15:27:05 node1 kernel:   MEM window: f4000000-f7ffffff
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:05:01.0
Apr  8 15:27:05 node1 kernel:   IO window: disabled.
Apr  8 15:27:05 node1 kernel:   MEM window: disabled.
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:04:00.0
Apr  8 15:27:05 node1 kernel:   IO window: disabled.
Apr  8 15:27:05 node1 kernel:   MEM window: f4000000-f7ffffff
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:04:00.3
Apr  8 15:27:05 node1 kernel:   IO window: disabled.
Apr  8 15:27:05 node1 kernel:   MEM window: disabled.
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:00:02.0
Apr  8 15:27:05 node1 kernel:   IO window: disabled.
Apr  8 15:27:05 node1 kernel:   MEM window: f2000000-f7ffffff
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:05 node1 kernel: PCI: Bridge: 0000:00:03.0
Apr  8 15:27:05 node1 kernel:   IO window: e000-efff
Apr  8 15:27:05 node1 kernel:   MEM window: fc700000-fc8fffff
Apr  8 15:27:05 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:04.0
Apr  8 15:27:06 node1 kernel:   IO window: d000-dfff
Apr  8 15:27:06 node1 kernel:   MEM window: fc500000-fc6fffff
Apr  8 15:27:06 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:05.0
Apr  8 15:27:06 node1 kernel:   IO window: disabled.
Apr  8 15:27:06 node1 kernel:   MEM window: disabled.
Apr  8 15:27:06 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:06.0
Apr  8 15:27:06 node1 kernel:   IO window: c000-cfff
Apr  8 15:27:06 node1 kernel:   MEM window: fc300000-fc4fffff
Apr  8 15:27:06 node1 kernel:   PREFETCH window: d1000000-d10fffff
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:07.0
Apr  8 15:27:06 node1 kernel:   IO window: disabled.
Apr  8 15:27:06 node1 kernel:   MEM window: disabled.
Apr  8 15:27:06 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:02:00.0
Apr  8 15:27:06 node1 kernel:   IO window: disabled.
Apr  8 15:27:06 node1 kernel:   MEM window: f8000000-fbffffff
Apr  8 15:27:06 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:1c.0
Apr  8 15:27:06 node1 kernel:   IO window: disabled.
Apr  8 15:27:06 node1 kernel:   MEM window: f8000000-fbffffff
Apr  8 15:27:06 node1 kernel:   PREFETCH window: disabled.
Apr  8 15:27:06 node1 kernel: PCI: Bridge: 0000:00:1e.0
Apr  8 15:27:06 node1 kernel:   IO window: b000-bfff
Apr  8 15:27:06 node1 kernel:   MEM window: fc100000-fc2fffff
Apr  8 15:27:06 node1 kernel:   PREFETCH window: d8000000-dfffffff
Apr  8 15:27:07 node1 kernel: GSI 16 sharing vector 0xA9 and IRQ 16
Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:02.0[A] ->


GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:04:00.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:05:00.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:05:01.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:03.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:04.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:06.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: ACPI: PCI Interrupt 0000:00:1c.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:07 node1 kernel: NET: Registered protocol family 2
Apr  8 15:27:07 node1 kernel: IP route cache hash table entries:
131072 (order: 8, 1048576 bytes)


Apr  8 15:27:07 node1 kernel: TCP established hash table entries:
262144 (order: 10, 4194304 bytes)


Apr  8 15:27:07 node1 kernel: TCP bind hash table entries: 65536


(order: 8, 1048576 bytes)



Apr  8 15:27:07 node1 kernel: TCP: Hash tables configured (established
262144 bind 65536)


Apr  8 15:27:07 node1 kernel: TCP reno registered
Apr  8 15:27:07 node1 kernel: audit: initializing netlink socket


(disabled)


Apr  8 15:27:07 node1 kernel: audit(1239218779.491:1): initialized
Apr  8 15:27:07 node1 kernel: Total HugeTLB memory allocated, 0
Apr  8 15:27:07 node1 kernel: VFS: Disk quotas dquot_6.5.1
Apr  8 15:27:07 node1 kernel: Dquot-cache hash table entries: 512




(order 0, 4096 bytes)


Apr  8 15:27:08 node1 kernel: Initializing Cryptographic API
Apr  8 15:27:08 node1 kernel: ksign: Installing public key data
Apr  8 15:27:08 node1 kernel: Loading keyring
Apr  8 15:27:08 node1 kernel: - Added public key 660501D58C5397BD
Apr  8 15:27:08 node1 kernel: - User ID: Red Hat, Inc. (Kernel Module


GPG key)

Apr  8 15:27:08 node1 kernel: io scheduler noop registered
Apr  8 15:27:08 node1 kernel: io scheduler anticipatory registered
Apr  8 15:27:08 node1 kernel: io scheduler deadline registered
Apr  8 15:27:08 node1 kernel: io scheduler cfq registered (default)
Apr  8 15:27:08 node1 kernel: assign_interrupt_mode Found MSI


capability

Apr  8 15:27:08 node1 last message repeated 5 times
Apr  8 15:27:08 node1 automount[3552]: lookup_read_master: lookup




(nisplus): couldn't locate nis+ table auto.master

Apr  8 15:27:08 node1 kernel: assign_interrupt_mode Found MSI
capability


Apr  8 15:27:09 node1 last message repeated 2 times
Apr  8 15:27:09 node1 kernel: pci_hotplug: PCI Hot Plug PCI Core
version: 0.5

Apr  8 15:27:09 node1 kernel: ACPI: CPU0 (power states: C1[C1] C3[C3])
Apr  8 15:27:09 node1 kernel: ACPI: CPU1 (power states: C1[C1] C3[C3])
Apr  8 15:27:09 node1 kernel: ACPI: CPU2 (power states: C1[C1] C3[C3])
Apr  8 15:27:09 node1 kernel: ACPI: CPU3 (power states: C1[C1] C3[C3])
Apr  8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):


AE_NOT_FOUND, Processor Device is not present [20060707]
Apr  8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x5
Apr  8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
AE_NOT_FOUND, Processor Device is not present [20060707]
Apr  8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x6
Apr  8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
AE_NOT_FOUND, Processor Device is not present [20060707]
Apr  8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x7
Apr  8 15:27:09 node1 kernel: ACPI Exception (acpi_processor-0681):
AE_NOT_FOUND, Processor Device is not present [20060707]

Apr  8 15:27:09 node1 kernel: ACPI: Getting cpuindex for acpiid 0x8
Apr  8 15:27:09 node1 kernel: Real Time Clock Driver v1.12ac
Apr  8 15:27:09 node1 kernel: Non-volatile memory driver v1.2
Apr  8 15:27:09 node1 kernel: Linux agpgart interface v0.101 (c) Dave


Jones


Apr  8 15:27:09 node1 kernel: Serial: 8250/16550 driver $Revision:
1.90 $ 4 ports, IRQ sharing enabled


Apr  8 15:27:09 node1 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4)
is a 16550A


Apr  8 15:27:09 node1 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3)
is a 16550A


Apr  8 15:27:09 node1 kernel: 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a
16550A


Apr  8 15:27:09 node1 kernel: 00:07: ttyS1 at I/O 0x2f8 (irq = 3) is a
16550A


Apr  8 15:27:09 node1 kernel: RAMDISK driver initialized: 16 RAM disks
of 16384K size 4096 blocksize


Apr  8 15:27:09 node1 kernel: Uniform Multi-Platform E-IDE driver
Revision: 7.00alpha2


Apr  8 15:27:09 node1 kernel: ide: Assuming 33MHz system bus speed for
PIO modes; override with idebus=xx


Apr  8 15:27:09 node1 kernel: ESB2: IDE controller at PCI slot
0000:00:1f.1


Apr  8 15:27:10 node1 kernel: ACPI: PCI Interrupt 0000:00:1f.1[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:10 node1 kernel: ESB2: chipset revision 9
Apr  8 15:27:10 node1 kernel: ESB2: not 100% native mode: will probe
irqs later


Apr  8 15:27:10 node1 kernel:     ide0: BM-DMA at 0xfc00-0xfc07, BIOS
settings: hda:DMA, hdb:pio


Apr  8 15:27:10 node1 kernel: hda: TEAC DVD-ROM DV28EV, ATAPI CD/DVD-
ROM drive

Apr  8 15:27:10 node1 kernel: ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Apr  8 15:27:10 node1 kernel: ide-floppy driver 0.99.newide
Apr  8 15:27:10 node1 kernel: usbcore: registered new driver hiddev
Apr  8 15:27:10 node1 kernel: usbcore: registered new driver usbhid
Apr  8 15:27:10 node1 kernel: drivers/usb/input/hid-core.c: v2.6:USB


HID core driver


Apr  8 15:27:10 node1 kernel: PNP: No PS/2 controller found. Probing
ports directly.


Apr  8 15:27:10 node1 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Apr  8 15:27:10 node1 kernel: serio: i8042 AUX port at 0x60,0x64 irq
12


Apr  8 15:27:10 node1 kernel: mice: PS/2 mouse device common for all
mice


Apr  8 15:27:10 node1 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256,
MD_SB_DISKS=27


Apr  8 15:27:10 node1 kernel: md: bitmap version 4.39
Apr  8 15:27:10 node1 kernel: TCP bic registered
Apr  8 15:27:10 node1 kernel: Initializing IPsec netlink socket
Apr  8 15:27:10 node1 kernel: NET: Registered protocol family 1
Apr  8 15:27:10 node1 kernel: NET: Registered protocol family 17
Apr  8 15:27:10 node1 kernel: ACPI: (supports S0 S4 S5)
Apr  8 15:27:10 node1 kernel: Freeing unused kernel memory: 196k freed
Apr  8 15:27:10 node1 kernel: Write protecting the kernel read-only


data: 475k


Apr  8 15:27:10 node1 kernel: SCSI subsystem initialized
Apr  8 15:27:10 node1 kernel: QLogic Fibre Channel HBA Driver:
8.02.14.01


Apr  8 15:27:10 node1 kernel: ACPI: PCI Interrupt 0000:0c:00.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:10 node1 kernel: qla2xxx 0000:0c:00.0: Found an ISP2432,
irq 169, iobase 0xffffc20000002000


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Configuring PCI
space...


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Configure NVRAM
parameters...


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Verifying loaded
RISC code...


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Allocated (64 KB)
for EFT...


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Allocated (1413
KB) for firmware dump...


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Waiting for LIP to
complete...


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LIP reset occured


(f700).



Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LIP occured


(f700).



Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LIP reset occured


(f7f7).



Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: LOOP UP detected


(4 Gbps).



Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: Topology -


(F_Port), Host Loop address 0x0


Apr  8 15:27:11 node1 kernel: scsi0 : qla2xxx
Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0:
Apr  8 15:27:11 node1 kernel:  QLogic Fibre Channel HBA Driver:


8.02.14.01


Apr  8 15:27:11 node1 kernel:   QLogic QLE2462 - PCI-Express to 4Gb
FC, Dual Channel


Apr  8 15:27:11 node1 kernel:   ISP2432: PCIe (2.5GT/s x4) _at_ 0000:0c:
00.0 hdma+, host#=0, fw=4.04.00 [IP] [84XX]

Apr  8 15:27:11 node1 kernel:   Vendor: DGC       Model: RAID
5            Rev: 0326
Apr  8 15:27:11 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 04


Apr  8 15:27:11 node1 kernel: qla2xxx 0000:0c:00.0: scsi(0:0:0:0):
Enabled tagged queuing, queue depth 32.


Apr  8 15:27:11 node1 kernel: SCSI device sda: 560557312 512-byte hdwr
sectors (287005 MB)


Apr  8 15:27:11 node1 kernel: sda: test WP failed, assume Write
Enabled

Apr  8 15:27:11 node1 kernel: sda: asking for cache data failed
Apr  8 15:27:11 node1 kernel: sda: assuming drive cache: write through
Apr  8 15:27:11 node1 kernel: SCSI device sda: 560557312 512-byte hdwr


sectors (287005 MB)


Apr  8 15:27:11 node1 kernel: sda: test WP failed, assume Write
Enabled

Apr  8 15:27:11 node1 kernel: sda: asking for cache data failed
Apr  8 15:27:11 node1 kernel: sda: assuming drive cache: write through
Apr  8 15:27:11 node1 kernel:  sda:<6>sd 0:0:0:0: Device not ready:
<6>: Current: sense key: Not Ready
Apr  8 15:27:12 node1 kernel:     Add. Sense: Logical unit not ready,


manual intervention required


Apr  8 15:27:12 node1 kernel:


Apr  8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:12 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:12 node1 kernel:


Apr  8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:12 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:12 node1 kernel:


Apr  8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:12 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:12 node1 kernel:


Apr  8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:12 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:12 node1 kernel:


Apr  8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:12 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:12 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:12 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:12 node1 kernel:


Apr  8 15:27:12 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:13 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:13 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:13 node1 kernel:


Apr  8 15:27:13 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:13 node1 kernel: Dev sda: unable to read RDB block 0
Apr  8 15:27:13 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:13 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:13 node1 kernel:


Apr  8 15:27:13 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
block 0


Apr  8 15:27:13 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:13 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:13 node1 kernel:


Apr  8 15:27:13 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:13 node1 kernel: Buffer I/O error on device sda, logical
block 0

Apr  8 15:27:13 node1 kernel:  unable to read partition table
Apr  8 15:27:13 node1 kernel: sd 0:0:0:0: Attached scsi disk sda
Apr  8 15:27:13 node1 kernel:   Vendor: DGC       Model: RAID
5            Rev: 0326
Apr  8 15:27:13 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 04


Apr  8 15:27:13 node1 kernel: qla2xxx 0000:0c:00.0: scsi(0:0:1:0):
Enabled tagged queuing, queue depth 32.


Apr  8 15:27:13 node1 kernel: SCSI device sdb: 560557312 512-byte hdwr
sectors (287005 MB)


Apr  8 15:27:13 node1 kernel: sdb: Write Protect is off
Apr  8 15:27:13 node1 kernel: SCSI device sdb: drive cache: write
through


Apr  8 15:27:13 node1 kernel: SCSI device sdb: 560557312 512-byte hdwr
sectors (287005 MB)


Apr  8 15:27:13 node1 kernel: sdb: Write Protect is off
Apr  8 15:27:14 node1 kernel: SCSI device sdb: drive cache: write
through

Apr  8 15:27:14 node1 kernel:  sdb: sdb1
Apr  8 15:27:14 node1 kernel: sd 0:0:1:0: Attached scsi disk sdb
Apr  8 15:27:14 node1 kernel: GSI 17 sharing vector 0x42 and IRQ 17
Apr  8 15:27:14 node1 kernel: ACPI: PCI Interrupt 0000:0c:00.1[B] ->


GSI 17 (level, low) -> IRQ 66


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Found an ISP2432,
irq 66, iobase 0xffffc20000004000


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Configuring PCI
space...


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Configure NVRAM
parameters...


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Verifying loaded
RISC code...


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Allocated (64 KB)
for EFT...


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Allocated (1413
KB) for firmware dump...


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Waiting for LIP to
complete...


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LIP reset occured


(f700).



Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LIP occured


(f700).



Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LIP reset occured


(f7f7).



Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: LOOP UP detected


(4 Gbps).



Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: Topology -


(F_Port), Host Loop address 0x0


Apr  8 15:27:14 node1 kernel: scsi1 : qla2xxx
Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1:
Apr  8 15:27:14 node1 kernel:  QLogic Fibre Channel HBA Driver:


8.02.14.01


Apr  8 15:27:14 node1 kernel:   QLogic QLE2462 - PCI-Express to 4Gb
FC, Dual Channel


Apr  8 15:27:14 node1 kernel:   ISP2432: PCIe (2.5GT/s x4) _at_ 0000:0c:
00.1 hdma+, host#=1, fw=4.04.00 [IP] [84XX]

Apr  8 15:27:14 node1 kernel:   Vendor: DGC       Model: RAID
5            Rev: 0326
Apr  8 15:27:14 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 04


Apr  8 15:27:14 node1 kernel: qla2xxx 0000:0c:00.1: scsi(1:0:0:0):
Enabled tagged queuing, queue depth 32.


Apr  8 15:27:14 node1 kernel: SCSI device sdc: 560557312 512-byte hdwr
sectors (287005 MB)


Apr  8 15:27:14 node1 kernel: sdc: test WP failed, assume Write
Enabled

Apr  8 15:27:15 node1 kernel: sdc: asking for cache data failed
Apr  8 15:27:15 node1 kernel: sdc: assuming drive cache: write through
Apr  8 15:27:15 node1 kernel: SCSI device sdc: 560557312 512-byte hdwr


sectors (287005 MB)


Apr  8 15:27:15 node1 kernel: sdc: test WP failed, assume Write
Enabled

Apr  8 15:27:15 node1 kernel: sdc: asking for cache data failed
Apr  8 15:27:15 node1 kernel: sdc: assuming drive cache: write through
Apr  8 15:27:15 node1 kernel:  sdc:<6>sd 1:0:0:0: Device not ready:
<6>: Current: sense key: Not Ready
Apr  8 15:27:15 node1 kernel:     Add. Sense: Logical unit not ready,


manual intervention required


Apr  8 15:27:15 node1 kernel:


Apr  8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:15 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:15 node1 kernel:


Apr  8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:15 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:15 node1 kernel:


Apr  8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:15 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:15 node1 kernel:


Apr  8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:15 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:15 node1 kernel:


Apr  8 15:27:15 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:15 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:15 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:16 node1 kernel:


Apr  8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:16 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:16 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:16 node1 kernel:


Apr  8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:16 node1 kernel: Dev sdc: unable to read RDB block 0
Apr  8 15:27:16 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:16 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:16 node1 kernel:


Apr  8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:16 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:16 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:16 node1 kernel:


Apr  8 15:27:16 node1 kernel: end_request: I/O error, dev sdc, sector
0

Apr  8 15:27:16 node1 kernel:  unable to read partition table
Apr  8 15:27:16 node1 kernel: sd 1:0:0:0: Attached scsi disk sdc
Apr  8 15:27:16 node1 kernel:   Vendor: DGC       Model: RAID
5            Rev: 0326
Apr  8 15:27:16 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 04


Apr  8 15:27:16 node1 kernel: qla2xxx 0000:0c:00.1: scsi(1:0:1:0):
Enabled tagged queuing, queue depth 32.


Apr  8 15:27:16 node1 kernel: SCSI device sdd: 560557312 512-byte hdwr
sectors (287005 MB)


Apr  8 15:27:16 node1 kernel: sdd: Write Protect is off
Apr  8 15:27:16 node1 kernel: SCSI device sdd: drive cache: write
through


Apr  8 15:27:16 node1 kernel: SCSI device sdd: 560557312 512-byte hdwr
sectors (287005 MB)


Apr  8 15:27:16 node1 kernel: sdd: Write Protect is off
Apr  8 15:27:17 node1 kernel: SCSI device sdd: drive cache: write
through

Apr  8 15:27:17 node1 kernel:  sdd: sdd1
Apr  8 15:27:17 node1 kernel: sd 1:0:1:0: Attached scsi disk sdd
Apr  8 15:27:17 node1 kernel: GSI 18 sharing vector 0x4A and IRQ 18
Apr  8 15:27:17 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.7[A] ->


GSI 21 (level, low) -> IRQ 74


Apr  8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: EHCI Host
Controller


Apr  8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: new USB bus
registered, assigned bus number 1


Apr  8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: debug port 1
Apr  8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: irq 74, io mem
0xfc900000


Apr  8 15:27:17 node1 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started,
EHCI 1.00, driver 10 Dec 2004


Apr  8 15:27:17 node1 kernel: usb usb1: configuration #1 chosen from 1
choice

Apr  8 15:27:17 node1 kernel: hub 1-0:1.0: USB hub found
Apr  8 15:27:17 node1 kernel: hub 1-0:1.0: 8 ports detected
Apr  8 15:27:17 node1 kernel: USB Universal Host Controller Interface


driver v3.0


Apr  8 15:27:17 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.0[A] ->
GSI 21 (level, low) -> IRQ 74


Apr  8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.0: UHCI Host
Controller


Apr  8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.0: new USB bus
registered, assigned bus number 2


Apr  8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.0: irq 74, io base
0x0000ace0


Apr  8 15:27:17 node1 kernel: usb usb2: configuration #1 chosen from 1
choice

Apr  8 15:27:17 node1 kernel: hub 2-0:1.0: USB hub found
Apr  8 15:27:17 node1 kernel: hub 2-0:1.0: 2 ports detected
Apr  8 15:27:17 node1 kernel: GSI 19 sharing vector 0x52 and IRQ 19
Apr  8 15:27:17 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.1[B] ->


GSI 20 (level, low) -> IRQ 82


Apr  8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.1: UHCI Host
Controller


Apr  8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.1: new USB bus
registered, assigned bus number 3


Apr  8 15:27:17 node1 kernel: uhci_hcd 0000:00:1d.1: irq 82, io base
0x0000acc0


Apr  8 15:27:18 node1 kernel: usb usb3: configuration #1 chosen from 1
choice

Apr  8 15:27:18 node1 kernel: hub 3-0:1.0: USB hub found
Apr  8 15:27:18 node1 kernel: hub 3-0:1.0: 2 ports detected
Apr  8 15:27:18 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.2[C] ->


GSI 21 (level, low) -> IRQ 74


Apr  8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.2: UHCI Host
Controller


Apr  8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.2: new USB bus
registered, assigned bus number 4


Apr  8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.2: irq 74, io base
0x0000aca0


Apr  8 15:27:18 node1 kernel: usb usb4: configuration #1 chosen from 1
choice

Apr  8 15:27:18 node1 kernel: hub 4-0:1.0: USB hub found
Apr  8 15:27:18 node1 kernel: hub 4-0:1.0: 2 ports detected
Apr  8 15:27:18 node1 kernel: usb 1-1: new high speed USB device using


ehci_hcd and address 2


Apr  8 15:27:18 node1 kernel: ACPI: PCI Interrupt 0000:00:1d.3[D] ->
GSI 20 (level, low) -> IRQ 82


Apr  8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.3: UHCI Host
Controller


Apr  8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.3: new USB bus
registered, assigned bus number 5


Apr  8 15:27:18 node1 kernel: uhci_hcd 0000:00:1d.3: irq 82, io base
0x0000ac80


Apr  8 15:27:18 node1 kernel: usb usb5: configuration #1 chosen from 1
choice

Apr  8 15:27:18 node1 kernel: hub 5-0:1.0: USB hub found
Apr  8 15:27:18 node1 kernel: hub 5-0:1.0: 2 ports detected
Apr  8 15:27:18 node1 kernel: usb 1-1: configuration #1 chosen from 1


choice

Apr  8 15:27:18 node1 kernel: hub 1-1:1.0: USB hub found
Apr  8 15:27:18 node1 kernel: hub 1-1:1.0: 2 ports detected
Apr  8 15:27:18 node1 kernel: megasas: 00.00.03.15-RH1 Wed Nov. 21


10:29:45 PST 2007


Apr  8 15:27:18 node1 kernel: megasas: 0x1000:0x0060:0x1028:0x1f0c:
bus 1:slot 0:func 0
Apr  8 15:27:18 node1 kernel: ACPI: PCI Interrupt 0000:01:00.0[A] ->


GSI 16 (level, low) -> IRQ 169

Apr  8 15:27:18 node1 kernel: megasas: FW now in Ready state
Apr  8 15:27:18 node1 kernel: scsi2 : LSI SAS based MegaRAID driver
Apr  8 15:27:18 node1 kernel:   Vendor: FUJITSU   Model:
MBC2073RC         Rev: D506
Apr  8 15:27:19 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 05
Apr  8 15:27:19 node1 kernel:   Vendor: FUJITSU   Model:
MBC2073RC         Rev: D506
Apr  8 15:27:19 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 05
Apr  8 15:27:19 node1 kernel:   Vendor: DP        Model:
BACKPLANE         Rev: 1.05
Apr  8 15:27:19 node1 kernel:   Type:
Enclosure                          ANSI SCSI revision: 05
Apr  8 15:27:19 node1 kernel:   Vendor: DELL      Model: PERC 6/
i          Rev: 1.11
Apr  8 15:27:19 node1 kernel:   Type:   Direct-
Access                      ANSI SCSI revision: 05


Apr  8 15:27:19 node1 kernel: SCSI device sde: 142082048 512-byte hdwr
sectors (72746 MB)

Apr  8 15:27:19 node1 kernel: sde: Write Protect is off
Apr  8 15:27:19 node1 kernel: SCSI device sde: drive cache: write back
Apr  8 15:27:19 node1 kernel: SCSI device sde: 142082048 512-byte hdwr


sectors (72746 MB)

Apr  8 15:27:19 node1 kernel: sde: Write Protect is off
Apr  8 15:27:19 node1 kernel: SCSI device sde: drive cache: write back
Apr  8 15:27:19 node1 kernel:  sde: sde1 sde2 sde3 sde4 < sde5 sde6


sde7 sde8 >

Apr  8 15:27:19 node1 kernel: sd 2:2:0:0: Attached scsi disk sde
Apr  8 15:27:19 node1 kernel: Initializing USB Mass Storage driver...
Apr  8 15:27:19 node1 kernel: usb 1-5: new high speed USB device using


ehci_hcd and address 3


Apr  8 15:27:19 node1 kernel: usb 1-5: configuration #1 chosen from 1
choice

Apr  8 15:27:19 node1 kernel: hub 1-5:1.0: USB hub found
Apr  8 15:27:19 node1 kernel: hub 1-5:1.0: 4 ports detected
Apr  8 15:27:19 node1 kernel: usb 1-1.1: new full speed USB device


using ehci_hcd and address 4


Apr  8 15:27:19 node1 kernel: usb 1-1.1: configuration #1 chosen from
1 choice


Apr  8 15:27:19 node1 kernel: input: Dell DRAC5 as /class/input/input0
Apr  8 15:27:19 node1 kernel: input: USB HID v1.10 Keyboard [Dell
DRAC5] on usb-0000:00:1d.7-1.1


Apr  8 15:27:19 node1 kernel: input: Dell DRAC5 as /class/input/input1
Apr  8 15:27:19 node1 kernel: input: USB HID v1.10 Mouse [Dell DRAC5]
on usb-0000:00:1d.7-1.1


Apr  8 15:27:20 node1 kernel: usb 1-1.2: new high speed USB device
using ehci_hcd and address 5


Apr  8 15:27:20 node1 kernel: usb 1-1.2: configuration #1 chosen from
1 choice


Apr  8 15:27:20 node1 kernel: scsi3 : SCSI emulation for USB Mass
Storage devices


Apr  8 15:27:20 node1 kernel: scsi4 : SCSI emulation for USB Mass
Storage devices


Apr  8 15:27:20 node1 kernel: usbcore: registered new driver usb-
storage

Apr  8 15:27:20 node1 kernel: USB Mass Storage support registered.
Apr  8 15:27:20 node1 kernel:   Vendor: Dell      Model: Virtual
CDROM    Rev: 123
Apr  8 15:27:20 node1 kernel:   Type:   CD-
ROM                             ANSI SCSI revision: 00
Apr  8 15:27:20 node1 kernel:   Vendor: Dell      Model: Virtual


Floppy   Rev: 123


Apr  8 15:27:20 node1 kernel:   Type:   Direct-

Access                      ANSI SCSI revision: 00


Apr  8 15:27:20 node1 kernel: sd 4:0:0:0: Attached scsi removable disk
sdf


Apr  8 15:27:20 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:20 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:20 node1 kernel:


Apr  8 15:27:20 node1 kernel: end_request: I/O error, dev sdc, sector
560557184


Apr  8 15:27:20 node1 kernel: printk: 9 messages suppressed.
Apr  8 15:27:20 node1 kernel: Buffer I/O error on device sdc, logical
block 70069648


Apr  8 15:27:20 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:20 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:20 node1 kernel:


Apr  8 15:27:20 node1 kernel: end_request: I/O error, dev sdc, sector
560557184


Apr  8 15:27:20 node1 kernel: Buffer I/O error on device sdc, logical
block 70069648


Apr  8 15:27:20 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:20 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:20 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:21 node1 kernel: Buffer I/O error on device sdc, logical
block 0


Apr  8 15:27:21 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:21 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sdc, sector
8


Apr  8 15:27:21 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:21 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:21 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
560557184


Apr  8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:21 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
560557184


Apr  8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:21 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:21 node1 kernel:


Apr  8 15:27:21 node1 kernel: end_request: I/O error, dev sda, sector
8


Apr  8 15:27:21 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:21 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:22 node1 kernel:


Apr  8 15:27:22 node1 kernel: end_request: I/O error, dev sda, sector
0


Apr  8 15:27:22 node1 kernel: kjournald starting.  Commit interval 5
seconds


Apr  8 15:27:22 node1 kernel: EXT3-fs: mounted filesystem with ordered
data mode.


Apr  8 15:27:22 node1 kernel: SELinux:  Disabled at runtime.
Apr  8 15:27:22 node1 kernel: e1000e: Intel(R) PRO/1000 Network Driver
- 0.2.0


Apr  8 15:27:22 node1 kernel: e1000e: Copyright (c) 1999-2007 Intel
Corporation.


Apr  8 15:27:22 node1 kernel: ACPI: PCI Interrupt 0000:0a:00.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:22 node1 kernel: sd 0:0:0:0: Attached scsi generic sg0
type 0


Apr  8 15:27:22 node1 kernel: sd 0:0:1:0: Attached scsi generic sg1
type 0


Apr  8 15:27:22 node1 kernel: sd 1:0:0:0: Attached scsi generic sg2
type 0


Apr  8 15:27:22 node1 kernel: sd 1:0:1:0: Attached scsi generic sg3
type 0


Apr  8 15:27:22 node1 kernel: scsi 2:0:32:0: Attached scsi generic sg4
type 13


Apr  8 15:27:22 node1 kernel: sd 2:2:0:0: Attached scsi generic sg5
type 0


Apr  8 15:27:22 node1 kernel: scsi 3:0:0:0: Attached scsi generic sg6
type 5


Apr  8 15:27:22 node1 kernel: sd 4:0:0:0: Attached scsi generic sg7
type 0

Apr  8 15:27:22 node1 kernel: input: PC Speaker as /class/input/input2
Apr  8 15:27:22 node1 kernel: EDAC MC: Ver: 2.0.1 May 23 2008
Apr  8 15:27:22 node1 kernel: 0000:00:04.0: eth0: (PCI Express:2.5GB/


s:Width x4) 00:15:17:7d:cc:32


Apr  8 15:27:22 node1 kernel: 0000:00:04.0: eth0: Intel(R) PRO/1000
Network Connection


Apr  8 15:27:22 node1 kernel: 0000:00:04.0: eth0: MAC: 0, PHY: 4, PBA
No: c57721-005


Apr  8 15:27:22 node1 kernel: ACPI: PCI Interrupt 0000:0a:00.1[B] ->
GSI 17 (level, low) -> IRQ 66


Apr  8 15:27:22 node1 kernel: intel_rng: FWH not detected
Apr  8 15:27:22 node1 kernel: hda: ATAPI 24X DVD-ROM drive, 198kB
Cache, UDMA(33)


Apr  8 15:27:22 node1 kernel: Uniform CD-ROM driver Revision: 3.20
Apr  8 15:27:22 node1 kernel: 0000:00:04.0: eth1: (PCI Express:2.5GB/
s:Width x4) 00:15:17:7d:cc:33


Apr  8 15:27:23 node1 kernel: 0000:00:04.0: eth1: Intel(R) PRO/1000
Network Connection


Apr  8 15:27:23 node1 kernel: 0000:00:04.0: eth1: MAC: 0, PHY: 4, PBA
No: c57721-005


Apr  8 15:27:23 node1 kernel: shpchp: Standard Hot Plug PCI Controller
Driver version: 0.4

Apr  8 15:27:23 node1 kernel: EDAC MC0: Giving out device to
i5000_edac.c I5000: DEV 0000:00:10.0
Apr  8 15:27:23 node1 kernel: Broadcom NetXtreme II Gigabit Ethernet


Driver bnx2 v1.6.9 (December 8, 2007)


Apr  8 15:27:23 node1 kernel: ACPI: PCI Interrupt 0000:03:00.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:23 node1 kernel: eth2: Broadcom NetXtreme II BCM5708
1000Base-T (B2) PCI-X 64-bit 133MHz found at mem f8000000, IRQ 169,
node addr 001ec9b285f5


Apr  8 15:27:23 node1 kernel: ACPI: PCI Interrupt 0000:07:00.0[A] ->
GSI 16 (level, low) -> IRQ 169


Apr  8 15:27:23 node1 kernel: eth3: Broadcom NetXtreme II BCM5708
1000Base-T (B2) PCI-X 64-bit 133MHz found at mem f4000000, IRQ 169,
node addr 001ec9b285f7


Apr  8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:23 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:23 node1 kernel:


Apr  8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
560557184


Apr  8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:23 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:23 node1 kernel:


Apr  8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
560557184


Apr  8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:23 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:23 node1 kernel:


Apr  8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:23 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:23 node1 kernel:


Apr  8 15:27:23 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:23 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:23 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:23 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557248


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557296


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:24 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:24 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:24 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:24 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
560557304


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:25 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:25 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:25 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:25 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:25 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:25 node1 kernel:


Apr  8 15:27:25 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:25 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:25 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:26 node1 kernel:


Apr  8 15:27:26 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:26 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:26 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:27 node1 kernel:


Apr  8 15:27:27 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:27 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:27 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:28 node1 kernel:


Apr  8 15:27:28 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:28 node1 kernel: sd 1:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:28 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:29 node1 kernel:


Apr  8 15:27:29 node1 kernel: end_request: I/O error, dev sdc, sector
0


Apr  8 15:27:29 node1 kernel: sr0: scsi-1 drive
Apr  8 15:27:29 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:29 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:29 node1 kernel:


Apr  8 15:27:29 node1 kernel: end_request: I/O error, dev sda, sector
560557184


Apr  8 15:27:29 node1 kernel: sd 0:0:0:0: Device not ready: <6>:
Current: sense key: Not Ready


Apr  8 15:27:29 node1 kernel:     Add. Sense: Logical unit not ready,
manual intervention required


Apr  8 15:27:29 node1 kernel:
Received on Mon Apr 13 2009 - 15:01:49 CDT












Original text of this message