Solaris N_x port disappeared from fabric errors
If errors similar to the following are seen in the system log then the fault could be with the SAN switch (see SAN switch errors below)
Solaris server errors
Errors in /var/adm/messages
May 12 16:35:20 node1 fctl: [ID 517869 kern.warning] WARNING:3196=>fp(2)::GPN_ID for D_ID=2f201 failed
May 12 16:35:20 node1 fctl: [ID 517869 kern.warning] WARNING:3197=>fp(2)::N_x Port with D_ID=2f201, PWWN=5003076601105179 disappeared from fabric
May 12 16:35:20 node1 fctl: [ID 517869 kern.warning] WARNING:3207=>fp(1)::GPN_ID for D_ID=2f301 failed
May 12 16:35:20 node1 fctl: [ID 517869 kern.warning] WARNING:3208=>fp(1)::N_x Port with D_ID=2f301, PWWN=5003076601204179 disappeared from fabric
May 12 16:35:23 node1 fctl: [ID 517869 kern.warning] WARNING:3283=>fp(1)::N_x Port with D_ID=2f301, PWWN=5003076601204179 reappearedin fabric
May 12 16:35:23 node1 scsi: [ID 107833 kern.warning]WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w5003076601205393,1 (ssd16):
Or
May 12 16:34:46 node1 vxdmp: [ID 917986 kern.notice] NOTICE: VxVM vxdmp V-5-0-112 disabled path 118/0x8 belonging to the dmpnode 286/0x8
May 12 16:34:46 node1 vxdmp: [ID 917986 kern.notice] NOTICE: VxVM vxdmp V-5-0-112 disabled path 118/0x20 belonging to the dmpnode 286/0x10
May 12 16:35:20 node1 scsi: [ID 107833 kern.warning] WARNING: /pci@1e,600000/pci@0/pci@1/pci@0/pci@8/SUNW,qlc@1/fp@0,0/ssd@w5005071357924179,0 (ssd3):
May 12 16:35:20 node1 Error for Command: read(10) Error Level: Retryable
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] Requested Block: 21228000 Error Block: 0
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] Vendor: IBM Serial Number:
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
May 12 16:35:20 node1 scsi: [ID 107833 kern.warning] WARNING: /pci@1e,600000/pci@0/pci@1/pci@0/pci@8/SUNW,qlc@1/fp@0,0/ssd@w5005071357924179,1 (ssd1):
May 12 16:35:20 node1 Error for Command: write(10) Error Level: Retryable
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] Requested Block: 43339154 Error Block: 0
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] Vendor: IBM Serial Number:
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] Sense Key: Unit Attention
May 12 16:35:20 node1 scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
May 12 16:39:04 node1 vxdmp: [ID 736771 kern.notice] NOTICE: VxVM vxdmp V-5-0-148 enabled path 118/0x8 belonging to the dmpnode 286/0x8
May 12 16:39:04 node1 vxdmp: [ID 736771 kern.notice] NOTICE: VxVM vxdmp V-5-0-148 enabled path 118/0x20 belonging to the dmpnode 286/0x10
SAN switch errors causing the above server errors
2010/05/12-16:35:20, [FW-1424], 170749,, WARNING, switch1, Switch status changed from HEALTHY to MARGINAL.
2010/05/12-16:35:20, [FW-1436], 170750,, WARNING, switch1, Switch status change contributing factor Marginal ports: 1 marginal ports. (Port(s) 20)
2010/05/12-16:35:54, [FW-1425], 170751,, INFO, switch1, Switch status changed from MARGINAL to HEALTHY.