DRBD-configure

Requirment : two machines, each with a dedicated network link. Enable the DRBD module in the kernel include drbd8-utils (this package contain the binaries drbdadm, drbdsetup, drbdm eta and drbd-overview) Steps to configure DRBD 1. power on both the nodes 2. mknod /dev/drbd0 b 147 0 -- Note : to get the major number of the drbd device run 'cat /proc/devi ces | grep drbd' 3. On both the nodes edit the /etc/drbd.conf (in soho box, the path is "/usr/loc al/etc/drbd.conf")file as follows resource r0 { # Resource name r0 protocol C; # protoc ol type using is Protocol C net { sndbuf-size 2M; } on nodex1 { # "nodex 1" is the hostname of the machine 1 device /dev/drbd0; # drbd disk disk /dev/dram0; # Actual block disk need to be synced address 10.0.0.1:7789; # ip address of Node "no dex1" meta-disk internal; } on nodex2 { # "nodex2" is th e hostname of the machine 1 device /dev/drbd0; # drbd disk disk /dev/dram0; # Actual block disk need to be synced address 10.0.0.2:7789; # ip address of Node "no dex1" meta-disk internal; } } 4. run 'drbdadm create-md r0' on both the nodes 5. run 'drbdadm up r0' on both the nodes 6. run 'drbdadm primary r0' on one of the node, to make it as primary --Note : for the first time, run 'drbdadm -- --overwrite-data-of-peer pr imary r0' -- this flag sync both the nodes for the first time use. 7. run 'cat /proc/drbd' - for monitoring the drbd status. login as: root [email protected]'s password: root@px12-400r-TI2Y7H:/# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot Start End Blocks Id System

/dev/sdb1

1

243202 1953514583+ ee EFI GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sda: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d796976 Device Boot /dev/sda1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT

Disk /dev/sdc: 997 MB, 997720064 bytes 32 heads, 62 sectors/track, 982 cylinders Units = cylinders of 1984 * 512 = 1015808 bytes Disk identifier: 0x00000000 Device Boot /dev/sdc1 Start 1 End 980 Blocks 972129 Id System 83 Linux

Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table root@px12-400r-TI2Y7H:/# /etc/init.d/open-iscsi status Running file /etc/init.d/open-iscsi Current active iSCSI sessions: iscsiadm: No active sessions. root@px12-400r-TI2Y7H:/# ping 192.16.1.22 PING 192.16.1.22 (192.16.1.22) 56(84) bytes of data. ^X^C --- 192.16.1.22 ping statistics --5 packets transmitted, 0 received, 100% packet loss, time 4021ms root@px12-400r-TI2Y7H:/# ping 192.168.1.22 PING 192.168.1.22 (192.168.1.22) 56(84) bytes of data. ^C --- 192.168.1.22 ping statistics --5 packets transmitted, 0 received, 100% packet loss, time 3999ms root@px12-400r-TI2Y7H:/# login as: root [email protected]'s password: root@px12-400r-TI2Y7H:/# hostname px12-400r-TI2Y7H root@px12-400r-TI2Y7H:/# ifconfig eth0 Link encap:Ethernet HWaddr 00:d0:b8:12:af:ad UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) Interrupt:16 Memory:fbb00000-fbb20000 eth1 Link encap:Ethernet HWaddr 00:d0:b8:12:af:ae inet addr:169.254.53.76 Bcast:169.254.255.255 Mask:255.255.0.0

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:829 errors:0 dropped:0 overruns:0 frame:0 TX packets:563 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:277746 (271.2 KiB) TX bytes:173958 (169.8 KiB) Interrupt:17 Memory:fba00000-fba20000 eth2 Link encap:Ethernet HWaddr 00:d0:b8:12:af:af inet addr:192.168.0.102 Bcast:192.168.0.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:7354 errors:0 dropped:0 overruns:0 frame:0 TX packets:3703 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1398582 (1.3 MiB) TX bytes:1814076 (1.7 MiB) Interrupt:18 Memory:fb900000-fb920000 Link encap:Ethernet HWaddr 00:d0:b8:12:af:b0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) Interrupt:19 Memory:fb800000-fb820000 Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:426 errors:0 dropped:0 overruns:0 frame:0 TX packets:426 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:47288 (46.1 KiB) TX bytes:47288 (46.1 KiB)

eth3

lo

root@px12-400r-TI2Y7H:/# ping 169.254.175.121 PING 169.254.175.121 (169.254.175.121) 56(84) bytes of data. 64 bytes from 169.254.175.121: icmp_seq=1 ttl=64 time=0.162 ms 64 bytes from 169.254.175.121: icmp_seq=2 ttl=64 time=0.136 ms 64 bytes from 169.254.175.121: icmp_seq=3 ttl=64 time=0.126 ms 64 bytes from 169.254.175.121: icmp_seq=4 ttl=64 time=0.164 ms 64 bytes from 169.254.175.121: icmp_seq=5 ttl=64 time=0.135 ms 64 bytes from 169.254.175.121: icmp_seq=6 ttl=64 time=0.189 ms ^C --- 169.254.175.121 ping statistics --6 packets transmitted, 6 received, 0% packet loss, time 4997ms rtt min/avg/max/mdev = 0.126/0.152/0.189/0.021 ms root@px12-400r-TI2Y7H:/# vi /etc/network/interfaces root@px12-400r-TI2Y7H:/# ls bin debug etc initrd lib64 nfs opt ram selinux tmp var boot dev home lib mnt oem proc sbin sys usr root@px12-400r-TI2Y7H:/# df -h Filesystem Size Used Avail Use% Mounted on rootfs 50M 2.8M 48M 6% / /dev/root.old 6.5M 2.9M 3.6M 45% /initrd none 50M 2.8M 48M 6% / /dev/sdc1 935M 236M 652M 27% /boot /dev/loop0 222M 222M 0 100% /mnt/apps /dev/loop1 7.5M 2.4M 4.7M 34% /etc /dev/loop2 188K 188K 0 100% /oem tmpfs 1.9G 0 1.9G 0% /mnt/apps/lib/init/rw tmpfs 1.9G 0 1.9G 0% /dev/shm /dev/mapper/md0_vg-vol1

20G 785M 20G 4% /mnt/system root@px12-400r-TI2Y7H:/# cd /mnt/system/ root@px12-400r-TI2Y7H:/mnt/system# ls DfsRoot bluetooth cores d2d log samba swapfile webDAV_www auditLog config cups download opt scst upload root@px12-400r-TI2Y7H:/mnt/system# mkdir cluster root@px12-400r-TI2Y7H:/mnt/system# cd cluster/' > > root@px12-400r-TI2Y7H:/mnt/system# cd cluster/ root@px12-400r-TI2Y7H:/mnt/system/cluster# ls root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 1_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 1_init.sh px12-400r-TI2Y7H 1_init.sh: line 4: nodex1: command not found root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 1_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# cat /etc/hosts 127.0.0.1 localhost 192.168.0.102 px12-400r-TI2Y7H px12-400r-TI2Y7H root@px12-400r-TI2Y7H:/mnt/system/cluster# ping px12-400r-TI2Y7H PING px12-400r-TI2Y7H (192.168.0.102) 56(84) bytes of data. 64 bytes from px12-400r-TI2Y7H (192.168.0.102): icmp_seq=1 ttl=64 time=0.014 64 bytes from px12-400r-TI2Y7H (192.168.0.102): icmp_seq=2 ttl=64 time=0.011 ^C --- px12-400r-TI2Y7H ping statistics --2 packets transmitted, 2 received, 0% packet loss, time 999ms rtt min/avg/max/mdev = 0.011/0.012/0.014/0.003 ms root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 eth1 Link encap:Ethernet HWaddr 00:d0:b8:12:af:ae inet addr:169.254.53.76 Bcast:169.254.255.255 Mask:255.255.0.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:977 errors:0 dropped:0 overruns:0 frame:0 TX packets:669 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:329339 (321.6 KiB) TX bytes:207744 (202.8 KiB) Interrupt:17 Memory:fba00000-fba20000 root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 -a -a: Unknown host ifconfig: `--help' gives usage information. root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# man ifconfig No manual entry for ifconfig See 'man 7 undocumented' for help when manual pages are not available. root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig -h Usage: ifconfig [-a] [-v] [-s] [[] ] [add [/]] [del [/]] [[-]broadcast []] [[-]pointopoint []] [netmask ] [dstaddr ] [tunnel ] [outfill ] [keepalive ] [hw ] [metric ] [mtu ] [[-]trailers] [[-]arp] [[-]allmulti] [multicast] [[-]promisc] [mem_start ] [io_addr ] [irq ] [media ] [txqueuelen ]

[[-]dynamic] [up|down] ... =Hardware Type. List of possible hardware types: loop (Local Loopback) slip (Serial Line IP) cslip (VJ Serial Line IP) slip6 (6-bit Serial Line IP) cslip6 (VJ 6-bit Serial Line IP) adaptive (tive Serial Line IP) strip (Metricom Starmode IP) ash (Ash) ether (Ethernet) tr (16/4 Mbps Token Ring) tr (16/4 Mbps Token Ring (New)) ax25 (AMPR AX. netrom (AMPR NET/ROM) rose (AMPR ROSE) tunnel (IPIP Tunnel) ppp (Point-to-Point Protocol) hdlc ((Cisco)-HDLC) lapb (LAPB) arcnet (ARCnet) dlci (Frame Relay DLCI) frad (Frame Relay Access Device) sit (IPv6-in-IPv4) fddi (Fiber Distributed Data Interface) hippi (HIPPI) irda (IrLAP) ec (Econet) x25 (generic X.25) eui64 (Generic EUI-64) =Address family. Default: inet List of possible address families: unix (UNIX Domain) inet (DARPA Internet) inet6 (IPv6) ax25 (AMPR AX.25) netrom (AMPR NET/ROM) rose (AMPR ROSE) ipx (Novell IPX) ddp (Appletalk DDP) ec (Econet) ash (Ash) x25 (CCITT X.25) root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 | grep addr eth1 Link encap:Ethernet HWaddr 00:d0:b8:12:af:ae inet addr:169.254.53.76 Bcast:169.254.255.255 Mask:255.255.0.0 root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 | cut -d: -f 1 eth1 Link encap inet addr UP BROADCAST RUNNING MULTICAST MTU RX packets TX packets collisions RX bytes Interrupt root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 | cut -daddr: -f 1 cut: the delimiter must be a single character Try `cut --help' for more information. root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 | cut -d"addr:" -f cut: the delimiter must be a single character Try `cut --help' for more information. root@px12-400r-TI2Y7H:/mnt/system/cluster# ifconfig eth1 | cut -d"addr:" -f root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# iscsiadm -m discovery -t st -p 198.0. 100 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs root@px12-400r-TI2Y7H:/mnt/system/cluster# iscsiadm -m discovery -t st -p px0d-T HYH41 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 2_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 2_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 2_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 2_init.sh 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence

192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.g fs, portal: 192.168.0.100,3260] Login to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-THYH4s, p ortal: 192.168.0.100,3260]: successful Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.i scsifence, portal: 192.168.0.100,3260] Login to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-THYH4csif ence, portal: 192.168.0.100,3260]: successful tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 2_init.sh 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.g fs, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.gfs, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.i scsifence, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.iscsifence, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 2_init.sh 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.g fs, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.gfs, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.i scsifence, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.iscsifence, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# iscsiadm -m session tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 2_init.sh 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.g fs, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.gfs, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.i scsifence, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.iscsifence, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 2_init.sh

root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 2_init.sh 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.iscsifence 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gfs Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.g fs, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.gfs, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px6-300d-41.i scsifence, portal: 192.168.0.100,3260] iscsiadm: Could not login to [iface: default, target: iqn.1992-04.com.emc:ste.px 6-300d-THYH41.iscsifence, portal: 192.168.0.100,3260]: iscsiadm: initiator reported error (15 - already exists) tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# iscsiadm -m session tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# scp 1_init.sh 2_init.sh px12-400rY5H: /mnt/system/cluster/ The authenticity of host 'px12-400r-ti2y5h (169.254.175.121)' can't be estabed. RSA key fingerprint is 32:40:ee:42:1d:95:89:ed:3c:e9:7e:07:fa:d0:a9:8f. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'px12-400r-ti2y5h,169.254.175.121' (RSA) to the lof k nown hosts. root@px12-400r-ti2y5h's password: 1_init.sh 100% 208 0.2KB/s 00:00 2_init.sh 100% 565 0.6KB/s 00:00 root@px12-400r-TI2Y7H:/mnt/system/cluster# vi /etc/lvm//lvm.conf root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT


Disk /dev/sdc: 997 MB, 997720064 bytes 32 heads, 62 sectors/track, 982 cylinders Units = cylinders of 1984 * 512 = 1015808 bytes

Disk identifier: 0x00000000 Device Boot /dev/sdc1 Start 1 End 980 Blocks 972129 Id System 83 Linux

Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table Disk /dev/sdd: 107.3 GB, 107374182400 bytes 255 heads, 63 sectors/track, 13054 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x74a26282 Disk /dev/sdd doesn't contain a valid partition table Disk /dev/sde: 1073 MB, 1073741824 bytes 34 heads, 61 sectors/track, 1011 cylinders Units = cylinders of 2074 * 512 = 1061888 bytes Disk identifier: 0x74a26282 Disk /dev/sde doesn't contain a valid partition table root@px12-400r-TI2Y7H:/mnt/system/cluster# mkqdisk -c /dev/sde sde sde10 sde12 sde14 sde3 sde5 sde7 sde9 sde1 sde11 sde13 sde2 sde4 sde6 sde8 root@px12-400r-TI2Y7H:/mnt/system/cluster# mkqdisk -c /dev/sde -l qdisk mkqdisk v2.03.09 Writing new quorum disk label 'qdisk' to /dev/sde. WARNING: About to destroy all data on /dev/sde; proceed [N/y] ? y Initializing status block for node 1... Initializing status block for node 2... Initializing status block for node 3... Initializing status block for node 4... Initializing status block for node 5... Initializing status block for node 6... Initializing status block for node 7... Initializing status block for node 8... Initializing status block for node 9... Initializing status block for node 10... Initializing status block for node 11... Initializing status block for node 12... Initializing status block for node 13... Initializing status block for node 14... Initializing status block for node 15... Initializing status block for node 16... root@px12-400r-TI2Y7H:/mnt/system/cluster# mkqdisk -L mkqdisk v2.03.09 /dev/sde: Magic: Label: Created: Host: Kernel Sector Size: Recorded Sector Size: eb7a62c2 qdisk Fri Feb 3 16:33:36 2012 px12-400r-TI2Y7H 512 512

root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 3_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 3_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 3_init.sh mkdir: cannot create directory `/usr/local/etc/cluster': Read-only file syst 3_init.sh: line 5: /etc/cluster/cluster.conf: No such file or directory root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 3_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 3_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi /etc/cluster/cluster.conf root@px12-400r-TI2Y7H:/mnt/system/cluster# scp 3_init.sh px12-400r-TI2Y5H:/myste m/cluster/ root@px12-400r-ti2y5h's password: 3_init.sh 100% 1352 1.3KB/s 00:00 root@px12-400r-TI2Y7H:/mnt/system/cluster# vgchange -aly connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. 1 logical volume(s) in volume group "md0_vg" now active root@px12-400r-TI2Y7H:/mnt/system/cluster# vgscan connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Reading all physical volumes. This may take a while... Found volume group "md0_vg" using metadata type lvm2 root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT



Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table Disk /dev/sdd: 107.3 GB, 107374182400 bytes 255 heads, 63 sectors/track, 13054 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x74a26282 Disk /dev/sdd doesn't contain a valid partition table Disk /dev/sde: 1073 MB, 1073741824 bytes 34 heads, 61 sectors/track, 1011 cylinders Units = cylinders of 2074 * 512 = 1061888 bytes Disk identifier: 0x00000000 Disk /dev/sde doesn't contain a valid partition table root@px12-400r-TI2Y7H:/mnt/system/cluster# pvcreate /dev/sdd connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Physical volume "/dev/sdd" successfully created root@px12-400r-TI2Y7H:/mnt/system/cluster# vgcreate Cvg /dev/sdd connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Volume group "Cvg" successfully created root@px12-400r-TI2Y7H:/mnt/system/cluster# vi /etc/lvm/lvm.conf root@px12-400r-TI2Y7H:/mnt/system/cluster# lvcreate -n Cvol1 -L 20G Cvg connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Logical volume "Cvol1" created root@px12-400r-TI2Y7H:/mnt/system/cluster# mkfs.gfs2 -t MBK:Cvg -p lock_dlm /de v/Cvg/Cvol1 This will destroy any data on /dev/Cvg/Cvol1. Are you sure you want to proceed? [y/n] y mkfs.gfs2: can't fsync device (-1): Input/output error root@px12-400r-TI2Y7H:/mnt/system/cluster# lvdisplay connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. /dev/sdd: read failed after 0 of 4096 at 0: Input/output error /dev/sde: read failed after 0 of 4096 at 0: Input/output error --- Logical volume --LV Name /dev/md0_vg/vol1 VG Name md0_vg LV UUID n8zkjq-ejXv-AiP7-eCd3-GIqO-kQfB-DFRS9i LV Write Access read/write LV Status available # open 1

LV Size Current LE Segments Allocation Read ahead sectors - currently set to Block device

20.01 GiB 5122 1 inherit auto 256 253:0

root@px12-400r-TI2Y7H:/mnt/system/cluster# lvcreate -n Cvol1 -L 20G Cvg co nnect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. /dev/sdd: read failed after 0 of 4096 at 0: Input/output error /dev/sde: read failed after 0 of 4096 at 0: Input/output error /dev/Cvg/Cvol1: read failed after 0 of 4096 at 21474770944: Input/output e /dev/Cvg/Cvol1: read failed after 0 of 4096 at 21474828288: Input/output e /dev/Cvg/Cvol1: read failed after 0 of 4096 at 0: Input/output error /dev/Cvg/Cvol1: read failed after 0 of 4096 at 4096: Input/output error /dev/sdd: read failed after 0 of 4096 at 107374116864: Input/output error /dev/sdd: read failed after 0 of 4096 at 107374174208: Input/output error /dev/sdd: read failed after 0 of 4096 at 4096: Input/output error /dev/sde: read failed after 0 of 4096 at 1073676288: Input/output error /dev/sde: read failed after 0 of 4096 at 1073733632: Input/output error /dev/sde: read failed after 0 of 4096 at 4096: Input/output error Volume group "Cvg" not found root@px12-400r-TI2Y7H:/mnt/system/cluster# iscsiadm -m session tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# fdsik -l -sh: fdsik: command not found root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT




Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table Disk /dev/sdd: 107.3 GB, 107374182400 bytes 255 heads, 63 sectors/track, 13054 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/sdd doesn't contain a valid partition table root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk /dev/sdd Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disel Building a new DOS disklabel with disk identifier 0x652621e6. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. The number of cylinders for this disk is set to 13054. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rit Command (m for help): p Disk /dev/sdd: 107.3 GB, 107374182400 bytes 255 heads, 63 sectors/track, 13054 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x652621e6 Device Boot Start End Blocks Id System

Command (m for help): q root@px12-400r-TI2Y7H:/mnt/system/cluster# ping px12-400r-TI2Y7H PING px12-400r-TI2Y7H (192.168.0.102) 56(84) bytes of data. 64 bytes from px12-400r-TI2Y7H (192.168.0.102): icmp_seq=1 ttl=64 time=0.009 64 bytes from px12-400r-TI2Y7H (192.168.0.102): icmp_seq=2 ttl=64 time=0.013 ^C --- px12-400r-TI2Y7H ping statistics --2 packets transmitted, 2 received, 0% packet loss, time 1002ms rtt min/avg/max/mdev = 0.009/0.011/0.013/0.002 ms root@px12-400r-TI2Y7H:/mnt/system/cluster# ping px12-400r-TI2Y5H PING px12-400r-TI2Y5H (169.254.175.121) 56(84) bytes of data. 64 bytes from 169.254.175.121: icmp_seq=1 ttl=64 time=0.112 ms 64 bytes from 169.254.175.121: icmp_seq=2 ttl=64 time=0.157 ms ^C --- px12-400r-TI2Y5H ping statistics --2 packets transmitted, 2 received, 0% packet loss, time 1011ms rtt min/avg/max/mdev = 0.112/0.134/0.157/0.025 ms

root@px12-400r-TI2Y7H:/mnt/system/cluster# fdsik -l -sh: fdsik: command not found root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk /dev/sdd Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disel Building a new DOS disklabel with disk identifier 0xbaa861eb. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. The number of cylinders for this disk is set to 13054. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rit Command (m for help): q root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT



Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table

Disk /dev/sdd: 107.3 GB, 107374182400 bytes 255 heads, 63 sectors/track, 13054 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/sdd doesn't contain a valid partition table root@px12-400r-TI2Y7H:/mnt/system/cluster# ping 192.168.0.100 PING 192.168.0.100 (192.168.0.100) 56(84) bytes of data. From 192.168.0.102 icmp_seq=2 Destination Host Unreachable ^C --- 192.168.0.100 ping statistics --2 packets transmitted, 0 received, +1 errors, 100% packet loss, time 1008ms root@px12-400r-TI2Y7H:/mnt/system/cluster# ping 192.168.0.100 PING 192.168.0.100 (192.168.0.100) 56(84) bytes of data. From 192.168.0.102 icmp_seq=1 Destination Host Unreachable ^C --- 192.168.0.100 ping statistics --2 packets transmitted, 0 received, +1 errors, 100% packet loss, time 1001ms root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/cman start Running file /etc/init.d/cman Starting cluster manager: Loading kernel modules:FATAL: Module configfs not found. done Mounting config filesystem: done Starting cluster configuration system: done Joining cluster:cman_tool: ccsd is not running done Starting daemons: groupd fenced dlm_controld gfs_controld Joining fence domain:fence_tool: can't communicate with fenced -1 done Starting Quorum Disk daemon: done root@px12-400r-TI2Y7H:/mnt/system/cluster# cman_tool status cman_tool: Cannot open connection to cman, is it running ? root@px12-400r-TI2Y7H:/mnt/system/cluster# ccs_tool update /etc/cluster/clusconf Unable to connect to the CCS daemon: Connection refused Failed to update config file. root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/c checkfs.sh cman ctdb checkroot.sh coredump_collector cups clvm cron root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/gfs gfs-tools gfs2-tools root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/gfs2-tools status Running file /etc/init.d/gfs2-tools root@px12-400r-TI2Y7H:/mnt/system/cluster# ccs_tool update /etc/cluster/clusconf Unable to connect to the CCS daemon: Connection refused Failed to update config file. root@px12-400r-TI2Y7H:/mnt/system/cluster# dmesg nsport error, dev sde, sector 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 00 08 00 end_request: recoverable transport error, dev sde, sector 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00

sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 1f ff 80 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 1f ff 80 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 end_request: recoverable transport error, dev sde, sector GFS2: gfs2 mount does not exist sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code

00 08 00 2097024 00 08 00 2097024 00 80 00 0 00 08 00 0 00 08 00 528 00 08 00 528 00 08 00 528

00 20 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0

sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0: sd 10:0:0:0: sd 10:0:0:0: end_request: sd 10:0:0:0:

[sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 recoverable transport error, dev sde, sector [sde] Unhandled error code [sde] Result: hostbyte=0x0f driverbyte=0x00 [sde] CDB: cdb[0]=0x28: 28 00 00 1f ff 80 00 recoverable transport error, dev sde, sector [sde] Unhandled error code

00 08 00 0 00 08 00 0 00 20 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 02 00 00 0 00 08 00 0 00 08 00 2097024

sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 1f ff 80 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 end_request: recoverable transport error, dev sde, sector GFS2: gfs2 mount does not exist sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector quiet_error: 216 callbacks suppressed Buffer I/O error on device sde, logical block 0 Buffer I/O error on device sde, logical block 1 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector

00 08 00 2097024 00 80 00 0 00 08 00 0 00 08 00 528 00 08 00 528 00 08 00 528

00 20 00 0

00 08 00 0

00 08 00 0

00 08 00 0

00 08 00 0

00 08 00 0

00 08 00 0

Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector Buffer I/O error on device sde, logical block 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 end_request: recoverable transport error, dev sde, sector sd 10:0:0:0: [sde] Unhandled error code

00 08 00 0

00 08 00 0

00 08 00 0 00 20 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 00 08 00 0 02 00 00 0

sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 00 08 00 end_request: recoverable transport error, dev sde, sector 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 1f ff 80 00 00 08 00 end_request: recoverable transport error, dev sde, sector 2097024 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 1f ff 80 00 00 08 00 end_request: recoverable transport error, dev sde, sector 2097024 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 00 80 00 end_request: recoverable transport error, dev sde, sector 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 00 00 00 00 08 00 end_request: recoverable transport error, dev sde, sector 0 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 00 08 00 end_request: recoverable transport error, dev sde, sector 528 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 00 08 00 end_request: recoverable transport error, dev sde, sector 528 sd 10:0:0:0: [sde] Unhandled error code sd 10:0:0:0: [sde] Result: hostbyte=0x0f driverbyte=0x00 sd 10:0:0:0: [sde] CDB: cdb[0]=0x28: 28 00 00 00 02 10 00 00 08 00 end_request: recoverable transport error, dev sde, sector 528 GFS2: gfs2 mount does not exist root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# ccs_tool update /etc/cluster/clusconf Unable to connect to the CCS daemon: Connection refused Failed to update config file. root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# find / -name "*ccsd*" /var/run/cluster/ccsd.pid /mnt/apps/usr/sbin/ccsd root@px12-400r-TI2Y7H:/mnt/system/cluster# ccs ccs_test ccs_tool ccsd root@px12-400r-TI2Y7H:/mnt/system/cluster# ccsd root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/cman start ing file /etc/init.d/cman Starting cluster manager: Loading kernel modules:FATAL: Module configfs not found. done Mounting config filesystem: done Starting cluster configuration system: done Joining cluster: done Starting daemons: groupd fenced dlm_controld gfs_controld Joining fence domain: done Starting Quorum Disk daemon: done root@px12-400r-TI2Y7H:/mnt/system/cluster# cman_tool status cman_tool: Cannot open connection to cman, is it running ? root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/cman restart

Runn

Running file /etc/init.d/cman Running file /etc/init.d/cman Stopping cluster manager Stopping Quorum Disk daemon: done Leaving fence domain:fence_tool: can't communicate with fenced done Stopping daemons: gfs_controld dlm_controld fenced groupd Leaving the cluster:cman_tool: Cannot open connection to cman, is it runnin done Stopping cluster configuration system: done Unmounting config filesystem: done Running file /etc/init.d/cman Starting cluster manager: Loading kernel modules:FATAL: Module configfs not found. done Mounting config filesystem: done Starting cluster configuration system: done Joining cluster: done Starting daemons: groupd fenced dlm_controld gfs_controld Joining fence domain: done Starting Quorum Disk daemon: done root@px12-400r-TI2Y7H:/mnt/system/cluster# cman_tool status Version: 6.1.0 Config Version: 1 Cluster Name: MBK Cluster Id: 515 Cluster Member: Yes Cluster Generation: 12 Membership state: Cluster-Member Nodes: 2 Expected votes: 1 Total votes: 2 Node votes: 1 Quorum: 1 Active subsystems: 7 Flags: 2node Dirty Ports Bound: 0 Node name: px12-400r-TI2Y7H Node ID: 1 Multicast addresses: 239.192.2.5 Node addresses: 192.168.0.102 root@px12-400r-TI2Y7H:/mnt/system/cluster# cman_tool nodes Node Sts Inc Joined Name 1 M 4 2012-02-03 17:09:56 px12-400r-TI2Y7H 2 M 12 2012-02-03 17:09:57 px12-400r-TI2Y5H root@px12-400r-TI2Y7H:/mnt/system/cluster# clustat Cluster Status for MBK @ Fri Feb 3 17:12:45 2012 Member Status: Quorate Member Name ------ ---px12-400r-TI2Y7H px12-400r-TI2Y5H ID Status ---- -----1 Online, Local 2 Online

root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/rgmanager.dpkg-new st Running file /etc/init.d/rgmanager.dpkg-new FATAL: Module sctp not found. root@px12-400r-TI2Y7H:/mnt/system/cluster# /etc/init.d/rgmanager.dpkg-new st Running file /etc/init.d/rgmanager.dpkg-new FATAL: Module sctp not found.

Starting cluster service manager: done. root@px12-400r-TI2Y7H:/mnt/system/cluster# clustat Cluster Status for MBK @ Fri Feb 3 17:14:05 2012 Member Status: Quorate Member Name ------ ---px12-400r-TI2Y7H px12-400r-TI2Y5H ID Status ---- -----1 Online, Local 2 Online cman_tool status

root@px12-400r-TI2Y7H:/mnt/system/cluster# Version: 6.1.0 Config Version: 1 Cluster Name: MBK Cluster Id: 515 Cluster Member: Yes Cluster Generation: 12 Membership state: Cluster-Member Nodes: 2 Expected votes: 1 Total votes: 2 Node votes: 1 Quorum: 1 Active subsystems: 8 Flags: 2node Dirty Ports Bound: 0 177 Node name: px12-400r-TI2Y7H Node ID: 1 Multicast addresses: 239.192.2.5 Node addresses: 192.168.0.102 root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# root@px12-400r-TI2Y7H:/mnt/system/cluster# Config file updated from version 1 to 2

vi /etc/cluster/cluster.conf vi /etc/cluster/cluster.conf ccs_tool update /etc/cluster/clusconf

Update complete. root@px12-400r-TI2Y7H:/mnt/system/cluster# cman_tool status ion: 6.1.0 Config Version: 2 Cluster Name: MBK Cluster Id: 515 Cluster Member: Yes Cluster Generation: 12 Membership state: Cluster-Member Nodes: 2 Expected votes: 1 Total votes: 2 Node votes: 1 Quorum: 1 Active subsystems: 8 Flags: 2node Dirty Ports Bound: 0 177 Node name: px12-400r-TI2Y7H Node ID: 1 Multicast addresses: 239.192.2.5 Node addresses: 192.168.0.102 root@px12-400r-TI2Y7H:/mnt/system/cluster# cman_tool status ion: 6.1.0 Config Version: 2 Cluster Name: MBK

Vers

Vers

Cluster Id: 515 Cluster Member: Yes Cluster Generation: 12 Membership state: Cluster-Member Nodes: 2 Expected votes: 1 Total votes: 2 Node votes: 1 Quorum: 1 Active subsystems: 8 Flags: 2node Dirty Ports Bound: 0 177 Node name: px12-400r-TI2Y7H Node ID: 1 Multicast addresses: 239.192.2.5 Node addresses: 192.168.0.102 root@px12-400r-TI2Y7H:/mnt/system/cluster# clustat Cluster Status for MBK @ Fri Feb 3 17:39:41 2012 Member Status: Quorate Member Name ------ ---px12-400r-TI2Y7H px12-400r-TI2Y5H ID Status ---- -----1 Online, Local, rgmanager 2 Online, rgmanager

Service Name Owner (Last) State ------- -------- ---------service:192.168.0.105 none recovering root@px12-400r-TI2Y7H:/mnt/system/cluster# iscsiadm -m session tcp: [1] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.gf tcp: [2] 192.168.0.100:3260,1 iqn.1992-04.com.emc:storage.px6-300d-THYH41.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT




Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table q ^C root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT



Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table ^C root@px12-400r-TI2Y7H:/mnt/system/cluster# vi 2_init.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# cp 2_init.sh iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# sh iscsi_logout.sh Logging out of session [sid: 1, target: iqn.1992-04.com.emc:storage.px6-300dH41.

gfs, portal: 192.168.0.100,3260] login as: root [email protected]'s password: root@px12-400r-TI2Y7H:/# clustat Cluster Status for MBK @ Fri Feb 3 21:16:09 2012 Member Status: Quorate Member Name ------ ---px12-400r-TI2Y7H px12-400r-TI2Y5H /dev/sde ID Status ---- -----1 Online, Local, rgmanager 2 Online, rgmanager 0 Online, Quorum Disk

Service Name Owner (Last) State ------- -------- ---------service:169.254.176.60 px12-400r-TI2Y5H started root@px12-400r-TI2Y7H:/# vgscan connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Reading all physical volumes. This may take a while... Found volume group "md0_vg" using metadata type lvm2 root@px12-400r-TI2Y7H:/# vi /etc/lvm/lvm.conf root@px12-400r-TI2Y7H:/# /etc/init.d/clvm status Running file /etc/init.d/clvm Cluster LVM Daemon is not running. root@px12-400r-TI2Y7H:/# /etc/init.d/clvm start Running file /etc/init.d/clvm Starting Cluster LVM Daemon: clvm. Activating all VGs. connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. 1 logical volume(s) in volume group "md0_vg" now active root@px12-400r-TI2Y7H:/# /etc/init.d/clvm status Running file /etc/init.d/clvm Cluster LVM Daemon is running. root@px12-400r-TI2Y7H:/# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sda: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes

Disk identifier: 0x2d796976 Device Boot /dev/sda1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT


Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table Disk /dev/sdd: 21.4 GB, 21474836480 bytes 64 heads, 32 sectors/track, 20480 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk identifier: 0x08be0f7f Disk /dev/sdd doesn't contain a valid partition table Disk /dev/sde: 3221 MB, 3221225472 bytes 100 heads, 62 sectors/track, 1014 cylinders Units = cylinders of 6200 * 512 = 3174400 bytes Disk identifier: 0x00000000 Disk /dev/sde doesn't contain a valid partition table root@px12-400r-TI2Y7H:/# /etc/init.d/clvm status Running file /etc/init.d/clvm Cluster LVM Daemon is running. root@px12-400r-TI2Y7H:/# /etc/init.d/clvm status root@px12-400r-TI2Y7H:/# vgchange -aly connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. 1 logical volume(s) in volume group "md0_vg" now active root@px12-400r-TI2Y7H:/# fdisk -l WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT

WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk d't s upport GPT. Use GNU Parted.

Disk /dev/sda: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d796976 Device Boot /dev/sda1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT


Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table Disk /dev/sdd: 21.4 GB, 21474836480 bytes 64 heads, 32 sectors/track, 20480 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk identifier: 0x08be0f7f Disk /dev/sdd doesn't contain a valid partition table Disk /dev/sde: 3221 MB, 3221225472 bytes 100 heads, 62 sectors/track, 1014 cylinders Units = cylinders of 6200 * 512 = 3174400 bytes Disk identifier: 0x00000000 Disk /dev/sde doesn't contain a valid partition table root@px12-400r-TI2Y7H:/# pvcreate /dev/sdd connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Physical volume "/dev/sdd" successfully created root@px12-400r-TI2Y7H:/# iptables -L FATAL: Module ip_tables not found. iptables v1.4.2: can't initialize iptables table `filter': iptables who? (do nee d to insmod?) Perhaps iptables or your kernel needs to be upgraded. root@px12-400r-TI2Y7H:/# iptables iptables v1.4.2: no command specified Try `iptables -h' or 'iptables --help' for more information. root@px12-400r-TI2Y7H:/# iptables -h iptables v1.4.2 Usage: iptables iptables iptables iptables iptables iptables -[AD] chain rule-specification [options] -[RI] chain rulenum rule-specification [options] -D chain rulenum [options] -[LS] [chain [rulenum]] [options] -[FZ] [chain] [options] -[NX] chain

iptables -E old-chain-name new-chain-name iptables -P chain target [options] iptables -h (print this help information) Commands: Either long --append --delete --delete short options are allowed. chain Append to chain chain Delete matching rule from chain chain rulenum Delete rule rulenum (1 = first) from chain --insert -I chain [rulenum] Insert in chain as rulenum (default 1=first) --replace -R chain rulenum Replace rule rulenum (1 = first) in chain --list -L [chain [rulenum]] List the rules in a chain or all chains --list-rules -S [chain [rulenum]] Print the rules in a chain or all chains --flush -F [chain] Delete all rules in chain or all chains --zero -Z [chain] Zero counters in chain or all chains --new -N chain Create a new user-defined chain --delete-chain -X [chain] Delete a user-defined chain --policy -P chain target Change policy on chain to target --rename-chain -E old-chain new-chain Change chain name, (moving any references) Options: [!] --proto -p proto protocol: by number or name, eg. `tcp' [!] --source -s address[/mask] source specification [!] --destination -d address[/mask] destination specification [!] --in-interface -i input name[+] network interface name ([+] for wildcard) --jump -j target target for rule (may load target extension) --goto -g chain jump to chain with no return --match -m match extended match (may load extension) --numeric -n numeric output of addresses and ports [!] --out-interface -o output name[+] network interface name ([+] for wildcard) --table -t table table to manipulate (default: `filter') --verbose -v verbose mode --line-numbers print line numbers when listing --exact -x expand numbers (display exact values) [!] --fragment -f match second or further fragments only --modprobe= try to insert modules using this command --set-counters PKTS BYTES set the counter during insert/append [!] --version -V print package version. root@px12-400r-TI2Y7H:/# iptables -L FATAL: Module ip_tables not found. iptables v1.4.2: can't initialize iptables table `filter': iptables who? (do nee d to insmod?) Perhaps iptables or your kernel needs to be upgraded. root@px12-400r-TI2Y7H:/# root@px12-400r-TI2Y7H:/# or -A -D -D

root@px12-400r-TI2Y7H:/# root@px12-400r-TI2Y7H:/# vgcreate Cvg0 /dev/sdd connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Volume group "Cvg0" successfully created root@px12-400r-TI2Y7H:/# dmesg nnection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020)

GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error

(1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020)

connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist

(1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020)

connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error

(1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020)

connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error

(1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020)

connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error GFS2: gfs2 mount does not exist connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error GFS2: gfs2 mount does not exist connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error connection2:0: detected conn error connection1:0: detected conn error

(1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020) (1020)

GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) GFS2: gfs2 mount does not exist connection2:0: detected conn error (1020) connection1:0: detected conn error (1020) connection1:0: detected conn error (1020) connection2:0: detected conn error (1020) root@px12-400r-TI2Y7H:/# vi /var/log/messages root@px12-400r-TI2Y7H:/# root@px12-400r-TI2Y7H:/# lvcreate -n Cvol0 -L 10G Cvg0 connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Logical volume "Cvol0" created root@px12-400r-TI2Y7H:/# /etc/init.d/gfs gfs-tools gfs2-tools root@px12-400r-TI2Y7H:/# /etc/init.d/gfs2-tools start Running file /etc/init.d/gfs2-tools root@px12-400r-TI2Y7H:/# mkfs.gfs2 -t MBK:Cvg0 -p lock_dlm -j 2 /dev/Cvg0/Cv This will destroy any data on /dev/Cvg0/Cvol0. Are you sure you want to proceed? [y/n] y mkfs.gfs2: can't fsync device (-1): Input/output error root@px12-400r-TI2Y7H:/# cd /mnt/system/cluster/ root@px12-400r-TI2Y7H:/mnt/system/cluster# ls 1_init.sh 2_init.sh 3_init.sh iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# cp 2_init.sh iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# vi iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# sh iscsi_logout.sh Logging out of session [sid: 1, target: iqn.1992-04.com.emc:storage.px4-300rM3R. gfs, portal: 192.168.0.104,3260] Logout of [sid: 1, target: iqn.1992-04.com.emc:storage.px4-300r-THXM3R.gfs, al: 192.168.0.104,3260]: successful Logging out of session [sid: 2, target: iqn.1992-04.com.emc:storage.px4-300rM3R. iscsifence, portal: 192.168.0.104,3260] Logout of [sid: 2, target: iqn.1992-04.com.emc:storage.px4-300r-THXM3R.iscsie, p ortal: 192.168.0.104,3260]: successful iscsiadm: No active sessions. (reverse-i-search)`sc': sh iscsi_logout.sh root@px12-400r-TI2Y7H:/mnt/system/cluster# scp iscsi_logout.sh root@px12-4002Y5H :/mnt/system/cluster# The authenticity of host 'px12-400r-ti2y5h (169.254.175.121)' can't be estabed.

RSA key fingerprint is 32:40:ee:42:1d:95:89:ed:3c:e9:7e:07:fa:d0:a9:8f. root@px12-400r-TI2Y7H:/mnt/system/cluster# scp iscsi_logout.sh px12-400r-TI2/mnt /system/cluster/ The authenticity of host 'px12-400r-ti2y5h (169.254.175.121)' can't be estabed. RSA key fingerprint is 32:40:ee:42:1d:95:89:ed:3c:e9:7e:07:fa:d0:a9:8f. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'px12-400r-ti2y5h,169.254.175.121' (RSA) to the lof k nown hosts. root@px12-400r-ti2y5h's password: iscsi_logout.sh 100% 276 0.3KB/s 00:00 root@px12-400r-TI2Y7H:/mnt/system/cluster# login as: root [email protected]'s password: root@px12-400r-TI2Y7H:/# cd /mnt/system/cluster/ root@px12-400r-TI2Y7H:/mnt/system/cluster# sh 2_init.sh 192.168.0.104:3260,1 iqn.1992-04.com.emc:storage.px4-300r-THXM3R.iscsifence 192.168.0.104:3260,1 iqn.1992-04.com.emc:storage.px4-300r-THXM3R.gfs Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px4-300r-3R.g fs, portal: 192.168.0.104,3260] Login to [iface: default, target: iqn.1992-04.com.emc:storage.px4-300r-THXM3s, p ortal: 192.168.0.104,3260]: successful Logging in to [iface: default, target: iqn.1992-04.com.emc:storage.px4-300r-3R.i scsifence, portal: 192.168.0.104,3260] Login to [iface: default, target: iqn.1992-04.com.emc:storage.px4-300r-THXM3csif ence, portal: 192.168.0.104,3260]: successful tcp: [3] 192.168.0.104:3260,1 iqn.1992-04.com.emc:storage.px4-300r-THXM3R.gf tcp: [4] 192.168.0.104:3260,1 iqn.1992-04.com.emc:storage.px4-300r-THXM3R.isence root@px12-400r-TI2Y7H:/mnt/system/cluster# vgremove Cvg0 connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. /dev/Cvg0/Cvol0: read failed after 0 of 4096 at 10737352704: Input/output r /dev/Cvg0/Cvol0: read failed after 0 of 4096 at 10737410048: Input/output r /dev/Cvg0/Cvol0: read failed after 0 of 4096 at 0: Input/output error /dev/Cvg0/Cvol0: read failed after 0 of 4096 at 4096: Input/output error Do you really want to remove volume group "Cvg0" containing 1 logical volumey/n] : y Do you really want to remove active logical volume Cvol0? [y/n]: y Logical volume "Cvol0" successfully removed Volume group "Cvg0" successfully removed root@px12-400r-TI2Y7H:/mnt/system/cluster# pvdisplay connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. --- Physical volume --PV Name /dev/md0 VG Name md0_vg PV Size 20.01 GiB / not usable 1.14 MiB Allocatable yes (but full) PE Size 4.00 MiB Total PE 5122 Free PE 0 Allocated PE 5122 PV UUID PnQu2D-VYNU-kwJg-hhi7-HWtp-8J03-Dt4l30 "/dev/sdf" is a new physical volume of "20.00 GiB" --- NEW Physical volume --PV Name /dev/sdf

VG Name PV Size Allocatable PE Size Total PE Free PE Allocated PE PV UUID

20.00 GiB NO 0 0 0 0 Xfb870-Aw4S-ed3U-wYac-b7Pn-EZkF-jJmhnc

root@px12-400r-TI2Y7H:/mnt/system/cluster# mkqdisk -L mkqdisk v2.03.09 /dev/sdg: Magic: Label: Created: Host: Kernel Sector Size: Recorded Sector Size: eb7a62c2 qdisk Thu Feb 2 16:25:11 2012 px12-400r-TI2Y5H 512 512

root@px12-400r-TI2Y7H:/mnt/system/cluster# clustat Cluster Status for MBK @ Fri Feb 3 22:57:48 2012 Member Status: Quorate Member Name ------ ---px12-400r-TI2Y7H px12-400r-TI2Y5H /dev/sde ID Status ---- -----1 Online, Local, rgmanager 2 Online, rgmanager 0 Offline, Quorum Disk State ----started

Service Name Owner (Last) ------- -------- -----service:169.254.176.60 px12-400r-TI2Y5H root@px12-400r-TI2Y7H:/mnt/system/cluster# fdisk -l

WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk d't s upport GPT. Use GNU Parted. Disk /dev/sdb: 2000.3 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x2d36cde9 Device Boot /dev/sdb1 Start 1 End Blocks Id System 243202 1953514583+ ee EFI GPT


Disk /dev/sdc: 997 MB, 997720064 bytes

32 heads, 62 sectors/track, 982 cylinders Units = cylinders of 1984 * 512 = 1015808 bytes Disk identifier: 0x00000000 Device Boot /dev/sdc1 Start 1 End 980 Blocks 972129 Id System 83 Linux

Disk /dev/md0: 21.4 GB, 21484425216 bytes 2 heads, 4 sectors/track, 5245221 cylinders Units = cylinders of 8 * 512 = 4096 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table Disk /dev/sdf: 21.4 GB, 21474836480 bytes 64 heads, 32 sectors/track, 20480 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk identifier: 0x3a31261f Disk /dev/sdf doesn't contain a valid partition table Disk /dev/sdg: 3221 MB, 3221225472 bytes 100 heads, 62 sectors/track, 1014 cylinders Units = cylinders of 6200 * 512 = 3174400 bytes Disk identifier: 0x28435397 Disk /dev/sdg doesn't contain a valid partition table root@px12-400r-TI2Y7H:/mnt/system/cluster# pvremove /dev/sdf connect() failed on local socket: No such file or directory Internal cluster locking initialisation failed. WARNING: Falling back to local file-based locking. Volume Groups with the clustered attribute will be inaccessible. Labels on physical volume "/dev/sdf" successfully wiped root@px12-400r-TI2Y7H:/mnt/system/cluster# mkfs.ext mkfs.ext2 mkfs.ext3 mkfs.ext4 mkfs.ext4dev root@px12-400r-TI2Y7H:/mnt/system/cluster# mkfs.ext mkfs.ext2 mkfs.ext3 mkfs.ext4 mkfs.ext4dev root@px12-400r-TI2Y7H:/mnt/system/cluster# mkfs.ext3 /dev/sdf sdf sdf10 sdf12 sdf14 sdf3 sdf5 sdf7 sdf9 sdf1 sdf11 sdf13 sdf2 sdf4 sdf6 sdf8 root@px12-400r-TI2Y7H:/mnt/system/cluster# mkfs.ext3 /dev/sdf mke2fs 1.41.3 (12-Oct-2008) /dev/sdf is entire device, not just one partition! Proceed anyway? (y,n) y Filesystem label= OS type: Linux Block size=4096 (log=2) Fragment size=4096 (log=2)

Date post:	22-Oct-2014
Category:	Documents
Upload:	manimukel
View:	49 times
Download:	25 times

DRBD-configure

Documents