Thursday, September 15, 2011

Recovering VxVM Volumes - Disk is LOST or Plex Status is RECOVER


Recovering VxVM Volumes - Disk is LOST or Plex Status is RECOVER 


Step 1. identify the lost disks

   SolarisHost1# vxdisk list
   ...
   - - c4t2d4 SolarisHost1-Application5 failed was:EMC_CLARiiON0_4
   - - DG-application03 DG-application failed was:EMC_CLARiiON0_5

Step 2. for each lost disk, find the device

   SolarisHost1# vxdisk -o alldgs list | grep DG-application
   ...
   EMC_CLARiiON1_5 auto:sliced     -           (DG-application) online
   ...
Note: the disk should appear as online with a seemingly deported diskgroup, for example ””(DG-application)””.


Step 3. reinsert the disk in the Veritas config

   SolarisHost1# vxdg -g DG-application -k adddisk =

   SolarisHost1# vxdg -g DG-application -k adddisk DG-application03=EMC_CLARiiON1_5

Note: ”“DG-application03”” is the Veritas disk name and ”“EMC_CLARiiON1_5”” is the associated device.


Step 4. find the broken Veritas plexes in the diskgroup

   SolarisHost1# vxprint -g DG-application -th | grep DISABLED | grep RECOVER

Step 5. for each broken plex, clear the error flags

   SolarisHost1# vxmend -g DG-application -o force off Application-01
   SolarisHost1# vxmend -g DG-application on Application-01
   SolarisHost1# vxmend -g DG-application fix clean Application-01

Step 6. Start all volumes in the diskgroup

   SolarisHost1# vxvol -g DG-application startall

Step 7. Mount the filesystems

Optionally: do a fsck first! 


Also applied when PLEX hang in RECOVER state :



v  MyDG1   fsgen        DISABLED 1048576  -        ACTIVE   -       -
pl MyDG1-01 MyDG1  DISABLED 1048576  -        RECOVER  -       -
sd MyDG1-04 MyDG1-01 ENABLED 1048576 0        -        -       -