hi

Below are the logs ...



[root@infraesx2 ~]# tail -f /var/log/vdsm/vdsm.log
StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)
Thread-24::ERROR::2015-09-30 16:25:52,565::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain
  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)
Thread-25::DEBUG::2015-09-30 16:26:00,915::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
Thread-25::DEBUG::2015-09-30 16:26:00,923::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000443414 s, 771 kB/s\n'; <rc> = 0
Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28
Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28
Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None)
Thread-24::DEBUG::2015-09-30 16:26:02,722::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n  Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5
Thread-24::WARNING::2015-09-30 16:26:02,723::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', '  Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28']
Thread-24::DEBUG::2015-09-30 16:26:02,723::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-24::ERROR::2015-09-30 16:26:02,726::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)
Thread-24::ERROR::2015-09-30 16:26:02,726::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain
  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)
Thread-25::DEBUG::2015-09-30 16:26:10,930::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
Thread-25::DEBUG::2015-09-30 16:26:10,938::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000428685 s, 798 kB/s\n'; <rc> = 0
Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28
Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28
Thread-24::DEBUG::2015-09-30 16:26:12,727::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
Thread-24::DEBUG::2015-09-30 16:26:12,728::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None)
Thread-24::DEBUG::2015-09-30 16:26:12,903::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n  Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5
Thread-24::WARNING::2015-09-30 16:26:12,904::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', '  Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28']
Thread-24::DEBUG::2015-09-30 16:26:12,905::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
Thread-24::ERROR::2015-09-30 16:26:12,907::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)
Thread-24::ERROR::2015-09-30 16:26:12,908::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain
  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)
^C
[root@infraesx2 ~]#


On Wed, Sep 30, 2015 at 9:46 PM, Amador Pahim <apahim@redhat.com> wrote:
On 09/30/2015 12:30 PM, Budur Nagaraju wrote:

Can't we add another host even though storage pool is available ??


 We can. The issue seems to be the new host not able to connect to the storage. Can you share the vdsm.log for the event?

On Sep 30, 2015 8:26 PM, "Amador Pahim" <apahim@redhat.com> wrote:
On 09/30/2015 09:59 AM, Budur Nagaraju wrote:
2015-09-30 18:22:15,059 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [6e31ee33] Correlation ID: 4f29b4a7, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host infraesx2 to Storage Pool Pulse
Seems like you already have a Storage Pool called 'Pulse' and the new host is not able to connect to it. vdsm.log on the infraesx2 host will give you more details.