Re: [ovirt-users] Multiple hosts
On Wed, Sep 30, 2015 at 6:11 PM, Budur Nagaraju <nbudoor@gmail.com> wrote:
2015-09-30 18:22:15,052 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [6e31ee33] Correlation ID: 6e31ee33, Job ID: b0ea3d1b-0019-4be5-89a9-b1135c4136f4, Call Stack: null, Custom Event ID: -1, Message: Host infraesx2 cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Pulse. Setting Host state to Non-Operational.
It seams that your host is not able to access a storage attached to your datacenter; could you please check that?
able to reach without any issues, [root@infraesx2 ~]# tail -f /var/log/vdsm/vdsm.log StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:25:52,565::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-25::DEBUG::2015-09-30 16:26:00,915::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-25::DEBUG::2015-09-30 16:26:00,923::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000443414 s, 771 kB/s\n'; <rc> = 0 Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None) Thread-24::DEBUG::2015-09-30 16:26:02,722::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5 Thread-24::WARNING::2015-09-30 16:26:02,723::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28'] Thread-24::DEBUG::2015-09-30 16:26:02,723::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-24::ERROR::2015-09-30 16:26:02,726::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found Traceback (most recent call last): File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:26:02,726::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-25::DEBUG::2015-09-30 16:26:10,930::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-25::DEBUG::2015-09-30 16:26:10,938::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000428685 s, 798 kB/s\n'; <rc> = 0 Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::DEBUG::2015-09-30 16:26:12,727::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-24::DEBUG::2015-09-30 16:26:12,728::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None) Thread-24::DEBUG::2015-09-30 16:26:12,903::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5 Thread-24::WARNING::2015-09-30 16:26:12,904::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28'] Thread-24::DEBUG::2015-09-30 16:26:12,905::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-24::ERROR::2015-09-30 16:26:12,907::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found Traceback (most recent call last): File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:26:12,908::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) ^C [root@infraesx2 ~]# On Wed, Sep 30, 2015 at 9:50 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
On Wed, Sep 30, 2015 at 6:11 PM, Budur Nagaraju <nbudoor@gmail.com> wrote:
2015-09-30 18:22:15,052 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [6e31ee33] Correlation ID: 6e31ee33, Job ID: b0ea3d1b-0019-4be5-89a9-b1135c4136f4, Call Stack: null, Custom Event ID: -1, Message: Host infraesx2 cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Pulse. Setting Host state to Non-Operational.
It seams that your host is not able to access a storage attached to your datacenter; could you please check that?
can you pls update how can I resolve the issue ? On Wed, Sep 30, 2015 at 9:57 PM, Budur Nagaraju <nbudoor@gmail.com> wrote:
able to reach without any issues,
[root@infraesx2 ~]# tail -f /var/log/vdsm/vdsm.log StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:25:52,565::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-25::DEBUG::2015-09-30 16:26:00,915::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-25::DEBUG::2015-09-30 16:26:00,923::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000443414 s, 771 kB/s\n'; <rc> = 0 Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None) Thread-24::DEBUG::2015-09-30 16:26:02,722::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5 Thread-24::WARNING::2015-09-30 16:26:02,723::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28'] Thread-24::DEBUG::2015-09-30 16:26:02,723::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-24::ERROR::2015-09-30 16:26:02,726::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found Traceback (most recent call last): File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:26:02,726::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-25::DEBUG::2015-09-30 16:26:10,930::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-25::DEBUG::2015-09-30 16:26:10,938::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000428685 s, 798 kB/s\n'; <rc> = 0 Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::DEBUG::2015-09-30 16:26:12,727::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-24::DEBUG::2015-09-30 16:26:12,728::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None) Thread-24::DEBUG::2015-09-30 16:26:12,903::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5 Thread-24::WARNING::2015-09-30 16:26:12,904::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28'] Thread-24::DEBUG::2015-09-30 16:26:12,905::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-24::ERROR::2015-09-30 16:26:12,907::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found Traceback (most recent call last): File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:26:12,908::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) ^C [root@infraesx2 ~]#
On Wed, Sep 30, 2015 at 9:50 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
On Wed, Sep 30, 2015 at 6:11 PM, Budur Nagaraju <nbudoor@gmail.com> wrote:
2015-09-30 18:22:15,052 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [6e31ee33] Correlation ID: 6e31ee33, Job ID: b0ea3d1b-0019-4be5-89a9-b1135c4136f4, Call Stack: null, Custom Event ID: -1, Message: Host infraesx2 cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Pulse. Setting Host state to Non-Operational.
It seams that your host is not able to access a storage attached to your datacenter; could you please check that?
This is a multi-part message in MIME format. --------------060907040801070804030206 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 09/30/2015 02:34 PM, Budur Nagaraju wrote:
can you pls update how can I resolve the issue ?
The issue seems to be prior to the logs you sent. Could you make the full log file available for download?
On Wed, Sep 30, 2015 at 9:57 PM, Budur Nagaraju <nbudoor@gmail.com <mailto:nbudoor@gmail.com>> wrote:
able to reach without any issues,
[root@infraesx2 ~]# tail -f /var/log/vdsm/vdsm.log StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:25:52,565::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-25::DEBUG::2015-09-30 16:26:00,915::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-25::DEBUG::2015-09-30 16:26:00,923::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000443414 s, 771 kB/s\n'; <rc> = 0 Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None) Thread-24::DEBUG::2015-09-30 16:26:02,722::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5 Thread-24::WARNING::2015-09-30 16:26:02,723::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28'] Thread-24::DEBUG::2015-09-30 16:26:02,723::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-24::ERROR::2015-09-30 16:26:02,726::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found Traceback (most recent call last): File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:26:02,726::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-25::DEBUG::2015-09-30 16:26:10,930::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-25::DEBUG::2015-09-30 16:26:10,938::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000428685 s, 798 kB/s\n'; <rc> = 0 Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 Thread-24::DEBUG::2015-09-30 16:26:12,727::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-24::DEBUG::2015-09-30 16:26:12,728::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None) Thread-24::DEBUG::2015-09-30 16:26:12,903::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5 Thread-24::WARNING::2015-09-30 16:26:12,904::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28'] Thread-24::DEBUG::2015-09-30 16:26:12,905::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-24::ERROR::2015-09-30 16:26:12,907::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found Traceback (most recent call last): File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) Thread-24::ERROR::2015-09-30 16:26:12,908::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information Traceback (most recent call last): File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain File "/usr/share/vdsm/storage/sdc.py", line 98, in produce File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',) ^C [root@infraesx2 ~]#
On Wed, Sep 30, 2015 at 9:50 PM, Simone Tiraboschi <stirabos@redhat.com <mailto:stirabos@redhat.com>> wrote:
On Wed, Sep 30, 2015 at 6:11 PM, Budur Nagaraju <nbudoor@gmail.com <mailto:nbudoor@gmail.com>> wrote:
2015-09-30 18:22:15,052 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [6e31ee33] Correlation ID: 6e31ee33, Job ID: b0ea3d1b-0019-4be5-89a9-b1135c4136f4, Call Stack: null, Custom Event ID: -1, Message: Host infraesx2 cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Pulse. Setting Host state to Non-Operational.
It seams that your host is not able to access a storage attached to your datacenter; could you please check that?
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------060907040801070804030206 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 09/30/2015 02:34 PM, Budur Nagaraju wrote:<br> </div> <blockquote cite="mid:CAHNF9Q-EhQQU_JQDqM9s+JG2uzVe=eN4e0PkoSxL-efwgDQKXg@mail.gmail.com" type="cite"> <div dir="ltr">can you pls update how can I resolve the issue ?<br> </div> </blockquote> <br> The issue seems to be prior to the logs you sent. Could you make the full log file available for download?<br> <br> <blockquote cite="mid:CAHNF9Q-EhQQU_JQDqM9s+JG2uzVe=eN4e0PkoSxL-efwgDQKXg@mail.gmail.com" type="cite"> <div class="gmail_extra"><br> <div class="gmail_quote">On Wed, Sep 30, 2015 at 9:57 PM, Budur Nagaraju <span dir="ltr"><<a moz-do-not-send="true" href="mailto:nbudoor@gmail.com" target="_blank">nbudoor@gmail.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div dir="ltr">able to reach without any issues,<br> <br> [root@infraesx2 ~]# tail -f /var/log/vdsm/vdsm.log <br> StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)<br> Thread-24::ERROR::2015-09-30 16:25:52,565::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information<br> Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 98, in produce<br> File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce<br> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain<br> StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)<br> Thread-25::DEBUG::2015-09-30 16:26:00,915::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br> Thread-25::DEBUG::2015-09-30 16:26:00,923::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000443414 s, 771 kB/s\n'; <rc> = 0<br> Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28<br> Thread-24::ERROR::2015-09-30 16:26:02,566::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28<br> Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex<br> Thread-24::DEBUG::2015-09-30 16:26:02,566::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None)<br> Thread-24::DEBUG::2015-09-30 16:26:02,722::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5<br> Thread-24::WARNING::2015-09-30 16:26:02,723::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28']<br> Thread-24::DEBUG::2015-09-30 16:26:02,723::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex<br> Thread-24::ERROR::2015-09-30 16:26:02,726::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found<br> Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain<br> StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)<br> Thread-24::ERROR::2015-09-30 16:26:02,726::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information<br> Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 98, in produce<br> File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce<br> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain<br> StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)<br> Thread-25::DEBUG::2015-09-30 16:26:10,930::fileSD::262::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/10.204.207.175:_var_lib_exports_iso/d5939ef5-3597-4b80-99f3-b365906308c0/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)<br> Thread-25::DEBUG::2015-09-30 16:26:10,938::fileSD::262::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000428685 s, 798 kB/s\n'; <rc> = 0<br> Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 93c85300-dfd1-4a59-be7b-78d871bc1f28<br> Thread-24::ERROR::2015-09-30 16:26:12,727::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 93c85300-dfd1-4a59-be7b-78d871bc1f28<br> Thread-24::DEBUG::2015-09-30 16:26:12,727::lvm::371::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex<br> Thread-24::DEBUG::2015-09-30 16:26:12,728::lvm::291::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 93c85300-dfd1-4a59-be7b-78d871bc1f28 (cwd None)<br> Thread-24::DEBUG::2015-09-30 16:26:12,903::lvm::291::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found\n Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28\n'; <rc> = 5<br> Thread-24::WARNING::2015-09-30 16:26:12,904::lvm::376::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "93c85300-dfd1-4a59-be7b-78d871bc1f28" not found', ' Cannot process volume group 93c85300-dfd1-4a59-be7b-78d871bc1f28']<br> Thread-24::DEBUG::2015-09-30 16:26:12,905::lvm::416::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex<br> Thread-24::ERROR::2015-09-30 16:26:12,907::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 not found<br> Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain<br> StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)<br> Thread-24::ERROR::2015-09-30 16:26:12,908::domainMonitor::256::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 93c85300-dfd1-4a59-be7b-78d871bc1f28 monitoring information<br> Traceback (most recent call last):<br> File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 98, in produce<br> File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce<br> File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain<br> File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain<br> StorageDomainDoesNotExist: Storage domain does not exist: (u'93c85300-dfd1-4a59-be7b-78d871bc1f28',)<br> ^C<br> [root@infraesx2 ~]# <br> <br> </div> <div class="HOEnZb"> <div class="h5"> <div class="gmail_extra"><br> <div class="gmail_quote">On Wed, Sep 30, 2015 at 9:50 PM, Simone Tiraboschi <span dir="ltr"><<a moz-do-not-send="true" href="mailto:stirabos@redhat.com" target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:stirabos@redhat.com">stirabos@redhat.com</a></a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div dir="ltr"> <div class="gmail_extra"><span><br> <div class="gmail_quote">On Wed, Sep 30, 2015 at 6:11 PM, Budur Nagaraju <span dir="ltr"><<a moz-do-not-send="true" href="mailto:nbudoor@gmail.com" target="_blank">nbudoor@gmail.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span><span>2015-09-30</span></span> 18:22:15,052 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [6e31ee33] Correlation ID: 6e31ee33, Job ID: b0ea3d1b-0019-4be5-89a9-b1135c4136f4, Call Stack: null, Custom Event ID: -1, Message: Host infraesx2 cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Center Pulse. Setting Host state to Non-Operational.</blockquote> </div> <div class="gmail_extra"><br> </div> </span>It seams that your host is not able to access a storage attached to your datacenter; could you please check that?<br> <br> </div> </div> </blockquote> </div> <br> </div> </div> </div> </blockquote> </div> <br> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------060907040801070804030206--
participants (3)
-
Amador Pahim -
Budur Nagaraju -
Simone Tiraboschi