On Mon, Jan 7, 2013 at 8:12 AM, Ayal Baron wrote:
Hi Gianluca,
The problem you have now doesn't seem related $subject. It looks like http://gerrit.ovirt.org/#/c/10024/5 to me. Can you check to see if your code contains the above fix? Did you vdsm from nightly as well or from Fedora 18 rpms?
Fede, does the f18 build include the above fix?
Thanks, Ayal.
For this particular host I already updated the rpm package vdsm-4.10.3-0.50.gitc6625ce.fc18.x86_64 that contains the patched file /usr/share/vdsm/storage/localFsSD.py so it seems I'm not hitting this problem. I ran yum update ovirt-engine-setup that pulled these new packages Jan 07 08:06:27 Updated: ovirt-engine-setup-3.2.0-1.20130106.git0cb01e1.fc18.noarch Jan 07 08:08:53 Updated: otopi-0.0.0-0.5.master.20130106.git0a731eb.fc18.noarch Jan 07 08:08:54 Updated: otopi-java-0.0.0-0.5.master.20130106.git0a731eb.fc18.noarch Jan 07 08:08:54 Updated: ovirt-host-deploy-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch Jan 07 08:08:54 Updated: ovirt-host-deploy-offline-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch Jan 07 08:08:54 Updated: ovirt-engine-setup-plugin-allinone-3.2.0-1.20130106.git0cb01e1.fc18.noarch Jan 07 08:08:54 Updated: ovirt-host-deploy-java-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch Jan 07 08:08:55 Updated: ovirt-engine-cli-3.2.0.8-1.20130106.git0b16093.fc18.noarch Then engine-upgrade and reboot but still not able to activate storage domain In vdsm.log Thread-20::DEBUG::2013-01-07 19:57:41,148::BindingXMLRPC::163::vds::(wrapper) [10.194.53.246] Thread-20::DEBUG::2013-01-07 19:57:41,149::task::568::TaskManager.Task::(_updateState) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::moving from state init -> state preparing Thread-20::INFO::2013-01-07 19:57:41,149::logUtils::41::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='a6e0d929-065b-4f69-a46a-0b07d3b79731', options=None) Thread-20::ERROR::2013-01-07 19:57:41,150::task::833::TaskManager.Task::(_setError) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 840, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 42, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 602, in getSpmStatus pool = self.getPool(spUUID) File "/usr/share/vdsm/storage/hsm.py", line 312, in getPool raise se.StoragePoolUnknown(spUUID) StoragePoolUnknown: Unknown pool id, pool not connected: ('a6e0d929-065b-4f69-a46a-0b07d3b79731',) Thread-20::DEBUG::2013-01-07 19:57:41,153::task::852::TaskManager.Task::(_run) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::Task._run: 133ef0a7-30ac-4cad-94ee-276dd59731e0 ('a6e0d929-065b-4f69-a46a-0b07d3b79731',) {} failed - stopping task Thread-20::DEBUG::2013-01-07 19:57:41,154::task::1177::TaskManager.Task::(stop) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::stopping in state preparing (force False) Thread-20::DEBUG::2013-01-07 19:57:41,154::task::957::TaskManager.Task::(_decref) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::ref 1 aborting True while in engine.log 2013-01-07 19:57:33,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) XML RPC error in command GetHardwareInfoVDS ( HostName = local_host ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, <type 'exceptions.Exception'>:method "getVdsHardwareInfo" is not supported 2013-01-07 19:57:33,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (QuartzScheduler_Worker-2) FINISH, GetHardwareInfoVDSCommand, log id: 5f98da5d 2013-01-07 19:57:33,795 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) Cannot convert string <<<<<<< to AuditLogType ... 2013-01-07 19:57:33,800 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table 2013-01-07 19:57:33,800 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_NORMAL not exist in string table 2013-01-07 19:57:33,800 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_WARNING not exist in string table 2013-01-07 19:57:33,801 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_ERROR not exist in string table ... 2013-01-07 19:57:46,007 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-8) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510' 2013-01-07 19:57:46,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-8) FINISH, ConnectStoragePoolVDSCommand, log id: 2f2957ee 2013-01-07 19:57:46,011 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) IrsBroker::Failed::GetStoragePoolInfoVDS 2013-01-07 19:57:46,011 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510' 2013-01-07 19:57:46,236 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-3-thread-19) [47e9e14a] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: eb9d38ff-34d6-4dd9-8309-b004f02ee510 Type: Storage 2013-01-07 19:57:46,358 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-3-thread-19) [47e9e14a] START, MarkPoolInReconstructModeVDSCommand( storagePoolId = a6e0d929-065b-4f69-a46a-0b07d3b79731, ignoreFailoverLimit = false, compatabilityVersion = null, reconstructMarkAction = ClearCache), log id: 768a1787 2013-01-07 19:57:46,361 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-19) [47e9e14a] clearing cache for problematic entities in pool a6e0d929-065b-4f69-a46a-0b07d3b79731 2013-01-07 19:57:46,363 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-3-thread-19) [47e9e14a] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 768a1787 2013-01-07 19:57:46,438 INFO [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-3-thread-18) Finished reconstruct for pool a6e0d929-065b-4f69-a46a-0b07d3b79731. Clearing all event queue 2013-01-07 19:57:56,131 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) hostFromVds::selectedVds - local_host, spmStatus Unknown_Pool, storage pool local_datacenter 2013-01-07 19:57:56,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-22) START, ConnectStoragePoolVDSCommand(HostName = local_host, HostId = 919c3ca3-980f-425f-a97d-778c9cd076ca, storagePoolId = a6e0d929-065b-4f69-a46a-0b07d3b79731, vds_spm_id = 1, masterDomainId = eb9d38ff-34d6-4dd9-8309-b004f02ee510, masterVersion = 1), log id: 56c65032 2013-01-07 19:58:00,669 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 304 mMessage Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510' 2013-01-07 19:58:00,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) HostName = local_host 2013-01-07 19:58:00,671 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-22) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510' Could it be that this host, that is a PC with 6Gb of ram and Opteron processor model name : AMD Athlon(tm) II X4 630 Processor gets its ip by dhcp? At this moment [root@tekkaman ovirt-engine]# ip addr list 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: p10p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master ovirtmgmt state UP qlen 1000 link/ether 90:e6:ba:c9:f1:e1 brd ff:ff:ff:ff:ff:ff inet6 fe80::92e6:baff:fec9:f1e1/64 scope link valid_lft forever preferred_lft forever 4: ovirtmgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP link/ether 90:e6:ba:c9:f1:e1 brd ff:ff:ff:ff:ff:ff inet 10.194.53.246/20 brd 10.194.63.255 scope global ovirtmgmt inet6 fe80::92e6:baff:fec9:f1e1/64 scope link valid_lft forever preferred_lft forever 6: ;vdsmdummy;: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN link/ether 12:1a:6c:ef:c0:fc brd ff:ff:ff:ff:ff:ff 7: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff 8: bond4: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff [root@tekkaman ovirt-engine]# ip route list default via 10.194.48.1 dev ovirtmgmt 10.194.48.0/20 dev ovirtmgmt proto kernel scope link src 10.194.53.246 169.254.0.0/16 dev ovirtmgmt scope link metric 1004 Gianluca