On Mon, Jan 7, 2013 at 8:12 AM, Ayal Baron wrote:
Hi Gianluca,

The problem you have now doesn't seem related $subject.
It looks like http://gerrit.ovirt.org/#/c/10024/5 to me.
Can you check to see if your code contains the above fix?
Did you vdsm from nightly as well or from Fedora 18 rpms?

Fede, does the f18 build include the above fix?

Thanks,
Ayal.

For this particular host I already updated the rpm package
vdsm-4.10.3-0.50.gitc6625ce.fc18.x86_64
that contains the patched file /usr/share/vdsm/storage/localFsSD.py so it seems I'm not hitting this problem.

I ran
yum update ovirt-engine-setup
that pulled these new packages

Jan 07 08:06:27 Updated: ovirt-engine-setup-3.2.0-1.20130106.git0cb01e1.fc18.noarch
Jan 07 08:08:53 Updated: otopi-0.0.0-0.5.master.20130106.git0a731eb.fc18.noarch
Jan 07 08:08:54 Updated: otopi-java-0.0.0-0.5.master.20130106.git0a731eb.fc18.noarch
Jan 07 08:08:54 Updated: ovirt-host-deploy-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch
Jan 07 08:08:54 Updated: ovirt-host-deploy-offline-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch
Jan 07 08:08:54 Updated: ovirt-engine-setup-plugin-allinone-3.2.0-1.20130106.git0cb01e1.fc18.noarch
Jan 07 08:08:54 Updated: ovirt-host-deploy-java-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch
Jan 07 08:08:55 Updated: ovirt-engine-cli-3.2.0.8-1.20130106.git0b16093.fc18.noarch

Then engine-upgrade and reboot but still not able to activate storage domain

In vdsm.log
Thread-20::DEBUG::2013-01-07 19:57:41,148::BindingXMLRPC::163::vds::(wrapper) [10.194.53.246]
Thread-20::DEBUG::2013-01-07 19:57:41,149::task::568::TaskManager.Task::(_updateState) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::moving from state init -> state preparing
Thread-20::INFO::2013-01-07 19:57:41,149::logUtils::41::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='a6e0d929-065b-4f69-a46a-0b07d3b79731', options=None)
Thread-20::ERROR::2013-01-07 19:57:41,150::task::833::TaskManager.Task::(_setError) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::Unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 840, in _run
    return fn(*args, **kargs)
  File "/usr/share/vdsm/logUtils.py", line 42, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/storage/hsm.py", line 602, in getSpmStatus
    pool = self.getPool(spUUID)
  File "/usr/share/vdsm/storage/hsm.py", line 312, in getPool
    raise se.StoragePoolUnknown(spUUID)
StoragePoolUnknown: Unknown pool id, pool not connected: ('a6e0d929-065b-4f69-a46a-0b07d3b79731',)
Thread-20::DEBUG::2013-01-07 19:57:41,153::task::852::TaskManager.Task::(_run) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::Task._run: 133ef0a7-30ac-4cad-94ee-276dd59731e0 ('a6e0d929-065b-4f69-a46a-0b07d3b79731',) {} failed - stopping task
Thread-20::DEBUG::2013-01-07 19:57:41,154::task::1177::TaskManager.Task::(stop) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::stopping in state preparing (force False)
Thread-20::DEBUG::2013-01-07 19:57:41,154::task::957::TaskManager.Task::(_decref) Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::ref 1 aborting True

while in engine.log
2013-01-07 19:57:33,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) XML RPC error in command GetHardwareInfoVDS ( HostName = local_host ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, <type 'exceptions.Exception'>:method "getVdsHardwareInfo" is not supported
2013-01-07 19:57:33,783 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (QuartzScheduler_Worker-2) FINISH, GetHardwareInfoVDSCommand, log id: 5f98da5d
2013-01-07 19:57:33,795 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) Cannot convert string <<<<<<< to AuditLogType
...
2013-01-07 19:57:33,800 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table
2013-01-07 19:57:33,800 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_NORMAL not exist in string table
2013-01-07 19:57:33,800 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_WARNING not exist in string table
2013-01-07 19:57:33,801 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_ERROR not exist in string table
...
2013-01-07 19:57:46,007 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-8) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'
2013-01-07 19:57:46,010 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-8) FINISH, ConnectStoragePoolVDSCommand, log id: 2f2957ee
2013-01-07 19:57:46,011 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) IrsBroker::Failed::GetStoragePoolInfoVDS
2013-01-07 19:57:46,011 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'
2013-01-07 19:57:46,236 INFO  [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (pool-3-thread-19) [47e9e14a] Running command: ReconstructMasterDomainCommand internal: true. Entities affected :  ID: eb9d38ff-34d6-4dd9-8309-b004f02ee510 Type: Storage
2013-01-07 19:57:46,358 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-3-thread-19) [47e9e14a] START, MarkPoolInReconstructModeVDSCommand( storagePoolId = a6e0d929-065b-4f69-a46a-0b07d3b79731, ignoreFailoverLimit = false, compatabilityVersion = null, reconstructMarkAction = ClearCache), log id: 768a1787
2013-01-07 19:57:46,361 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-3-thread-19) [47e9e14a] clearing cache for problematic entities in pool a6e0d929-065b-4f69-a46a-0b07d3b79731
2013-01-07 19:57:46,363 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (pool-3-thread-19) [47e9e14a] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 768a1787
2013-01-07 19:57:46,438 INFO  [org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-3-thread-18) Finished reconstruct for pool a6e0d929-065b-4f69-a46a-0b07d3b79731. Clearing all event queue
2013-01-07 19:57:56,131 INFO  [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) hostFromVds::selectedVds - local_host, spmStatus Unknown_Pool, storage pool local_datacenter
2013-01-07 19:57:56,153 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-22) START, ConnectStoragePoolVDSCommand(HostName = local_host, HostId = 919c3ca3-980f-425f-a97d-778c9cd076ca, storagePoolId = a6e0d929-065b-4f69-a46a-0b07d3b79731, vds_spm_id = 1, masterDomainId = eb9d38ff-34d6-4dd9-8309-b004f02ee510, masterVersion = 1), log id: 56c65032
2013-01-07 19:58:00,669 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value
 Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc
mStatus                       Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc
mCode                         304
mMessage                      Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'


2013-01-07 19:58:00,671 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) HostName = local_host
2013-01-07 19:58:00,671 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-22) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731, msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'

Could it be that this host, that is a PC with 6Gb of ram and Opteron processor
model name    : AMD Athlon(tm) II X4 630 Processor
gets its ip by dhcp?

At this moment
[root@tekkaman ovirt-engine]# ip addr list
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: p10p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master ovirtmgmt state UP qlen 1000
    link/ether 90:e6:ba:c9:f1:e1 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::92e6:baff:fec9:f1e1/64 scope link
       valid_lft forever preferred_lft forever
4: ovirtmgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
    link/ether 90:e6:ba:c9:f1:e1 brd ff:ff:ff:ff:ff:ff
    inet 10.194.53.246/20 brd 10.194.63.255 scope global ovirtmgmt
    inet6 fe80::92e6:baff:fec9:f1e1/64 scope link
       valid_lft forever preferred_lft forever
6: ;vdsmdummy;: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
    link/ether 12:1a:6c:ef:c0:fc brd ff:ff:ff:ff:ff:ff
7: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN
    link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
8: bond4: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue state DOWN
    link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
[root@tekkaman ovirt-engine]# ip route list
default via 10.194.48.1 dev ovirtmgmt
10.194.48.0/20 dev ovirtmgmt  proto kernel  scope link  src 10.194.53.246
169.254.0.0/16 dev ovirtmgmt  scope link  metric 1004

Gianluca