[Users] al-in-one failed to attach storage with latest f18 nightly

Sun Jan 27 13:21:47 UTC 2013

Hello,
just setup from latest nightly
3.2.0-1.20130125.git032a91f.fc18
installation seems ok but then I get these messages

in host events

2013-Jan-27, 14:10
Failed to connect Host local_host to Storage Pool local_datacenter

2013-Jan-27, 14:10
Host local_host cannot access one of the Storage Domains attached to
the Data Center local_datacenter. Setting Host state to
Non-Operational.

2013-Jan-27, 14:10
Failed to Reconstruct Master Domain for Data Center local_datacenter.

2013-Jan-27, 14:10
Detected new Host local_host. Host state was set to Up.

2013-Jan-27, 14:10
Host local_host was autorecovered.

In Action items:
Host failed to attach one of the Storage Domains attached to it.

The first errors in vdsm.log after boot are these ones:
Thread-20::DEBUG::2013-01-27
14:10:05,063::resourceManager::640::ResourceManager::(releaseResource)
Resource 'Storage.ac13ff4f-37fe-437e-876f-c2aa2c09a9c
8' is free, finding out if anyone is waiting for it.
Thread-20::DEBUG::2013-01-27
14:10:05,063::resourceManager::648::ResourceManager::(releaseResource)
No one is waiting for resource
'Storage.ac13ff4f-37fe-437e-876f-c2aa2c09a9c8', Clearing records.
Thread-20::ERROR::2013-01-27
14:10:05,063::task::833::TaskManager.Task::(_setError)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::Unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 840, in _run
    return fn(*args, **kargs)
  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/storage/hsm.py", line 933, in connectStoragePool
    masterVersion, options)
  File "/usr/share/vdsm/storage/hsm.py", line 980, in _connectStoragePool
    res = pool.connect(hostID, scsiKey, msdUUID, masterVersion)
  File "/usr/share/vdsm/storage/sp.py", line 688, in connect
    self.__rebuild(msdUUID=msdUUID, masterVersion=masterVersion)
  File "/usr/share/vdsm/storage/sp.py", line 1221, in __rebuild
    masterVersion=masterVersion)
  File "/usr/share/vdsm/storage/sp.py", line 1573, in getMasterDomain
    raise se.StoragePoolMasterNotFound(self.spUUID, msdUUID)
StoragePoolMasterNotFound: Cannot find master domain:
'spUUID=ac13ff4f-37fe-437e-876f-c2aa2c09a9c8,
msdUUID=6e1b254f-2edb-48c9-811a-f1082e30c5a4'
Thread-20::DEBUG::2013-01-27
14:10:05,066::task::852::TaskManager.Task::(_run)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::Task._run:
d90f779b-e815-4d9a-af9e-ac4a997a2f06
('ac13ff4f-37fe-437e-876f-c2aa2c09a9c8', 1,
'ac13ff4f-37fe-437e-876f-c2aa2c09a9c8',
'6e1b254f-2edb-48c9-811a-f1082e30c5a4', 1) {} failed - stopping task
Thread-20::DEBUG::2013-01-27
14:10:05,066::task::1177::TaskManager.Task::(stop)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::stopping in state
preparing (force False)
Thread-20::DEBUG::2013-01-27
14:10:05,066::task::957::TaskManager.Task::(_decref)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::ref 1 aborting True
Thread-20::INFO::2013-01-27
14:10:05,066::task::1134::TaskManager.Task::(prepare)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::aborting: Task is
aborted: 'Cannot find master domain' - code 304
Thread-20::DEBUG::2013-01-27
14:10:05,066::task::1139::TaskManager.Task::(prepare)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::Prepare: aborted: Cannot
find master domain
Thread-20::DEBUG::2013-01-27
14:10:05,066::task::957::TaskManager.Task::(_decref)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::ref 0 aborting True
Thread-20::DEBUG::2013-01-27
14:10:05,067::task::892::TaskManager.Task::(_doAbort)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::Task._doAbort: force
False
Thread-20::DEBUG::2013-01-27
14:10:05,067::resourceManager::976::ResourceManager.Owner::(cancelAll)
Owner.cancelAll requests {}
Thread-20::DEBUG::2013-01-27
14:10:05,067::task::568::TaskManager.Task::(_updateState)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::moving from state
preparing -> state aborting
Thread-20::DEBUG::2013-01-27
14:10:05,067::task::523::TaskManager.Task::(__state_aborting)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::_aborting: recover policy
none
Thread-20::DEBUG::2013-01-27
14:10:05,067::task::568::TaskManager.Task::(_updateState)
Task=`d90f779b-e815-4d9a-af9e-ac4a997a2f06`::moving from state
aborting -> state failed
Thread-20::DEBUG::2013-01-27
14:10:05,067::resourceManager::939::ResourceManager.Owner::(releaseAll)
Owner.releaseAll requests {} resources {}
Thread-20::DEBUG::2013-01-27
14:10:05,067::resourceManager::976::ResourceManager.Owner::(cancelAll)
Owner.cancelAll requests {}
Thread-20::ERROR::2013-01-27
14:10:05,068::dispatcher::67::Storage.Dispatcher.Protect::(run)
{'status': {'message': "Cannot find master domain:
'spUUID=ac13ff4f-37fe-437e-876f-c2aa2c09a9c8,
msdUUID=6e1b254f-2edb-48c9-811a-f1082e30c5a4'", 'code': 304}}
Thread-27::DEBUG::2013-01-27
14:11:33,529::BindingXMLRPC::926::vds::(wrapper) client
[192.168.1.101]::call getCapabilities with () {}
Thread-27::DEBUG::2013-01-27
14:11:33,564::BindingXMLRPC::933::vds::(wrapper) return
getCapabilities with {'status': {'message': 'Done', 'code': 0},
'info': {'HBAInventory': {'iSCSI': [{'InitiatorName':
'iqn.1994-05.com.redhat:e6aa759a959'}], 'FC': []}, 'packages2':
{'kernel': {'release': '204.fc18.x86_64', 'buildtime': 1358349772.0,
'version': '3.7.2'}, 'spice-server': {'release': '1.fc18',
'buildtime': 1356035501L, 'version': '0.12.2'}, 'vdsm': {'release':
'0.119.git4caf7d4.fc18', 'buildtime': 1359107301L, 'version':
'4.10.3'}, 'qemu-kvm': {'release': '1.fc18', 'buildtime': 1355702442L,
'version': '1.2.2'}, 'libvirt': {'release': '3.fc18', 'buildtime':
1355788803L, 'version': '0.10.2.2'}, 'qemu-img': {'release': '1.fc18',
'buildtime': 1355702442L, 'version': '1.2.2'}, 'mom': {'release':
'1.fc18', 'buildtime': 1349470214L, 'version': '0.3.0'}}, 'cpuModel':
'AMD Athlon(tm) II X4 630 Processor', 'hooks': {}, 'cpuSockets': '1',
'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks':
{'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.101', 'cfg':
{'IPADDR': '192.168.1.101', 'GATEWAY': '192.168.1.254', 'DELAY': '0',
'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO':
'none', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge',
'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp':
'off', 'bridged': True, 'gateway': '192.168.1.254', 'ports':
['p10p1']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.101', 'cfg':
{'IPADDR': '192.168.1.101', 'GATEWAY': '192.168.1.254', 'DELAY': '0',
'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO':
'none', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge',
'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '255.255.255.0', 'stp':
'off', 'ports': ['p10p1']}}, 'uuid':
'E0E1001E-8C00-002A-6F9A-90E6BAC9F1E1', 'lastClientIface':
'ovirtmgmt', 'nics': {'p10p1': {'addr': '', 'cfg': {'BRIDGE':
'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': '90:e6:ba:c9:f1:e1',
'STP': 'no', 'DEVICE': 'p10p1', 'ONBOOT': 'yes'}, 'mtu': '1500',
'netmask': '', 'hwaddr': '90:e6:ba:c9:f1:e1', 'speed': 100}},
'software_revision': '0.119', 'clusterLevels': ['3.0', '3.1', '3.2'],
'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,pdpe1gb,rdtscp,lm,3dnowext,3dnow,constant_tsc,rep_good,nopl,nonstop_tsc,extd_apicid,pni,monitor,cx16,popcnt,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,abm,sse4a,misalignsse,3dnowprefetch,osvw,ibs,skinit,wdt,hw_pstate,npt,lbrv,svm_lock,nrip_save,model_athlon,model_Opteron_G3,model_Opteron_G1,model_phenom,model_Opteron_G2',
'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:e6aa759a959',
'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1'],
'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {},
'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr':
'00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'mtu': '1500',
'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}},
'software_version': '4.10', 'memSize': '5970', 'cpuSpeed': '800.000',
'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4',
'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '',
'cpuThreads': '4', 'emulatedMachines': [u'pc-1.2', u'none', u'pc',
u'pc-1.1', u'pc-1.0', u'pc-0.15', u'pc-0.14', u'pc-0.13', u'pc-0.12',
u'pc-0.11', u'pc-0.10', u'isapc'], 'operatingSystem': {'release': '1',
'version': '18', 'name': 'Fedora'}, 'lastClient': '192.168.1.101'}}

info on host
[root at tekkaman vdsm]# vdsClient -s 0 getVdsCaps
    HBAInventory = {'iSCSI': [{'InitiatorName':
'iqn.1994-05.com.redhat:e6aa759a959'}], 'FC': []}
    ISCSIInitiatorName = iqn.1994-05.com.redhat:e6aa759a959
    bondings = {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500',
'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0':
{'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [],
'hwaddr': '00:00:00:00:00:00'}}
    bridges = {'ovirtmgmt': {'addr': '192.168.1.101', 'cfg':
{'IPADDR': '192.168.1.101', 'ONBOOT': 'yes', 'DELAY': '0',
'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', 'BOOTPROTO':
'none', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge',
'GATEWAY': '192.168.1.254'}, 'mtu': '1500', 'netmask':
'255.255.255.0', 'stp': 'off', 'ports': ['p10p1']}}
    clusterLevels = ['3.0', '3.1', '3.2']
    cpuCores = 4
    cpuFlags = fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ht,syscall,nx,mmxext,fxsr_opt,pdpe1gb,rdtscp,lm,3dnowext,3dnow,constant_tsc,rep_good,nopl,nonstop_tsc,extd_apicid,pni,monitor,cx16,popcnt,lahf_lm,cmp_legacy,svm,extapic,cr8_legacy,abm,sse4a,misalignsse,3dnowprefetch,osvw,ibs,skinit,wdt,hw_pstate,npt,lbrv,svm_lock,nrip_save,model_athlon,model_Opteron_G3,model_Opteron_G1,model_phenom,model_Opteron_G2
    cpuModel = AMD Athlon(tm) II X4 630 Processor
    cpuSockets = 1
    cpuSpeed = 800.000
    cpuThreads = 4
    emulatedMachines = ['pc-1.2', 'none', 'pc', 'pc-1.1', 'pc-1.0',
'pc-0.15', 'pc-0.14', 'pc-0.13', 'pc-0.12', 'pc-0.11', 'pc-0.10',
'isapc']
    guestOverhead = 65
    hooks = {}
    kvmEnabled = true
    lastClient = 192.168.1.101
    lastClientIface = ovirtmgmt
    management_ip =
    memSize = 5970
    netConfigDirty = False
    networks = {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr':
'192.168.1.101', 'cfg': {'IPADDR': '192.168.1.101', 'ONBOOT': 'yes',
'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0',
'BOOTPROTO': 'none', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE':
'Bridge', 'GATEWAY': '192.168.1.254'}, 'mtu': '1500', 'netmask':
'255.255.255.0', 'stp': 'off', 'bridged': True, 'gateway':
'192.168.1.254', 'ports': ['p10p1']}}
    nics = {'p10p1': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt',
'NM_CONTROLLED': 'no', 'DEVICE': 'p10p1', 'STP': 'no', 'HWADDR':
'90:e6:ba:c9:f1:e1', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '',
'hwaddr': '90:e6:ba:c9:f1:e1', 'speed': 100}}
    operatingSystem = {'release': '1', 'version': '18', 'name': 'Fedora'}
    packages2 = {'kernel': {'release': '204.fc18.x86_64', 'buildtime':
1358349772.0, 'version': '3.7.2'}, 'spice-server': {'release':
'1.fc18', 'buildtime': 1356035501, 'version': '0.12.2'}, 'vdsm':
{'release': '0.119.git4caf7d4.fc18', 'buildtime': 1359107301,
'version': '4.10.3'}, 'qemu-kvm': {'release': '1.fc18', 'buildtime':
1355702442, 'version': '1.2.2'}, 'libvirt': {'release': '3.fc18',
'buildtime': 1355788803, 'version': '0.10.2.2'}, 'qemu-img':
{'release': '1.fc18', 'buildtime': 1355702442, 'version': '1.2.2'},
'mom': {'release': '1.fc18', 'buildtime': 1349470214, 'version':
'0.3.0'}}
    reservedMem = 321
    software_revision = 0.119
    software_version = 4.10
    supportedENGINEs = ['3.0', '3.1']
    supportedProtocols = ['2.2', '2.3']
    uuid = E0E1001E-8C00-002A-6F9A-90E6BAC9F1E1
    version_name = Snow Man
    vlans = {}
    vmTypes = ['kvm']

Thanks,
Gianluca