On Mon, Jan 7, 2013 at 8:12 AM, Ayal Baron wrote:
Hi Gianluca,
The problem you have now doesn't seem related $subject.
It looks like
http://gerrit.ovirt.org/#/c/10024/5 to me.
Can you check to see if your code contains the above fix?
Did you vdsm from nightly as well or from Fedora 18 rpms?
Fede, does the f18 build include the above fix?
Thanks,
Ayal.
For this particular host I already updated the rpm package
vdsm-4.10.3-0.50.gitc6625ce.fc18.x86_64
that contains the patched file /usr/share/vdsm/storage/localFsSD.py so it
seems I'm not hitting this problem.
I ran
yum update ovirt-engine-setup
that pulled these new packages
Jan 07 08:06:27 Updated:
ovirt-engine-setup-3.2.0-1.20130106.git0cb01e1.fc18.noarch
Jan 07 08:08:53 Updated:
otopi-0.0.0-0.5.master.20130106.git0a731eb.fc18.noarch
Jan 07 08:08:54 Updated:
otopi-java-0.0.0-0.5.master.20130106.git0a731eb.fc18.noarch
Jan 07 08:08:54 Updated:
ovirt-host-deploy-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch
Jan 07 08:08:54 Updated:
ovirt-host-deploy-offline-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch
Jan 07 08:08:54 Updated:
ovirt-engine-setup-plugin-allinone-3.2.0-1.20130106.git0cb01e1.fc18.noarch
Jan 07 08:08:54 Updated:
ovirt-host-deploy-java-0.0.0-0.0.master.20130106.gitaa0edd4.fc18.noarch
Jan 07 08:08:55 Updated:
ovirt-engine-cli-3.2.0.8-1.20130106.git0b16093.fc18.noarch
Then engine-upgrade and reboot but still not able to activate storage domain
In vdsm.log
Thread-20::DEBUG::2013-01-07
19:57:41,148::BindingXMLRPC::163::vds::(wrapper) [10.194.53.246]
Thread-20::DEBUG::2013-01-07
19:57:41,149::task::568::TaskManager.Task::(_updateState)
Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::moving from state init ->
state preparing
Thread-20::INFO::2013-01-07
19:57:41,149::logUtils::41::dispatcher::(wrapper) Run and protect:
getSpmStatus(spUUID='a6e0d929-065b-4f69-a46a-0b07d3b79731', options=None)
Thread-20::ERROR::2013-01-07
19:57:41,150::task::833::TaskManager.Task::(_setError)
Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::Unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/storage/task.py", line 840, in _run
return fn(*args, **kargs)
File "/usr/share/vdsm/logUtils.py", line 42, in wrapper
res = f(*args, **kwargs)
File "/usr/share/vdsm/storage/hsm.py", line 602, in getSpmStatus
pool = self.getPool(spUUID)
File "/usr/share/vdsm/storage/hsm.py", line 312, in getPool
raise se.StoragePoolUnknown(spUUID)
StoragePoolUnknown: Unknown pool id, pool not connected:
('a6e0d929-065b-4f69-a46a-0b07d3b79731',)
Thread-20::DEBUG::2013-01-07
19:57:41,153::task::852::TaskManager.Task::(_run)
Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::Task._run:
133ef0a7-30ac-4cad-94ee-276dd59731e0
('a6e0d929-065b-4f69-a46a-0b07d3b79731',) {} failed - stopping task
Thread-20::DEBUG::2013-01-07
19:57:41,154::task::1177::TaskManager.Task::(stop)
Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::stopping in state preparing
(force False)
Thread-20::DEBUG::2013-01-07
19:57:41,154::task::957::TaskManager.Task::(_decref)
Task=`133ef0a7-30ac-4cad-94ee-276dd59731e0`::ref 1 aborting True
while in engine.log
2013-01-07 19:57:33,782 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand]
(QuartzScheduler_Worker-2) XML RPC error in command GetHardwareInfoVDS (
HostName = local_host ), the error was:
java.util.concurrent.ExecutionException:
java.lang.reflect.InvocationTargetException, <type
'exceptions.Exception'>:method "getVdsHardwareInfo" is not supported
2013-01-07 19:57:33,783 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand]
(QuartzScheduler_Worker-2) FINISH, GetHardwareInfoVDSCommand, log id:
5f98da5d
2013-01-07 19:57:33,795 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(QuartzScheduler_Worker-2) Cannot convert string <<<<<<< to
AuditLogType
...
2013-01-07 19:57:33,800 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(QuartzScheduler_Worker-2) AuditLogType: DWH_ERROR not exist in string table
2013-01-07 19:57:33,800 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_NORMAL not exist in
string table
2013-01-07 19:57:33,800 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_WARNING not exist
in string table
2013-01-07 19:57:33,801 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(QuartzScheduler_Worker-2) AuditLogType: EXTERNAL_EVENT_ERROR not exist in
string table
...
2013-01-07 19:57:46,007 ERROR
[org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-8)
Command ConnectStoragePoolVDS execution failed. Exception:
IRSNoMasterDomainException: IRSGenericException: IRSErrorException:
IRSNoMasterDomainException: Cannot find master domain:
'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731,
msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'
2013-01-07 19:57:46,010 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(QuartzScheduler_Worker-8) FINISH, ConnectStoragePoolVDSCommand, log id:
2f2957ee
2013-01-07 19:57:46,011 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(QuartzScheduler_Worker-8) IrsBroker::Failed::GetStoragePoolInfoVDS
2013-01-07 19:57:46,011 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(QuartzScheduler_Worker-8) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731,
msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'
2013-01-07 19:57:46,236 INFO
[org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand]
(pool-3-thread-19) [47e9e14a] Running command:
ReconstructMasterDomainCommand internal: true. Entities affected : ID:
eb9d38ff-34d6-4dd9-8309-b004f02ee510 Type: Storage
2013-01-07 19:57:46,358 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand]
(pool-3-thread-19) [47e9e14a] START, MarkPoolInReconstructModeVDSCommand(
storagePoolId = a6e0d929-065b-4f69-a46a-0b07d3b79731, ignoreFailoverLimit =
false, compatabilityVersion = null, reconstructMarkAction = ClearCache),
log id: 768a1787
2013-01-07 19:57:46,361 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(pool-3-thread-19) [47e9e14a] clearing cache for problematic entities in
pool a6e0d929-065b-4f69-a46a-0b07d3b79731
2013-01-07 19:57:46,363 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand]
(pool-3-thread-19) [47e9e14a] FINISH, MarkPoolInReconstructModeVDSCommand,
log id: 768a1787
2013-01-07 19:57:46,438 INFO
[org.ovirt.engine.core.bll.eventqueue.EventQueueMonitor] (pool-3-thread-18)
Finished reconstruct for pool a6e0d929-065b-4f69-a46a-0b07d3b79731.
Clearing all event queue
2013-01-07 19:57:56,131 INFO
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(QuartzScheduler_Worker-22) hostFromVds::selectedVds - local_host,
spmStatus Unknown_Pool, storage pool local_datacenter
2013-01-07 19:57:56,153 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(QuartzScheduler_Worker-22) START, ConnectStoragePoolVDSCommand(HostName =
local_host, HostId = 919c3ca3-980f-425f-a97d-778c9cd076ca, storagePoolId =
a6e0d929-065b-4f69-a46a-0b07d3b79731, vds_spm_id = 1, masterDomainId =
eb9d38ff-34d6-4dd9-8309-b004f02ee510, masterVersion = 1), log id: 56c65032
2013-01-07 19:58:00,669 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase]
(QuartzScheduler_Worker-22) Command
org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand
return value
Class Name:
org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc
mStatus Class Name:
org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc
mCode 304
mMessage Cannot find master domain:
'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731,
msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'
2013-01-07 19:58:00,671 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase]
(QuartzScheduler_Worker-22) HostName = local_host
2013-01-07 19:58:00,671 ERROR
[org.ovirt.engine.core.vdsbroker.VDSCommandBase]
(QuartzScheduler_Worker-22) Command ConnectStoragePoolVDS execution failed.
Exception: IRSNoMasterDomainException: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=a6e0d929-065b-4f69-a46a-0b07d3b79731,
msdUUID=eb9d38ff-34d6-4dd9-8309-b004f02ee510'
Could it be that this host, that is a PC with 6Gb of ram and Opteron
processor
model name : AMD Athlon(tm) II X4 630 Processor
gets its ip by dhcp?
At this moment
[root@tekkaman ovirt-engine]# ip addr list
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: p10p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
master ovirtmgmt state UP qlen 1000
link/ether 90:e6:ba:c9:f1:e1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::92e6:baff:fec9:f1e1/64 scope link
valid_lft forever preferred_lft forever
4: ovirtmgmt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
state UP
link/ether 90:e6:ba:c9:f1:e1 brd ff:ff:ff:ff:ff:ff
inet 10.194.53.246/20 brd 10.194.63.255 scope global ovirtmgmt
inet6 fe80::92e6:baff:fec9:f1e1/64 scope link
valid_lft forever preferred_lft forever
6: ;vdsmdummy;: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN
link/ether 12:1a:6c:ef:c0:fc brd ff:ff:ff:ff:ff:ff
7: bond0: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue
state DOWN
link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
8: bond4: <NO-CARRIER,BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue
state DOWN
link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
[root@tekkaman ovirt-engine]# ip route list
default via 10.194.48.1 dev ovirtmgmt
10.194.48.0/20 dev ovirtmgmt proto kernel scope link src 10.194.53.246
169.254.0.0/16 dev ovirtmgmt scope link metric 1004
Gianluca