Hi again,
It seems it was too rush to say goodby :-).
Everything was ok while resetting all the networks and stuff in the 3.2
environment until it came the time to create the VMs.
I have an ISCSI target with different luns for each VM and when I
created one of them and tried to start it, it failed with this error:
vdsm.log from one of the hosts:
Thread-8267::ERROR::2013-07-01
14:53:58,697::vm::716::vm.Vm::(_startUnderlyingVm)
vmId=`1084e767-1b5e-4903-af0f-c7d90528725b`::The vm start process failed
Traceback (most recent call last):
File "/usr/share/vdsm/vm.py", line 678, in _startUnderlyingVm
self._run()
File "/usr/share/vdsm/libvirtvm.py", line 1546, in _run
self._connection.createXML(domxml, flags),
File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py",
line 111, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2645, in
createXML
if ret is None:raise libvirtError('virDomainCreateXML() failed',
conn=self)
libvirtError: internal error process exited while connecting to monitor:
Supported machines are:
pc RHEL 6.4.0 PC (alias of rhel6.4.0)
rhel6.4.0 RHEL 6.4.0 PC (default)
rhel6.3.0 RHEL 6.3.0 PC
rhel6.2.0 RHEL 6.2.0 PC
rhel6.1.0 RHEL 6.1.0 PC
rhel6.0.0 RHEL 6.0.0 PC
rhel5.5.0 RHEL 5.5.0 PC
rhel5.4.4 RHEL 5.4.4 PC
rhel5.4.0 RHEL 5.4.0 PC
engine.log
2013-07-01 14:53:57,503 INFO [org.ovirt.engine.core.bll.RunVmCommand]
(pool-3-thread-47) [5b2421ce] Running command: RunVmCommand internal:
false. Entities affected : ID: 1084e767-1b5e-4903-af0f-c7d90528725b
Type: VM
2013-07-01 14:53:57,634 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
(pool-3-thread-47) [5b2421ce] START,
ConnectStorageServerVDSCommand(HostName = Dell2, HostId =
d0179516-177f-4925-bdf5-d38c70a8eced, storagePoolId =
5849b030-626e-47cb-ad90-3ce782d831b3, storageType = ISCSI,
connectionList = [{ id: 478b35df-da9a-4cb0-847f-2f61f17a02f7,
connection: 192.168.130.10, iqn: iqn.1992-08.com.netapp:sn.135056614,
vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null,
nfsTimeo: null };{ id: 717e3505-3290-421b-bb00-25e046f63362, connection:
192.168.131.10, iqn: iqn.1992-08.com.netapp:sn.135056614, vfsType: null,
mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null
};]), log id: 2a113886
2013-07-01 14:53:57,827 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand]
(pool-3-thread-47) [5b2421ce] FINISH, ConnectStorageServerVDSCommand,
return: {717e3505-3290-421b-bb00-25e046f63362=0,
478b35df-da9a-4cb0-847f-2f61f17a02f7=0}, log id: 2a113886
2013-07-01 14:53:57,862 INFO
[org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47)
[5b2421ce] START, CreateVmVDSCommand(HostName = Dell2, HostId =
d0179516-177f-4925-bdf5-d38c70a8eced,
vmId=1084e767-1b5e-4903-af0f-c7d90528725b, vm=VM [Vftp]), log id: 2c35fafa
2013-07-01 14:53:57,909 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand]
(pool-3-thread-47) [5b2421ce] START, CreateVDSCommand(HostName = Dell2,
HostId = d0179516-177f-4925-bdf5-d38c70a8eced,
vmId=1084e767-1b5e-4903-af0f-c7d90528725b, vm=VM [Vftp]), log id: 4d43a09f
2013-07-01 14:53:57,983 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand]
(pool-3-thread-47) [5b2421ce]
org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand
spiceSslCipherSuite=DEFAULT,memSize=2048,kvmEnable=true,smp=2,vmType=kvm,emulatedMachine=pc-0.14,keyboardLayout=en-us,pitReinjection=false,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-10800,transparentHugePages=true,vmId=1084e767-1b5e-4903-af0f-c7d90528725b,devices=[Ljava.util.Map;@73c32341,acpiEnable=true,vmName=Vftp,cpuType=Westmere,custom={}
2013-07-01 14:53:57,985 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand]
(pool-3-thread-47) [5b2421ce] FINISH, CreateVDSCommand, log id: 4d43a09f
2013-07-01 14:53:57,999 INFO
[org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47)
[5b2421ce] IncreasePendingVms::CreateVmIncreasing vds Dell2 pending vcpu
count, now 2. Vm: Vftp
2013-07-01 14:53:58,029 INFO
[org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-47)
[5b2421ce] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id:
2c35fafa
2013-07-01 14:53:58,041 INFO [org.ovirt.engine.core.bll.RunVmCommand]
(pool-3-thread-47) [5b2421ce] Lock freed to object EngineLock
[exclusiveLocks= key: 1084e767-1b5e-4903-af0f-c7d90528725b value: VM
, sharedLocks= ]
2013-07-01 14:54:00,257 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(DefaultQuartzScheduler_Worker-10) START, DestroyVDSCommand(HostName =
Dell2, HostId = d0179516-177f-4925-bdf5-d38c70a8eced,
vmId=1084e767-1b5e-4903-af0f-c7d90528725b, force=false, secondsToWait=0,
gracefully=false), log id: 5c10d8b7
2013-07-01 14:54:00,333 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand]
(DefaultQuartzScheduler_Worker-10) FINISH, DestroyVDSCommand, log id:
5c10d8b7
2013-07-01 14:54:00,381 INFO
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
(DefaultQuartzScheduler_Worker-10) Running on vds during rerun failed
vm: null
2013-07-01 14:54:00,402 INFO
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
(DefaultQuartzScheduler_Worker-10) vm Vftp running in db and not running
in vds - add to rerun treatment. vds Dell2
2013-07-01 14:54:00,455 ERROR
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
(DefaultQuartzScheduler_Worker-10) Rerun vm
1084e767-1b5e-4903-af0f-c7d90528725b. Called from vds Dell2
2013-07-01 14:54:00,514 INFO
[org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand]
(pool-3-thread-45) START, UpdateVdsDynamicDataVDSCommand(HostName =
Dell2, HostId = d0179516-177f-4925-bdf5-d38c70a8eced,
vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@9783b7fc),
log id: 4f595659
2013-07-01 14:54:00,524 INFO
[org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand]
(pool-3-thread-45) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 4f595659
2013-07-01 14:54:00,566 INFO [org.ovirt.engine.core.bll.RunVmCommand]
(pool-3-thread-45) Lock Acquired to object EngineLock [exclusiveLocks=
key: 1084e767-1b5e-4903-af0f-c7d90528725b value: VM
, sharedLocks= ]
2013-07-01 14:54:00,583 INFO
[org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand]
(pool-3-thread-45) START, IsVmDuringInitiatingVDSCommand( vmId =
1084e767-1b5e-4903-af0f-c7d90528725b), log id: 3671275a
2013-07-01 14:54:00,594 INFO
[org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand]
(pool-3-thread-45) FINISH, IsVmDuringInitiatingVDSCommand, return:
false, log id: 3671275a
2013-07-01 14:54:00,657 INFO [org.ovirt.engine.core.bll.RunVmCommand]
(pool-3-thread-45) Running command: RunVmCommand internal: false.
Entities affected : ID: 1084e767-1b5e-4903-af0f-c7d90528725b Type: VM
Another thing I found was this, but as I still don't use gluster, I
think it won't matter at this time.
2013-07-01 14:38:28,117 ERROR
[org.ovirt.engine.core.bll.gluster.GlusterManager]
(DefaultQuartzScheduler_Worker-1) Error while refreshing Gluster
lightweight data of cluster
Default!: org.ovirt.engine.core.common.errors.VdcBLLException:
VdcBLLException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException:
VDSGenericException: VDSErrorExce
ption: Failed to GlusterVolumesListVDS, error = Command execution failed
error: Connection failed. Please check if gluster daemon is operational.
return code: 1
at
org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:168) [bll.jar:]
at
org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33)
[bll.jar:]
at
org.ovirt.engine.core.bll.gluster.GlusterManager.runVdsCommand(GlusterManager.java:258)
[bll.jar:]
at
org.ovirt.engine.core.bll.gluster.GlusterManager.fetchVolumes(GlusterManager.java:454)
[bll.jar:]
at
org.ovirt.engine.core.bll.gluster.GlusterManager.fetchVolumes(GlusterManager.java:440)
[bll.jar:]
at
org.ovirt.engine.core.bll.gluster.GlusterManager.refreshVolumeData(GlusterManager.java:411)
[bll.jar:]
at
org.ovirt.engine.core.bll.gluster.GlusterManager.refreshClusterData(GlusterManager.java:191)
[bll.jar:]
at
org.ovirt.engine.core.bll.gluster.GlusterManager.refreshLightWeightData(GlusterManager.java:170)
[bll.jar:]
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
[:1.7.0_25]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.7.0_25]
And also I have an login event every minute which didn't happen in 3.1
version.
Regards.
Juan Pablo Lorier