On Thu, Sep 25, 2014 at 1:58 AM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Hello, after upgrading engine and hypervisor to rc3 I get this message when trying to start VM:
VM vm_name is down with error. Exit message: internal error internal error NUMA memory tuning in 'preferred' mode only supports single node.
hypervisor is Intel blade MFS5520VI with
processor : 15 vendor_id : GenuineIntel cpu family : 6 model : 26 model name : Intel(R) Xeon(R) CPU X5570 @ 2.93GHz stepping : 5 cpu MHz : 2927.000 cache size : 8192 KB physical id : 1 siblings : 8 core id : 3 cpu cores : 4 apicid : 23 initial apicid : 23 fpu : yes fpu_exception : yes cpuid level : 11 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dts tpr_shadow vnmi flexpriority ept vpid bogomips : 5851.73 clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management:
Did anything change from rc2 to rc3 regarding this?
Gianluca
If it can be of any help, both engine and node are CentOS 6.5 and on node I have this output from numactl command: [root@ovnode04 vdsm]# numactl --show policy: default preferred node: current physcpubind: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 cpubind: 0 1 nodebind: 0 1 membind: 0 1 [root@ovnode04 vdsm]# numactl --hardware available: 2 nodes (0-1) node 0 cpus: 0 2 4 6 8 10 12 14 node 0 size: 8128 MB node 0 free: 7567 MB node 1 cpus: 1 3 5 7 9 11 13 15 node 1 size: 8192 MB node 1 free: 7747 MB node distances: node 0 1 0: 10 21 1: 21 10 In engine.log: 2014-09-25 01:58:18,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-16) [21714fa2] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=7200,transparentHugePages=true,vmId=0ce8ebc0-8464-4e9a-b382-1836234b3560,acpiEnable=true,custom={device_fc07dfb4-c33c-4302-915f-fcafcbaf201fdevice_814694f2-e3d9-4808-87d1-1576acbb6b39device_8e5365f1-1027-498e-9453-0289278434d4device_ef937c2a-c7ca-4405-98d8-72387b983ed7=VmDevice {vmId=0ce8ebc0-8464-4e9a-b382-1836234b3560, deviceId=ef937c2a-c7ca-4405-98d8-72387b983ed7, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_fc07dfb4-c33c-4302-915f-fcafcbaf201f=VmDevice {vmId=0ce8ebc0-8464-4e9a-b382-1836234b3560, deviceId=fc07dfb4-c33c-4302-915f-fcafcbaf201f, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_fc07dfb4-c33c-4302-915f-fcafcbaf201fdevice_814694f2-e3d9-4808-87d1-1576acbb6b39device_8e5365f1-1027-498e-9453-0289278434d4=VmDevice {vmId=0ce8ebc0-8464-4e9a-b382-1836234b3560, deviceId=8e5365f1-1027-498e-9453-0289278434d4, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_fc07dfb4-c33c-4302-915f-fcafcbaf201fdevice_814694f2-e3d9-4808-87d1-1576acbb6b39=VmDevice {vmId=0ce8ebc0-8464-4e9a-b382-1836234b3560, deviceId=814694f2-e3d9-4808-87d1-1576acbb6b39, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}},spiceSslCipherSuite=DEFAULT,memSize=2048,smp=2,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=1365,display=qxl,smartcardEnable=false,bootMenuEnable=false,numaTune={mode=preferred, nodeset=0,1},spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{address={bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}, specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=544e064e-f2df-40c8-89e3-9311cc82af45}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=00fd82da-3da6-45c1-b18b-54e3ccb52c9b}, {shared=false, index=0, volumeID=72821a56-1806-4b8f-bd73-7b5ef4f3c12f, propagateErrors=off, format=cow, type=disk, iface=scsi, bootOrder=1, address={unit=0, bus=0, target=0, controller=0, type=drive}, domainID=346732c8-e1e9-49de-9ca4-63f4477ef6dd, imageID=f9c73080-8653-44bd-9bd9-acc7a9925971, specParams={}, optional=false, device=disk, poolID=4512e567-f94e-476a-a050-6cd0a15e260a, readonly=false, deviceId=f9c73080-8653-44bd-9bd9-acc7a9925971}, {nicModel=pv, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:01:a4:a3:42:01, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=2d8e61a1-a759-4115-9c38-081d32bb9d3f}, {specParams={}, device=console, type=console, deviceId=cf5798e1-f7f5-4c7e-b3e3-9903ad6b3b0a}, {address={bus=0x00, domain=0x0000, type=pci, slot=0x06, function=0x0}, specParams={model=virtio}, device=memballoon, type=balloon, deviceId=f9007dbf-da2b-41ce-b589-272af18ef860}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=49fe629a-fa54-4eba-9e95-14768b4bec4c}, {address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=3bf8fbed-9a33-4e25-b07e-356a54cacc86}],vmName=c65new,cpuType=Nehalem,fileTransferEnable=true 2014-09-25 01:58:18,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-16) [21714fa2] FINISH, CreateVDSCommand, log id: 8f7a8dd 2014-09-25 01:58:18,099 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-16) [21714fa2] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 78789fc9 2014-09-25 01:58:18,100 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-16) [21714fa2] Lock freed to object EngineLock [exclusiveLocks= key: 0ce8ebc0-8464-4e9a-b382-1836234b3560 value: VM , sharedLocks= ] 2014-09-25 01:58:18,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-16) [21714fa2] Correlation ID: 21714fa2, Job ID: 8fcd2749-9b69-4cfb-8b13-f3a7fb752895, Call Stack: null, Custom Event ID: -1, Message: VM c65new was started by admin (Host: ovnode04). 2014-09-25 01:58:19,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-1) START, DestroyVDSCommand(HostName = ovnode04, HostId = 36fec87b-c21f-4157-ab2f-434b67c05cb9, vmId=0ce8ebc0-8464-4e9a-b382-1836234b3560, force=false, secondsToWait=0, gracefully=false, reason=), log id: 5be4f2f8 2014-09-25 01:58:20,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, DestroyVDSCommand, log id: 5be4f2f8 2014-09-25 01:58:20,071 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM c65new is down with error. Exit message: internal error internal error NUMA memory tuning in 'preferred' mode only supports single node. 2014-09-25 01:58:20,072 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) Running on vds during rerun failed vm: null 2014-09-25 01:58:20,072 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) VM c65new (0ce8ebc0-8464-4e9a-b382-1836234b3560) is running in db and not running in VDS ovnode04 2014-09-25 01:58:20,097 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) Rerun vm 0ce8ebc0-8464-4e9a-b382-1836234b3560. Called from vds ovnode04 2014-09-25 01:58:20,107 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-17) Correlation ID: 21714fa2, Job ID: 8fcd2749-9b69-4cfb-8b13-f3a7fb752895, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM c65new on Host ovnode04.