Unable to start VM on host with OVS networking
by Jonathan Dieter
I have a production ovirt setup that's gone through multiple updates over the years. At some point when 4.0 or 4.1 came out, I switched from legacy networking to OVS, and everything worked perfectly until I upgraded to 4.2. Since I upgraded to 4.2, I've been getting messages that the networks were all out of sync, but everything continued working properly.
Today I tracked down the network sync problem, fixed it on one of my three hosts, and then attempted to start a VM on the host. It refused to start with the error message: "Unable to add bridge ovirtmgmt port vnet0: Operation not supported". From what I can tell, the xml being generated is still for the old legacy network. I completely reinstalled the node, using the latest 4.2.3 node ISO image, and it still doesn't work.
In the cluster, the switch type is "OVS (Experimental)" (and this option can't be changed, apparently), the compatibility version is 4.2, the firewall type is firewalld and there's no "Default Network Provider".
I suspect that my upgrades have somehow left my system in half OVS/half legacy mode, but I'm not sure how to move it all the way to OVS mode and I don't want to mess with the other two hosts until I'm sure I've got it figured out.
My (compressed) vdsm.log is at https://www.lesbg.com/jdieter/vdsm.log.xz and my (compressed) supervdsm.log is at https://www.lesbg.com/jdieter/supervdsm.log.xz.
If anyone could point me in the right direction to get this fixed, I'd sure appreciate it.
Jonathan
6 years, 6 months
restore Self-Hosted Engine
by thetas emmanuel
hi,
I follow this doc
https://www.ovirt.org/documentation/self-hosted/chap-Backing_up_and_Resto...
But like others, i can't restore database
I Have :
pg_restore: [archiver (db)] Error while PROCESSING TOC:
pg_restore: [archiver (db)] Error from TOC entry 7397; 0 0 COMMENT
EXTENSION plpgsql
pg_restore: [archiver (db)] could not execute query: ERROR: must be
owner of extension plpgsql
Command was: COMMENT ON EXTENSION plpgsql IS 'PL/pgSQL procedural
language';
..
...
Any solution ?
emmanuel
6 years, 6 months
Error attaching cd iso image from data domain
by Gianluca Cecchi
Hello,
I'm with oVirt 4.2.3 (upgraded from 4.1 and compatibilities set to 4.2)
I have a CentOS 7 VM.
I correctly uploaded an iSO image to the disks of a data storage domain
(iSCSI).
Now in web admin portal I select the VM, then the 3 dots in top right, then
change cd
I'm proposed with the [Eject] line and into the dropdown I see the two iso
images I have uploaded up to now.
I select an image and then OK
I get a window with title "Operation canceled" and content
Error while executing action Change CD: Drive image file could not be found
Do I have to edit any setting in my VM to be able to connect an ISO image
this way?
Or other things to check?
In engine.log I have:
2018-05-30 11:58:58,772+02 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (d
efault task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] Failed in
'ChangeDiskVDS' method
2018-05-30 11:58:58,775+02 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(default task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] EVENT_ID:
VDS_BROKER_COMMAND_FAILURE(10,802), VDSM ov200 command ChangeDiskVDS
failed: Drive image file could not be found
2018-05-30 11:58:58,775+02 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (default
task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] Command
'org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand' return
value 'org.ovirt.engine.core.vdsbroker.vdsbroker.OneVmReturn@5e673b59'
2018-05-30 11:58:58,775+02 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (default
task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] HostName = ov200
2018-05-30 11:58:58,775+02 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (default
task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] Command
'ChangeDiskVDSCommand(HostName = ov200,
ChangeDiskVDSCommandParameters:{hostId='d16e723c-b44c-4c1c-be76-c67911e47ccd',
vmId='2e571c77-bae1-4c1c-bf98-effaf9fed741', iface='ide', index='2',
diskPath='/rhev/data-center/mnt/blockSD/fa33df49-b09d-4f86-9719-ede649542c21/images/71a84a1c-0c53-4bb9-9474-deb92419e955/5404add1-cac4-4129-b8f5-2e7b2fc0da86'})'
execution failed: VDSGenericException: VDSErrorException: Failed to
ChangeDiskVDS, error = Drive image file could not be found, code = 13
2018-05-30 11:58:58,775+02 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (default
task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] FINISH,
ChangeDiskVDSCommand, log id: 740b3c78
2018-05-30 11:58:58,775+02 ERROR
[org.ovirt.engine.core.bll.storage.disk.ChangeDiskCommand] (default task-9)
[d9aae17f-2a49-4d70-a909-6395d61d3ab1] Command
'org.ovirt.engine.core.bll.storage.disk.ChangeDiskCommand' failed:
EngineException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException:
VDSGenericException: VDSErrorException: Failed to ChangeDiskVDS, error =
Drive image file could not be found, code = 13 (Failed with error imageErr
and code 13)
2018-05-30 11:58:58,779+02 ERROR
[org.ovirt.engine.core.bll.storage.disk.ChangeDiskCommand] (default task-9)
[d9aae17f-2a49-4d70-a909-6395d61d3ab1] Transaction rolled-back for command
'org.ovirt.engine.core.bll.storage.disk.ChangeDiskCommand'.
2018-05-30 11:58:58,784+02 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(default task-9) [d9aae17f-2a49-4d70-a909-6395d61d3ab1] EVENT_ID:
USER_FAILED_CHANGE_DISK_VM(102), Failed to change disk in VM c7service
(Host: ov200, User: g.cecchi@internal-authz).
2018-05-30 11:59:30,262+02 INFO
[org.ovirt.engine.core.bll.tasks.AsyncTaskManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-33) [] Setting new tasks
map. The map contains now 0 tasks
2018-05-30 11:59:30,262+02 INFO
[org.ovirt.engine.core.bll.tasks.AsyncTaskManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-33) [] Cleared all tasks of
pool 'ef17cad6-7724-4cd8-96e3-9af6e529db51'.
Thanks,
Gianluca
6 years, 6 months
Asking about snapshot concept
by Terry hey
Dear all,
I have a pre-allocated virtual machine.
When i created a snapshot for that virtual machine, i found that it became
thin-provision.
And the size of the snapshot is same as the virtual machine.
i would like to ask why these two behavior happened.
1. preallocated to thin provision
2. the size of snapshot is same as the disk size of virtual machine.
Regards
Terry
6 years, 6 months
oVirt hosted-engine-setup issues with getting host facts
by Mariusz Kozakowski
Hello,
We've been trying to setup oVirt environment for few days but we have issue with hosted-engine-setup (ansible script).
We managed to fix few small things and have them merged upstream but unfortunately right now the installation process fails on getting host facts.
It looks like it cannot proceed because it fails when connecting to ovirt-engine API of the bootstrap VM.
The oVirt API / webpanel is working, I tested it via a browser and I can login without issues using the admin password chosen earlier in the process.
2018-05-18 15:26:47,800+0200 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:100 TASK [Wait for the host to be up]
2018-05-18 15:39:14,025+0200 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94 {u'_ansible_parsed': True, u'_ansible_no_log': False, u'changed': False, u'attempts': 120, u'invocation': {u'module_args': {
u'pattern': u'name=host01.redacted', u'fetch_nested': False, u'nested_attributes': []}}, u'ansible_facts': {u'ovirt_hosts': []}}
2018-05-18 15:39:14,127+0200 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:98 fatal: [localhost]: FAILED! => {"ansible_facts": {"ovirt_hosts": []}, "attempts": 120, "changed": false}
May 18 13:34:34 host01 python: ansible-ovirt_hosts_facts Invoked with pattern=name=host01.redacted fetch_nested=False nested_attributes=[] auth={'timeout': 0, 'url': 'https://ovirt-dev.redacted/ovirt-engine/api', 'insecure': True, 'kerberos': False, 'compress': True, 'headers': None, 'token': 'R--token-redacted', 'ca_file': None}
Do you have idea what/where is issue and how to fix it?
6 years, 6 months
Failure to import a VM
by Aziz
Hi All,
I'm getting an error when trying to import an OVA file to my oVirt. It
seems that a JAVA command is failing with an exception :
Here are the logs from the engine.log file, while importing the OVA file.
2018-05-28 16:47:09,491Z ERROR
[org.ovirt.engine.core.bll.exportimport.ImportVmFromOvaCommand]
(EE-ManagedThreadFactory-engine-Thread-19767)
[e0306ff3-db73-4030-924b-57d86023db28] Command
'org.ovirt.engine.core.bll.exportimport.ImportVmFromOvaCommand' failed: For
input string: ""
2018-05-28 16:47:09,491Z ERROR
[org.ovirt.engine.core.bll.exportimport.ImportVmFromOvaCommand]
(EE-ManagedThreadFactory-engine-Thread-19767)
[e0306ff3-db73-4030-924b-57d86023db28] Exception:
java.lang.NumberFormatException: For input string: ""
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
[rt.jar:1.8.0_171]
at java.lang.Long.parseLong(Long.java:601) [rt.jar:1.8.0_171]
at
org.ovirt.engine.core.utils.MacAddressRangeUtils.macToLong(MacAddressRangeUtils.java:124)
[utils.jar:]
at
org.ovirt.engine.core.bll.network.macpool.MacPoolUsingRanges.isMacInRange(MacPoolUsingRanges.java:193)
[bll.jar:]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[rt.jar:1.8.0_171]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[rt.jar:1.8.0_171]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_171]
at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_171]
at
org.ovirt.engine.core.utils.lock.LockedObjectFactory$LockingInvocationHandler.invoke(LockedObjectFactory.java:66)
[utils.jar:]
at com.sun.proxy.$Proxy187.isMacInRange(Unknown Source)
at java.util.function.Predicate.lambda$negate$1(Predicate.java:80)
[rt.jar:1.8.0_171]
at
java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
[rt.jar:1.8.0_171]
at
java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
[rt.jar:1.8.0_171]
at
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
[rt.jar:1.8.0_171]
at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382)
[rt.jar:1.8.0_171]
at
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
[rt.jar:1.8.0_171]
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
[rt.jar:1.8.0_171]
at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
[rt.jar:1.8.0_171]
at
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
[rt.jar:1.8.0_171]
at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
[rt.jar:1.8.0_171]
at
org.ovirt.engine.core.bll.network.vm.ExternalVmMacsFinder.findExternalMacAddresses(ExternalVmMacsFinder.java:37)
[bll.jar:]
at
org.ovirt.engine.core.bll.exportimport.ImportVmCommandBase.reportExternalMacs(ImportVmCommandBase.java:512)
[bll.jar:]
at
org.ovirt.engine.core.bll.exportimport.ImportVmCommandBase.addVmInterfaces(ImportVmCommandBase.java:640)
[bll.jar:]
at
org.ovirt.engine.core.bll.exportimport.ImportVmCommandBase.lambda$addVmToDb$2(ImportVmCommandBase.java:533)
[bll.jar:]
at
org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInNewTransaction(TransactionSupport.java:202)
[utils.jar:]
at
org.ovirt.engine.core.bll.exportimport.ImportVmCommandBase.addVmToDb(ImportVmCommandBase.java:529)
[bll.jar:]
at
org.ovirt.engine.core.bll.exportimport.ImportVmFromExternalProviderCommand.addVmToDb(ImportVmFromExternalProviderCommand.java:364)
[bll.jar:]
at
org.ovirt.engine.core.bll.exportimport.ImportVmCommandBase.executeVmCommand(ImportVmCommandBase.java:474)
[bll.jar:]
at
org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:161)
[bll.jar:]
at
org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133)
[bll.jar:]
at
org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285)
[bll.jar:]
at
org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934)
[bll.jar:]
at
org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164)
[utils.jar:]
at
org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103)
[utils.jar:]
at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345)
[bll.jar:]
at
org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400)
[bll.jar:]
at
org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner.executeValidatedCommand(PrevalidatingMultipleActionsRunner.java:204)
[bll.jar:]
at
org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner.runCommands(PrevalidatingMultipleActionsRunner.java:176)
[bll.jar:]
at
org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner.lambda$invokeCommands$3(PrevalidatingMultipleActionsRunner.java:182)
[bll.jar:]
at
org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:96)
[utils.jar:]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[rt.jar:1.8.0_171]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[rt.jar:1.8.0_171]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[rt.jar:1.8.0_171]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[rt.jar:1.8.0_171]
at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_171]
at
org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250)
[javax.enterprise.concurrent-1.0.jar:]
at
org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78)
2018-05-28 16:47:09,515Z ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-19767)
[e0306ff3-db73-4030-924b-57d86023db28] EVENT_ID:
IMPORTEXPORT_IMPORT_VM_FAILED(1,153), Failed to import Vm PA-VM-8.0.0 to
Data Center DC2, Cluster Cluster2
2018-05-28 16:47:09,523Z INFO
[org.ovirt.engine.core.bll.exportimport.ImportVmFromOvaCommand]
(EE-ManagedThreadFactory-engine-Thread-19767)
[e0306ff3-db73-4030-924b-57d86023db28] Lock freed to object
'EngineLock:{exclusiveLocks='[PA-VM-8.0.0=VM_NAME,
2b384fab-2ddb-4069-b4ba-59d0fe4fc8c5=VM]', sharedLocks=''}'
2018-05-28 16:47:11,057Z ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-81) []
IrsBroker::Failed::GetStoragePoolInfoVDS
Can anyone help to get this resolved ?
Thanks
6 years, 6 months
Debugging ceph access
by Bernhard Dick
Hi,
as you might already know I try to use ceph with openstack in an oVirt
test environment. I'm able to create and remove volumes. But if I try to
run a VM which contains a ceph volume it is in the "Wait for launch"
state for a very long time. Then it gets into "down" state again. The
qemu log states
2018-05-25T15:03:41.100401Z qemu-kvm: -drive
file=rbd:rbd/volume-3bec499e-d0d0-45ef-86ad-2c187cdb2811:id=cinder:auth_supported=cephx\;none:mon_host=[mon0]\:6789\;[mon1]\:6789,file.password-secret=scsi0-0-0-0-secret0,format=raw,if=none,id=drive-scsi0-0-0-0,serial=3bec499e-d0d0-45ef-86ad-2c187cdb2811,cache=none,werror=stop,rerror=stop,aio=threads:
error connecting: Connection timed out
2018-05-25 15:03:41.109+0000: shutting down, reason=failed
On the monitor hosts I see traffic with the ceph-mon-port, but not on
other ports (the osds for example). In the ceph logs however I don't
really see what happens.
Do you have some tips how to debug this problem?
Regards
Bernhard
6 years, 6 months
Cannot see ipaddr of new VM
by 03ce007@gmail.com
I have got a self-hosted-engine (4.2) running on centos (7.4).
I am trying to create new vanilla vm with static ip using cloud-init to test ssh connectivity. I have below playbook -
- name: Add vanilla vm
ovirt_vms:
auth: "{{ ovirt_auth }}"
name: test01
cluster: Default
state: running
memory: 2GiB
cpu_cores: 8
operating_system: rhel_7x64
high_availability: true
high_availability_priority: 50 # Available from Ansible 2.5
cloud_init:
nic_boot_protocol: static
nic_ip_address: 10.34.60.86
nic_netmask: 255.255.252.0
nic_gateway: 10.34.63.254
nic_name: eth1
nic_on_boot: true
host_name: test01.ovirt.dw
custom_script: |
write_files:
- content: |
Hello, world!
path: /tmp/greeting.txt
permissions: '0644'
user_name: root
root_password: super_password
nics:
- name: vnet0
network: ovirtmgmt
profile: ovirtmgmt
interface: virtio
# taken from actual vm-infra playbook
- name: Add disks
ovirt_disks:
auth: "{{ ovirt_auth }}"
name: "{{ item.0.name }}_{{ item.1.name }}"
vm_name: test01
size: "{{ item.1.size | default(omit) }}"
format: "{{ item.1.format | default(omit) }}"
storage_domain: "{{ item.1.storage_domain | default(omit) }}"
interface: "{{ item.1.interface | default(omit) }}"
bootable: "{{ item.1.bootable | default(omit) }}"
wait: true
with_subelements:
- "{{ vms }}"
- "profile.disks"
- flags:
skip_missing: true
the playbook runs successfully, but when I want to see the summary of vms using ovirt4.py, i do not see any devices attached, nor using curl api i see anything under reported_devices.
Is there something I am missing?
thank you.
6 years, 6 months