May 2019 - Users - oVirt List Archives

Re: [ovirt-announce] Re: Re: [ANN] oVirt 4.3.4 First Release Candidate is now available
by Strahil 21 May '19

21 May '19

On May 21, 2019 06:00, Satheesaran Sundaramoorthi <sasundar(a)redhat.com> wrote: > > > On Fri, May 17, 2019 at 1:12 AM Nir Soffer <nsoffer(a)redhat.com> wrote: >> >> On Thu, May 16, 2019 at 10:12 PM Darrell Budic <budic(a)onholyground.com> wrote: >>> >>> On May 16, 2019, at 1:41 PM, Nir Soffer <nsoffer(a)redhat.com> wrote: >>>> >>>> >>>> On Thu, May 16, 2019 at 8:38 PM Darrell Budic <budic(a)onholyground.com> wrote: >>>>> >>>>> I tried adding a new storage domain on my hyper converged test cluster running Ovirt 4.3.3.7 and gluster 6.1. I was able to create the new gluster volume fine, but it’s not able to add the gluster storage domain (as either a managed gluster volume or directly entering values). The created gluster volume mounts and looks fine from the CLI. Errors in VDSM log: >>>>> >>>> ... >>>>> >>>>> 2019-05-16 10:25:09,584-0500 ERROR (jsonrpc/5) [storage.fileSD] Underlying file system doesn't supportdirect IO (fileSD:110) >>>>> 2019-05-16 10:25:09,584-0500 INFO (jsonrpc/5) [vdsm.api] FINISH createStorageDomain error=Storage Domain target is unsupported: () from=::ffff:10.100.90.5,44732, flow_id=31d993dd, task_id=ecea28f3-60d4-476d-9ba8-b753b7c9940d (api:52) >>>> >>>> >>>> The direct I/O check has failed. >>>> >>>> >>>> So something is wrong in the files system. >>>> >>>> To confirm, you can try to do: >>>> >>>> dd if=/dev/zero of=/path/to/mountoint/test bs=4096 count=1 oflag=direct >>>> >>>> This will probably fail with: >>>> dd: failed to open '/path/to/mountoint/test': Invalid argument >>>> >>>> If it succeeds, but oVirt fail to connect to this domain, file a bug and we will investigate. >>>> >>>> Nir >>> >>> >>> Yep, it fails as expected. Just to check, it is working on pre-existing volumes, so I poked around at gluster settings for the new volume. It has network.remote-dio=off set on the new volume, but enabled on old volumes. After enabling it, I’m able to run the dd test: >>> >>> [root@boneyard mnt]# gluster vol set test network.remote-dio enable >>> volume set: success >>> [root@boneyard mnt]# dd if=/dev/zero of=testfile bs=4096 count=1 oflag=direct >>> 1+0 records in >>> 1+0 records out >>> 4096 bytes (4.1 kB) copied, 0.0018285 s, 2.2 MB/s >>> >>> I’m also able to add the storage domain in ovirt now. >>> >>> I see network.remote-dio=enable is part of the gluster virt group, so apparently it’s not getting set by ovirt duding the volume creation/optimze for storage? >> >> >> I'm not sure who is responsible for changing these settings. oVirt always required directio, and we >> never had to change anything in gluster. >> >> Sahina, maybe gluster changed the defaults? >> >> Darrell, please file a bug, probably for RHHI. > > > Hello Darrell & Nir, > > Do we have a bug available now for this issue ? > I just need to make sure performance.strict-o-direct=on is enabled on that volume. > > > Satheesaran Sundaramoorthi > > Senior Quality Engineer, RHHI-V QE > > Red Hat APAC > Please check https://bugzilla.redhat.com/show_bug.cgi?id=1711054 Best Regards, Strahil Nikolov

1 0

Re: [ANN] oVirt 4.3.4 First Release Candidate is now available
by Strahil 21 May '19

21 May '19

Hi Sandro, Thanks for the update. I have just upgraded to RC1 (using gluster v6 here) and the issue I detected in 4.3.3.7 - where gluster Storage domain fails creation - is still present. Can you check if the 'dd' command executed during creation has been recently modified ? I've received update from Darrell (also gluster v6) , but haven't received an update from anyone who is using gluster v5 -> thus I haven't opened a bug yet. Best Regards, Strahil NikolovOn May 16, 2019 11:21, Sandro Bonazzola <sbonazzo(a)redhat.com> wrote: > > The oVirt Project is pleased to announce the availability of the oVirt 4.3.4 First Release Candidate, as of May 16th, 2019. > > This update is a release candidate of the fourth in a series of stabilization updates to the 4.3 series. > This is pre-release software. This pre-release should not to be used inproduction. > > This release is available now on x86_64 architecture for: > * Red Hat Enterprise Linux 7.6 or later > * CentOS Linux (or similar) 7.6 or later > > This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: > * Red Hat Enterprise Linux 7.6 or later > * CentOS Linux (or similar) 7.6 or later > * oVirt Node 4.3 (available for x86_64 only) > > Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included. > > See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. > > Notes: > - oVirt Appliance is already available > - oVirt Node is already available[2] > > Additional Resources: > * Read more about the oVirt 4.3.4 release highlights:http://www.ovirt.org/release/4.3.4/ > * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt > * Check out the latest project news on the oVirt blog:http://www.ovirt.org/blog/ > > [1] http://www.ovirt.org/release/4.3.4/ > [2] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ > > -- > > Sandro Bonazzola > > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > > Red Hat EMEA > > sbonazzo(a)redhat.com

8 17

Virtual office, how?
by andres.b.dev＠gmail.com 21 May '19

21 May '19

I'm trying to be able to create different virtual LANs, where, for example, I have 2 groups of pcs A and B belongs to network N1 C and D belongs to network N2 N1 and N2 with his own public IP. For example A: Local ip: 192.168.122.100 B: Local ip: 192.168.122.101 C: Local ip: 192.168.122.102 D: Local ip: 192.168.122.103 Where A and B has the same public ip, and C and D has the same public ip. Now, I want that A can ssh on B, but not on C or D. The same goes for C, where C can access to D via ssh but not to A or B I'm not sure if OVS solve this problem or not, or if this is not possible. Is this possible? How?

2 2

Every now and then Backup question
by Markus Schaufler 21 May '19

21 May '19

Hi, looking for a backup solution compareable to vmware/veeam - ie. features like agent-less, incremental, lan-free backups with dedup and single item restore. As I understand the main construction site for all commercial backup solutions available for kvm/rhev was the underlying qemu with its CBT implementation. The main functions should now be implemented as there are solutions like vprotect which state that they support incremental backups for rhev. But as I read at https://www.openvirtualization.pro/agent-less-backup-strategies-for-ovirt-r… there might still be some drawbacks. Are there ressources or a roadmap covering the state of the backup/recovery process, ie. what is possible now and whats in progress? I'm sure a big showstopper for open source virtualization projects are is uncertainty about backup/recovery and especially disaster recovery processes. Follow up questions to the users with bigger environments: Whats your current backup and DR strategy? Does anybody have experience with commercially availbe backup solutions like Bacula, SEP, Commvault, etc.?

2 1

newbie questions about installation using synology NAS
by bmillett＠gmail.com 20 May '19

20 May '19

I'm starting fairly fresh. Ovirt engine 4.3.3.7 on a host 2 nodes installed with ovirt-release-host-node-4.3.3.1 synology DS418 with 5 TB disks I've configured the master engine and am ready to add the nodes. My questions have to do with the order or steps . Do I need to mount /volume1/data/images/rhev from the DS418 on each of the nodes before I add them or do I just add the nodes, then define a domain using the NFS mounts from the DS418? Thanks.

3 2

Re: newbie questions about installation using synology NAS
by Strahil 20 May '19

20 May '19

Define the nodes and when you create your NFS storage domain - it will be automatically mounted on all hosts in the DC. Best Regards, Strahil NikolovOn May 20, 2019 00:03, bmillett(a)gmail.com wrote: > > I'm starting fairly fresh. > Ovirt engine 4.3.3.7 on a host > 2 nodes installed with ovirt-release-host-node-4.3.3.1 > synology DS418 with 5 TB disks > > I've configured the master engine and am ready to add the nodes. > My questions have to do with the order or steps . > Do I need to mount /volume1/data/images/rhev from the DS418 on each of the nodes before I add them or > do I just add the nodes, then define a domain using the NFS mounts from the DS418? > > Thanks. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/IXCF3CZGQDDOF…

2 1

Re: oVirt upgrade version from 4.2 to 4.3
by Strahil 20 May '19

20 May '19

I would recommend you to postpone your upgrade if you use gluster (without the API) , as creation of virtual disks via UI on gluster is having issues - only preallocated can be created. Best Regards, Strahil NikolovOn May 19, 2019 09:53, Yedidyah Bar David <didi(a)redhat.com> wrote: > > On Thu, May 16, 2019 at 3:40 PM <dmarini(a)it.iliad.com> wrote: > > > > I cannot find an official upgrade procedure from 4.2 to 4.3 oVirt version on this page: https://www.ovirt.org/documentation/upgrade-guide/upgrade-guide.html > > > > Can you help me? > > As others noted, the above should be sufficient, for general upgrade > instructions, even though it does require some updates. > > You probably want to read also: > > https://ovirt.org/release/4.3.0/ > > as well as all the other relevant pages in: > > https://ovirt.org/release/ > > Best regards, > > > > > Thanks > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/WG2EI6HL3S2AT… > > > > -- > Didi > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KAJGM3URCFSNN…

3 2

oVirt upgrade version from 4.2 to 4.3
by dmarini＠it.iliad.com 19 May '19

19 May '19

I cannot find an official upgrade procedure from 4.2 to 4.3 oVirt version on this page: https://www.ovirt.org/documentation/upgrade-guide/upgrade-guide.html Can you help me? Thanks

5 6

Re: [ovirt-announce] Re: [ANN] oVirt 4.3.4 First Release Candidate is now available
by Strahil 19 May '19

19 May '19

OK, Can we summarize it: 1. VDO must 'emulate512=true' 2. 'network.remote-dio' should be off ? As per this: https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3/htm… We should have these: quick-read=off read-ahead=off io-cache=off stat-prefetch=off eager-lock=enable remote-dio=on quorum-type=auto server-quorum-type=server I'm a little bit confused here. Best Regards, Strahil NikolovOn May 19, 2019 07:44, Sahina Bose <sabose(a)redhat.com> wrote: > > > > On Sun, 19 May 2019 at 12:21 AM, Nir Soffer <nsoffer(a)redhat.com> wrote: >> >> On Fri, May 17, 2019 at 7:54 AM Gobinda Das <godas(a)redhat.com> wrote: >>> >>> From RHHI side default we are setting below volume options: >>> >>> { group: 'virt', >>> storage.owner-uid: '36', >>> storage.owner-gid: '36', >>> network.ping-timeout: '30', >>> performance.strict-o-direct: 'on', >>> network.remote-dio: 'off' >> >> >> According to the user reports, this configuration is not compatible with oVirt. >> >> Was this tested? > > > Yes, this is set by default in all test configuration. We’re checking on the bug, but the error is likely when the underlying device does not support 512b writes. > With network.remote-dio off gluster will ensure o-direct writes >> >> >>> } >>> >>> >>> On Fri, May 17, 2019 at 2:31 AM Strahil Nikolov <hunter86_bg(a)yahoo.com> wrote: >>>> >>>> Ok, setting 'gluster volume set data_fast4 network.remote-dio on' allowed me to create the storage domain without any issues. >>>> I set it on all 4 new gluster volumes and the storage domains were successfully created. >>>> >>>> I have created bug for that: >>>> https://bugzilla.redhat.com/show_bug.cgi?id=1711060 >>>> >>>> If someone else already opened - please ping me to mark this one as duplicate. >>>> >>>> Best Regards, >>>> Strahil Nikolov >>>> >>>> >>>> В четвъртък, 16 май 2019 г., 22:27:01 ч. Гринуич+3, Darrell Budic <budic(a)onholyground.com> написа: >>>> >>>> >>>> On May 16, 2019, at 1:41 PM, Nir Soffer <nsoffer(a)redhat.com> wrote: >>>> >>>>> >>>>> On Thu, May 16, 2019 at 8:38 PM Darrell Budic <budic(a)onholyground.com> wrote: >>>>>> >>>>>> I tried adding a new storage domain on my hyper converged test cluster running Ovirt 4.3.3.7 and gluster 6.1. I was able to create the new gluster volume fine, but it’s not able to add the gluster storage domain (as either a managed gluster volume or directly entering values). The created gluster volume mounts and looks fine from the CLI. Errors in VDSM log: >>>>>> >>>>> ... >>>>>> >>>>>> 2019-05-16 10:25:09,584-0500 ERROR (jsonrpc/5) [storage.fileSD] Underlying file system doesn't supportdirect IO (fileSD:110) >>>>>> 2019-05-16 10:25:09,584-0500 INFO (jsonrpc/5) [vdsm.api] FINISH createStorageDomain error=Storage Domain target is unsupported: () from=::ffff:10.100.90.5,44732, flow_id=31d993dd, task_id=ecea28f3-60d4-476d-9ba8-b753b7c9940d (api:52) >>>>> >>>>> >>>>> The direct I/O check has failed. >>>>> >>>>> >>>>> So something is wrong in the files system. >>>>> >>>>> To confirm, you can try to do: >>>>> >>>>> dd if=/dev/zero of=/path/to/mountoint/test bs=4096 count=1 oflag=direct >>>>> >>>>> This will probably fail with: >>>>> dd: failed to open '/path/to/mountoint/test': Invalid argument >>>>> >>>>> If it succeeds, but oVirt fail to connect to this domain, file a bug and we will investigate. >>>>> >>>>> Nir >>>> >>>> >>>> Yep, it fails as expected. Just to check, it is working on pre-existing volumes, so I poked around at gluster settings for the new volume. It has network.remote-dio=off set on the new volume, but enabled on old volumes. After enabling it, I’m able to run the dd test: >>>> >>>> [root@boneyard mnt]# gluster vol set test network.remote-dio enable >>>> volume set: success >>>> [root@boneyard mnt]# dd if=/dev/zero of=testfile bs=4096 count=1 oflag=direct >>>> 1+0 records in >>>> 1+0 records out >>>> 4096 bytes (4.1 kB) copied, 0.0018285 s, 2.2 MB/s >>>> >>>> I’m also able to add the storage domain in ovirt now. >>>> >>>> I see network.remote-dio=enable is part of the gluster virt group, so apparently it’s not getting set by ovirt duding the volume creation/optimze for storage? >>>> >>>> >>>> >>>> _______________________________________________ >>>> Users mailing list -- users(a)ovirt.org >>>> To unsubscribe send an email to users-leave(a)ovirt.org >>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives: >>>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/OPBXHYOHZA4XR… >>>> >>>> _______________________________________________ >>>> Users mailing list -- users(a)ovirt.org >>>> To unsubscribe send an email to users-leave(a)ovirt.org >>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B7K24XYG3M43C… >>> >>> >>> >>> -- >>> >>> >>> Thanks, >>> Gobinda

1 0

Re: [ovirt-announce] Re: [ANN] oVirt 4.3.4 First Release Candidate is now available
by Strahil 19 May '19

19 May '19

This is my previous e-mail: On May 16, 2019 15:23, Strahil Nikolov <hunter86_bg(a)yahoo.com> wrote: It seems that the issue is within the 'dd' command as it stays waiting for input: [root@ovirt1 mnt]# /usr/bin/dd iflag=fullblock of=file oflag=direct,seek_bytes seek=1048576 bs=256512 count=1 conv=notrunc,nocreat,fsync ^C0+0 records in 0+0 records out 0 bytes (0 B) copied, 19.3282 s, 0.0 kB/s Changing the dd command works and shows that the gluster is working: [root@ovirt1 mnt]# cat /dev/urandom | /usr/bin/dd of=file oflag=direct,seek_bytes seek=1048576 bs=256512 count=1 conv=notrunc,nocreat,fsync 0+1 records in 0+1 records out 131072 bytes (131 kB) copied, 0.00705081 s, 18.6 MB/s Best Regards, Strahil Nikolov ----- Препратено съобщение ----- От: Strahil Nikolov <hunter86_bg(a)yahoo.com> До: Users <users(a)ovirt.org> Изпратено: четвъртък, 16 май 2019 г., 5:56:44 ч. Гринуич-4 Тема: ovirt 4.3.3.7 cannot create a gluster storage domain Hey guys, I have recently updated (yesterday) my platform to latest available (v4.3.3.7) and upgraded to gluster v6.1 .The setup is hyperconverged 3 node cluster with ovirt1/gluster1 & ovirt2/gluster2 as replica nodes (glusterX is for gluster communication) while ovirt3 is the arbiter. Today I have tried to add new domain storages but they fail with the following: 2019-05-16 10:15:21,296+0300 INFO (jsonrpc/2) [vdsm.api] FINISH createStorageDomain error=Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/glusterSD/gluster1:_data__fast2/591d9b61-5c7d-4388-a6b7-ab03181dff8a/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/glusterSD/gluster1:_data__fast2/591d9b61-5c7d-4388-a6b7-ab03181dff8a/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.0138582 s, 0.0 kB/s\n" from=::ffff:192.168.1.2,43864, flow_id=4a54578a, task_id=d2535d0f-c7f7-4f31-a10f-704923ce1790 (api:52) 2019-05-16 10:15:21,296+0300 ERROR (jsonrpc/2) [storage.TaskManager.Task] (Task='d2535d0f-c7f7-4f31-a10f-704923ce1790') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in createStorageDomain File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2614, in createStorageDomain storageType, domVersion, block_size, alignment) File "/usr/lib/python2.7/site-packages/vdsm/storage/nfsSD.py", line 106, in create block_size) File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 466, in _prepareMetadata cls.format_external_leases(sdUUID, xleases_path) File "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 1255, in format_external_leases xlease.format_index(lockspace, backend) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 681, in format_index index.dump(file) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 843, in dump file.pwrite(INDEX_BASE, self._buf) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 1076, in pwr It seems that the 'dd' is having trouble checking the new gluster volume. The output is from the RC1 , but as you see Darell's situation is maybe the same.On May 16, 2019 21:41, Nir Soffer <nsoffer(a)redhat.com> wrote: > > On Thu, May 16, 2019 at 8:38 PM Darrell Budic <budic(a)onholyground.com> wrote: >> >> I tried adding a new storage domain on my hyper converged test cluster running Ovirt 4.3.3.7 and gluster 6.1. I was able to create the new gluster volume fine, but it’s not able to add the gluster storage domain (as either a managed gluster volume or directly entering values). The created gluster volume mounts and looks fine from the CLI. Errors in VDSM log: >> > ... >> >> 2019-05-16 10:25:09,584-0500 ERROR (jsonrpc/5) [storage.fileSD] Underlying file system doesn't supportdirect IO (fileSD:110) >> 2019-05-16 10:25:09,584-0500 INFO (jsonrpc/5) [vdsm.api] FINISH createStorageDomain error=Storage Domain target is unsupported: () from=::ffff:10.100.90.5,44732, flow_id=31d993dd, task_id=ecea28f3-60d4-476d-9ba8-b753b7c9940d (api:52) > > > The direct I/O check has failed. > > This is the code doing the check: > > 98 def validateFileSystemFeatures(sdUUID, mountDir): > 99 try: > 100 # Don't unlink this file, we don't have the cluster lock yet as it > 101 # requires direct IO which is what we are trying to test for. This > 102 # means that unlinking the file might cause a race. Since we don't > 103 # care what the content of the file is, just that we managed to > 104 # open it O_DIRECT. > 105 testFilePath = os.path.join(mountDir, "__DIRECT_IO_TEST__") > 106 oop.getProcessPool(sdUUID).directTouch(testFilePath) > 107 except OSError as e: > 108 if e.errno == errno.EINVAL: > 109 log = logging.getLogger("storage.fileSD") > 110 log.error("Underlying file system doesn't support"

4 3

Re: Gluster VM image Resync Time
by Strahil 18 May '19

18 May '19

By default ovirt uses 'sharding' which splits the files into logical chunks. This greatly reduces healing time, as VM's disk is not always completely overwritten and only the shards that are different will be healed. Maybe you should change the default shard size. Best Regards, Strahil NikolovOn Mar 27, 2019 08:24, Indivar Nair <indivar.nair(a)techterra.in> wrote: > > Hi All, > > We are planning a 2 + 1 arbitrated mirrored Gluster setup. > We would have around 50 - 60 VMs, with an average 500GB disk size. > > Now in case one of the Gluster Nodes go completely out of sync, roughly, how long would it take to resync? (as per your experience) > Will it impact the working of VMs in any way? > Is there anything to be taken care of, in advance, to prepare for such a situation? > > Regards, > > > Indivar Nair >

4 7

Any plans for oVirt and SBD fencing (a.k.a. poison pill)
by hunter86_bg＠yahoo.com 18 May '19

18 May '19

Hello Community, Do you have any idea if SBD fencing mechanism will be implemented in the nearest future? It will be nice to be able to resset a host just like corosync/pacemaker cluster implementation.

4 3

HostedEngine Deployment fails activating NFS Storage Domain hosted_storage via GUI Step 4
by Ralf Schenk 17 May '19

17 May '19

Hello, I'm deploying HostedEngine to a NFS Storage. HostedEngineLocal ist setup and running already. But Step 4 (Moving to hosted_storage Domain on NFS) fails. The Host ist Node-NG 4.3.3.1 based. The intended NFS Domain gets mounted in the host but activation (I think via EngineAPI fails): [ INFO ] TASK [ovirt.hosted_engine_setup : Activate storage domain] [ ERROR ] Error: Fault reason is "Operation Failed". Fault detail is "[]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[]\". HTTP response code is 400."} mount in host shows: storage.rxmgmt.databay.de:/ovirt/hosted_storage on /rhev/data-center/mnt/storage.rxmgmt.databay.de:_ovirt_hosted__storage type nfs4 (rw,relatime,vers=4.1,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,timeo=600,retrans=6,sec=sys,clientaddr=172.16.252.231,local_lock=none,addr=172.16.252.3) I also sshd into the locally running engine vi 192.168.122.XX and the VM can mount the storage domain, too: [root@engine01 ~]# mount storage.rxmgmt.databay.de:/ovirt/hosted_storage /mnt/ -o vers=4.1 [root@engine01 ~]# mount | grep nfs sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) storage.rxmgmt.databay.de:/ovirt/hosted_storage on /mnt type nfs4 (rw,relatime,vers=4.1,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.122.71,local_lock=none,addr=172.16.252.3) [root@engine01 ~]# ls -al /mnt/ total 18 drwxrwxr-x. 3 vdsm kvm 4 Apr 30 12:59 . dr-xr-xr-x. 17 root root 224 Apr 16 14:31 .. drwxr-xr-x. 4 vdsm kvm 4 Apr 30 12:40 4dc42146-b3fb-47ec-bf06-8d9bf7cdf893 -rwxr-xr-x. 1 vdsm kvm 0 Apr 30 12:55 __DIRECT_IO_TEST__ Anything I can do ? Log-Extract of ovirt-hosted-engine-setup-ansible-create_storage_domain included. -- *Ralf Schenk* fon +49 (0) 24 05 / 40 83 70 fax +49 (0) 24 05 / 40 83 759 mail *rs(a)databay.de* <mailto:rs@databay.de> *Databay AG* Jens-Otto-Krag-Straße 11 D-52146 Würselen *www.databay.de* <http://www.databay.de> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202 Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns Aufsichtsratsvorsitzender: Wilhelm Dohmen ------------------------------------------------------------------------

3 9

Re: Host needs to be reinstalled after configuring power management
by Michael Watters 17 May '19

17 May '19

Same here. The ssh host keys on our host nodes never change but there must be something in the ovirt database that needs to be updated. On 5/16/19 6:20 PM, Andrew DeMaria wrote: > That did the trick, thank you! That is really strange behavior however > considering the fingerprint did not change.. > > On Thu, May 16, 2019 at 7:14 AM Michael Watters <wattersm(a)watters.ws > <mailto:wattersm@watters.ws>> wrote: > > Had the same message on our cluster. The solution was to click > edit on each host and refetch the ssh host key. I'm not sure why > this is necessary in the first place however. > > > On 5/14/19 3:15 PM, Andrew DeMaria wrote: >> Hi, >> >> I am running ovirt 4.3 and have found the following action item >> immediately after configuring power management for a host: >> >> Host needs to be reinstalled as important configuration changes >> were applied on it. >> >> >> The thing is - I've just freshly installed this host and it seems >> strange that I need to reinstall it. >> Is there a better way to install a host and configure power >> management without having to reinstall it after? >> >> >> Thanks, >> >> Andrew >> >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> >> To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org> >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/5HMTDLIYVJJEP… > _______________________________________________ > Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> > To unsubscribe send an email to users-leave(a)ovirt.org > <mailto:users-leave@ovirt.org> > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/P6NHGE2EJ7PYH… >

1 0

Re: Dropped RX Packets
by Karli Sjöberg 17 May '19

17 May '19

1 0

Re: seal a rhel8 vm for templating fails
by Strahil 16 May '19

16 May '19

Can you try on a linux host to seal the VM via virt-sysprep ? Maybe virt-sysprep is not EL 8 ready... Best Regards, Strahil NikolovOn May 16, 2019 19:15, Nathanaël Blanchet <blanchet(a)abes.fr> wrote: > > Hi, > > I was used to successfully seal some el7 vms when templating, but with > rhel8, it always fails with that logs: > > 2019-05-16 15:45:03,499+02 ERROR > [org.ovirt.engine.core.bll.AddVmTemplateCommand] > (EE-ManagedThreadFactory-engineScheduled-Thread-55) > [db02e602-4b9d-4935-908c-e9e8c90a808b] Ending command > 'org.ovirt.engine.core.bll.AddVmTemplateCommand' with failure. > 2019-05-16 15:45:03,533+02 INFO > [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] > (EE-ManagedThreadFactory-engineScheduled-Thread-55) > [db02e602-4b9d-4935-908c-e9e8c90a808b] START, SetVmStatusVDSCommand( > SetVmStatusVDSCommandParameters:{vmId='b79d8d62-212a-4f62-b236-3be6f1ed251e', > status='Down', exitStatus='Normal'}), log id: 7e657121 > 2019-05-16 15:45:03,538+02 INFO > [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] > (EE-ManagedThreadFactory-engineScheduled-Thread-55) > [db02e602-4b9d-4935-908c-e9e8c90a808b] FINISH, SetVmStatusVDSCommand, > log id: 7e657121 > 2019-05-16 15:45:03,546+02 INFO > [org.ovirt.engine.core.bll.AddVmTemplateCommand] > (EE-ManagedThreadFactory-engineScheduled-Thread-55) > [db02e602-4b9d-4935-908c-e9e8c90a808b] Lock freed to object > 'EngineLock:{exclusiveLocks='[rhel8.0=TEMPLATE_NAME, > 8fb93ef2-d8a1-4d95-afed-c37131312462=TEMPLATE, > 3ae1ad71-193b-4222-9727-159b402fef49=DISK]', > sharedLocks='[b79d8d62-212a-4f62-b236-3be6f1ed251e=VM]'}' > 2019-05-16 15:45:03,560+02 ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engineScheduled-Thread-55) > [db02e602-4b9d-4935-908c-e9e8c90a808b] EVENT_ID: > USER_ADD_VM_TEMPLATE_SEAL_FAILURE(1,324), Failed to seal Template > rhel8.0 (VM: thym-rhel8). > > But I successfully make a el8 template without sealing, but the issue is > that subscription-manager doesn't activate properly when creating new > vms from it. > > ovirt 3.3.3 > > -- > Nathanaël Blanchet > > Supervision réseau > Pôle Infrastrutures Informatiques > 227 avenue Professeur-Jean-Louis-Viala > 34193 MONTPELLIER CEDEX 5 > Tél. 33 (0)4 67 54 84 55 > Fax 33 (0)4 67 54 84 14 > blanchet(a)abes.fr > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/OO7EGM25KWGV5…

2 1

Dropped RX Packets
by Magnus Isaksson 16 May '19

16 May '19

Hello all! I'm having quite some trouble with VMs that have a large amount of dropped packets on RX. This, plus customers complain about short dropped connections, for example one customer has a SQL server and an other serevr connecting to it, and it is randomly dropping connections. Before they moved their VM:s to us they did not have any of these issues. Does anyone have an idea of what this can be due to? And how can i fix it? It is starting to be a deal breaker for our customers on whether they will stay with us or not. I was thinking of reinstalling the nodes with oVirt Node, instead of the full CentOS, would this perhaps fix the issue? The enviroment is: Huawei x6000 with 4 nodes Each node having Intel X722 network card and connecting with 10G (fiber) to a Juniper EX 4600. Storage via FC to a IBM FS900. Each node is running a full CentOS 7.6 connecting to a Engine 4.2.8.2 Regards Magnus

4 4

seal a rhel8 vm for templating fails
by Nathanaël Blanchet 16 May '19

16 May '19

Hi, I was used to successfully seal some el7 vms when templating, but with rhel8, it always fails with that logs: 2019-05-16 15:45:03,499+02 ERROR [org.ovirt.engine.core.bll.AddVmTemplateCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-55) [db02e602-4b9d-4935-908c-e9e8c90a808b] Ending command 'org.ovirt.engine.core.bll.AddVmTemplateCommand' with failure. 2019-05-16 15:45:03,533+02 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-55) [db02e602-4b9d-4935-908c-e9e8c90a808b] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameters:{vmId='b79d8d62-212a-4f62-b236-3be6f1ed251e', status='Down', exitStatus='Normal'}), log id: 7e657121 2019-05-16 15:45:03,538+02 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-55) [db02e602-4b9d-4935-908c-e9e8c90a808b] FINISH, SetVmStatusVDSCommand, log id: 7e657121 2019-05-16 15:45:03,546+02 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-55) [db02e602-4b9d-4935-908c-e9e8c90a808b] Lock freed to object 'EngineLock:{exclusiveLocks='[rhel8.0=TEMPLATE_NAME, 8fb93ef2-d8a1-4d95-afed-c37131312462=TEMPLATE, 3ae1ad71-193b-4222-9727-159b402fef49=DISK]', sharedLocks='[b79d8d62-212a-4f62-b236-3be6f1ed251e=VM]'}' 2019-05-16 15:45:03,560+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-55) [db02e602-4b9d-4935-908c-e9e8c90a808b] EVENT_ID: USER_ADD_VM_TEMPLATE_SEAL_FAILURE(1,324), Failed to seal Template rhel8.0 (VM: thym-rhel8). But I successfully make a el8 template without sealing, but the issue is that subscription-manager doesn't activate properly when creating new vms from it. ovirt 3.3.3 -- Nathanaël Blanchet Supervision réseau Pôle Infrastrutures Informatiques 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

1 0

Re: oVirt Open Source Backup solution?
by Strahil 16 May '19

16 May '19

Derek, That's risky. Just read lock the DB, create the lvm snapshot and release the lock. Otherwise you risk a transaction to be interrupted. Best Regards, Strahil NikolovOn May 13, 2019 16:47, Derek Atkins <derek(a)ihtfp.com> wrote: > > Strahil <hunter86_bg(a)yahoo.com> writes: > > > Another option is to create a snapshot, backup the snapahot and merge > > the disks (delete the snapshot actually). > > Sadly that option doesn't work with Databases, as you might inyerrupt > > a transaction and leave the DB in inconsistent state. > > Yet another reason to do it from inside the VM. > > What I do (on systems that have a running database) is to run a "flush" > operation to sync the database to disk, and then from within the flush > operation I create an LVM snapshot, and then I backup off the snapshot. > If I'm not running a database, then I just create the snapshot directly. > > > Best Regards, > > Strahil Nikolov > > -derek > -- > Derek Atkins 617-623-3745 > derek(a)ihtfp.com www.ihtfp.com > Computer and Internet Security Consultant > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JS6YVB3S33VYL…

4 6

oVirt Open Source Backup solution?
by michael＠wanderingmad.com 16 May '19

16 May '19

Is there a good low to no-cost solution to backup oVirt and the virtual machines? I've been unabel to find something that will do a direct VM backup instead of a backup agent installed on VM

6 6

[ANN] oVirt 4.3.4 First Release Candidate is now available
by Sandro Bonazzola 16 May '19

16 May '19

The oVirt Project is pleased to announce the availability of the oVirt 4.3.4 First Release Candidate, as of May 16th, 2019. This update is a release candidate of the fourth in a series of stabilization updates to the 4.3 series. This is pre-release software. This pre-release should not to be used inproduction. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later * oVirt Node 4.3 (available for x86_64 only) Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included. See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Node is already available[2] Additional Resources: * Read more about the oVirt 4.3.4 release highlights: http://www.ovirt.org/release/4.3.4/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.4/ [2] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://redhat.com/summit>

1 0

Cluster Un-stable since power outage
by Alan G 16 May '19

16 May '19

Hi, We have a dev cluster running 4.2. It had to be powered down as the building was going to loose power. Since we've brought it back up it has been massively un-stable (Hosts constantly switching state, VMs migrating all the time). I now have one host running (with HE) and all others in maintenance mode. When I try activate another host i see storage errors in vdsm.log 2019-05-07 09:41:00,114+0000 ERROR (monitor/a98c0b4) [storage.Monitor] Error checking domain a98c0b42-47b9-4632-8b54-0ff3bd80d4c2 (monitor:424) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 416, in _checkDomainStatus masterStats = self.domain.validateMaster() File "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 941, in validateMaster if not self.validateMasterMount(): File "/usr/lib/python2.7/site-packages/vdsm/storage/blockSD.py", line 1377, in validateMasterMount return mount.isMounted(self.getMasterDir()) File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 161, in isMounted getMountFromTarget(target) File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 173, in getMountFromTarget for rec in _iterMountRecords(): File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 143, in _iterMountRecords for rec in _iterKnownMounts(): File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 139, in _iterKnownMounts yield _parseFstabLine(line) File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 81, in _parseFstabLine fs_spec = fileUtils.normalize_path(_unescape_spaces(fs_spec)) File "/usr/lib/python2.7/site-packages/vdsm/storage/fileUtils.py", line 94, in normalize_path host, tail = address.hosttail_split(path) File "/usr/lib/python2.7/site-packages/vdsm/common/network/address.py", line 43, in hosttail_split raise HosttailError('%s is not a valid hosttail address:' % hosttail) HosttailError: :/ is not a valid hosttail address: Not sure if it's related but since the restart the hosted_storage domain has been elected the master domain. I'm a bit stuck at the moment. My only idea is to remove HE and switch to a standalone Engine VM running outside the cluster. Thanks, Alan

2 2

Old mailing list SPAM
by Markus Stockhausen 16 May '19

16 May '19

Hi, does anyone currently get old mails of 2016 from the mailing list? We are spammed with something like this from teknikservice.nu: ... Received: from mail.ovirt.org (localhost [IPv6:::1]) by mail.ovirt.org (Postfix) with ESMTP id A33EA46AD3; Tue, 14 May 2019 14:48:48 -0400 (EDT) Received: by mail.ovirt.org (Postfix, from userid 995) id D283A407D0; Tue, 14 May 2019 14:42:29 -0400 (EDT) Received: from bauhaus.teknikservice.nu (smtp.teknikservice.nu [81.216.61.60]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.ovirt.org (Postfix) with ESMTPS id BF954467FE for <users(a)ovirt.org>; Tue, 14 May 2019 14:36:54 -0400 (EDT) Received: by bauhaus.teknikservice.nu (Postfix, from userid 0) id 259822F504; Tue, 14 May 2019 20:32:33 +0200 (CEST) <----- 3 YEAR TIME WARP ? Received: from washer.actnet.nu (washer.actnet.nu [212.214.67.187]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by bauhaus.teknikservice.nu (Postfix) with ESMTPS id 430FEDA541 for <ricky(a)schneberger.se>; Thu, 6 Oct 2016 18:02:51 +0200 (CEST) Received: from lists.ovirt.org (lists.ovirt.org [173.255.252.138]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by washer.actnet.nu (Postfix) with ESMTPS id D75A82293FC for <ricky(a)schneberger.se>; Thu, 6 Oct 2016 18:04:11 +0200 (CEST) ... Markus

6 5

[Users] Problem Creating "oVirtEngine" Machine
by Richie＠HIP 15 May '19

15 May '19

--Apple-Mail=_DF4BF6D1-1F87-4F60-9CF9-070D4D836241 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 I can't agree with you more. Modifying every box's or Virtual Machine's = HOSTS file with a FQDN and IP SHOULD work, but in my case it is not. = There are several reasons I've come to believe could be the problem = during my trial-and-errors testing and learning. FIRST - MACHINE IPs. THe machine's "Names" where not appearing in the Microsoft Active = Directory DHCP along with their assigned IPs; in other words, the DHCP = just showed an "Assigned IP", equal to the Linux Machine's IP, with a = <empty> ('i.e. blank, none, silch, plan old "no-letters-or-numbers") = "Name" in the "Name" (i.e. machines "network name", or FQDN-value used = by the Windows AD DNS-service) column. =20 if your IP is is appearing with an <empty> "name", there is no "host = name" to associate the IP, it makes it difficult to define a FQDN; which = isn't that useful if we're going to use the HOSTS files in all = participating machines in an oVirt Installation. I kept banging my head for three (3) long hours trying to find the = problem. In Fedora 18, I could't find where the "network name" of the machine = could be defined. =20 I tried putting the "Additional Search Domains" and/or "DHCP Client ID" = in Fedora's 18 Desktop - under "System Settings > Hardware > Network > = Options > IPv4 Setting" The DHCP went crazy; showing an "Aberrant-MAC-Address" (i.e. a really = long-sting value where the machine's MAC address should be), and we knew = the MAC address as we obtained using "ifconfig" on the machine getting = it's IP from the DHCP. So we reverted these entries from the = aforementioned, rebooted, and got an assigned IP, with proper MAC = address, but still no "Name" Kept wondering around the "Settings" and seeing which one made sense, = but what the heck, I went for it. =20 Under "System Settings > System > Details" I found the information about = GNOME and the machine's hardware. =20 There was a field for "Device Name" that originally had = "localhost.localdomain"; I changed the value to "ovirtmanager". and = under "Graphic" changed to "Forced Fallback Mode" to "ON". =20 I also installed all Kerberos libraries and client (i.e. authconfig-gtk, = authhub, authhub-client, krb5-apple-clents, krb5-auth-dialog, = krb5-workstation, pam-kcoda, pam-krb5, root-net.krb5) and rebooted VOILA=85!!! =20 I don;t know if it was the definition of "Device Name" from = "localhost.localdomain" to "ovirtengine", of the Kerberos libraries = install, or both. But finally the MS AD DHCP was showing the = Addigned-IP, the machine "Name" and the proper MAC-address. Regardless, = setting the machine's "Network Name" under "System Settings > System > = Details > Device Name", with no explanation of what "Device Name" meant = or was used for, was the last place I would have imagined this network = setting could be defined. NOTE - Somebody has to try the two steps I did together, separately. to = see which one is the real problem-solver; for me it is working, and "if = it ain't broke, don't fix it=85" Now that I have the DHCP / IP thing sorted, I have to do the DNS stuff. To this point, I've addressed the DHCP and "Network Name" of the = IP-Lease (required for the DNS to work). This still does't completely = explain why, by modifying the HOSTS file (allowing be to set and IP and = non-DNS FQDN). allows me to install the oVirtEngine "as long as I do not = use default HTTPd service parameters as suggested by the install". By = using the HOST file to "define" FQDNs, AND NOT using the default HTTPd = suggested changes, I'm able to install the oVirtEngine (given that I use = ports 8700 and 8701) to access the "oVirtEngine Welcome Screen", BUT = NONE of the "oVirt Portals" work=85 YET=85!!! More to come during the week Richie Jos=E9 E ("Richie") Piovanetti, MD, MS=20 M: 787-615-4884 | richiepiovanetti(a)healthcareinfopartners.com On Aug 2, 2013, at 3:10 AM, Joop <jvdwege(a)xs4all.nl> wrote: > Hello Ritchie, >=20 >> In a conversation via IRC, someone suggested that I activate = "dnsmask" to overcome what appears to be a DNS problem. I'll try that = other possibility once I get home later today. >>=20 >> In the mean time, what do you mean by "fixing the hostname"=85? I = opened and fixed the HOSTNAMES and changed it from = "localhost-localdomain" to "localhost.localdomain" and that made no = difference. Albeit, after changing I didm;t restart, remove ovirtEngine = ((using "engine-cleanup") and reinstalled via "engine-setup". Is that = what you mean=85? >>=20 >>=20 >>=20 >> In the mean time, the fact that even if I resolve the issue of = oVirtEngine I will not be able to connect to the oVirt Nodes unless I = have DNS resolution, apparently means I should do something with = resolving via DNS in my home LAN (i.e implement some sort of "DNS Cache" = so I can resolve my home computers via DNS inside my LAN). >>=20 >> Any suggestions are MORE THAN WELCOME=85!!! >> =20 >=20 > Having setup ovirt more than I can count right now I share your = feeling that it isn't always clear why things are going wrong, but in = this case I suspect that there is a rather small thing missing. > In short if you setup ovirt-engine, either using virtualbox or on real = hardware, and you give your host a meaningfull name AND you add that = info also in your /etc/hosts file than things SHOULD work, no need for = dnsmasq or even bind. Would make things easier once you start adding = virt hosts to you infrastructure since you will need to duplicate these = actions on each host (add engine name/ip to each host and add each host = to the others and all hosts to engine) >=20 > Just ask if you need more assistance and I will write down a small = howto that should work out of the box else I might have some time to see = if I can get things going. >=20 > Regards, >=20 > Joop >=20 --Apple-Mail=_DF4BF6D1-1F87-4F60-9CF9-070D4D836241 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dwindows-1252"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">I = can't agree with you more.  Modifying every box's or Virtual = Machine's HOSTS file with a FQDN and IP SHOULD work, but in my case it = is not.  There are several reasons I've come to believe could be = the problem during my trial-and-errors testing and = learning.<div><div><br></div><div>FIRST - MACHINE IPs.</div><ul = class=3D"MailOutline"><li>THe machine's "Names" where not appearing in = the <b>Microsoft Active Directory DHCP</b> along with their assigned = IPs; in other words, the DHCP just showed an "Assigned IP", equal to the = Linux Machine's IP, with a <empty> ('i.e. blank, none, silch, plan = old "no-letters-or-numbers") "Name" in the "Name" (i.e. machines = "network name", or FQDN-value used by the Windows AD DNS-service) = column.  </li><li>if your IP is is appearing with an <empty> = "name", there is no "host name" to associate the IP, it makes it = difficult to define a FQDN; which isn't that useful if we're going to = use the HOSTS files in all participating machines in an oVirt = Installation.</li><li>I kept banging my head for three (3) long hours = trying to find the problem.</li><ul><li>In Fedora 18, I could't find = where the "network name" of the machine could be defined. =  </li><li>I tried putting the "Additional Search Domains" and/or = "DHCP Client ID" in Fedora's 18 Desktop - under "System Settings > = Hardware > Network > Options > IPv4 Setting"</li><ul><li>The = DHCP went crazy;  showing an "Aberrant-MAC-Address" (i.e. a really = long-sting value where the machine's MAC address should be), and we knew = the MAC address as we obtained using "ifconfig" on the machine getting = it's IP from the DHCP.  So we reverted these entries from the = aforementioned, rebooted, and got an assigned IP, with proper MAC = address, but still no "Name"</li></ul><li>Kept wondering around the = "Settings" and seeing which one made sense, but what the heck, I went = for it.  </li><ul><li>Under "System Settings > System > = Details" I found the information about GNOME and the machine's hardware. =  </li><li>There was a field for "Device Name" that originally had = "localhost.localdomain"; I changed the value to "ovirtmanager". and = under "Graphic" changed to "Forced Fallback Mode" to "ON". =  </li><li>I also installed all Kerberos libraries and client (i.e. = authconfig-gtk, authhub, authhub-client, krb5-apple-clents, = krb5-auth-dialog, krb5-workstation, pam-kcoda, pam-krb5, root-net.krb5) = and rebooted</li><li>VOILA=85!!!  </li></ul><li>I don;t know if it = was the definition of "Device Name" from "localhost.localdomain" to = "ovirtengine", of the Kerberos libraries install, or both.  But = finally the MS AD DHCP was showing the Addigned-IP, the machine "Name" = and the proper MAC-address.  Regardless, setting the machine's = "Network Name" under "System Settings > System > Details = > Device Name", with no explanation of what "Device Name" meant = or was used for, was the last place I would have imagined this = network setting could be defined.</li><li><b>NOTE</b> - Somebody has to = try the two steps I did together, separately. to see which one is the = real problem-solver; for me it is working, and "if it ain't broke, don't = fix it=85"</li></ul></ul><div><br = class=3D"webkit-block-placeholder"></div><div>Now that I have the DHCP / = IP thing sorted, I have to do the DNS stuff.</div><div><br></div><div>To = this point, I've addressed the DHCP and "Network Name" of the IP-Lease = (required for the DNS to work).  This still does't completely = explain why, by modifying the HOSTS file (allowing be to set and IP and = non-DNS FQDN). allows me to install the oVirtEngine "<b><i>as long as I = do not use default  HTTPd service parameters as suggested by the = install</i></b>".  <b>By using the HOST file to "define" FQDNs, AND = NOT using the default HTTPd suggested changes, I'm able to install the = oVirtEngine (given that I use ports 8700 and 8701) to access the = "oVirtEngine Welcome Screen", BUT NONE of the "oVirt Portals" work</b>=85 = YET=85!!!</div><div><br></div><div>More to come during the = week</div><div><br></div><div>Richie</div><div = apple-content-edited=3D"true"><br>Jos=E9 E ("Richie") Piovanetti, MD, = MS <br>M: 787-615-4884 | <a = href=3D"mailto:richiepiovanetti@healthcareinfopartners.com">richiepiovanet= ti(a)healthcareinfopartners.com</a><br><br><br><br><br><br></div><br><div><d= iv>On Aug 2, 2013, at 3:10 AM, Joop <<a = href=3D"mailto:jvdwege@xs4all.nl">jvdwege(a)xs4all.nl</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><blockquote = type=3D"cite">Hello Ritchie,<br><br><blockquote type=3D"cite">In a = conversation via IRC, someone suggested that I activate "dnsmask" to = overcome what appears to be a DNS problem.  I'll try that other = possibility once I get home later today.<br><br>In the mean time, what = do you mean by "fixing the hostname"=85?  I opened and fixed the = HOSTNAMES and changed it from "localhost-localdomain" to = "localhost.localdomain" and that made no difference.  Albeit, after = changing I didm;t restart, remove ovirtEngine ((using "engine-cleanup") = and reinstalled via "engine-setup".  Is that what you = mean=85?<br><br><br><br>In the mean time, the fact that even if I = resolve the issue of oVirtEngine I will not be able to connect to the = oVirt Nodes unless I have DNS resolution, apparently means I should do = something with resolving via DNS in my home LAN (i.e implement some sort = of "DNS Cache" so I can resolve my home computers via DNS inside my = LAN).<br><br>Any suggestions are MORE THAN WELCOME=85!!!<br> =  <br></blockquote><br>Having setup ovirt more than I can count = right now I share your feeling that it isn't always clear why things are = going wrong, but in this case I suspect that there is a rather small = thing missing.<br>In short if you setup ovirt-engine, either using = virtualbox or on real hardware, and you give your host a meaningfull = name AND you add that info also in your /etc/hosts file than things = SHOULD work, no need for dnsmasq or even bind. Would make things easier = once you start adding virt hosts to you infrastructure since you will = need to duplicate these actions on each host (add engine name/ip to each = host and add each host to the others and all hosts to = engine)<br><br>Just ask if you need more assistance and I will write = down a small howto that should work out of the box else I might have = some time to see if I can get things = going.<br><br>Regards,<br><br>Joop<br><br></blockquote></div><br></div></b= ody></html>= --Apple-Mail=_DF4BF6D1-1F87-4F60-9CF9-070D4D836241--

2 1

Re: [ovirt-users] Question about the ovirt-engine-sdk-java
by Michael Pasternak 15 May '19

15 May '19

------=_Part_1975902_834617789.1445161505459 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi=C2=A0Salifou, Actually java sdk is=C2=A0intentionally=C2=A0hiding transport level interna= ls so developers could stay in java domain,if your headers are static, easi= est way would be using reverse proxy in a middle to intercept requests,=C2= =A0 can you tell me why do you need this? =20 On Friday, October 16, 2015 1:14 AM, Salifou Sidi M. Malick <ssidimah@= redhat.com> wrote: =20 Hi Micheal, I have a question about the ovirt-engine-sdk-java. Is there a way to add custom request headers to each RHEVM API call? Here is an example of a request that I would like to do: $ curl -v -k \ =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -H "ID: user1(a)ad.xyz.com" \ =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -H "PASSWORD: Pwssd" \ =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 -H "TARGET: kobe" \ =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 https://vm0.smalick.com/api/hosts I would like to add ID, PASSWORD and TARGET as HTTP request header.=20 Thanks, Salifou ------=_Part_1975902_834617789.1445161505459 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><head></head><body><div style=3D"color:#000; background-color:#fff; f= ont-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helve= tica, Arial, Lucida Grande, sans-serif;font-size:13px"><div id=3D"yui_3_16_= 0_1_1445160422533_3555" dir=3D"ltr"><span id=3D"yui_3_16_0_1_1445160422533_= 4552">Hi </span><span style=3D"font-family: 'Helvetica Neue', 'Segoe U= I', Helvetica, Arial, 'Lucida Grande', sans-serif;" id=3D"yui_3_16_0_1_1445= 160422533_3568" class=3D"">Salifou,</span></div><div id=3D"yui_3_16_0_1_144= 5160422533_3555" dir=3D"ltr"><span style=3D"font-family: 'Helvetica Neue', = 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif;" class=3D""><br>= </span></div><div id=3D"yui_3_16_0_1_1445160422533_3555" dir=3D"ltr"><span = style=3D"font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Luci= da Grande', sans-serif;" class=3D"" id=3D"yui_3_16_0_1_1445160422533_3595">= Actually java sdk is </span><span style=3D"font-family: 'Helvetica Neu= e', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif;" id=3D"yui_3= _16_0_1_1445160422533_4360" class=3D"">intentionally </span><span styl= e=3D"font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida G= rande', sans-serif;" id=3D"yui_3_16_0_1_1445160422533_4362" class=3D"">hidi= ng transport level internals so developers could stay in java domain,</span= ></div><div id=3D"yui_3_16_0_1_1445160422533_3555" dir=3D"ltr"><span class= =3D"" id=3D"yui_3_16_0_1_1445160422533_4435"><font face=3D"Helvetica Neue, = Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" id=3D"yui_3_16_0_1_1= 445160422533_4432" class=3D"">if your headers are static, easiest way would= be using reverse proxy in a middle to intercept requests, </font><br>= </span></div><div id=3D"yui_3_16_0_1_1445160422533_3555" dir=3D"ltr"><span = class=3D""><font face=3D"Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida= Grande, sans-serif" class=3D""><br></font></span></div><div id=3D"yui_3_16= _0_1_1445160422533_3555" dir=3D"ltr"><span style=3D"font-family: 'Helvetica= Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif;" id=3D"y= ui_3_16_0_1_1445160422533_4357">can you tell me why do you need this?</span= ><br></div> <br><div class=3D"qtdSeparateBR"><br><br></div><div class=3D"y= ahoo_quoted" style=3D"display: block;"> <div style=3D"font-family: Helvetic= aNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida= Grande, sans-serif; font-size: 13px;"> <div style=3D"font-family: Helvetic= aNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-si= ze: 16px;"> <div dir=3D"ltr"> <font size=3D"2" face=3D"Arial"> On Friday, O= ctober 16, 2015 1:14 AM, Salifou Sidi M. Malick <ssidimah(a)redhat.com>= wrote:<br> </font> </div> <br><br> <div class=3D"y_msg_container">Hi Mich= eal,<br><br>I have a question about the ovirt-engine-sdk-java.<br><br>Is th= ere a way to add custom request headers to each RHEVM API call?<br><br>Here= is an example of a request that I would like to do:<br><br>$ curl -v -k \<= br>          -H "ID: <a ymailto=3D"mailto:user1@ad= .xyz.com" href=3D"mailto:user1@ad.xyz.com">user1(a)ad.xyz.com</a>" \<br>&nbsp= ;         -H "PASSWORD: Pwssd" \<br>    &nbsp= ;     -H "TARGET: kobe" \<br>          <= a href=3D"https://vm0.smalick.com/api/hosts" target=3D"_blank">https://vm0.= smalick.com/api/hosts</a><br><br><br>I would like to add ID, PASSWORD and T= ARGET as HTTP request header. <br><br>Thanks,<br>Salifou<br><br><br><br></d= iv> </div> </div> </div></div></body></html> ------=_Part_1975902_834617789.1445161505459--

2 1

[Users] oVirt Weekly Sync Meeting Minutes -- 2012-05-23
by Mike Burns 15 May '19

15 May '19

Minutes: http://ovirt.org/meetings/ovirt/2012/ovirt.2012-05-23-14.00.html Minutes (text): http://ovirt.org/meetings/ovirt/2012/ovirt.2012-05-23-14.00.txt Log: http://ovirt.org/meetings/ovirt/2012/ovirt.2012-05-23-14.00.log.html ========================= #ovirt: oVirt Weekly Sync ========================= Meeting started by mburns at 14:00:23 UTC. The full logs are available at http://ovirt.org/meetings/ovirt/2012/ovirt.2012-05-23-14.00.log.html . Meeting summary --------------- * agenda and roll call (mburns, 14:00:41) * Status of next release (mburns, 14:05:17) * LINK: https://bugzilla.redhat.com/show_bug.cgi?id=822145 (mburns, 14:05:29) * AGREED: freeze date and beta release delayed by 1 week to 2012-06-07 (mburns, 14:12:33) * post freeze, release notes flag needs to be used where required (mburns, 14:14:21) * https://bugzilla.redhat.com/show_bug.cgi?id=821867 is a VDSM blocker for 3.1 (oschreib, 14:17:27) * ACTION: dougsland to fix upstream vdsm right now, and open a bug on libvirt augeas (oschreib, 14:21:44) * LINK: https://bugzilla.redhat.com/show_bug.cgi?id=822158 (mburns, 14:23:39) * assignee not available, update to come tomorrow (mburns, 14:24:59) * ACTION: oschreib to make sure BZ#822158 is handled quickly (oschreib, 14:25:29) * LINK: https://bugzilla.redhat.com/show_bug.cgi?id=824397 (mburns, 14:28:55) * 824397 expected to be merged prior next week's meeting (mburns, 14:29:45) * LINK: https://bugzilla.redhat.com/show_bug.cgi?id=824420 (mburns, 14:30:15) * tracker for node based on F17 (mburns, 14:30:28) * blocked by util-linux bug currently (mburns, 14:30:40) * new build expected from util-linux maintainer in next couple days (mburns, 14:30:55) * sub-project status -- engine (mburns, 14:32:49) * nothing to report outside of blockers discussed above (mburns, 14:34:00) * sub-project status -- vdsm (mburns, 14:34:09) * nothing outside of blockers above (mburns, 14:35:36) * sub-project status -- node (mburns, 14:35:43) * working on f17 migration, but blocked by util-linux bug (mburns, 14:35:58) * should be ready for freeze deadline (mburns, 14:36:23) * Review decision on Java 7 and Fedora jboss rpms in oVirt Engine (mburns, 14:36:43) * Java7 basically working (mburns, 14:37:19) * LINK: http://gerrit.ovirt.org/#change,4416 (oschreib, 14:39:35) * engine will make ack/nack statement next week (mburns, 14:39:49) * fedora jboss rpms patch is in review, short tests passed (mburns, 14:40:04) * engine ack on fedora jboss rpms and java7 needed next week (mburns, 14:44:47) * Upcoming Workshops (mburns, 14:45:11) * NetApp workshop set for Jan 22-24 2013 (mburns, 14:47:16) * already at half capacity for Workshop at LinuxCon Japan (mburns, 14:47:37) * please continue to promote it (mburns, 14:48:19) * proposal: board meeting to be held at all major workshops (mburns, 14:48:43) * LINK: http://www.ovirt.org/wiki/OVirt_Global_Workshops (mburns, 14:49:30) * Open Discussion (mburns, 14:50:12) * oVirt/Quantum integration discussion will be held separately (mburns, 14:50:43) Meeting ended at 14:52:47 UTC. Action Items ------------ * dougsland to fix upstream vdsm right now, and open a bug on libvirt augeas * oschreib to make sure BZ#822158 is handled quickly Action Items, by person ----------------------- * dougsland * dougsland to fix upstream vdsm right now, and open a bug on libvirt augeas * oschreib * oschreib to make sure BZ#822158 is handled quickly * **UNASSIGNED** * (none) People Present (lines said) --------------------------- * mburns (98) * oschreib (55) * doronf (12) * lh (11) * sgordon (8) * dougsland (8) * ovirtbot (6) * ofrenkel (4) * cestila (2) * RobertMdroid (2) * ydary (2) * rickyh (1) * yzaslavs (1) * cctrieloff (1) * mestery_ (1) * dustins (1) Generated by `MeetBot`_ 0.1.4 .. _`MeetBot`: http://wiki.debian.org/MeetBot

2 1

[QE][ACTION REQUIRED] oVirt 3.5.1 RC status - postponed
by Sandro Bonazzola 15 May '19

15 May '19

Hi, We have still blockers for oVirt 3.5.1 RC release so we need to postpone it until they'll be fixed. The bug tracker [1] shows 1 open blocker: Bug ID Whiteboard Status Summary 1160846 sla NEW Can't add disk to VM without specifying disk profile when the storage domain has more than one disk profile In order to stabilize the release a new branch ovirt-engine-3.5.1 will be created from the same git hash used for composing the RC. - ACTION: Gilad please provide ETA on above blocker, the new proposed RC date will be decided on the given ETA. Maintainers: - Please be sure that 3.5 snapshot allow to create VMs - Please be sure that no pending patches are going to block the release - If any patch must block the RC release please raise the issue as soon as possible. There are still 57 bugs [2] targeted to 3.5.1. Excluding node and documentation bugs we still have 37 bugs [3] targeted to 3.5.1. Maintainers / Assignee: - Please add the bugs to the tracker if you think that 3.5.1 should not be released without them fixed. - ACTION: Please update the target to 3.5.2 or later for bugs that won't be in 3.5.1: it will ease gathering the blocking bugs for next releases. - ACTION: Please fill release notes, the page has been created here [4] Community: - If you're testing oVirt 3.5 nightly snapshot, please add yourself to the test page [5] [1] http://bugzilla.redhat.com/1155170 [2] http://goo.gl/7G0PDV [3] http://goo.gl/6gUbVr [4] http://www.ovirt.org/OVirt_3.5.1_Release_Notes [5] http://www.ovirt.org/Testing/oVirt_3.5.1_Testing -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 1

Re: New to OVirt
by Joop 15 May '19

15 May '19

On 14-5-2019 06:32, Slobodan Stevanovic wrote: > I downloaded oVirt_Node ISO and deployed it to the servers. Than, I > used the following instructions > > https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Deploying_H… > > At first, I tried to deploy gluster to three servers, but it was > giving me some issues on one of them. So, I used that document as a > guide line for single deployment. > > After, the gluster was done I clicked on OVirt Engine setup wizard. I > filled out the info so it can be deployed on the same server. However, > the installation never finishes successfully. > > I can see that the host has a new virtual machine running, but it does > not get the IP address from the wizard. The VM gets the IP from the > newly created subnet. > > > On Monday, May 13, 2019, 11:09:43 AM PDT, Joop <jvdwege(a)xs4all.nl> wrote: > > > On 10-5-2019 19:20, Slobodan Stevanovic wrote: >> >> I am having hard time installing OVIrt. >> >> Gluster deployment for the single node sometimes work, but host >> engine deployment never works. >> >> >> Any one has suggestion on which release of OVirt to use as a beginner. >> >> > Could you tell what problems you're having and what documentation > you're following? > > I just did a hyperconverged hosted-engine setup on a single server > using the cockpit installer and had just 2 problems: > - firewall-cmd uses glusterfs as a service name and that isn't > installed, its in glusterfs-server rpm but that isn't installed for > some reason. > - multipath problems but that could be my problem, anyway I manually > blacklisted both my SSD gluster drives. > > Going todo it tomorrow again to get a collegue to work on it so if > anything comes up I'll post it here. So I did the same routine today and followed this piece of documentation: https://www.ovirt.org/download/ --> Install oVirt with Cockpit Used a std Centos minimal install, used a fixed IP address with a DNS A record and a PTR record, made one for the engine too!!, ran yum update, reboot Add the ovirt-release43 repo sudo yum install cockpit cockpit-ovirt-dashboard -y sudo yum install glusterfs-server -y # this seemed to miss but includes the firewalld glusterfs service name.! sudo systemctl enable --now cockpit.socket sudo firewall-cmd --add-service=cockpit sudo firewall-cmd --add-service=cockpit --permanent sudo yum install ansible-glusterfs-roles #??? not sure about the exact name but use yum info *ansiblie* | grep ^Name | sort to find it. Wizard needs them. login into cockpit Select the gluster HCI wizard instead of the HostedEngine one and follow the instructions to the t, use fixed IP adresses which DO have a DNS entry, saves you a lot of hair pulling. Joop

2 1

VM has paused due to no storage space error
by Sandvik Agustin 15 May '19

15 May '19

Hi users, I have this problem that sometimes 1 to 3 VM just automatically paused with user interaction and getting this error "VM has paused due to no storage space error". any inputs from you guys are very appreciated. TIA Sandvik

5 5

VM Import from remote libvirt Server on web gui with Host key verification failed or permission denied error
by Rogério Ceni Coelho 15 May '19

15 May '19

Hi Ovirt Jedi´s !!! First of all, congratulations for this amazing product. I am an Vmware and Hyper-V Engineer but i am very excited with oVirt. Now, let´s go to work ... :-) I am trying to Import vm from remote libvirt server on web gui but i was unable to solve the problem until now. [image: pasted1] Node logs : [root@hlg-rbs-ovirt-kvm01-poa ~]# tail -f /var/log/vdsm/vdsm.log | grep -i error | grep -v Host.getStats jsonrpc.Executor/0::ERROR::2016-10-06 10:24:52,432::v2v::151::root::(get_external_vms) error connection to hypervisor: 'Cannot recv data: Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer' jsonrpc.Executor/0::INFO::2016-10-06 10:24:52,433::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC call Host.getExternalVMs failed (error 65) in 10.05 seconds [root@hlg-rbs-ovirt-kvm02-poa ~]# grep error /var/log/vdsm/vdsm.log | grep get_external_vms jsonrpc.Executor/7::ERROR::2016-10-06 10:25:37,344::v2v::151::root::(get_external_vms) error connection to hypervisor: 'Cannot recv data: Host key verification failed.: Connection reset by peer' [root@hlg-rbs-ovirt-kvm02-poa ~]# Engine Logs : [root@hlg-rbs-ovirt01-poa ~]# tail -f /var/log/ovirt-engine/engine.log 2016-10-06 10:24:42,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] START, GetVmsFromExternalProviderVDSCommand(HostName = hlg-rbs-ovirt-kvm01-poa.rbs.com.br, GetVmsFromExternalProviderParameters:{runAsync='true', hostId='5feddfba-d7b2-423e-a946-ac2bf36906fa', url='qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system', username='root', originType='KVM'}), log id: eb750c7 *2016-10-06 10:24:53,435 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] Unexpected return value: StatusForXmlRpc [code=65, message=Cannot recv data: Permission denied, please try again.* *Permission denied, please try again.* *Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer]* 2016-10-06 10:24:53,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] Failed in 'GetVmsFromExternalProviderVDS' method 2016-10-06 10:24:53,435 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] Unexpected return value: StatusForXmlRpc [code=65, message=Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer] 2016-10-06 10:24:53,454 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-97) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM hlg-rbs-ovirt-kvm01-poa.rbs.com.br command failed: Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer 2016-10-06 10:24:53,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand' return value 'org.ovirt.engine.core.vdsbroker.vdsbroker.VMListReturnForXmlRpc@6c6f696c' 2016-10-06 10:24:53,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] HostName = hlg-rbs-ovirt-kvm01-poa.rbs.com.br 2016-10-06 10:24:53,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] Command 'GetVmsFromExternalProviderVDSCommand(HostName = hlg-rbs-ovirt-kvm01-poa.rbs.com.br, GetVmsFromExternalProviderParameters:{runAsync='true', hostId='5feddfba-d7b2-423e-a946-ac2bf36906fa', url='qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system', username='root', originType='KVM'})' execution failed: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer, code = 65 2016-10-06 10:24:53,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-97) [] FINISH, GetVmsFromExternalProviderVDSCommand, log id: eb750c7 2016-10-06 10:24:53,459 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-97) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to retrieve VMs information from external server qemu+ssh://root@prd-openshift-kvm03-poa.rbs.com.br/system 2016-10-06 10:24:53,459 ERROR [org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery] (default task-97) [] Query 'GetVmsFromExternalProviderQuery' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer, code = 65 (Failed with error unexpected and code 16) 2016-10-06 10:24:53,460 ERROR [org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery] (default task-97) [] Exception: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer, code = 65 (Failed with error unexpected and code 16) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:114) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.runVdsCommand(QueriesCommandBase.java:257) [bll.jar:] at org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery.getVmsFromExternalProvider(GetVmsFromExternalProviderQuery.java:32) [bll.jar:] at org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery.executeQueryCommand(GetVmsFromExternalProviderQuery.java:27) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:103) [bll.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:558) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:529) [bll.jar:] at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:80) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:] at sun.reflect.GeneratedMethodAccessor179.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.3.2.Final.jar:2.3.2.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:243) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:66) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:195) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view3.runQuery(Unknown Source) [common.jar:] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runQuery(GenericApiGWTServiceImpl.java:53) at sun.reflect.GeneratedMethodAccessor222.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:73) [branding.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:66) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:51) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:56) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:284) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:263) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:793) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_102] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_102] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_102] 2016-10-06 10:25:27,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] START, GetVmsFromExternalProviderVDSCommand(HostName = hlg-rbs-ovirt-kvm02-poa.rbs.com.br, GetVmsFromExternalProviderParameters:{runAsync='true', hostId='f9c9d929-b460-4102-bb29-de1e6ad6ad72', url='qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system', username='root', originType='KVM'}), log id: 4f3174a6 *2016-10-06 10:25:38,338 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] Unexpected return value: StatusForXmlRpc [code=65, message=Cannot recv data: Host key verification failed.: Connection reset by peer]* 2016-10-06 10:25:38,338 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] Failed in 'GetVmsFromExternalProviderVDS' method 2016-10-06 10:25:38,338 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] Unexpected return value: StatusForXmlRpc [code=65, message=Cannot recv data: Host key verification failed.: Connection reset by peer] 2016-10-06 10:25:38,343 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-113) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM hlg-rbs-ovirt-kvm02-poa.rbs.com.br command failed: Cannot recv data: Host key verification failed.: Connection reset by peer 2016-10-06 10:25:38,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand' return value 'org.ovirt.engine.core.vdsbroker.vdsbroker.VMListReturnForXmlRpc@42dd60af' 2016-10-06 10:25:38,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] HostName = hlg-rbs-ovirt-kvm02-poa.rbs.com.br 2016-10-06 10:25:38,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] Command 'GetVmsFromExternalProviderVDSCommand(HostName = hlg-rbs-ovirt-kvm02-poa.rbs.com.br, GetVmsFromExternalProviderParameters:{runAsync='true', hostId='f9c9d929-b460-4102-bb29-de1e6ad6ad72', url='qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system', username='root', originType='KVM'})' execution failed: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Host key verification failed.: Connection reset by peer, code = 65 2016-10-06 10:25:38,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-113) [] FINISH, GetVmsFromExternalProviderVDSCommand, log id: 4f3174a6 2016-10-06 10:25:38,344 ERROR [org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery] (default task-113) [] Query 'GetVmsFromExternalProviderQuery' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Host key verification failed.: Connection reset by peer, code = 65 (Failed with error unexpected and code 16) 2016-10-06 10:25:38,345 ERROR [org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery] (default task-113) [] Exception: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Host key verification failed.: Connection reset by peer, code = 65 (Failed with error unexpected and code 16) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:114) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.runVdsCommand(QueriesCommandBase.java:257) [bll.jar:] at org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery.getVmsFromExternalProvider(GetVmsFromExternalProviderQuery.java:32) [bll.jar:] at org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery.executeQueryCommand(GetVmsFromExternalProviderQuery.java:27) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:103) [bll.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:558) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:529) [bll.jar:] at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:80) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:] at sun.reflect.GeneratedMethodAccessor179.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.3.2.Final.jar:2.3.2.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:243) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:66) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:195) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view3.runQuery(Unknown Source) [common.jar:] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runQuery(GenericApiGWTServiceImpl.java:53) at sun.reflect.GeneratedMethodAccessor222.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:73) [branding.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:66) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:51) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:56) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:284) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:263) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:793) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_102] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_102] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_102] 2016-10-06 10:25:52,527 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] START, GetVmsFromExternalProviderVDSCommand(HostName = hlg-rbs-ovirt-kvm03-poa.rbs.com.br, GetVmsFromExternalProviderParameters:{runAsync='true', hostId='02ead14e-0208-4a74-b1c2-4c19383820f9', url='qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system', username='root', originType='KVM'}), log id: 7c8b1e2d 2016-10-06 10:26:02,695 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] Unexpected return value: StatusForXmlRpc [code=65, message=Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer] 2016-10-06 10:26:02,695 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] Failed in 'GetVmsFromExternalProviderVDS' method 2016-10-06 10:26:02,696 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] Unexpected return value: StatusForXmlRpc [code=65, message=Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer] 2016-10-06 10:26:02,701 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-118) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM hlg-rbs-ovirt-kvm03-poa.rbs.com.br command failed: Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer 2016-10-06 10:26:02,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand' return value 'org.ovirt.engine.core.vdsbroker.vdsbroker.VMListReturnForXmlRpc@5ce9f7f2' 2016-10-06 10:26:02,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] HostName = hlg-rbs-ovirt-kvm03-poa.rbs.com.br 2016-10-06 10:26:02,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] Command 'GetVmsFromExternalProviderVDSCommand(HostName = hlg-rbs-ovirt-kvm03-poa.rbs.com.br, GetVmsFromExternalProviderParameters:{runAsync='true', hostId='02ead14e-0208-4a74-b1c2-4c19383820f9', url='qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system', username='root', originType='KVM'})' execution failed: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer, code = 65 2016-10-06 10:26:02,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFromExternalProviderVDSCommand] (default task-118) [] FINISH, GetVmsFromExternalProviderVDSCommand, log id: 7c8b1e2d 2016-10-06 10:26:02,701 ERROR [org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery] (default task-118) [] Query 'GetVmsFromExternalProviderQuery' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer, code = 65 (Failed with error unexpected and code 16) 2016-10-06 10:26:02,701 ERROR [org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery] (default task-118) [] Exception: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmsFromExternalProviderVDS, error = Cannot recv data: Permission denied, please try again. Permission denied, please try again. Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).: Connection reset by peer, code = 65 (Failed with error unexpected and code 16) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:114) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.runVdsCommand(QueriesCommandBase.java:257) [bll.jar:] at org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery.getVmsFromExternalProvider(GetVmsFromExternalProviderQuery.java:32) [bll.jar:] at org.ovirt.engine.core.bll.GetVmsFromExternalProviderQuery.executeQueryCommand(GetVmsFromExternalProviderQuery.java:27) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand(QueriesCommandBase.java:103) [bll.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java:558) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:529) [bll.jar:] at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:80) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:] at sun.reflect.GeneratedMethodAccessor179.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.3.2.Final.jar:2.3.2.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:243) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:66) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:195) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view3.runQuery(Unknown Source) [common.jar:] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runQuery(GenericApiGWTServiceImpl.java:53) at sun.reflect.GeneratedMethodAccessor222.invoke(Unknown Source) [:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102] at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196) at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172) at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233) at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132) at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:73) [branding.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:66) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:51) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:56) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:284) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:263) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:793) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_102] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_102] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_102] ^C [root@hlg-rbs-ovirt01-poa ~]# When i try with virsh i have sucess. [root@hlg-rbs-ovirt-kvm01-poa ~]# virsh -c qemu+ssh:// root(a)prd-openshift-kvm03-poa.rbs.com.br/system The authenticity of host 'prd-openshift-kvm03-poa.rbs.com.br (10.1.8.32)' can't be established. ECDSA key fingerprint is af:e9:12:29:65:ad:41:ab:0a:3c:a1:f0:73:1c:62:a5. Are you sure you want to continue connecting (yes/no)? yes root(a)prd-openshift-kvm03-poa.rbs.com.br's password: Welcome to virsh, the virtualization interactive terminal. Type: 'help' for help with commands 'quit' to quit virsh # list Id Name State ---------------------------------------------------- 5 prd-openshift-etcd03-poa running 6 prd-openshift-master03-poa running 8 prd-openshift-node03-poa running virsh # list --all Id Name State ---------------------------------------------------- 5 prd-openshift-etcd03-poa running 6 prd-openshift-master03-poa running 8 prd-openshift-node03-poa running - teste shut off - teste1 shut off - tpl-centos72-64 shut off virsh # quit [root@hlg-rbs-ovirt-kvm01-poa ~]# Thanks.

3 2

Re: Gluster volume heals and after 5 seconds has /dom_md/ids dirty again
by Strahil 15 May '19

15 May '19

Hi Darrel, Is ovirrt dealing OK with Gluster 6.X ? Best Regards, Strahil NikolovOn May 13, 2019 18:37, Darrell Budic <budic(a)onholyground.com> wrote: > > I encountered serious issues with 5.3-5.5 (crashing bricks, multiple brick processes for the same brick causing disconnects and excessive heals). I had better luck with 5.6, although it’s not clear to me if the duplicate brick process issue is still present in that version. I finally jumped to 6 which has been more stable for me. I’d recommend upgrading at least to 5.6 if not going right to 6.1. > > > On May 13, 2019, at 10:30 AM, Andreas Elvers <andreas.elvers+ovirtforum(a)solutions.work> wrote: > > > >> What version of gluster are you running at the moment? > > > > I'm running glusterfs-5.5-1.el7.x86_64 the one that comes with oVirt Node 4.3.3.1 > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/OPMOUE5FQRYF4… > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/MDCYZ6JUMJHKN…

4 3

Libvirt ERROR cannot access backing file after importing VM from OpenStack
by Vrgotic, Marko 15 May '19

15 May '19

Dear oVirt team, When trying to start imported VM, it fails with following message: ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-2) [] EVENT_ID: VM_DOWN_ERROR(119), VM instance-00000673 is down with error. Exit message: Cannot access backing file '/var/lib/nova/instances/_base/2f4f8c5fc11bb83bcab03f4c829ddda4da8c0bce' of storage file '/rhev/data-center/mnt/glusterSD/aws-gfs-01.awesome.lan:_gv0__he/2607c265-248c-40ad-b020-f3756454839e/images/816ac00f-ba98-4827-b5c8-42a8ba496089/8ecfcd5b-db67-4c23-9869-0e20d7553aba' (as uid:107, gid:107): No such file or directory. Platform details: Ovirt SHE Version 4.2.2.6-1.el7.centos GlusterFS, unmanaged by oVirt. VM is imported & converted from OpenStack, according to log files, successfully (one WARN, related to different MAC address): 2018-05-24 12:03:31,028+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsNamesFromExternalProviderVDSCommand] (default task-29) [cc5931a2-1af5-4d65-b0b3-362588db9d3f] FINISH, GetVmsNamesFromExternalProviderVDSCommand, return: [VM [instance-0001f94c], VM [instance-00078f6a], VM [instance-00000814], VM [instance-0001f9ac], VM [instance-000001ff], VM [instance-0001f718], VM [instance-00000673], VM [instance-0001ecf2], VM [instance-00078d38]], log id: 7f178a5e 2018-05-24 12:48:33,722+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsNamesFromExternalProviderVDSCommand] (default task-8) [103d56e1-7449-4853-ae50-48ee94d43d77] FINISH, GetVmsNamesFromExternalProviderVDSCommand, return: [VM [instance-0001f94c], VM [instance-00078f6a], VM [instance-00000814], VM [instance-0001f9ac], VM [instance-000001ff], VM [instance-0001f718], VM [instance-00000673], VM [instance-0001ecf2], VM [instance-00078d38]], log id: 3aa178c5 2018-05-24 12:48:47,291+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFullInfoFromExternalProviderVDSCommand] (default task-17) [4bf555c7-9d64-4ecc-b059-8a60a4b27bdd] START, GetVmsFullInfoFromExternalProviderVDSCommand(HostName = aws-ovhv-01, GetVmsFromExternalProviderParameters:{hostId='cbabe1e8-9e7f-4c4b-be9c-49154953564d', url='qemu+tcp://root@172.19.0.12/system', username='null', originType='KVM', namesOfVms='[instance-00000673]'}), log id: 4c445109 2018-05-24 12:48:47,318+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmsFullInfoFromExternalProviderVDSCommand] (default task-17) [4bf555c7-9d64-4ecc-b059-8a60a4b27bdd] FINISH, GetVmsFullInfoFromExternalProviderVDSCommand, return: [VM [instance-00000673]], log id: 4c445109 2018-05-24 12:49:20,466+02 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmFromExternalProviderCommand] (default task-41) [14edb003-b4a0-4355-b3de-da2b68774fe3] Lock Acquired to object 'EngineLock:{exclusiveLocks='[instance-00000673=VM_NAME, 1f0b608f-7cfc-4b27-a876-b5d8073011a1=VM]', sharedLocks=''}' 2018-05-24 12:49:20,586+02 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-653408) [14edb003-b4a0-4355-b3de-da2b68774fe3] EVENT_ID: MAC_ADDRESS_IS_EXTERNAL(925), VM instance-00000673 has MAC address(es) fa:16:3e:74:18:50, which is/are out of its MAC pool definitions. 2018-05-24 12:49:21,021+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-653408) [14edb003-b4a0-4355-b3de-da2b68774fe3] EVENT_ID: IMPORTEXPORT_STARTING_IMPORT_VM(1,165), Starting to import Vm instance-00000673 to Data Center AVEUNL, Cluster AWSEUOPS 2018-05-24 12:49:28,816+02 INFO [org.ovirt.engine.core.bll.exportimport.ImportVmFromExternalProviderCommand] (EE-ManagedThreadFactory-engine-Thread-653407) [] Lock freed to object 'EngineLock:{exclusiveLocks='[instance-00000673=VM_NAME, 1f0b608f-7cfc-4b27-a876-b5d8073011a1=VM]', sharedLocks=''}' 2018-05-24 12:49:28,911+02 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConvertVmVDSCommand] (EE-ManagedThreadFactory-commandCoordinator-Thread-2) [2047673e] START, ConvertVmVDSCommand(HostName = aws-ovhv-01, ConvertVmVDSParameters:{hostId='cbabe1e8-9e7f-4c4b-be9c-49154953564d', url='qemu+tcp://root@172.19.0.12/system', username='null', vmId='1f0b608f-7cfc-4b27-a876-b5d8073011a1', vmName='instance-00000673', storageDomainId='2607c265-248c-40ad-b020-f3756454839e', storagePoolId='5a5de92c-0120-0167-03cb-00000000038a', virtioIsoPath='null', compatVersion='null', Disk0='816ac00f-ba98-4827-b5c8-42a8ba496089'}), log id: 53408517 2018-05-24 12:49:29,010+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-commandCoordinator-Thread-2) [2047673e] EVENT_ID: IMPORTEXPORT_STARTING_CONVERT_VM(1,193), Starting to convert Vm instance-00000673 2018-05-24 12:52:57,982+02 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (default task-16) [df1d5f72-eb17-46e4-9946-20ca9809b54c] Failed to Acquire Lock to object 'EngineLock:{exclusiveLocks='[instance-00000673=VM_NAME]', sharedLocks='[1f0b608f-7cfc-4b27-a876-b5d8073011a1=VM]'}' 2018-05-24 12:59:24,575+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-20) [2047673e] EVENT_ID: IMPORTEXPORT_IMPORT_VM(1,152), Vm instance-00000673 was imported successfully to Data Center AVEUNL, Cluster AWSEUOPS Than trying to start VM fails with following messages: 2018-05-24 13:00:32,085+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-653729) [] EVENT_ID: USER_STARTED_VM(153), VM instance-00000673 was started by admin@internal-authz (Host: aws-ovhv-06). 2018-05-24 13:00:33,417+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] VM '1f0b608f-7cfc-4b27-a876-b5d8073011a1'(instance-00000673) moved from 'WaitForLaunch' --> 'Down' 2018-05-24 13:00:33,436+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-9) [] EVENT_ID: VM_DOWN_ERROR(119), VM instance-00000673 is down with error. Exit message: Cannot access backing file '/var/lib/nova/instances/_base/2f4f8c5fc11bb83bcab03f4c829ddda4da8c0bce' of storage file '/rhev/data-center/mnt/glusterSD/aws-gfs-01.awesome.lan:_gv0__he/2607c265-248c-40ad-b020-f3756454839e/images/816ac00f-ba98-4827-b5c8-42a8ba496089/8ecfcd5b-db67-4c23-9869-0e20d7553aba' (as uid:107, gid:107): No such file or directory. 2018-05-24 13:00:33,437+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-9) [] add VM '1f0b608f-7cfc-4b27-a876-b5d8073011a1'(instance-00000673) to rerun treatment 2018-05-24 13:00:33,455+02 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-653732) [] EVENT_ID: USER_INITIATED_RUN_VM_FAILED(151), Failed to run VM instance-00000673 on Host aws-ovhv-06. 2018-05-24 13:00:33,460+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-653732) [] EVENT_ID: USER_FAILED_RUN_VM(54), Failed to run VM instance-00000673 (User: admin@internal-authz). Checking on the Gluster volume, directory and files exist, permissions are in order: [root@aws-ovhv-01 816ac00f-ba98-4827-b5c8-42a8ba496089] -rw-rw----. 1 vdsm kvm 14G May 24 12:59 8ecfcd5b-db67-4c23-9869-0e20d7553aba -rw-rw----. 1 vdsm kvm 1.0M May 24 12:49 8ecfcd5b-db67-4c23-9869-0e20d7553aba.lease -rw-r--r--. 1 vdsm kvm 310 May 24 12:49 8ecfcd5b-db67-4c23-9869-0e20d7553aba.meta Than I have checked image info, and noticed that backing file entry is pointing to non-existing location, which does and should not exist on oVirt hosts: [root@aws-ovhv-01 816ac00f-ba98-4827-b5c8-42a8ba496089]# qemu-img info 8ecfcd5b-db67-4c23-9869-0e20d7553aba image: 8ecfcd5b-db67-4c23-9869-0e20d7553aba file format: qcow2 virtual size: 160G (171798691840 bytes) disk size: 14G cluster_size: 65536 backing file: /var/lib/nova/instances/_base/2f4f8c5fc11bb83bcab03f4c829ddda4da8c0bce Format specific information: compat: 1.1 lazy refcounts: false refcount bits: 16 corrupt: false Can somebody advise me how to fix, address this, as I am in need of importing 200+ VMs from OpenStack to oVirt? Kindly awaiting your reply. Marko Vrgotic

7 36

Change host names/IPs
by Davide Ferrari 15 May '19

15 May '19

Hello Is there a clean way and possibly without downtime to change the hostname and IP addresses of all the hosts in a running oVirt cluster? -- Davide Ferrari Senior Systems Engineer

4 7

CVE-2018-12130
by Ladislav Humenik 15 May '19

15 May '19

Hello, Red Hat has yesterday published a new flaw in CPU micro-architecture, and i already saw there is need to update vdsm. Will you backport the update also for ovirt community and at least for the latest 4.2.x version too? links to CVE: https://access.redhat.com/security/cve/cve-2018-12130 https://access.redhat.com/security/vulnerabilities/mds -- Kind regards Ladislav Humenik

1 0

ovirt 4.3.3 SELINUX issue
by Strahil Nikolov 14 May '19

14 May '19

Hello All, I want to warn you that selinux-policy & selinux-policy-targeted with version '3.13.1-229.el7_6.12' cause an issue with my HostedEngine where I got "Login incorrect" screen of death. I have also raised a bug: https://bugzilla.redhat.com/show_bug.cgi?id=1710083 If you want to test your luck, increase the default grub timeout in "/etc/default/grub" to 15 and rebuild the grub menu via 'grub2-mkconfig -o /boot/grub2/grub.cfg' If the issue occurs to you - just append 'enforcing=0' to your kernel and the issue will be over.Of course, you can always rollback either from a rescue DVD or from the running 'enforcing=0' system. Best Regards,Strahil Nikolov

1 0

oVirt and Windows NFS
by ron＠prgstudios.com 14 May '19

14 May '19

Hi Everyone - Greetings from Detroit Michigan! Has anyone had any luck with using oVirt to connect to a Windows Server running an NFS service? I've made several attempts so far and am having problems getting the two to work together. I was hoping someone had some hints (besides the obvious "use Linux" bit). Thanks! Ron

3 2

Is teamd supported on 4.3?
by Valentin Bajrami 14 May '19

14 May '19

Hello guys, Next week, I'm planning to deploy ovirt-node 4.3 on a few hosts. I've been running bonds for the past years but I'd like to know if teaming (teamd) is also supported with this version. My current package version(s): OS Version: | RHEL - 7 - 6.1810.2.el7.centos OS Description: | oVirt Node 4.3.1 Kernel Version: | 3.10.0 - 957.5.1.el7.x86_64 KVM Version: | 2.12.0 - 18.el7_6.3.1 LIBVIRT Version: | libvirt-4.5.0-10.el7_6.4 VDSM Version: | vdsm-4.30.9-1.el7 SPICE Version: | 0.14.0 - 6.el7_6.1 GlusterFS Version: | glusterfs-5.3-2.el7 CEPH Version: | librbd1-10.2.5-4.el7 Open vSwitch Version: | openvswitch-2.10.1-3.el7 Kernel Features: | PTI: 1, IBRS: 0, RETP: 1 VNC Encryption: | Disabled Is anyone running teamd on this version ? Thanks in advance -- Kind regards / Met vriendelijke groet, Valentin Bajrami Target Holding

2 4

botched 3.6 -> 4.0/1/2 upgrade, how to recover
by Axel.Thimm＠01lgc.com 14 May '19

14 May '19

Hello, an old 3.6 self-hosted one-system installation was half upgraded to 4.0 and I took on the task to continue upgrading it. I managed to setup a new engine and upgraded step by step until 4.2 where the host needs to be upgraded. During that time the host was "non-responsive", but I though that this had to do with the upgrade process. Upon trying to upgrade the host the setup broke to pieces. I tried to downgrade everything and restart the old engine to no avail. I now try the way forward to try to start the new engine or create a complete new one, I don;t care much about the old engine's inherited information - all I need to to resurrect the VMs again. At the end of the day the setup is supposed to migrate to a three system hyperconverged setup anyway. How should I proceed to get a working state that fires up the VMs? Is it safe to install a hosted engine from scratch and reattach the domain? Probably the VM configuration will be lost and I will have to puzzle together the disks. I still have the 3.6 engine's backup file, if that is of any help. Should I perhaps recreate a 4.0 engine with that file and try to continue from there? I guess all information on which VMs are attached to which images etc are in the DB of the engine, so I either have to get this info off the 3.6 backup or wire them up again by inspection. BTW this is not a pure ovirt, but an RHV with self-evaluation support, but I believe that any pure ovirt solution will apply. Many thanks in advance.

5 10

Re: Is teamd supported on 4.3?
by Strahil 14 May '19

14 May '19

I'm using teaming and I don't see issues. Just cannot control the teaming device. Best Regards, Strahil NikolovOn May 13, 2019 22:26, Dominik Holler <dholler(a)redhat.com> wrote: > > On Mon, 13 May 2019 15:30:11 +0200 > Valentin Bajrami <valentin.bajrami(a)target-holding.nl> wrote: > > > Hello guys, > > > > Next week, I'm planning to deploy ovirt-node 4.3 on a few hosts. I've > > been running bonds for the past years but I'd like to know if teaming > > (teamd) is also supported with this version. > > > > No, unfortunately not. > May I ask why you want to use teaming instead of bonding? > > > > My current package version(s): > > > > OS Version: | RHEL - 7 - 6.1810.2.el7.centos > > OS Description: | oVirt Node 4.3.1 > > Kernel Version: | 3.10.0 - 957.5.1.el7.x86_64 > > KVM Version: | 2.12.0 - 18.el7_6.3.1 > > LIBVIRT Version: | libvirt-4.5.0-10.el7_6.4 > > VDSM Version: | vdsm-4.30.9-1.el7 > > SPICE Version: | 0.14.0 - 6.el7_6.1 > > GlusterFS Version: | glusterfs-5.3-2.el7 > > CEPH Version: | librbd1-10.2.5-4.el7 > > Open vSwitch Version: | openvswitch-2.10.1-3.el7 > > Kernel Features: | PTI: 1, IBRS: 0, RETP: 1 > > VNC Encryption: | Disabled > > > > Is anyone running teamd on this version ? > > > > Thanks in advance > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XVFQQWUJK3QTV…

3 2

Ovirt Node transfer to New Engine (it is possible)
by IT INFRA 14 May '19

14 May '19

Hi, It is possible to transfer my node to other ovirt engine (new 4.3) here's the scenario. Old Server: (no internet prod) Engine (ovirt 4.1) - Hardware failure No possible recovery Node1 (node 4.1) Node2 (node 4.1) New Server Engine (Ovirt 4.3) *note have full backup of old engine 4.1 version\ * can't re install using yum install http://resources.ovirt.org/pub/yum-repo/ovirt-release41.rpm (no more link available) any possible solution on this.. Thanks,

1 1

A "memory" issue when trying to start VM on oVirt 4.3
by Vrgotic, Marko 14 May '19

14 May '19

Dear oVirt, We are running 4.3.3 oVirt with SHE on three CentOS nodes for HA – with NFS storage. We also have two Local Storage DCs managed by same SHE. [cid:image001.png@01D50A59.F4276FD0] The issue we are reporting was present on 4.3.2 as well. The memory usage on both hosts (third one is in maintenance mode) does not go above 45%: [cid:image002.png@01D50A59.F4276FD0] I have also attached the UI Dashboard screenshot. However, when trying to start one VM: [cid:image003.png@01D50A59.F4276FD0] Engine reports that there is not enough memory and writes the following in the engine.log: 2019-05-14 11:23:10,809Z INFO [org.ovirt.engine.core.bll.RunVmCommand] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] Lock Acquired to object 'EngineLock:{exclusiveLocks='[13b2299f-b4b4-48e4-b2f9-09450eff235d=VM]', sharedLocks=''}' 2019-05-14 11:23:10,819Z INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] START, IsVmDuringInitiatingVDSCommand( IsVmDuringInitiatingVDSCommandParameters:{vmId='13b2299f-b4b4-48e4-b2f9-09450eff235d'}), log id: 5f80129f 2019-05-14 11:23:10,819Z INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5f80129f 2019-05-14 11:23:10,833Z INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] Candidate host 'ovirt-staging-hv-01' ('d81b296a-f3b2-49ea-9b4d-04c90f3508e9') was filtered out by 'VAR__FILTERTYPE__INTERNAL' filter 'Memory' (correlation id: null) 2019-05-14 11:23:10,833Z INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] Candidate host 'ovirt-staging-hv-02' ('f4fdeccd-4cf4-4ed7-9eb1-d98ac65c4ce6') was filtered out by 'VAR__FILTERTYPE__INTERNAL' filter 'Memory' (correlation id: null) 2019-05-14 11:23:10,838Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] EVENT_ID: USER_FAILED_RUN_VM(54), Failed to run VM csm2-216-d due to a failed validation: [Cannot run VM. There is no host that satisfies current scheduling constraints. See below for details:, The host ovirt-staging-hv-01 did not satisfy internal filter Memory because its available memory is too low (0 MB) to run the VM., The host ovirt-staging-hv-01 did not satisfy internal filter Memory because its available memory is too low (0 MB) to run the VM.] (User: admin@internal-authz). 2019-05-14 11:23:10,838Z WARN [org.ovirt.engine.core.bll.RunVmCommand] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] Validation of action 'RunVm' failed for user admin@internal-authz. Reasons: VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-01,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL,VAR__FILTERTYPE__INTERNAL,$hostName ovirt-staging-hv-02,$filterName Memory,$availableMem 0,VAR__DETAIL__NOT_ENOUGH_MEMORY,SCHEDULING_HOST_FILTERED_REASON_WITH_DETAIL 2019-05-14 11:23:10,838Z INFO [org.ovirt.engine.core.bll.RunVmCommand] (default task-14) [63aa9817-80fd-4b18-8c86-26c910a2954a] Lock freed to object 'EngineLock:{exclusiveLocks='[13b2299f-b4b4-48e4-b2f9-09450eff235d=VM]', sharedLocks=''}' Current memory optimization is set to “None” Please let me know if you need additional log files. Kindly awaiting your reply. Marko Vrgotic Sr. System Engineer

1 0

Re: oVirt and Windows NFS
by Strahil 14 May '19

14 May '19

Get a vanilla CentOS7 and try to access the shares to Windows. Is windows in AD ? Best Regards, Strahil NikolovOn May 14, 2019 01:31, ron(a)prgstudios.com wrote: > > Hi Everyone - Greetings from Detroit Michigan! > > Has anyone had any luck with using oVirt to connect to a Windows Server running an NFS service? > > I've made several attempts so far and am having problems getting the two to work together. I was hoping someone had some hints (besides the obvious "use Linux" bit). > > Thanks! > > Ron > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/BH4KT3ODZYEGT…

1 0

Re: Gluster volume heals and after 5 seconds has /dom_md/ids dirty again
by Strahil 14 May '19

14 May '19

I have just noticed this behaviour. I stopped and redesigned my brick (addded vdo layer) and after the heal (1000+ entries got sync) the dom_ids need healing. Running 'gluster volume heal volume_name full' heals the file and 1 min later it happens again. I will try to do a rolling reboot and see if the issues got fixes. Best Regards, Strahil NikolovOn May 13, 2019 18:14, Darrell Budic <budic(a)onholyground.com> wrote: > > I see this sometimes after rebooting a server, and it usually stops happening, generally within a few hours, I’ve never tracked it down further. Don’t know for sure, but I assume it’s related to healing and goes away once everything syncs up. > > Occasionally it turns out to be a communications problem between servers (usually an update to something screws up my firewall), so I always check my peer status when I see it and make sure all servers are talking to each other. > > > On May 13, 2019, at 4:13 AM, Andreas Elvers <andreas.elvers+ovirtforum(a)solutions.work> wrote: > > > > I restored my engine to a gluster volume named :/engine on a three node hyperconverged oVirt 4.3.3.1 cluster. Before restoring I was checking the status of the volumes. They were clean. No heal entries. All peers connected. gluster volume status looked good. Then I restored. This went well. The engine is up. But the engine gluster volume shows entries on node02 and node03. The engine was installed to node01. I have to deploy the engine to the other two hosts to reach full HA, but I bet maintenance is not possible until the volume is healed. > > > > I tried "gluster volume heal engine" also with added "full". The heal entries will disappear for a few seconds and then /dom_md/ids will pop up again. The __DIRECT_IO_TEST__ will join later. The split-brain info has no entries. Is this some kind of hidden split brain? Maybe there is data on node01 brick which got not synced to the other two nodes? I can only speculate. Gluster docs say: this should heal. But it doesn't. I have two other volumes. Those are fine. One of them containing 3 VMs that are running. I also tried to shut down the engine, so no-one was using the volume. Then heal. Same effect. Those two files will always show up. But none other. Heal can always be started successfully from any of the participating nodes. > > > > Reset the volume bricks one by one and cross fingers? > > > > [root@node03 ~]# gluster volume heal engine info > > Brick node01.infra.solutions.work:/gluster_bricks/engine/engine > > Status: Connected > > Number of entries: 0 > > > > Brick node02.infra.solutions.work:/gluster_bricks/engine/engine > > /9f4d5ae9-e01d-4b73-8b6d-e349279e9782/dom_md/ids > > /__DIRECT_IO_TEST__ > > Status: Connected > > Number of entries: 2 > > > > Brick node03.infra.solutions.work:/gluster_bricks/engine/engine > > /9f4d5ae9-e01d-4b73-8b6d-e349279e9782/dom_md/ids > > /__DIRECT_IO_TEST__ > > Status: Connected > > Number of entries: 2 > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/L3YCRPRAGPUMB… > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/6XOCRXRCQOUKE…

1 0

Gluster volume heals and after 5 seconds has /dom_md/ids dirty again
by Andreas Elvers 14 May '19

14 May '19

I restored my engine to a gluster volume named :/engine on a three node hyperconverged oVirt 4.3.3.1 cluster. Before restoring I was checking the status of the volumes. They were clean. No heal entries. All peers connected. gluster volume status looked good. Then I restored. This went well. The engine is up. But the engine gluster volume shows entries on node02 and node03. The engine was installed to node01. I have to deploy the engine to the other two hosts to reach full HA, but I bet maintenance is not possible until the volume is healed. I tried "gluster volume heal engine" also with added "full". The heal entries will disappear for a few seconds and then /dom_md/ids will pop up again. The __DIRECT_IO_TEST__ will join later. The split-brain info has no entries. Is this some kind of hidden split brain? Maybe there is data on node01 brick which got not synced to the other two nodes? I can only speculate. Gluster docs say: this should heal. But it doesn't. I have two other volumes. Those are fine. One of them containing 3 VMs that are running. I also tried to shut down the engine, so no-one was using the volume. Then heal. Same effect. Those two files will always show up. But none other. Heal can always be started successfully from any of the participating nodes. Reset the volume bricks one by one and cross fingers? [root@node03 ~]# gluster volume heal engine info Brick node01.infra.solutions.work:/gluster_bricks/engine/engine Status: Connected Number of entries: 0 Brick node02.infra.solutions.work:/gluster_bricks/engine/engine /9f4d5ae9-e01d-4b73-8b6d-e349279e9782/dom_md/ids /__DIRECT_IO_TEST__ Status: Connected Number of entries: 2 Brick node03.infra.solutions.work:/gluster_bricks/engine/engine /9f4d5ae9-e01d-4b73-8b6d-e349279e9782/dom_md/ids /__DIRECT_IO_TEST__ Status: Connected Number of entries: 2

3 11

Re: oVirt Open Source Backup solution?
by Strahil 14 May '19

14 May '19

Another option is to create a snapshot, backup the snapahot and merge the disks (delete the snapshot actually). Sadly that option doesn't work with Databases, as you might inyerrupt a transaction and leave the DB in inconsistent state. Best Regards, Strahil Nikolov On May 10, 2019 15:37, Derek Atkins <derek(a)ihtfp.com> wrote: > > Hi, > > Michael Blanchard <michael(a)wanderingmad.com> writes: > > > If you haven't seen my other posts, I'm not a very experienced Linux admin, so > > I'm trying to make it as easy as possible to run and maintain. It's hard > > enough for me to not break ovirt in crazy ways > > This has nothing to do with ovirt. > > You could use rdiff-backup on any running machine, be it virtual or bare > metal. It's just a way to use a combination of diff and rsync to backup > machines. Indeed, I was using it with my vmware-based systems and, when > I migrated them to ovirt, the backups just continued working. > > > Get Outlook for Android > > -derek > -- > Derek Atkins 617-623-3745 > derek(a)ihtfp.com www.ihtfp.com > Computer and Internet Security Consultant > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/CBMHSCOBQ3MQH…

6 6

New to OVirt
by Slobodan Stevanovic 13 May '19

13 May '19

I am having hard time installing OVIrt. Gluster deployment for the single node sometimes work, but host engine deployment never works. Any one has suggestion on which release of OVirt to use as a beginner.

6 10

Permission Problem for admin portal
by s.gay＠ovea.com 13 May '19

13 May '19

Hello, I'm using the lastest ovirt release. I would like to add a cluster permission for a user. This user should only see this cluster and not other information or other cluster I've create a new user in internal or external When the ClusterAdmin role is added in the permission tab of a cluster, the user can access the entire infrastructure through the user portal or administrator portal. It can modify other VMs, ... I checked the other cluster and the user does not appear in the permissions When I add the UserRole role to the cluster and remove the ClusterAdmin role, it sees only the VMs in the cluster in the user portal When the user creating a VM, he can see all the cluster in the drop-down window for cluster selection It's possible to add only a cluster permission for users ? Thanks

3 2

HostedEngine migration from ovirt1:/engine to gluster1:/engine (new ip)
by Strahil Nikolov 13 May '19

13 May '19

Hello Community, I have added new interfaces and bonded them in order to split storage from oVirt traffic and I have one last issue. In Storage -> Storage Domains , I have the "hosted_storage" domain that is pointing to the old "ovirt1.localdomain:/engine" instead of "gluster1:/engine". I have managed to reconfigure the ha agent to bring the new storage , but it seems the engine mounts the old gluster path and this causes problem with the ha agent . How can I edit the "hosted_storage" in a safe manner to point to "gluster1:/engine" and mount options of "backup-volfile-servers=gluster2:ovirt3". Should I edit the DB ? P.S.: My google skills did not show any results on this topic and thus I'm raising it to the mail list.Thanks in advance. Best Regards,Strahil Nikolov

2 2

Upgrade success story (4.3.0->4.3.3)
by Juhani Rautiainen 13 May '19

13 May '19

Hi! Just wanted to let you know that I succesfully upgrade our cluster to 4.3.3 (FC SAN based system and no Gluster). I postponed upgrade a lot because of the difficulties I had when upgrading from 4.2.8->4.3.0. This time Hosted Engine upgrade went without any problems. The first node also upgraded itself from admin UI without any problems. The second node was different story. I couldn't upgrade it because yum complained about missing packages. This was mysterious as I just had upgraded the other node. I bypassed this by taking ovirt-4.3 repos from other node since diffing files gave results that they differed. After that node upgraded from UI but went missing after reboot. Contacting it via ILO I found out that it had turned to DHCP again (which it never should do). Somehow settings in VDSM persistent settings were still wrong and pointing to DHCP (it has always been in fixed address). Fixed this by hand by using vdsm persistent settings from the running node. Now the node reboots reliably. Anyway thanks for all the good work oVirt people put in. Small problems here and there but it's getting better by the release. -Juhani

1 0

Node losing management network address?
by Juhani Rautiainen 13 May '19

13 May '19

Hi! I had weird occurence in my two node ovirt cluster today (I have HE). I noticed that one node had ovirtmgmt network unsynchronized. I tried to resynchronize it. This led the node being rebooted by HP ILO. After reboot the node came up with DHCP address. Tried to change it back by fixing ifcfg-ovirtmgmt to original static address. It reverter back to DHCP if I tried the resync the network. I decided to remove HE from the node in order to remove the node in order to be able to add it back. After I started HE removal, address popped back to static address. I did upgrade which was pending on node and after reboot it came back with DHCP address again. After this I removed the node from the cluster, added it back and now it seems to work. I'm just wondering how I prevent this from happening again? How this unsync situation happens for instance and why it decides that DHCP is the way to go? -Juhani

5 11

VMs import over slow 1gig interface instead of fast 10gig interface?
by Jacob Green 13 May '19

13 May '19

Ok, so I want to try and more thoroughly explain my situation. I want to better understand what is happening, and if there is a way to force import over the faster connection. Today I have two Ovirt environments, one on 4.1 and one on 4.2, on the new environment we have migrated to new VLANs for Management and Data. The export domain is a NFS domain hosted on a Trunas device that has an ip address of X.X.12.100. Our host has multiple Ethernet connections, one Bonded 20Gigabit interface. That is where we have the ovirtmgmt profile. And a secondary 1 Gigabit interface that we call our VLAN12 profile or server VLAN. *The problem.... *When importing a VM from the export domain, the import is happening over the 1Gigabit interface on the VLAN12 profile. Instead of the 20gigabit Bonded interface on VLAN 100. *My understanding.... *So I probably just misunderstand how this works, but here is what I thought should happen, in the *Setup Host Network* screen for this host I have the ovirtmgmt on VLAN100 with the bonded 20Gigabit interface performing the following. "*Management, Display, Migration, VM and Default Route*." Then I have the secondary 1 Gigabit interface just doing "*VM*" on VLAN12. What I thought should happen is that anything Migration related "*/Includes importing from export domain?/*" should happen on the Migration interface, which in my case is the ovritmgmt interface on VLAN100. I have also confirmed that I can ping from the VLAN100 ovirtmgmt interface to the storage on VLAN12. So there is connectivity from that interface to the storage. What I am trying to figure out is there a way to force it to do imports over the 20Gigabit interface that resides on VLAN100 instead of the slower VLAN12 interface, that is just there for general VM connectivity. Thank you for any advice or guidance on this matter. -- Jacob Green Systems Admin American Alloy Steel

7 9

Re: OvfUpdateIntervalInMinutes restored to original value too early?
by Andreas Elvers 12 May '19

12 May '19

I suppose the /var/log/ovirt-hosted-engine-setup/engine-logs-2019-05-10T16:16:14Z/ovirt-engine/engine.log is the bootstrap engine log. It is attached. The bootstrap engine looks quite ok when glancing through the dashboard, datacenter, storage domains,… Although there are two old hosted storage domains.

1 1

Upgrade engine to 4.3.3 or setup a new engine
by Magnus Isaksson 12 May '19

12 May '19

Hello all I'm having trouble upgrading my engine to 4.3.3 from 4.2.8 The upgrade goes well, no errors but webgui wont load, it just says "waiting for engine" I have tried to set up a new machine with engine and import the DB from the old(after upgrade) still the same problem. So after quite a few tries i gave up and set up a fresh new engine 4.3.3 But can i move/migrate the hosts with running VM:s in to the new engine? In vmware vcenter it is just to add the host and all VM:s and stuff comes over, but im guessing from what ive read that it is not that simple with ovirt. Or how should i solve this? //Magnus

2 1

HostedEngine cleaned up
by Sakhi Hadebe 12 May '19

12 May '19

Hi, We have a situation where the HostedEngine was cleaned up and the VMs are no longer running. Looking at the logs we can see the drive files as: 2019-03-26T07:42:46.915838Z qemu-kvm: -drive file=/rhev/data-center/mnt/glusterSD/glustermount.goku:_vmstore/9f8ef3f6-53f2-4b02-8a6b-e171b000b420/images/b2b872cd-b468-4f14-ae20-555ed823e84b/76ed4113-51b6-44fd-a3cd-3bd64bf93685,format=qcow2,if=none,id=drive-ua-b2b872cd-b468-4f14-ae20-555ed823e84b,serial=b2b872cd-b468-4f14-ae20-555ed823e84b,werror=stop,rerror=stop,cache=none,aio=native: 'serial' is deprecated, please use the corresponding option of '-device' instead I assume this is the disk was writing to before it went down. Trying to list the file gives an error and the file is not there; ls -l /rhev/data-center/mnt/glusterSD/glustermount.goku:_vmstore/9f8ef3f6-53f2-4b02-8a6b-e171b000b420/images/b2b872cd-b468-4f14-ae20-555ed823e84b/76ed4113-51b6-44fd-a3cd-3bd64bf93685 Is there a way we can recover the VM's disk images ? NOTE: No HostedEngine backups -- Regards, Sakhi Hadebe

7 13

engine-setup failed in upgrade step to 4.3.2 with DNF errors on Centos 7.6
by Oliver Riesener 12 May '19

12 May '19

# engine-setup ``` [ INFO ] Stage: Initializing [ INFO ] Stage: Environment setup Configuration files: ['/etc/ovirt-engine-setup.conf.d/10-packaging-jboss.conf', '/etc/ovirt-engine-setup.conf.d/10-packaging.conf', '/etc/ovirt-engine-setup.conf.d/20-setup-aio.conf', '/etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf'] Log file: /var/log/ovirt-engine/setup/ovirt-engine-setup-20190329154037-huchep.log Version: otopi-1.8.1 (otopi-1.8.1-1.el7) [ INFO ] DNF Downloading 1 files, 0.00KB [ INFO ] DNF Downloaded Extra Packages for Enterprise Linux 7 - x86_64 [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup (late) [ INFO ] Stage: Environment customization --== PRODUCT OPTIONS ==-- Set up Cinderlib integration (Currently in tech preview) (Yes, No) [No]: [ INFO ] ovirt-provider-ovn already installed, skipping. --== PACKAGES ==-- [ INFO ] Checking for product updates... [ ERROR ] DNF 'Base' object has no attribute '_group_persistor' [ INFO ] DNF Performing DNF transaction rollback [ ERROR ] Failed to execute stage 'Environment customization': 'Base' object has no attribute '_group_persistor' [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20190329154037-huchep.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20190329154107-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed What can i do ? ```

2 2

[Users] Lifecycle / upgradepath
by Sven Kieske 11 May '19

11 May '19

Hi Community, Currently, there is no single document describing supported (which means: working ) upgrade scenarios. I think the project has matured enough, to have such an supported upgradepath, which should be considered in the development of new releases. As far as I know, currently it is supported to upgrade from x.y.z to x.y.z+1 and from x.y.z to x.y+1.z but not from x.y-1.z to x.y+1.z directly. maybe this should be put together in a wiki page at least. also it would be cool to know how long a single "release" would be supported. In this context I would define a release as a version bump from x.y.z to x.y+1.z or to x+1.y.z a bump in z would be a bugfix release. The question is, how long will we get bugfix releases for a given version? What are your thoughts? -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

2 1

Planned restart of production services
by Evgheni Dereveanchin 11 May '19

11 May '19

Hi everyone, I will be restarting several production systems within the following hour to apply updates. The following services may be unreachable for some period of time: - resources.ovirt.org - package repositories - jenkins.ovirt.org - CI master Package repositories will be unreachable for a short period of time. No new CI jobs will be started during this period. I will announce you once maintenance is complete. -- Regards, Evgheni Dereveanchin

1 1

[Users] Nested virtualization with Opteron 2nd generation and oVirt 3.1 possible?
by Gianluca Cecchi 11 May '19

11 May '19

Hello, I have 2 physical servers with Opteron 2nd gen cpu. There is CentOS 6.3 installed and some VM already configured on them. Their /proc/cpuinfo contains ... model name : Dual-Core AMD Opteron(tm) Processor 8222 ... kvm_amd kernel module is loaded with its default enabled nested option # systool -m kvm_amd -v Module = "kvm_amd" Attributes: initstate = "live" refcnt = "15" srcversion = "43D8067144E7D8B0D53D46E" Parameters: nested = "1" npt = "1" ... I already configured a fedora 17 VM as a oVirt 3.1 Engine I'm trying to configure another VM as oVirt 3.1 node with ovirt-node-iso-2.5.5-0.1.fc17.iso It seems I'm not able to configure so that ovirt install doesn't complain. After some attempts, I tried this in my vm.xml for the cpu: <cpu mode='custom' match='exact'> <model fallback='allow'>athlon</model> <vendor>AMD</vendor> <feature policy='require' name='pni'/> <feature policy='require' name='rdtscp'/> <feature policy='force' name='svm'/> <feature policy='require' name='clflush'/> <feature policy='require' name='syscall'/> <feature policy='require' name='lm'/> <feature policy='require' name='cr8legacy'/> <feature policy='require' name='ht'/> <feature policy='require' name='lahf_lm'/> <feature policy='require' name='fxsr_opt'/> <feature policy='require' name='cx16'/> <feature policy='require' name='extapic'/> <feature policy='require' name='mca'/> <feature policy='require' name='cmp_legacy'/> </cpu> Inside node /proc/cpuinfo becomes processor : 3 vendor_id : AuthenticAMD cpu family : 6 model : 2 model name : QEMU Virtual CPU version 0.12.1 stepping : 3 microcode : 0x1000065 cpu MHz : 3013.706 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall mmxext fxsr_opt lm nopl pni cx16 hypervisor lahf_lm cmp_legacy cr8_legacy bogomips : 6027.41 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: 2 questions: 1) Is there any combination in xml file to give to my VM so that oVirt doesn't complain about missing hardware virtualization with this processor? 2) suppose 1) is not possible in my case and I still want to test the interface and try some config operations to see for example the differences with RHEV 3.0, how can I do? At the moment this complaint about hw virtualization prevents me to activate the node. I get Installing Host f17ovn01. Step: RHEV_INSTALL. Host f17ovn01 was successfully approved. Host f17ovn01 running without virtualization hardware acceleration Detected new Host f17ovn01. Host state was set to Non Operational. Host f17ovn01 moved to Non-Operational state. Host f17ovn01 moved to Non-Operational state as host does not meet the cluster's minimum CPU level. Missing CPU features : CpuFlags Can I lower the requirements to be able to operate without hw virtualization in 3.1? Thanks in advance, Gianluca

2 1

4.3.3 single node hyperconverged wizard failing because var/log is too small?
by Edward Berger 10 May '19

10 May '19

I'm trying to bring up a single node hyperconverged with the current node-ng ISO installation, but it ends with this failure message. TASK [gluster.features/roles/gluster_hci : Check if /var/log has enough disk space] *** fatal: [br014.bridges.psc.edu] FAILED! => {"changed": true, "cmd": "df -m /var/log | awk '/[0-9]%/ {print $4}'", "delta": "0:00:00.008513", "end": "2019-05-09 20:09:27.914400", "failed_when_result": true, "rc": 0, "start": "2019-05-09 20:09:27.905887", "stderr": "", "stderr_lines": [], "stdout": "7470", "stdout_lines": ["7470"]} I have what the installer created by default for /var/log, so I don't know why its complaining. [root@br014 ~]# df -kh Filesystem Size Used Avail Use% Mounted on /dev/mapper/onn_br014-ovirt--node--ng--4.3.3.1--0.20190417.0+1 3.5T 2.1G 3.3T 1% / devtmpfs 63G 0 63G 0% /dev tmpfs 63G 4.0K 63G 1% /dev/shm tmpfs 63G 18M 63G 1% /run tmpfs 63G 0 63G 0% /sys/fs/cgroup /dev/mapper/onn_br014-home 976M 2.6M 907M 1% /home /dev/mapper/onn_br014-tmp 976M 2.8M 906M 1% /tmp /dev/mapper/onn_br014-var 15G 42M 14G 1% /var /dev/sda2 976M 173M 737M 19% /boot /dev/mapper/onn_br014-var_log 7.8G 41M 7.3G 1% /var/log /dev/mapper/onn_br014-var_log_audit 2.0G 7.6M 1.8G 1% /var/log/audit /dev/mapper/onn_br014-var_crash 9.8G 37M 9.2G 1% /var/crash /dev/sda1 200M 12M 189M 6% /boot/efi tmpfs 13G 0 13G 0% /run/user/1000 tmpfs 13G 0 13G 0% /run/user/0 /dev/mapper/gluster_vg_sdb-gluster_lv_engine 3.7T 33M 3.7T 1% /gluster_bricks/engine /dev/mapper/gluster_vg_sdc-gluster_lv_data 3.7T 34M 3.7T 1% /gluster_bricks/data /dev/mapper/gluster_vg_sdd-gluster_lv_vmstore 3.7T 34M 3.7T 1% /gluster_bricks/vmstore The machine had 4 4TB disks, so sda is the installation for oVirt node-ng, the other 3 disks for the gluster volumes. root@br014 ~]# pvs PV VG Fmt Attr PSize PFree /dev/sda3 onn_br014 lvm2 a-- <3.64t 100.00g /dev/sdb gluster_vg_sdb lvm2 a-- <3.64t <26.02g /dev/sdc gluster_vg_sdc lvm2 a-- <3.64t 0 /dev/sdd gluster_vg_sdd lvm2 a-- <3.64t 0 [root@br014 ~]# vgs VG #PV #LV #SN Attr VSize VFree gluster_vg_sdb 1 1 0 wz--n- <3.64t <26.02g gluster_vg_sdc 1 2 0 wz--n- <3.64t 0 gluster_vg_sdd 1 2 0 wz--n- <3.64t 0 onn_br014 1 11 0 wz--n- <3.64t 100.00g [root@br014 ~]# lvs LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert gluster_lv_engine gluster_vg_sdb -wi-ao---- 3.61t gluster_lv_data gluster_vg_sdc Vwi-aot--- 3.61t gluster_thinpool_gluster_vg_sdc 0.05 gluster_thinpool_gluster_vg_sdc gluster_vg_sdc twi-aot--- <3.61t 0.05 0.13 gluster_lv_vmstore gluster_vg_sdd Vwi-aot--- 3.61t gluster_thinpool_gluster_vg_sdd 0.05 gluster_thinpool_gluster_vg_sdd gluster_vg_sdd twi-aot--- <3.61t 0.05 0.13 home onn_br014 Vwi-aotz-- 1.00g pool00 4.79 ovirt-node-ng-4.3.3.1-0.20190417.0 onn_br014 Vwi---tz-k <3.51t pool00 root ovirt-node-ng-4.3.3.1-0.20190417.0+1 onn_br014 Vwi-aotz-- <3.51t pool00 ovirt-node-ng-4.3.3.1-0.20190417.0 0.13 pool00 onn_br014 twi-aotz-- 3.53t 0.19 1.86 root onn_br014 Vri---tz-k <3.51t pool00 swap onn_br014 -wi-ao---- 4.00g tmp onn_br014 Vwi-aotz-- 1.00g pool00 4.84 var onn_br014 Vwi-aotz-- 15.00g pool00 3.67 var_crash onn_br014 Vwi-aotz-- 10.00g pool00 2.86 var_log onn_br014 Vwi-aotz-- 8.00g pool00 3.25 var_log_audit onn_br014 Vwi-aotz-- 2.00g pool00 4.86 Here's the full deploy log from the UI. Let me know if you need specific logs. PLAY [Setup backend] *********************************************************** TASK [Gathering Facts] ********************************************************* ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/firewall_config : Start firewalld if not already started] *** ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/firewall_config : check if required variables are set] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/firewall_config : Open/Close firewalld ports] ******** ok: [br014.bridges.psc.edu] => (item=2049/tcp) ok: [br014.bridges.psc.edu] => (item=54321/tcp) ok: [br014.bridges.psc.edu] => (item=5900/tcp) ok: [br014.bridges.psc.edu] => (item=5900-6923/tcp) ok: [br014.bridges.psc.edu] => (item=5666/tcp) ok: [br014.bridges.psc.edu] => (item=16514/tcp) TASK [gluster.infra/roles/firewall_config : Add/Delete services to firewalld rules] *** ok: [br014.bridges.psc.edu] => (item=glusterfs) TASK [gluster.infra/roles/backend_setup : Gather facts to determine the OS distribution] *** ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Change to Install lvm tools for debian systems.] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Change to Install lvm tools for RHEL systems.] *** ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Install python-yaml package for Debian systems] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Initialize vdo_devs array] *********** ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Record VDO devices (if any)] ********* skipping: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdb', u'pvname': u'/dev/sdb'}) skipping: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdc', u'pvname': u'/dev/sdc'}) skipping: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdd', u'pvname': u'/dev/sdd'}) TASK [gluster.infra/roles/backend_setup : Enable and start vdo service] ******** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Create VDO with specified size] ****** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Check if valid disktype is provided] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Set PV data alignment for JBOD] ****** ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Set PV data alignment for RAID] ****** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Set VG physical extent size for RAID] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Create volume groups] **************** ok: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdb', u'pvname': u'/dev/sdb'}) ok: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdc', u'pvname': u'/dev/sdc'}) ok: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdd', u'pvname': u'/dev/sdd'}) TASK [gluster.infra/roles/backend_setup : Create thick logical volume] ********* ok: [br014.bridges.psc.edu] => (item={u'lvname': u'gluster_lv_engine', u'vgname': u'gluster_vg_sdb', u'size': u'3700G'}) TASK [gluster.infra/roles/backend_setup : Calculate chunksize for RAID6/RAID10/RAID5] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Set chunksize for JBOD] ************** ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Create a LV thinpool] **************** ok: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdc', u'thinpoolname': u'gluster_thinpool_gluster_vg_sdc', u'poolmetadatasize': u'16G'}) ok: [br014.bridges.psc.edu] => (item={u'vgname': u'gluster_vg_sdd', u'thinpoolname': u'gluster_thinpool_gluster_vg_sdd', u'poolmetadatasize': u'16G'}) TASK [gluster.infra/roles/backend_setup : Create thin logical volume] ********** ok: [br014.bridges.psc.edu] => (item={u'lvname': u'gluster_lv_data', u'vgname': u'gluster_vg_sdc', u'thinpool': u'gluster_thinpool_gluster_vg_sdc', u'lvsize': u'3700G'}) ok: [br014.bridges.psc.edu] => (item={u'lvname': u'gluster_lv_vmstore', u'vgname': u'gluster_vg_sdd', u'thinpool': u'gluster_thinpool_gluster_vg_sdd', u'lvsize': u'3700G'}) TASK [gluster.infra/roles/backend_setup : Extend volume group] ***************** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Change attributes of LV] ************* skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Create LV for cache] ***************** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Create metadata LV for cache] ******** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Convert logical volume to a cache pool LV] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Convert logical volume to a cache pool LV without cachemetalvname] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Convert an existing logical volume to a cache LV] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Set XFS options for JBOD] ************ ok: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Set XFS options for RAID devices] **** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Create filesystem on thin logical vols] *** ok: [br014.bridges.psc.edu] => (item={u'lvname': u'gluster_lv_data', u'vgname': u'gluster_vg_sdc', u'thinpool': u'gluster_thinpool_gluster_vg_sdc', u'lvsize': u'3700G'}) ok: [br014.bridges.psc.edu] => (item={u'lvname': u'gluster_lv_vmstore', u'vgname': u'gluster_vg_sdd', u'thinpool': u'gluster_thinpool_gluster_vg_sdd', u'lvsize': u'3700G'}) TASK [gluster.infra/roles/backend_setup : Create filesystem on thick logical vols] *** ok: [br014.bridges.psc.edu] => (item={u'lvname': u'gluster_lv_engine', u'vgname': u'gluster_vg_sdb', u'size': u'3700G'}) TASK [gluster.infra/roles/backend_setup : Create mount directories if not already present] *** ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/engine', u'vgname': u'gluster_vg_sdb', u'lvname': u'gluster_lv_engine'}) ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/data', u'vgname': u'gluster_vg_sdc', u'lvname': u'gluster_lv_data'}) ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/vmstore', u'vgname': u'gluster_vg_sdd', u'lvname': u'gluster_lv_vmstore'}) TASK [gluster.infra/roles/backend_setup : Set mount options for VDO] *********** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_setup : Mount the vdo devices (If any)] ****** skipping: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/engine', u'vgname': u'gluster_vg_sdb', u'lvname': u'gluster_lv_engine'}) skipping: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/data', u'vgname': u'gluster_vg_sdc', u'lvname': u'gluster_lv_data'}) skipping: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/vmstore', u'vgname': u'gluster_vg_sdd', u'lvname': u'gluster_lv_vmstore'}) TASK [gluster.infra/roles/backend_setup : Mount the devices] ******************* ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/engine', u'vgname': u'gluster_vg_sdb', u'lvname': u'gluster_lv_engine'}) ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/data', u'vgname': u'gluster_vg_sdc', u'lvname': u'gluster_lv_data'}) ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/vmstore', u'vgname': u'gluster_vg_sdd', u'lvname': u'gluster_lv_vmstore'}) TASK [gluster.infra/roles/backend_setup : Set Gluster specific SeLinux context on the bricks] *** ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/engine', u'vgname': u'gluster_vg_sdb', u'lvname': u'gluster_lv_engine'}) ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/data', u'vgname': u'gluster_vg_sdc', u'lvname': u'gluster_lv_data'}) ok: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/vmstore', u'vgname': u'gluster_vg_sdd', u'lvname': u'gluster_lv_vmstore'}) TASK [gluster.infra/roles/backend_setup : restore file(s) default SELinux security contexts] *** changed: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/engine', u'vgname': u'gluster_vg_sdb', u'lvname': u'gluster_lv_engine'}) changed: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/data', u'vgname': u'gluster_vg_sdc', u'lvname': u'gluster_lv_data'}) changed: [br014.bridges.psc.edu] => (item={u'path': u'/gluster_bricks/vmstore', u'vgname': u'gluster_vg_sdd', u'lvname': u'gluster_lv_vmstore'}) TASK [gluster.infra/roles/backend_reset : unmount the directories (if mounted)] *** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_reset : Delete volume groups] **************** skipping: [br014.bridges.psc.edu] TASK [gluster.infra/roles/backend_reset : Remove VDO devices] ****************** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Create temporary storage directory] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Get the name of the directory created] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : check if gluster_features_ganesha_clusternodes is set] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Define service port] **************** skipping: [br014.bridges.psc.edu] => (item=^#(STATD_PORT=.*)) skipping: [br014.bridges.psc.edu] => (item=^#(LOCKD_TCPPORT=.*)) skipping: [br014.bridges.psc.edu] => (item=^#(LOCKD_UDPPORT=.*)) TASK [gluster.features/roles/nfs_ganesha : Check packages installed, if not install] *** skipping: [br014.bridges.psc.edu] => (item=glusterfs-ganesha) skipping: [br014.bridges.psc.edu] => (item=nfs-ganesha) skipping: [br014.bridges.psc.edu] => (item=corosync) skipping: [br014.bridges.psc.edu] => (item=pacemaker) skipping: [br014.bridges.psc.edu] => (item=libntirpc) skipping: [br014.bridges.psc.edu] => (item=pcs) TASK [gluster.features/roles/nfs_ganesha : Restart services] ******************* skipping: [br014.bridges.psc.edu] => (item=nfslock) skipping: [br014.bridges.psc.edu] => (item=nfs-config) skipping: [br014.bridges.psc.edu] => (item=rpc-statd) TASK [gluster.features/roles/nfs_ganesha : Stop services] ********************** skipping: [br014.bridges.psc.edu] => (item=nfs-server) TASK [gluster.features/roles/nfs_ganesha : Disable service] ******************** skipping: [br014.bridges.psc.edu] => (item=nfs-server) TASK [gluster.features/roles/nfs_ganesha : Enable services] ******************** skipping: [br014.bridges.psc.edu] => (item=glusterfssharedstorage) skipping: [br014.bridges.psc.edu] => (item=nfs-ganesha) skipping: [br014.bridges.psc.edu] => (item=network) skipping: [br014.bridges.psc.edu] => (item=pcsd) skipping: [br014.bridges.psc.edu] => (item=pacemaker) TASK [gluster.features/roles/nfs_ganesha : Start services] ********************* skipping: [br014.bridges.psc.edu] => (item=network) skipping: [br014.bridges.psc.edu] => (item=pcsd) TASK [gluster.features/roles/nfs_ganesha : Create a user hacluster if not already present] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Set the password for hacluster] ***** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Set the hacluster user the same password on new nodes] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Pcs cluster authenticate the hacluster on new nodes] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Pause for a few seconds after pcs auth] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Set gluster_use_execmem flag on and keep it persistent] *** skipping: [br014.bridges.psc.edu] => (item=gluster_use_execmem) skipping: [br014.bridges.psc.edu] => (item=ganesha_use_fusefs) TASK [gluster.features/roles/nfs_ganesha : check if gluster_features_ganesha_masternode is set] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy the ssh keys to the local machine] *** skipping: [br014.bridges.psc.edu] => (item=secret.pem.pub) skipping: [br014.bridges.psc.edu] => (item=secret.pem) TASK [gluster.features/roles/nfs_ganesha : check if gluster_features_ganesha_newnodes_vip is set] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy the public key to remote nodes] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy the private key to remote node] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Deploy the pubkey on all nodes] ***** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Make the volume a gluster shared volume] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Generate ssh key in one of the nodes in HA cluster] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy the ssh keys to the local machine] *** skipping: [br014.bridges.psc.edu] => (item=secret.pem.pub) skipping: [br014.bridges.psc.edu] => (item=secret.pem) TASK [gluster.features/roles/nfs_ganesha : Create configuration directory for nfs_ganesha] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy ganesha.conf to config directory on shared volume] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Create ganesha-ha.conf file] ******** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Enable NFS Ganesha] ***************** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Pause for 30 seconds (takes a while to enable NFS Ganesha)] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Check NFS Ganesha status] *********** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Report NFS Ganesha status] ********** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Report NFS Ganesha status (If any errors)] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : check if gluster_features_ganesha_volume is set] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Export the NFS Ganesha volume] ****** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy the public key to remote nodes] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Copy the private key to remote node] *** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Deploy the pubkey on all nodes] ***** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Adds a node to the cluster] ********* skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Report ganesha add-node status] ***** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/nfs_ganesha : Delete the temporary directory] ***** skipping: [br014.bridges.psc.edu] TASK [gluster.features/roles/gluster_hci : Check if packages are installed, if not install] *** ok: [br014.bridges.psc.edu] => (item=vdsm) ok: [br014.bridges.psc.edu] => (item=vdsm-gluster) ok: [br014.bridges.psc.edu] => (item=ovirt-host) ok: [br014.bridges.psc.edu] => (item=screen) TASK [gluster.features/roles/gluster_hci : Enable and start glusterd and chronyd] *** ok: [br014.bridges.psc.edu] => (item=chronyd) ok: [br014.bridges.psc.edu] => (item=glusterd) ok: [br014.bridges.psc.edu] => (item=firewalld) TASK [gluster.features/roles/gluster_hci : Add user qemu to gluster group] ***** ok: [br014.bridges.psc.edu] TASK [gluster.features/roles/gluster_hci : Disable the hook scripts] *********** changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1/set/post/S30samba-set.sh) changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1/start/post/S30samba-start.sh) changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh) changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1/reset/post/S31ganesha-reset.sh) changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1//start/post/S31ganesha-start.sh) changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh) changed: [br014.bridges.psc.edu] => (item=/var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh) TASK [gluster.features/roles/gluster_hci : Check if valid FQDN is provided] **** changed: [br014.bridges.psc.edu -> localhost] => (item=br014.bridges.psc.edu ) TASK [gluster.features/roles/gluster_hci : Check if /var/log has enough disk space] *** fatal: [br014.bridges.psc.edu] FAILED! => {"changed": true, "cmd": "df -m /var/log | awk '/[0-9]%/ {print $4}'", "delta": "0:00:00.008513", "end": "2019-05-09 20:09:27.914400", "failed_when_result": true, "rc": 0, "start": "2019-05-09 20:09:27.905887", "stderr": "", "stderr_lines": [], "stdout": "7470", "stdout_lines": ["7470"]} NO MORE HOSTS LEFT ************************************************************* NO MORE HOSTS LEFT ************************************************************* to retry, use: --limit @/usr/share/cockpit/ovirt-dashboard/ansible/hc_wizard.retry PLAY RECAP ********************************************************************* br014.bridges.psc.edu : ok=25 changed=3 unreachable=0 failed=1

2 2

Gluster Snapshot Datepicker Not Working?
by Alex McWhirter 10 May '19

10 May '19

Updated to 4.3.3.7, the date picker for gluster snapshot appears to not be working? It wont register clicks, and manually typing in times doesn't work. Can anyone else confirm?

1 0

Hosted Engine Restore Issues
by Alan G 10 May '19

10 May '19

Hi, Trying to re-deploy Hosted Engine into a new storage domain. "hosted-engine --deploy --noansible" has completed and the engine is up, but I cannot remove the existing hosted_storage domain to allow the new one to be imported. I cannot remove the domain until the old HostedEngine VM is removed, but I cannot remove that as it has Delete Protection enabled. Any attempt to remove delete protection errors with "There was an attempt to change Hosted Engine VM values that are locked". How is this process supposed to work? Thanks, Alan

1 0

OvfUpdateIntervalInMinutes restored to original value too early?
by Andreas Elvers 10 May '19

10 May '19

I'm having a problem with restore. It fails while "Wait for OVF_STORE disk content". Looking at the ansible output and at the bug report https://bugzilla.redhat.com/show_bug.cgi?id=1644748 isn't the original value of 60 minutes for OvfUpdateIntervalInMinutes restored too early? [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch host SPM_ID] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Parse host SPM_ID] [ INFO ] ok: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Restore original DisableFenceAtStartupInSec] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove DisableFenceAtStartupInSec temporary file] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Restore original OvfUpdateIntervalInMinutes] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove OvfUpdateIntervalInMinutes temporary file] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Removing temporary value] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Restoring original value] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Remove temporary directory for ansible as postgres user] [ INFO ] changed: [localhost -> engine.infra.solutions.work] [ INFO ] TASK [ovirt.hosted_engine_setup : Fail if he_force_ip4 and he_force_ip6 are set at the same time] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Prepare getent key] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Trigger hosted engine OVF update and enable the serial console] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Wait until OVF update finishes] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Parse OVF_STORE disk list] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Check OVF_STORE volume status] [ INFO ] changed: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Wait for OVF_STORE disk content] [ ERROR ] {u'_ansible_parsed': True, u'stderr_lines': [u'20+0 records in', u'20+0 records out', u'10240 bytes (10 kB) copied, 0.000164261 s, 62.3 MB/s', u'tar: 1e74609b-51e1-45c8-9106-2596ee59ba3a.ovf: Not found in archive', u'tar: Exiting with failure status due to previous errors'], u'changed': True, u'end': u'2019-05-10 12:57:57.610068', u'_ansible_item_label': {u'image_id': u'59d16f28-64ed-4c3f-aaad-7d98e2718f53', u'name': u'OVF_STORE', u'id': u'98bd5cfc-809d-4d40-83e0-98e379af5f97'}, u'stdout': u'', u'failed': True, u'_ansible_item_result': True, u'msg': u'non-zero return code', u'rc': 2, u'start': u'2019-05-10 12:57:56.928294', u'attempts': 12, u'cmd': u"vdsm-client Image prepare storagepoolID=597f329c-0296-03af-0369-000000000139 storagedomainID=8f115ea6-91ec-4e10-9240-bc8eda47b7ff imageID=98bd5cfc-809d-4d40-83e0-98e379af5f97 volumeID=59d16f28-64ed-4c3f-aaad-7d98e2718f53 | grep path | awk '{ print $2 }' | xargs -I{} sudo -u vdsm dd if={} | tar -tvf - 1e74609b-51e1-45c8-9106-259 6ee59ba3a.ovf", u'item': {u'image_id': u'59d16f28-64ed-4c3f-aaad-7d98e2718f53', u'name': u'OVF_STORE', u'id': u'98bd5cfc-809d-4d40-83e0-98e379af5f97'}, u'delta': u'0:00:00.681774', u'invocation': {u'module_args': {u'warn': False, u'executable': None, u'_uses_shell': True, u'_raw_params': u"vdsm-client Image prepare storagepoolID=597f329c-0296-03af-0369-000000000139 storagedomainID=8f115ea6-91ec-4e10-9240-bc8eda47b7ff imageID=98bd5cfc-809d-4d40-83e0-98e379af5f97 volumeID=59d16f28-64ed-4c3f-aaad-7d98e2718f53 | grep path | awk '{ print $2 }' | xargs -I{} sudo -u vdsm dd if={} | tar -tvf - 1e74609b-51e1-45c8-9106-2596ee59ba3a.ovf", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'stdout_lines': [], u'stderr': u'20+0 records in\n20+0 records out\n10240 bytes (10 kB) copied, 0.000164261 s, 62.3 MB/s\ntar: 1e74609b-51e1-45c8-9106-2596ee59ba3a.ovf: Not found in archive\ntar: Exiting with failure status due to previous errors', u'_ansible_no_log': False}

2 1

Re: oVirt Open Source Backup solution?
by Derek Atkins 10 May '19

10 May '19

Hi, Michael Blanchard <michael(a)wanderingmad.com> writes: > If you haven't seen my other posts, I'm not a very experienced Linux admin, so > I'm trying to make it as easy as possible to run and maintain. It's hard > enough for me to not break ovirt in crazy ways This has nothing to do with ovirt. You could use rdiff-backup on any running machine, be it virtual or bare metal. It's just a way to use a combination of diff and rsync to backup machines. Indeed, I was using it with my vmware-based systems and, when I migrated them to ovirt, the backups just continued working. > Get Outlook for Android -derek -- Derek Atkins 617-623-3745 derek(a)ihtfp.com www.ihtfp.com Computer and Internet Security Consultant

1 0

Re: oVirt and NetApp NFS storage
by Strahil 10 May '19

10 May '19

I know 2 approaches. 1. Use NFS hard mounting option - it will never give error to sanlock and it will be waiting until NFS is recovered (never tries this one, but in theory might work) 2. Change the default sanlock timeout (last time I tried that - it didn't work) . You might need help from Sandro or Sahina for that option. Best Regards, Strahil NikolovOn Apr 18, 2019 11:45, klaasdemter(a)gmail.com wrote: > > Hi, > > I got a question regarding oVirt and the support of NetApp NFS storage. > We have a MetroCluster for our virtual machine disks but a HA-Failover > of that (active IP gets assigned to another node) seems to produce > outages too long for sanlock to handle - that affects all VMs that have > storage leases. NetApp says a "worst case" takeover time is 120 seconds. > That would mean sanlock has already killed all VMs. Is anyone familiar > with how we could setup oVirt to allow such storage outages? Do I need > to use another type of storage for my oVirt VMs because that NFS > implementation is unsuitable for oVirt? > > > Greetings > > Klaas > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/TSJJKK5UG57CC…

4 6

Ansible oVirt.image-template role
by Jeremy Tourville 10 May '19

10 May '19

I am trying to run an Ansible playbook that doesn't appear to run correctly. I have followed the example from this blog - https://evaryont.me/blog/2018/09/getting-started-with-vagrant-and-ovirt-fro… The playbook finishes with an ok status but the template never gets built in Ovirt. I have taken logs from three locations hoping to spot the error: * [root@ansible ansible]#ansible-playbook -vvvv runsetup.yml * [root@ansible ansible]# less /var/log/ansible.log * [root@engine ~]# tail -f /var/log/messages (while the playbook is being run. The server Ansible is my control node and Engine is my managed host. Can anyone help me interpret the attached logs in an effort to further troubleshoot? Thanks!

3 2

Re: Ovirt nodeNG RDMA support?
by Strahil 10 May '19

10 May '19

I saw you are using gluster v5.3 . Any reason not to update to 5.5 ? It is quite more stable than 5.3 and some enhancements were done. Best Regards, Strahil NikolovOn May 10, 2019 00:13, michael(a)wanderingmad.com wrote: > > Tried that, get this error: > > > [root@Icarus ~]# gluster volume stop storage_ssd > Stopping volume will make its data inaccessible. Do you want to continue? (y/n) y > volume stop: storage_ssd: success > [root@Icarus ~]# gluster volume set storage_ssd config.transport tcp,rdma > volume set: failed: Commit failed on localhost. Please check the log file for more details. > and here is the glusterd.log > > [2019-05-09 21:10:45.945855] W [MSGID: 101095] [xlator.c:456:xlator_dynload] 0-xlator: /usr/lib64/glusterfs/5.3/xlator/nfs/server.so: cannot open shared object file: No such file or directory > [2019-05-09 21:10:46.041341] I [MSGID: 106521] [glusterd-op-sm.c:2953:glusterd_op_set_volume] 0-management: changing transport-type for volume storage_ssd to tcp,rdma > [2019-05-09 21:10:46.041965] W [MSGID: 101095] [xlator.c:180:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/5.3/xlator/nfs/server.so: cannot open shared object file: No such file or di > rectory > [2019-05-09 21:10:46.059356] E [MSGID: 106068] [glusterd-volgen.c:1025:volgen_write_volfile] 0-management: failed to create volfile > [2019-05-09 21:10:46.059394] E [glusterd-volgen.c:6556:glusterd_create_volfiles] 0-management: Could not generate gfproxy client volfiles > [2019-05-09 21:10:46.059406] E [MSGID: 106068] [glusterd-op-sm.c:3062:glusterd_op_set_volume] 0-management: Unable to create volfile for 'volume set' > [2019-05-09 21:10:46.059420] E [MSGID: 106122] [glusterd-syncop.c:1434:gd_commit_op_phase] 0-management: Commit of operation 'Volume Set' failed on localhost > [2019-05-09 21:10:46.062304] E [MSGID: 101191] [event-epoll.c:671:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch handler > [root@prometheus ~]# > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/HJGBS3DVBUDVN…

1 0

Re: Migrating Domain Storage Gluster
by Strahil 10 May '19

10 May '19

If this is replica 2 arbiter 1 (old name replica 3 arbiter 1) or a plain replica 3 volume - you don't need the downtime. Just stop the bricks on one of the nodes. Mount (and verify) those SSDs on the same location and use the gluster's reset brick option. Wait for the heal to complete and repeat with the other node(s). Best Regards, Strahil NikolovOn May 9, 2019 21:00, Alex McWhirter <alex(a)triadic.us> wrote: > > Basically i want to take out all of the HDD's in the main gluster pool, > and replace with SSD's. > > My thought was to put everything in maintenance, copy the data manually > over to a transient storage server. Destroy the gluster volume, swap in > all the new drives, build a new gluster volume with the same name / > settings, move data back, and be done. > > Any thoughts on this? > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/TP6V2OYG5ZXPU…

1 0

Re: HostedEngine cleaned up
by Strahil 10 May '19

10 May '19

This is due to sharding. I joined ovirt 6 moths ago and this option was still there. Best Regards, Strahil NikolovOn May 9, 2019 18:04, Dmitry Filonov <filonov(a)hkl.hms.harvard.edu> wrote: > > The data chunks are under .glusterfs folder on bricks now. Not a single huge file you can easily access from a brick. > Not sure when that change was introduced though. > > Fil > > > On Thu, May 9, 2019, 10:43 AM <olaf.buitelaar(a)gmail.com> wrote: >> >> It looks like i've got the exact same issue; >> drwxr-xr-x. 2 vdsm kvm 4.0K Mar 29 16:01 . >> drwxr-xr-x. 22 vdsm kvm 4.0K Mar 29 18:34 .. >> -rw-rw----. 1 vdsm kvm 64M Feb 4 01:32 44781cef-173a-4d84-88c5-18f7310037b4 >> -rw-rw----. 1 vdsm kvm 1.0M Oct 16 2018 44781cef-173a-4d84-88c5-18f7310037b4.lease >> -rw-r--r--. 1 vdsm kvm 311 Mar 29 16:00 44781cef-173a-4d84-88c5-18f7310037b4.meta >> Within the meta file the image is marked legal and reports a size of SIZE=41943040, interestingly the format is mark RAW, while it was a thinly created volume. >> My suspicion is that something went wrong while the volume was being livemigrated, and somehow the merging of the images broke the volume. >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/UDPJ2R5XUFNZR…

1 0

Ovirt nodeNG RDMA support?
by michael＠wanderingmad.com 09 May '19

09 May '19

When I was able to load CentosOS as a host OS, Was able to use RDMA, but it seems like the 4.3x branch of nodeNG is missing RDMA support? I enabled rdma and started the service, but gluster refuses to recognize that RDMA is available and always reports RDMA port as 0 and when I try to make a new drive with tcp,rdma transport options, it always fails.

4 6

Need VM run once api
by Chandrahasa S 09 May '19

09 May '19

This is a multipart message in MIME format. --=_alternative 00361B2065257E90_= Content-Type: text/plain; charset="US-ASCII" Hi Experts, We are integrating ovirt with our internal cloud. Here we installed cloudinit in vm and then converted vm to template. We deploy template with initial run parameter Hostname, IP Address, Gateway and DNS. but when we power ON initial, run parameter is not getting pushed to inside the vm. But its working when we power on VM using run once option on Ovirt portal. I believe we need to power ON vm using run once API, but we are not able get this API. Can some one help on this. I got reply on this query last time but unfortunately mail got deleted. Thanks & Regards Chandrahasa S =====-----=====-----===== Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissemination, use, review, distribution, printing or copying of the information contained in this e-mail message and/or attachments to it are strictly prohibited. If you have received this communication in error, please notify us by reply e-mail or telephone and immediately and permanently delete the message and any attachments. Thank you --=_alternative 00361B2065257E90_= Content-Type: text/html; charset="US-ASCII" <font size=2 face="sans-serif">Hi Experts,</font> <br> <br><font size=2 face="sans-serif">We are integrating ovirt with our internal cloud.</font> <br> <br><font size=2 face="sans-serif">Here we installed cloudinit in vm and then converted vm to template. We deploy template with initial run parameter Hostname, IP Address, Gateway and DNS.</font> <br> <br><font size=2 face="sans-serif">but when we power ON initial, run parameter is not getting pushed to inside the vm. But its working when we power on VM using run once option on Ovirt portal.</font> <br> <br><font size=2 face="sans-serif">I believe we need to power ON vm using run once API, but we are not able get this API.</font> <br> <br><font size=2 face="sans-serif">Can some one help on this.</font> <br> <br><font size=2 face="sans-serif">I got reply on this query last time but unfortunately mail got deleted.</font> <br> <br><font size=2 face="sans-serif">Thanks & Regards<br> Chandrahasa S<br> </font><p>=====-----=====-----=====<br> Notice: The information contained in this e-mail<br> message and/or attachments to it may contain <br> confidential or privileged information. If you are <br> not the intended recipient, any dissemination, use, <br> review, distribution, printing or copying of the <br> information contained in this e-mail message <br> and/or attachments to it are strictly prohibited. If <br> you have received this communication in error, <br> please notify us by reply e-mail or telephone and <br> immediately and permanently delete the message <br> and any attachments. Thank you</p> <p></p> --=_alternative 00361B2065257E90_=--

5 4

Disk stuck initializing
by Mikael Öhman 09 May '19

09 May '19

I created a extra disk to attach to a VM, which I used for several months. When it was time to remove it (as I intended to replace it) I managed to detach it, but before I could remove it I got it stuck in with status "initializing". I wish to delete this disk, as I'm done using it, but all options are grayed out in the UI. The disk is not attached to any anything. The underlying storage domain, which is running GlusterFS across the 3 oVirt hypervisors is showing no issues. Several other disks are running on with no issues. The only thing I could find in the engine log was 2019-05-09 17:03:39,693+02 INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (ServerService Thread Pool -- 72) [d3615da6-823c-4421-ad00-6d8060b8b291] Lock Acquired to object 'EngineLock:{exclusiveLocks='', sharedLocks='[0498e532-a1de-4281-953d-7dec31271437=DISK]'}' What can I do to clean this up and free the used space? Best regards, Mikael

1 0

LDAP - not able to find members of groups
by Timmi 09 May '19

09 May '19

Hi oVirt List, I manage to connect oVirt to my LDAP and I'm able to search for users and groups. I'm using openLDAP within a ClearOS installation and it looks like this is a bit different to the standard openLDAP. Inside the LDAP groups there is an attribute with is calls "member". Example: member cn=Timmi,ou=Users,ou=Accounts,dc=domain,dc=com Is someone able to help me how to make sure that oVirt is able to join the users to the groups? Best regards Timmi

2 2

Logical interface naming issues
by Tom Edwards 09 May '19

09 May '19

Hello oVirt community, Seems lik a bug. I don't have more than one environment to test on so I can't be 100% sure and didn't want to file a report (but didn't know where else to report this). I have a fresh install self hosted ovirt cluster 4.3.1.1-1.el7. When I build any logical network adapter with a "-" in the name ex "guest-network-01" the network interface names appear on the hosts (using ip addr command) as garbled names like on8cd19bc011414. They still appear to work, but when you try to make a VNic profile based on the broken name the VMs fail to boot, the VM has to be killed via command line on each host afterwards (they try to boot and hang on all hosts in the cluster corrupting the disk of the VM) because it can't find the parent logical network interface by name. Example errors: VM Security-Onion is down with error. Exit message: (1, 'Cannot find device "guest-dmz-ne"\n', ['/sbin/tc', 'qdisc', 'add', 'dev', 'guest-dmz-network', 'ingress']). VDSM ovirt-2 command DestroyVDS failed: General Exception: ('(1, \'Cannot find device "guest-dmz-ne"\\n\', [\'/sbin/tc\', \'filter\', \'show\', \'dev\', \'guest-dmz-network\', \'parent\', \'ffff:\'])',) That took me a very long time to figure out and broke many vms in the process =(

2 1

many 4.2 leftovers after upgrade 4.3.3
by Arman Khalatyan 09 May '19

09 May '19

Hello everybody, after the upgrade of ovirt-engine node I have several packages still pointing from 4.2 repo. Actually everything is working as expected. yum clean all&& yum upgrade does not find any updates, but reinstall bringing same packages from the 4.3 repo for example: *yum reinstall safelease.x86_64 Loaded plugins: changelog, fastestmirror, langpacks, vdsmupgrade, versionlockRepository centos-sclo-rh-release is listed more than once in the configurationLoading mirror speeds from cached hostfile * base: centos.mirrors.as250.net <http://centos.mirrors.as250.net> * centos-qemu-ev: ftp.rz.uni-frankfurt.de <http://ftp.rz.uni-frankfurt.de> * extras: ftp.rrzn.uni-hannover.de <http://ftp.rrzn.uni-hannover.de> * ovirt-4.3: ftp.nluug.nl <http://ftp.nluug.nl> * ovirt-4.3-epel: mirror.infonline.de <http://mirror.infonline.de> * updates: centos.mirrors.as250.net <http://centos.mirrors.as250.net>Resolving Dependencies--> Running transaction check---> Package safelease.x86_64 0:1.0-7.el7 will be reinstalled--> Finished Dependency ResolutionDependencies Resolved============================================================================================================================================================================================== Package Arch Version Repository Size==============================================================================================================================================================================================Reinstalling: safelease x86_64 1.0-7.el7 ovirt-4.3-centos-ovirt43 21 kTransaction Summary==============================================================================================================================================================================================Reinstall 1 PackageTotal download size: 21 kInstalled size: 43 kIs this ok [y/d/N]: * But we have many others, should I reinstall them manually to get right packages? *yum list installed | grep ovirt-4.2Repository centos-sclo-rh-release is listed more than once in the configurationcollectd.x86_64 5.8.1-4.el7 @ovirt-4.2-centos-opstoolscollectd-disk.x86_64 5.8.1-4.el7 @ovirt-4.2-centos-opstoolscollectd-postgresql.x86_64 5.8.1-4.el7 @ovirt-4.2-centos-opstoolscollectd-write_http.x86_64 5.8.1-4.el7 @ovirt-4.2-centos-opstoolscollectd-write_syslog.x86_64 5.8.1-4.el7 @ovirt-4.2-centos-opstoolsgdeploy.noarch 2.0.8-1.el7 @ovirt-4.2-centos-gluster312nbdkit.x86_64 1.2.7-2.el7 @ovirt-4.2-epelnbdkit-plugin-python-common.x86_64 1.2.7-2.el7 @ovirt-4.2-epelnbdkit-plugin-python2.x86_64 1.2.7-2.el7 @ovirt-4.2-epelnbdkit-plugin-vddk.x86_64 1.2.7-2.el7 @ovirt-4.2-epelovirt-ansible-disaster-recovery.noarch 1.1.4-1.el7 @ovirt-4.2ovirt-ansible-image-template.noarch 1.1.9-1.el7 @ovirt-4.2ovirt-ansible-manageiq.noarch 1.1.13-1.el7 @ovirt-4.2ovirt-ansible-roles.noarch 1.1.6-1.el7 @ovirt-4.2ovirt-engine-cli.noarch 3.6.9.2-1.el7.centos @ovirt-4.2ovirt-js-dependencies.noarch 1.2.0-3.1.el7.centos @ovirt-4.2python-linecache2.noarch 1.0.0-1.el7 @ovirt-4.2-centos-ovirt42python-testtools.noarch 1.8.0-2.el7 @ovirt-4.2-centos-ovirt42python2-asn1crypto.noarch 0.23.0-2.el7 @ovirt-4.2-centos-ovirt42python2-cffi.x86_64 1.11.2-1.el7 @ovirt-4.2-centos-ovirt42python2-chardet.noarch 3.0.4-7.el7 @ovirt-4.2-centos-opstoolspython2-crypto.x86_64 2.6.1-16.el7 @ovirt-4.2-epelpython2-cryptography.x86_64 2.1.4-2.el7 @ovirt-4.2-centos-ovirt42python2-ecdsa.noarch 0.13-10.el7 @ovirt-4.2-epelpython2-extras.noarch 1.0.0-2.el7 @ovirt-4.2-centos-ovirt42python2-fixtures.noarch 3.0.0-7.el7 @ovirt-4.2-centos-ovirt42python2-idna.noarch 2.5-1.el7 @ovirt-4.2-centos-opstoolspython2-pyOpenSSL.noarch 17.3.0-3.el7 @ovirt-4.2-centos-ovirt42python2-pysocks.noarch 1.5.6-3.el7 @ovirt-4.2-centos-opstoolspython2-requests.noarch 2.19.1-4.el7 @ovirt-4.2-centos-opstoolspython2-traceback2.noarch 1.4.0-14.el7 @ovirt-4.2-centos-ovirt42python2-urllib3.noarch 1.21.1-1.el7 @ovirt-4.2-centos-opstoolssafelease.x86_64 1.0-7.el7 @ovirt-4.2-centos-ovirt42vdsm-jsonrpc-java.noarch 1.4.15-1.el7 @ovirt-4.2* Thanks,Arman.

2 2

EVENT_ID not generated for VM Reboot
by Sigbjorn Lie-Soland 08 May '19

08 May '19

Hi list, When a user powers down a VM from within the VM operating system (poweroff), a "moved from 'Up' --> 'Down'" message is written to engine.log, and a EVENT_ID: VM_DOWN is created -- 2019-05-08 20:53:03,495+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM 'xxxxxxxx-3966-4da2-a505-xxxxxxxxxxxx'(vmname1) moved from 'Up' --> 'Down' 2019-05-08 20:53:03,550+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-3) [] EVENT_ID: VM_DOWN(61), VM vmname1 is down. Exit message: User shut down from within the guest -- When a user starts a VM from the webadmin, a "moved from 'WaitForLaunch' --> 'PoweringUp'" and "'PoweringUp' --> 'Up'" is written to engine.log, and the events EVENT_ID: USER_STARTED_VM and EVENT_ID: USER_RUN_VM is created. -- 2019-05-08 20:53:20,976+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1388598) [xxxxxxxx-da2d-452d-a604-xxxxxxxxxxxx] EVENT_ID: USER_STARTED_VM(153), VM vmname1 was started by adminuser@ipadomain (Host: hypervisor1). 2019-05-08 20:53:24,091+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM 'xxxxxxxx-3966-4da2-a505-xxxxxxxxxxxx'(vmname1) moved from 'WaitForLaunch' --> 'PoweringUp' 2019-05-08 20:53:45,140+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-3) [] VM 'xxxxxxxx-3966-4da2-a505-xxxxxxxxxxxx'(vmname1) moved from 'PoweringUp' --> 'Up' 2019-05-08 20:53:45,238+02 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-3) [] EVENT_ID: USER_RUN_VM(32), VM vmname1 started on Host hypervisor1 -- However when a user reboots a VM from within the VM operating system, the messages "moved from 'Up' --> 'RebootInProgress'" and "moved from 'RebootInProgress' --> 'Up'" is written to the engine.log, but no EVENT_ID is generated. -- -- 2019-05-08 20:52:27,367+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM 'xxxxxxxx-3966-4da2-a505-xxxxxxxxxxxx'(vmname1) moved from 'Up' --> 'RebootInProgress' 2019-05-08 20:52:49,926+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM 'xxxxxxxx-3966-4da2-a505-xxxxxxxxxxxx'(vmname1) moved from 'RebootInProgress' --> 'Up' -- So systems like CloudForms/ManageIQ which reads the manager event log via the manager REST API is not notified when a VM is rebooted, and is therefore unable to perform any EmsEvent when the VM reboots. Why is there no EVENT_ID generated when a VM reboots? Is it possible to enable EVENT_ID's to be created for VM reboot events? Regards, Siggi

1 0

[Urgent] USB passthrough
by Juan Pablo Lorier 08 May '19

08 May '19

Hi, I'm trying to attach an USB device to a VM but although the host detects the USB device (is shown in lsusb), the host device tab in the VM is not showing that device. It show all other but not that one. Is there something I should do to update ovrit host devices? Regards

1 0

Re: Creating Thin-provisioned disks on a gluster volume
by Strahil 08 May '19

08 May '19

I have already opened a bug for that. If you are not in a hurry - postpone the migration. Best Regards, Strahil NikolovOn May 8, 2019 00:49, Dmitry Filonov <filonov(a)hkl.hms.harvard.edu> wrote: > > Hi - > We want to migrate our aging oVirt cluster to a new one and decided to go for the hyperconverged setup with Gluster and hosted engine. Got 3 new machines, set everything up, did a test VM migration and were almost ready to do final migration of our VMs when I notice one really weird thing. > When migrating VMs from NFS storage onto Gluster they stay thin provisioned. But if I try creating new disk image from the oVirt GUI - I get preallocated volume. No matter if I select "thin provision" or "Preallocated" I always get preallocated volume created. > > The engine.log says - > 2019-05-07 17:14:20,562-04 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (default task-20) [bbd94792-2f86-44eb-9334-807dd44d0742] START, CreateImageVDSCommand( CreateImageVDSCommandParameters:{storagePoolId='43550c2c-7100-11e9-9b45-00163e4babb7', ignoreFailoverLimit='false', storageDomainId='1de2f7ac-ee52-43fb-89ac-f86b62f73b9a', imageGroupId='86c5c5e9-6533-4caf-a5a5-401556a5059a', imageSizeInBytes='21474836480', volumeFormat='RAW', newImageId='470b8035-9380-408d-a644-96e8d74c4e8e', imageType='Preallocated', newImageDescription='{"DiskAlias":"test","DiskDescription":""}', imageInitialSizeInBytes='0'}), log id: 228ddfd5 > > Is there any tweak I didn't notice to make things actually what it suppose to be doing? > > oVirt 4.3.3.5-1.el7 > glusterfs 5.5-1.el7 > CentOS Linux release 7.6.1810 > > Thank you! > > -- > Dmitry Filonov > Linux Administrator > SBGrid Core | Harvard Medical School > 250 Longwood Ave, SGM-114 > Boston, MA 02115

1 0

Best arquitecture for 2 location
by raul.caballero.girol＠gmail.com 08 May '19

08 May '19

Hi everybody, I have 2 location separate geographically. I want to deploy an ovirt installation. Evary location has 3 host with a storage system. What is the best arquitecture for this scenario?. My problem is that I don know how to recover the manager if its storage is down. With a backup/recover? How I remove the old manager when I recover the storage? Cheers

2 4

Creating Thin-provisioned disks on a gluster volume
by Dmitry Filonov 08 May '19

08 May '19

Hi - We want to migrate our aging oVirt cluster to a new one and decided to go for the hyperconverged setup with Gluster and hosted engine. Got 3 new machines, set everything up, did a test VM migration and were almost ready to do final migration of our VMs when I notice one really weird thing. When migrating VMs from NFS storage onto Gluster they stay thin provisioned. But if I try creating new disk image from the oVirt GUI - I get preallocated volume. No matter if I select "thin provision" or "Preallocated" I always get preallocated volume created. The engine.log says - 2019-05-07 17:14:20,562-04 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (default task-20) [bbd94792-2f86-44eb-9334-807dd44d0742] START, CreateImageVDSCommand( CreateImageVDSCommandParameters:{storagePoolId='43550c2c-7100-11e9-9b45-00163e4babb7', ignoreFailoverLimit='false', storageDomainId='1de2f7ac-ee52-43fb-89ac-f86b62f73b9a', imageGroupId='86c5c5e9-6533-4caf-a5a5-401556a5059a', imageSizeInBytes='21474836480', volumeFormat='RAW', newImageId='470b8035-9380-408d-a644-96e8d74c4e8e',* imageType='Preallocated', *newImageDescription='{"DiskAlias":"test","DiskDescription":""}', imageInitialSizeInBytes='0'}), log id: 228ddfd5 Is there any tweak I didn't notice to make things actually what it suppose to be doing? oVirt 4.3.3.5-1.el7 glusterfs 5.5-1.el7 CentOS Linux release 7.6.1810 Thank you! -- Dmitry Filonov Linux Administrator SBGrid Core | Harvard Medical School 250 Longwood Ave, SGM-114 Boston, MA 02115

2 2

Hosted engine restore went very wrong
by Andreas Elvers 07 May '19

07 May '19

I really feel like an idiot. I tried to move our hosted engine from our Default datacenter to our Ceph Datacenter. I ran intro problems which were correctly addressed. see: https://lists.ovirt.org/archives/list/users@ovirt.org/thread/ZFCLFWRN6XR6KM… It was in case a race condition. I was able to bring back the engine to our Default Cluster. And then I tried to do the move again to our Ceph Datacenter. I got the error "The target Data Center does not contain the Virtual Disk" twice yesterday. Because it was late, I decided to do it in the next morning. I did a new backup from the engine. Copied it over to the new node of the Ceph Datacenter and started the hosted-engine --deploy. But I FORGET TO SHUTDOWN the other engine! Oh man. The deploy script errored out with: [ ERROR ] fatal: [localhost]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} [ ERROR ] fatal: [localhost -> engine.infra.solutions.work]: FAILED! => {"changed": false, "msg": "There was a failure deploying the engine on the local engine VM. The system may not be provisioned accord Then I realised something was different this time. I shutdown and undefined the Local Engine. The node is now in a degraded state. Is it possible to start the deployment again on a degraded node? I started the old engine again, but I'm not able to reach the login page. Any Idea what to do next?

1 5

Re: All Windows vms report "Actual timezone in guest doesn't match configuration"
by michael＠wanderingmad.com 07 May '19

07 May '19

I got my questions mixed up, restarting guest services does nothing.

6 9

vm_dynamic table very big in ovirt engine db
by Nardus Geldenhuys 07 May '19

07 May '19

Hi There Hope you are well. We have two clusters with two ovirt-engines. On the one cluster's ovirt -engine the vm_dynamic tables is almost 3.5 GB big, is that normal ? We are on the latest engine software. Regards Nar

1 0

Host has available update for ovirt-host, but nothing found
by Gianluca Cecchi 07 May '19

07 May '19

I have 4.3.3 on engine and hosts in 4.3.3 with plain CentOS, updated from 4.3.2 on 2/5. Since the day after, 3/5, I get the event Check for available updates on host ov200 was completed successfully with message 'found updates for packages ovirt-host'. and also the icon at side of host in web admin gui. But: [root@ov200 ~]# yum update Loaded plugins: fastestmirror, langpacks, product-id, search-disabled-repos, subscription-manager, : vdsmupgrade This system is not registered with an entitlement server. You can use subscription-manager to register. Repository centos-sclo-rh-release is listed more than once in the configuration Loading mirror speeds from cached hostfile * base: centos.mirror.garr.it * epel-util: epel.besthosting.ua * extras: centos.mirror.garr.it * ovirt-4.3: ftp.nluug.nl * ovirt-4.3-epel: epel.besthosting.ua * updates: centos.mirror.garr.it No packages marked for update [root@ov200 ~]# [root@ov200 ~]# rpm -q ovirt-host package ovirt-host is not installed [root@ov200 ~]# yum search ovirt-host: ===================================== N/S matched: ovirt-host ====================================== ovirt-host-deploy-common.noarch : Commong files for ovirt-host-deploy ovirt-host-deploy-java.noarch : ovirt-host-deploy java support ovirt-host-deploy-javadoc.noarch : Javadocs for ovirt-host-deploy ovirt-host.x86_64 : Track required packages for oVirt hosts ovirt-host-dependencies.x86_64 : This meta package pulls in all the dependencies needed for minimal : oVirt hosts. ovirt-hosted-engine-ha.noarch : oVirt Hosted Engine High Availability Manager ovirt-hosted-engine-setup.noarch : oVirt Hosted Engine setup tool python2-ovirt-host-deploy.noarch : oVirt host deploy tool This is not an oVirt-NG host, but plain CentOS.... What to do? Do I have to install the ovirt-host package anyway? Thanks in advance, Gianluca

2 4

silent install failing in 4.3.3.5-1 due to question on fqdn of host
by Brian Kircher 07 May '19

07 May '19

Anyone happen to know if I can get the following into an answer file for a silent deployment? It’s asking to confirm or change from the fqdn of the host doing the HE install. Default is fine, but I have to connect in to the screen to answer this before it will continue. Default hostname changed to generic in below log. Forward and reverse are both working via dns. QUESTION/1/OVESETUP_NETWORK_FQDN_first_HE 019-04-30 18:56:38,802-0500 DEBUG otopi.context context.dumpEnvironment:745 ENVIRONMENT DUMP - END 2019-04-30 18:56:38,804-0500 DEBUG otopi.context context._executeMethod:127 Stage validation METHOD otopi.plugins.gr_he_common.network<http://otopi.plugins.gr_he_common.network> .bridge.Plugin._validate_hostname_first_host 2019-04-30 18:56:38,806-0500 DEBUG otopi.plugins.gr_he_common.network<http://otopi.plugins.gr_he_common.network> .bridge dialog.queryEnvKey:90 queryEnvKey called for key OVEHOSTED_NETWORK/host_name 2019-04-30 18:56:38,806-0500 DEBUG otopi.plugins.otopi.dialog.human human.queryString:159 query OVESETUP_NETWORK_FQDN_first_HE 2019-04-30 18:56:38,807-0500 DEBUG otopi.plugins.otopi.dialog.human dialog.__logString:204 DIALOG:SEND Please provide the hostname of this host on the management network [ host01.domain.com<http://host01.domain.com> ]: Version 4.3.3.5<http://4.3.3.5>-1.el7 Thanks, Brian ________________________________ This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing, or copying of this email is strictly prohibited. If you received this email in error, please immediately notify the sender and delete the original.

3 4

Re: Best arquitecture for 2 location
by Strahil 07 May '19

07 May '19

You may use gluster with geo-replucation, but that doesn't support gluster updates from remote to local side, so the second location is your DR site and nothing else should be running. Maybe Simone/Sahina can clarify the ovirt part of the setup. Best Regards, Strahil NikolovOn May 6, 2019 18:15, raul.caballero.girol(a)gmail.com wrote: > > Hi everybody, > > I have 2 location separate geographically. I want to deploy an ovirt installation. Evary location has 3 host with a storage system. What is the best arquitecture for this scenario?. My problem is that I don know how to recover the manager if its storage is down. With a backup/recover? How I remove the old manager when I recover the storage? > > Cheers > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/O2TACPYDX3OYK…

1 0

replaced ovirt certs, now i'm locked out with unable to find valid certification path
by michael＠wanderingmad.com 07 May '19

07 May '19

I followed the guide here to replace the self-signed certs with 3rd party certs, and now i'm getting this error on signin: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target do i need to have the .p12 in place also? I extracted the .key and .cer from the existing PFX, and copied them to all the places in the article, renaming the .cer to .pem as neded and I always get that error. Yes, I did copy to the java directory and ran the program to update the trust store, and I can list out the trust store and see it listed. Has there been a recent change in how it handles certs? I tried it with the blank password for the certstore, with "changeit" and also changing the password to "123456" and none work.

2 5

Problem with restoring engine
by Andreas Elvers 06 May '19

06 May '19

Hello today I tried to migrate the hosted engine from our Default Datacenter (NFS) to our Ceph Datacenter. The deployment worked with the automatic "hosted-engine --deploy --restore-from-file=backup/file_name" command. Perfect. Only thing is: I messed up with the cluster name. The name should be Luise01 but I entered Luise1. Duh... Now I want to bring the engine back to the Default Datacenter. Easy thing. Just repeat the same steps again. 1. Enable global ha maintenenace 2. Stop and disable the engine 3. create the engine backup 4 ... continue with all the steps from chapter 13.1.8 RHEV Docs 4.3 Beta. Everything looked great. The ansible playbook was running, then asking for the storage domain. I entered the NFS path. It got registered, but then the ansible playbook errors out with [ INFO ] TASK [ovirt.hosted_engine_setup : Add VM] [ ERROR ] Error: Fault reason is "Operation Failed". Fault detail is "[Cannot attach Virtual Disk. The target Data Center does not contain the Virtual Disk.]". HTTP response code is 409. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Cannot attach Virtual Disk. The target Data Center does not contain the Virtual Disk.]\". HTTP response code is 409."} [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up [ INFO ] Cleaning temporary resources I see that there is a bug report on https://bugzilla.redhat.com/show_bug.cgi?id=1649424 Any idea how to get around this error ? Additionally I now have a HostedEngineLocal (shut off) on that node... How do I remove it? engine-cleanup ? Have to get some sleep. best regards.

2 2

NonResponsive Host and unknown VMs
by Alexis Grillon 06 May '19

06 May '19

Hello, Context : (probably) After a failed deletion of snapshot during a backup (it had been somes times since i got this problem), one of my host has gone Nonresponsive, and with him, all the VMs who was stored on it or run on it. Instead of removing the problem snapshot (usually it does the trick). I did reboot the host (and without maintenance, it wasn't available) On the Host log, it seems there's nothing wrong, on the Engine log, there's mostly a "ERROR [org.ovirt.engine.core.dal.dbbroker. auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-10) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxx command Get Host Capabilities failed: Message timeout which can be caused by communication issues", without further informations. One last thing, it seems gluster is working well but the command "gluster volume status" goes timeout (nothing from log seems wrong) Of course, the host ping from the engine, and the engine ping from the host. You'll find on the bottom of the mail more informations about the setup. Here are a few questions if someone can help : - Should i open a bug on that (looks a lot like https://bugzilla.redhat.com/show_bug.cgi?id=1404082 but i can't do all the test of this bug) ? - Should i be worried about the gluster timeout (the engine is on it) / should i move the gluster point of the unresponsive host on another, and remove the unresponsive host from the pool to fix that ? - i guess that if i fix the unresponsivness of the host, it'll fix the vm (that one is an easy one i hope !) - Once i will have found why the host is unresponsive, and if i can't fix it (have to reinstall it by example), how can i remove the host and the affected vms from the cluster (nearly everything is unavailable on them, maintenance for storage and host are unavailable) ? Any help will be greatly appreciated, thank you. Informations about the setup : ovirt 4.2.8.2 Gluster has been created on system before the installation of ovirt (but is well working this way). Mostly, storage of VMs are made with NFS mount on host, not on a gluster exception made for the engine. The unresponsive host is the arbiter brick of the gluster volumes. I can wipe the unresponsive host, but the cluster is a production cluster, i can't shutdown everything :) ---- Cordialement, Alexis Grillon Pôle Humanités Numériques, Outils, Méthodes et Analyse de Données. Maison Européenne des Sciences de l'Homme et de la Société MESHS - Lille Nord de France / CNRS tel. +33 (0)3 20 12 58 57 | alexis.grillon(a)meshs.fr www.meshs.fr | 2, rue des Canonniers 59000 Lille GPG fingerprint AC37 4C4B 6308 975B 77D4 772F 214F 1E97 6C08 CD11

1 0

Cascade Lake CPU in oVirt
by Matthias Leopold 06 May '19

06 May '19

Hi, do I get it right that hypervisor hosts with Cascade Lake CPU could be used in oVirt, but would be recognized as "Skylake"? Cascade Lake specific features could only be used in VMs after CL is supported by libvirt (https://bugzilla.redhat.com/show_bug.cgi?id=1677209) and this libvirt is imported in oVirt? We're thinking about buying new hardware and I want to be sure it can be used... thx matthias

2 1

Q35 in pre 4.3 updated environments?
by Gianluca Cecchi 06 May '19

06 May '19

Hello, having some environments born before 4.3.0 and Q35 introduction. Now on 4.3.3, but of course existing VMs seem not impacted and retain their machine type, eg a dumpxml gives: <type arch='x86_64' machine='pc-i440fx-rhel7.6.0'>hvm</type> Any advise if I want to update any of them to Q35 (supposing their installed OS does support that kind of hw emulation, of course)? Apart from shutdown, edit, system, advanced parameters, change, save and boot? This question leads me to something strange I have noticed: updating cluster to 4.3, when 4.3.0 was released, seems not to have changed default "Emulated Machine" type for it. In fact if I go in my cluster, I see it still with value "pc-i440fx-rhel7.6.0", even if its compatibility version is 4.3. Is this expected? If I edit the cluster I don't see an option to change to q35. My cpu type is "Intel Westmere IBRS SSBD Family", could it influence this situation in any way? Thanks in advance, Gianluca

2 1

Migrating from RHV to ovirt
by Andrés Jiménez 06 May '19

06 May '19

Hi, all I do have a 5 hosts cluster with over 300 VMs in production with Red Hat Virtualization version 4.2.8 and I am willing to switch to a pure CentOS + oVirt 4.2 setup. Management is based in a RHVM hosted-engine in a dedicated iSCSI DataStore and our hosts are a mix of RHVH nodes (3) and CentOS with oVirt 4.2 repositories (2). I was wondering if I can just set up a new hosted-engine in a CentOS host and recover a backup of our current ovirt- engine (rhvm). Would that work straight away without affecting my running VMs? Cheers, -- Andrés Jiménez Gómez Linube e-mail: soporte(a)linube.com www.linube.com La información contenida en este mensaje y/o archivo(s) adjunto(s) es confidencial/privilegiada y está destinada a ser leída sólo por la(s) persona(s) a la(s) que va dirigida. Si usted lee este mensaje y no es el destinatario señalado, el empleado o el agente responsable de entregar el mensaje al destinatario, o ha recibido esta comunicación por error, le informamos que está totalmente prohibida, y puede ser ilegal, cualquier divulgación, distribución o reproducción de esta comunicación, y le rogamos que nos lo notifique inmediatamente y nos devuelva el mensaje original a la dirección arriba mencionada. Gracias

1 0

Please Help, Ovirt Node Hosted Engine Deployment Problems 4.3.2
by Todd Barton 06 May '19

06 May '19

I've having to rebuild an environment that started back in the early 3.x days. A lot has changed and I'm attempting to use the Ovirt Node based setup to build a new environment, but I can't get through the hosted engine deployment process via the cockpit (I've done command line as well). I've tried static DHCP address and static IPs as well as confirmed I have resolvable host-names. This is a test environment so I can work through any issues in deployment. When the cockpit is displaying the waiting for host to come up task, the cockpit gets disconnected. It appears to a happen when the bridge network is setup. At that point, the deployment is messed up and I can't return to the cockpit. I've tried this with one or two nic/interfaces and tried every permutation of static and dynamic ip addresses. I've spent a week trying different setups and I've got to be doing something stupid. Attached is a screen capture of the resulting IP info after my latest try failing. I used two nics, one for the gluster and bridge network and the other for the ovirt cockpit access. I can't access cockpit on either ip address after the failure. I've attempted this setup as both a single host hyper-converged setup and a three host hyper-converged environment...same issue in both. Can someone please help me or give me some thoughts on what is wrong? Thanks! Todd Barton

4 13

oVirt 4.3.3 third async update is now available
by Sandro Bonazzola 06 May '19

06 May '19

The oVirt Team has just released a new version of the following packages: - ovirt-engine-4.3.3.7 The async release includes an additional fix ( https://gerrit.ovirt.org/#/c/99738/) for Bug 1697367 <https://bugzilla.redhat.com/show_bug.cgi?id=1697367> - make SMT setting more user friendly Thanks, -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://redhat.com/summit>

1 0

Stale hosted engine node information harmful ?
by Andreas Elvers 02 May '19

02 May '19

I have 5 nodes (node01 to node05). Originally all those nodes were part of our default datacenter/cluster with a NFS storage domain for vmdisk, engine and iso-images. All five nodes were engine HA nodes. Later node01, node02 and node03 were re-installed to have engine HA removed. Then those nodes were removed from the default cluster. Eventually node01,02 and 03 were completely re-installed to host our new Ceph/Gluster based datecenter. The engine is still running on the old default Datacenter. Now I wish to move it over to our ceph/gluster datacenter. when I look at the current output of "hosted-engine --vm-status" I see: --== Host node01.infra.solutions.work (id: 1) status ==-- conf_on_shared_storage : True Status up-to-date : False Hostname : node01.infra.solutions.work Host ID : 1 Engine status : unknown stale-data Score : 0 stopped : True Local maintenance : False crc32 : e437bff4 local_conf_timestamp : 155627 Host timestamp : 155877 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=155877 (Fri Aug 3 13:09:19 2018) host-id=1 score=0 vm_conf_refresh_time=155627 (Fri Aug 3 13:05:08 2018) conf_on_shared_storage=True maintenance=False state=AgentStopped stopped=True --== Host node02.infra.solutions.work (id: 2) status ==-- conf_on_shared_storage : True Status up-to-date : False Hostname : node02.infra.solutions.work Host ID : 2 Engine status : unknown stale-data Score : 0 stopped : True Local maintenance : False crc32 : 11185b04 local_conf_timestamp : 154757 Host timestamp : 154856 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=154856 (Fri Aug 3 13:22:19 2018) host-id=2 score=0 vm_conf_refresh_time=154757 (Fri Aug 3 13:20:40 2018) conf_on_shared_storage=True maintenance=False state=AgentStopped stopped=True --== Host node03.infra.solutions.work (id: 3) status ==-- conf_on_shared_storage : True Status up-to-date : False Hostname : node03.infra.solutions.work Host ID : 3 Engine status : unknown stale-data Score : 0 stopped : False Local maintenance : True crc32 : 9595bed9 local_conf_timestamp : 14363 Host timestamp : 14362 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=14362 (Thu Aug 2 18:03:25 2018) host-id=3 score=0 vm_conf_refresh_time=14363 (Thu Aug 2 18:03:25 2018) conf_on_shared_storage=True maintenance=True state=LocalMaintenance stopped=False --== Host node04.infra.solutions.work (id: 4) status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : node04.infra.solutions.work Host ID : 4 Engine status : {"health": "good", "vm": "up", "detail": "Up"} Score : 3400 stopped : False Local maintenance : False crc32 : 245854b1 local_conf_timestamp : 317498 Host timestamp : 317498 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=317498 (Thu May 2 09:44:47 2019) host-id=4 score=3400 vm_conf_refresh_time=317498 (Thu May 2 09:44:47 2019) conf_on_shared_storage=True maintenance=False state=EngineUp stopped=False --== Host node05.infra.solutions.work (id: 5) status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : node05.infra.solutions.work Host ID : 5 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped : False Local maintenance : False crc32 : 0711afa0 local_conf_timestamp : 318044 Host timestamp : 318044 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=318044 (Thu May 2 09:44:45 2019) host-id=5 score=3400 vm_conf_refresh_time=318044 (Thu May 2 09:44:45 2019) conf_on_shared_storage=True maintenance=False state=EngineDown stopped=False The old node01, node02 and node03 are still present. The new incarnations of node01, node02 and node03 will be the destination the the deployment of the new home of our engine to which I wish to restore the backup to. But I'm not sure, if (and how) the old date should be removed first.

2 2

oVirt 4.3.3 - servers cannot be reached
by Wood Peter 02 May '19

02 May '19

Hi, I setup AD authentication and from command line all looks good. Unfortunately, on the Web UI users sometimes login successfully but most of the times the login screen just hangs and after 2-3 min. it displays "Unable to log in because servers cannot be reached. Try again later." In engine.log I see this: 2019-05-02 11:12:11,581-07 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-72) [] EVENT_ID: USER_VDC_LOGIN_FAILED(114), User peter(a)ad.mycompany.com connecting from '10.12.29.48' failed to log in : 'Unable to log in because servers cannot be reached. Try again later.'. 2019-05-02 11:12:11,583-07 ERROR [org.ovirt.engine.core.sso.servlets.InteractiveAuthServlet] (default task-68) [] Cannot authenticate user 'peter(a)ad.mycompany.com' connecting from '10.12.29.48': Unable to log in because servers cannot be reached. Try again later. Even when my login attempt on the Web UI is hanging I can still successfully run the login test from shell: ovirt-engine-extensions-tool aaa login-user --profile=ad.mycompany.com --user-name=peter The above command never fails. That makes me wonder why am I getting the "servers cannot be reached" error? I assume the AD servers cannot be reached but from the command line it works perfect every time. Any idea what could be the problem or where to look for the error. Thank you, -- Peter

1 0

oVirt VM Table View Survey
by Sandro Bonazzola 02 May '19

02 May '19

Hi, the oVirt UX team at Red Hat would like to get your feedback on the VM table view that's featured in the admin portal. The survey will also run during Summit out of the UXD research and feedback booth. We kindly ask you to join the survey and answer at https://redhatdg.co1.qualtrics.com/jfe/form/SV_cGwhuzRUQGTXnp3 This survey is under oVirt Privacy Policy available at https://www.ovirt.org/site/privacy-policy.html -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://redhat.com/summit>

1 0

Prevent Gluster Volume being monitored by oVirt
by smirta＠gmx.net 02 May '19

02 May '19

Dear all We are running a oVirt GlusterFS hyperconverged setup with arbiter version 4.2.6.4-1.el7 here. It looks like we are affected by this bug https://bugzilla.redhat.com/show_bug.cgi?id=1614430 with one or more gluster volumes that are not storage domains of oVirt. Is there a way to exclude them from monitoring (vdsm-gluster) or to prevent being added to the engine's database? Thanks Simon

1 0

Re: Stale hosted engine node information harmful ?
by Strahil 02 May '19

02 May '19

In a Red Hat Solution , it is recommended to restart ovirt-ha-agent & ovirt-ha-broker. I usually set the global maintenance and wait 20s-30s . Then I just stop on all nodes ovirt-ha-agent.service & ovirt-ha-broker.service . Once everywhere is stopped, start the 2 services on all nodes and wait 4-5min. Last verify the status from each host, before removing global maintenance. Best Regards, Strahil NikolovOn May 2, 2019 12:30, Andreas Elvers <andreas.elvers+ovirtforum(a)solutions.work> wrote: > > I have 5 nodes (node01 to node05). Originally all those nodes were part of our default datacenter/cluster with a NFS storage domain for vmdisk, engine and iso-images. All five nodes were engine HA nodes. > Later node01, node02 and node03 were re-installed to have engine HA removed. Then those nodes were removed from the default cluster. Eventually node01,02 and 03 were completely re-installed to host our new Ceph/Gluster based datecenter. The engine is still running on the old default Datacenter. Now I wish to move it over to our ceph/gluster datacenter. > > when I look at the current output of "hosted-engine --vm-status" I see: > > --== Host node01.infra.solutions.work (id: 1) status ==-- > > conf_on_shared_storage : True > Status up-to-date : False > Hostname : node01.infra.solutions.work > Host ID : 1 > Engine status : unknown stale-data > Score : 0 > stopped : True > Local maintenance : False > crc32 : e437bff4 > local_conf_timestamp : 155627 > Host timestamp : 155877 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=155877 (Fri Aug 3 13:09:19 2018) > host-id=1 > score=0 > vm_conf_refresh_time=155627 (Fri Aug 3 13:05:08 2018) > conf_on_shared_storage=True > maintenance=False > state=AgentStopped > stopped=True > > > --== Host node02.infra.solutions.work (id: 2) status ==-- > > conf_on_shared_storage : True > Status up-to-date : False > Hostname : node02.infra.solutions.work > Host ID : 2 > Engine status : unknown stale-data > Score : 0 > stopped : True > Local maintenance : False > crc32 : 11185b04 > local_conf_timestamp : 154757 > Host timestamp : 154856 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=154856 (Fri Aug 3 13:22:19 2018) > host-id=2 > score=0 > vm_conf_refresh_time=154757 (Fri Aug 3 13:20:40 2018) > conf_on_shared_storage=True > maintenance=False > state=AgentStopped > stopped=True > > > --== Host node03.infra.solutions.work (id: 3) status ==-- > > conf_on_shared_storage : True > Status up-to-date : False > Hostname : node03.infra.solutions.work > Host ID : 3 > Engine status : unknown stale-data > Score : 0 > stopped : False > Local maintenance : True > crc32 : 9595bed9 > local_conf_timestamp : 14363 > Host timestamp : 14362 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=14362 (Thu Aug 2 18:03:25 2018) > host-id=3 > score=0 > vm_conf_refresh_time=14363 (Thu Aug 2 18:03:25 2018) > conf_on_shared_storage=True > maintenance=True > state=LocalMaintenance > stopped=False > > > --== Host node04.infra.solutions.work (id: 4) status ==-- > > conf_on_shared_storage : True > Status up-to-date : True > Hostname : node04.infra.solutions.work > Host ID : 4 > Engine status : {"health": "good", "vm": "up", "detail": "Up"} > Score : 3400 > stopped : False > Local maintenance : False > crc32 : 245854b1 > local_conf_timestamp : 317498 > Host timestamp : 317498 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=317498 (Thu May 2 09:44:47 2019) > host-id=4 > score=3400 > vm_conf_refresh_time=317498 (Thu May 2 09:44:47 2019) > conf_on_shared_storage=True > maintenance=False > state=EngineUp > stopped=False > > > --== Host node05.infra.solutions.work (id: 5) status ==-- > > conf_on_shared_storage : True > Status up-to-date : True > Hostname : node05.infra.solutions.work > Host ID : 5 > Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} > Score : 3400 > stopped : False > Local maintenance : False > crc32 : 0711afa0 > local_conf_timestamp : 318044 > Host timestamp : 318044 > Extra metadata (valid at timestamp): > metadata_parse_version=1 > metadata_feature_version=1 > timestamp=318044 (Thu May 2 09:44:45 2019) > host-id=5 > score=3400 > vm_conf_refresh_time=318044 (Thu May 2 09:44:45 2019) > conf_on_shared_storage=True > maintenance=False > state=EngineDown > stopped=False > > > The old node01, node02 and node03 are still present. > > The new incarnations of node01, node02 and node03 will be the destination the the deployment of the new home of our engine to which I wish to restore the backup to. But I'm not sure, if (and how) the old date should be removed first. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/WF5BNCWZHS2ZF…

2 1

Re: All hosts non-operational after upgrading from 4.2 to 4.3
by Strahil 02 May '19

02 May '19

Are you able to access your iSCSI via the /rhev/data-center/mnt... mount point ? Best Regards, Strahil NikolovOn Apr 5, 2019 19:04, John Florian <jflorian(a)doubledog.org> wrote: > > I am in a severe pinch here. A while back I upgraded from 4.2.8 to 4.3.3 and only had one step remaining and that was to set the cluster compat level to 4.3 (from 4.2). When I tried this it gave the usual warning that each VM would have to be rebooted to complete, but then I got my first unusual piece when it then told me next that this could not be completed until each host was in maintenance mode. Quirky I thought, but I stopped all VMs and put both hosts into maintenance mode. I then set the cluster to 4.3. Things didn't want to become active again and I eventually noticed that I was being told the DC needed to be 4.3 as well. Don't remember that from before, but oh well that was easy. > > However, the DC and SD remains down. The hosts are non-op. I've powered everything off and started fresh but still wind up in the same state. Hosts will look like their active for a bit (green triangle) but then go non-op after about a minute. It appears that my iSCSI sessions are active/logged in. The one glaring thing I see in the logs is this in vdsm.log: > > 2019-04-05 12:03:30,225-0400 ERROR (monitor/07bb1bf) [storage.Monitor] Setting up monitor for 07bb1bf8-3b3e-4dc0-bc43-375b09e06683 failed (monitor:329) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 326, in _setupLoop > self._setupMonitor() > File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 348, in _setupMonitor > self._produceDomain() > File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 158, in wrapper > value = meth(self, *a, **kw) > File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 366, in _produceDomain > self.domain = sdCache.produce(self.sdUUID) > File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 110, in produce > domain.getRealDomain() > File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 51, in getRealDomain > return self._cache._realProduce(self._sdUUID) > File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 134, in _realProduce > domain = self._findDomain(sdUUID) > File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 151, in _findDomain > return findMethod(sdUUID) > File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 176, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) > StorageDomainDoesNotExist: Storage domain does not exist: (u'07bb1bf8-3b3e-4dc0-bc43-375b09e06683',) > > How do I proceed to get back operational?

2 1

Re: Fwd: [Gluster-users] Announcing Gluster release 5.5
by Strahil 02 May '19

02 May '19

Hi Darrel, Will it fix the cluster brick sudden death issue ? Best Regards, Strahil NikolovOn Mar 21, 2019 21:56, Darrell Budic <budic(a)onholyground.com> wrote: > > This release of Gluster 5.5 appears to fix the gluster 3.12->5.3 migration problems many ovirt users have encountered. > > I’ll try and test it out this weekend and report back. If anyone else gets a chance to check it out, let us know how it goes! > > -Darrell > >> Begin forwarded message: >> >> From: Shyam Ranganathan <srangana(a)redhat.com> >> Subject: [Gluster-users] Announcing Gluster release 5.5 >> Date: March 21, 2019 at 6:06:33 AM CDT >> To: announce(a)gluster.org, gluster-users Discussion List <gluster-users(a)gluster.org> >> Cc: GlusterFS Maintainers <maintainers(a)gluster.org> >> >> The Gluster community is pleased to announce the release of Gluster >> 5.5 (packages available at [1]). >> >> Release notes for the release can be found at [3]. >> >> Major changes, features and limitations addressed in this release: >> >> - Release 5.4 introduced an incompatible change that prevented rolling >> upgrades, and hence was never announced to the lists. As a result we are >> jumping a release version and going to 5.5 from 5.3, that does not have >> the problem. >> >> Thanks, >> Gluster community >> >> [1] Packages for 5.5: >> https://download.gluster.org/pub/gluster/glusterfs/5/5.5/ >> >> [2] Release notes for 5.5: >> https://docs.gluster.org/en/latest/release-notes/5.5/ >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users(a)gluster.org >> https://lists.gluster.org/mailman/listinfo/gluster-users > >

9 18