February 2019 - Users - oVirt List Archives

glusterevents daemon fails after upgrade from 4.2.8 to 4.3
by Edward Berger 26 Feb '19

26 Feb '19

I upgraded some nodes from 4.28 to 4.3 and now when I look at the cockpit "services" tab I see a red failure for Gluster Events Notifier and clicking through I get these messages below. 14:00 glustereventsd.service failed. systemd 14:00 Unit glustereventsd.service entered failed state. systemd 14:00 glustereventsd.service: main process exited, code=exited, status=1/FAILURE systemd 14:00 ValueError: Attempted relative import in non-package glustereventsd 14:00 from .eventsapiconf import (LOG_FILE, glustereventsd 14:00 File "/usr/libexec/glusterfs/events/utils.py", line 29, in <module> glustereventsd 14:00 import utils glustereventsd 14:00 File "/usr/libexec/glusterfs/events/handlers.py", line 12, in <module> glustereventsd 14:00 import handlers glustereventsd 14:00 File "/usr/sbin/glustereventsd", line 24, in <module> glustereventsd

5 6

Re: [ovirt-users] Large DWH Database, how to empty
by Matt . 26 Feb '19

26 Feb '19

Hi, OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB smaller. Does this sounds familiar to you with other settings in 4.0.5 ? Thanks, Matt 2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco(a)redhat.com>: > No. That will corrupt your database. > > Are you using the full dwh or the smaller version for the dashboards? > > Please set the delete thresholds to save less data and the data older then > the time you set will be deleted. > Add a file to /ovirt-engine-dwhd.conf.d/ > update_time_to_keep_records.conf > > Add these lines with the new configurations. The numbers represent the hours > to keep the data. > > DWH_TABLES_KEEP_SAMPLES=24 > DWH_TABLES_KEEP_HOURLY=1440 > DWH_TABLES_KEEP_DAILY=43800 > > > These are the configurations for a full dwh. > > The smaller version configurations are: > DWH_TABLES_KEEP_SAMPLES=24 > DWH_TABLES_KEEP_HOURLY=720 > DWH_TABLES_KEEP_DAILY=0 > > The delete process by default at 3am every day (DWH_DELETE_JOB_HOUR=3) > > Best regards, > > Shirly Radco > > BI Software Engineer > Red Hat Israel Ltd. > 34 Jerusalem Road > Building A, 4th floor > Ra'anana, Israel 4350109 > > > On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014(a)gmail.com> wrote: >> >> Hi, >> >> I seem to have some large database for the DWH logging and I wonder >> how I can empty it safely. >> >> Can I just simply empty the database ? >> >> Have a good weekend! >> >> Cheers, >> >> Matt >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > >

1 0

engine-iso-uploader very slow
by t.marchetti＠caen.it 26 Feb '19

26 Feb '19

Hi, I'm a newbe with ovirt, I've install on my test machine ovirt with self hosted engine with nfs storage. I'm tryng to execute <engine-iso-uploader upload -i ISO /tmp/ubuntu-18.04-desktop-amd64.iso> and the execution is very slow, approx 2 hour, but I don't know why, any suggestion? Thanks in advance Bye

4 3

Re: [ovirt-users] Packet loss
by Doron Fediuck 26 Feb '19

26 Feb '19

----_com.android.email_640187878761650 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 SGkgS3lsZSzCoApXZSBtYXkgaGF2ZSBzZWVuIHNvbWV0aGluZyBzaW1pbGFyIGluIHRoZSBwYXN0 IGJ1dCBJIHRoaW5rIHRoZXJlIHdlcmUgdmxhbnMgaW52b2x2ZWQuwqAKSXMgaXQgdGhlIHNhbWUg Zm9yIHlvdT/CoApUb255IC8gRGFuLCBkb2VzIGl0IHJpbmcgYSBiZWxsP8Kg ----_com.android.email_640187878761650 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0 L2h0bWw7IGNoYXJzZXQ9VVRGLTgiPjwvaGVhZD48Ym9keSA+PGRpdj5IaSBLeWxlLCZuYnNwOzwv ZGl2PjxkaXY+V2UgbWF5IGhhdmUgc2VlbiBzb21ldGhpbmcgc2ltaWxhciBpbiB0aGUgcGFzdCBi dXQgSSB0aGluayB0aGVyZSB3ZXJlIHZsYW5zIGludm9sdmVkLiZuYnNwOzwvZGl2PjxkaXY+SXMg aXQgdGhlIHNhbWUgZm9yIHlvdT8mbmJzcDs8L2Rpdj48ZGl2PlRvbnkgLyBEYW4sIGRvZXMgaXQg cmluZyBhIGJlbGw/Jm5ic3A7PC9kaXY+PC9ib2R5PjwvaHRtbD4= ----_com.android.email_640187878761650--

2 1

Re: Adding user to internalz with webadmin?
by Strahil 26 Feb '19

26 Feb '19

You need to login on the engine and use 'ovirt-aaa-jdbc-tool' to create your user and assign a password. Once you have the user, you can assign roles to it via the web UI. Best Regards, Strahil NikolovOn Feb 26, 2019 07:21, Juhani Rautiainen <juhani.rautiainen(a)gmail.com> wrote: > > Hi! > > How do you add users to internalz with webadmin? I mean there is add a > button in Administration->Users which opens 'Add Users and > Groups'-window . Windows has 'Add'- and 'Add and close'- buttons in > the bottom. Just can't figure out how they work. Pushing either of > those Add-buttons just closes the window. > > -Juhani > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/Y4GFUACEHEEHY…

1 0

Re: oVirt Node install failed
by Strahil 26 Feb '19

26 Feb '19

I guess you can log on ovirt2 and run hosted-engine --set-maintenance --mode=local && sleep 30 && hosted-engine --vm-status Then reinstall ovirt2 from the web UI and mark the engine for deployment. Once the reinstall is over - remove maintenance via : hosted-engine --set-maintenance --mode=none Best Regards, Strahil Nikolov

1 0

Move infrastructure ,how to change FQDN
by Fabrice SOLER 26 Feb '19

26 Feb '19

Hello, I need to move all the physical infrastructure oVirt to another site (for student education). The node's FQDN and the hosted engine's FQDN must change. The version is ovirt 4.2.8 for the hosted engine and nodes. Is there sommone who know how to do ? Fabrice SOLER

2 1

[ANN] oVirt 4.3.1 Second Release Candidate is now available
by Sandro Bonazzola 26 Feb '19

26 Feb '19

The oVirt Project is pleased to announce the availability of the oVirt 4.3.1 Second Release Candidate, as of February 26th, 2019. This update is a release candidate of the first in a series of stabilization updates to the 4.3 series. This is pre-release software. This pre-release should not to be used in production. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later * oVirt Node 4.3 (available for x86_64 only) Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included. See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is available for EL7 only - oVirt Node is available for EL7 only [2] - Fedora 28 based appliance and node couldn't be built due to a bug in Lorax (the tool used to build the images) affecting Fedora 28. Additional Resources: * Read more about the oVirt 4.3.1 release highlights: http://www.ovirt.org/release/4.3.1/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.1/ [2] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

1 0

running engine-setup against postgresql running on non-default port
by ivan.kabaivanov＠gmail.com 26 Feb '19

26 Feb '19

Hi, I'm running Linux From Scratch and I'm compiling ovirt from source. It all builds and installs fine. However, since I may sometimes run engine-setup from within a chroot on a host that already runs ovirt-engine and postgresql on port 5432, I would like to be able to start a new instance of postgresql on port 55555 inside the chroot, run engine-setup within the same chroot, tell it to connect to postgresql on port 55555, then once set up, I would like to manually change all config files and change postgresql port from 55555 to 5432, so when I transfer this installation to a different computer postgresql will run on 5432 and ovirt-engine (and all the other components) will know to use port 5432. Trouble is, this is easier said than done. Even when I tell engine-setup to connect to 55555 something insists on connecting to 5432: [ INFO ] Installing PostgreSQL uuid-ossp extension into database [ ERROR ] Failed to execute stage 'Misc configuration': could not connect to server: No such file or directory Is the server running locally and accepting connections on Unix domain socket "/var/run/postgresql/.s.PGSQL.5432"? I've manually changed all the ovirt-engine and ovirt-engine-dwh files that contained 5432, to no avail. Ideas? Thanks, IvanK.

2 3

Gluster setup Problem
by Matthew Roth 26 Feb '19

26 Feb '19

I have 3 servers, Node 1 is 3tb /dev/sda, Node 2, 3tb /dev/sdb, node3 3tb /dev/sdb I start the process for gluster deployment. I change node 1 to sda and all the other ones to sdb. I get no errors however, when I get to Creating physical Volume all it does is spin forever . doesnt get any further. I can leave it there for 5 hours and doesn't go anywhere. #gdeploy configuration generated by cockpit-gluster plugin [hosts] cmdnode1.cmd911.com cmdnode2.cmd911.com cmdnode3.cmd911.com [script1:cmdnode1.cmd911.com] action=execute ignore_script_errors=no file=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sda -h cmdnode1.cmd911.com, cmdnode2.cmd911.com, cmdnode3.cmd911.com [script1:cmdnode2.cmd911.com] action=execute ignore_script_errors=no file=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h cmdnode1.cmd911.com, cmdnode2.cmd911.com, cmdnode3.cmd911.com [script1:cmdnode3.cmd911.com] action=execute ignore_script_errors=no file=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h cmdnode1.cmd911.com, cmdnode2.cmd911.com, cmdnode3.cmd911.com [disktype] raid6 [diskcount] 12 [stripesize] 256 [service1] action=enable service=chronyd [service2] action=restart service=chronyd [shell2] action=execute command=vdsm-tool configure --force [script3] action=execute file=/usr/share/gdeploy/scripts/blacklist_all_disks.sh ignore_script_errors=no [pv1:cmdnode1.cmd911.com] action=create devices=sda ignore_pv_errors=no [pv1:cmdnode2.cmd911.com] action=create devices=sdb ignore_pv_errors=no [pv1:cmdnode3.cmd911.com] action=create devices=sdb ignore_pv_errors=no [vg1:cmdnode1.cmd911.com] action=create vgname=gluster_vg_sda pvname=sda ignore_vg_errors=no [vg1:cmdnode2.cmd911.com] action=create vgname=gluster_vg_sdb pvname=sdb ignore_vg_errors=no [vg1:cmdnode3.cmd911.com] action=create vgname=gluster_vg_sdb pvname=sdb ignore_vg_errors=no [lv1:cmdnode1.cmd911.com] action=create poolname=gluster_thinpool_sda ignore_lv_errors=no vgname=gluster_vg_sda lvtype=thinpool size=1005GB poolmetadatasize=5GB [lv2:cmdnode2.cmd911.com] action=create poolname=gluster_thinpool_sdb ignore_lv_errors=no vgname=gluster_vg_sdb lvtype=thinpool size=1005GB poolmetadatasize=5GB [lv3:cmdnode3.cmd911.com] action=create poolname=gluster_thinpool_sdb ignore_lv_errors=no vgname=gluster_vg_sdb lvtype=thinpool size=41GB poolmetadatasize=1GB [lv4:cmdnode1.cmd911.com] action=create lvname=gluster_lv_engine ignore_lv_errors=no vgname=gluster_vg_sda mount=/gluster_bricks/engine size=100GB lvtype=thick [lv5:cmdnode1.cmd911.com] action=create lvname=gluster_lv_data ignore_lv_errors=no vgname=gluster_vg_sda mount=/gluster_bricks/data lvtype=thinlv poolname=gluster_thinpool_sda virtualsize=500GB [lv6:cmdnode1.cmd911.com] action=create lvname=gluster_lv_vmstore ignore_lv_errors=no vgname=gluster_vg_sda mount=/gluster_bricks/vmstore lvtype=thinlv poolname=gluster_thinpool_sda virtualsize=500GB [lv7:cmdnode2.cmd911.com] action=create lvname=gluster_lv_engine ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/engine size=100GB lvtype=thick [lv8:cmdnode2.cmd911.com] action=create lvname=gluster_lv_data ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/data lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=500GB [lv9:cmdnode2.cmd911.com] action=create lvname=gluster_lv_vmstore ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/vmstore lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=500GB [lv10:cmdnode3.cmd911.com] action=create lvname=gluster_lv_engine ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/engine size=20GB lvtype=thick [lv11:cmdnode3.cmd911.com] action=create lvname=gluster_lv_data ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/data lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=20GB [lv12:cmdnode3.cmd911.com] action=create lvname=gluster_lv_vmstore ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/vmstore lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=20GB [selinux] yes [service3] action=restart service=glusterd slice_setup=yes [firewalld] action=add ports=111/tcp,2049/tcp,54321/tcp,5900/tcp,5900-6923/tcp,5666/tcp,16514/tcp,54322/tcp services=glusterfs [script2] action=execute file=/usr/share/gdeploy/scripts/disable-gluster-hooks.sh [shell3] action=execute command=usermod -a -G gluster qemu [volume1] action=create volname=engine transport=tcp replica=yes replica_count=3 key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal value=virt,36,36,30,on,off,enable brick_dirs=cmdnode1.cmd911.com:/gluster_bricks/engine/engine,cmdnode2.cmd911.com:/gluster_bricks/engine/engine,cmdnode3.cmd911.com:/gluster_bricks/engine/engine ignore_volume_errors=no arbiter_count=1 [volume2] action=create volname=data transport=tcp replica=yes replica_count=3 key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal value=virt,36,36,30,on,off,enable brick_dirs=cmdnode1.cmd911.com:/gluster_bricks/data/data,cmdnode2.cmd911.com:/gluster_bricks/data/data,cmdnode3.cmd911.com:/gluster_bricks/data/data ignore_volume_errors=no arbiter_count=1 [volume3] action=create volname=vmstore transport=tcp replica=yes replica_count=3 key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal value=virt,36,36,30,on,off,enable brick_dirs=cmdnode1.cmd911.com:/gluster_bricks/vmstore/vmstore,cmdnode2.cmd911.com:/gluster_bricks/vmstore/vmstore,cmdnode3.cmd911.com:/gluster_bricks/vmstore/vmstore ignore_volume_errors=no arbiter_count=1

3 4

Adding user to internalz with webadmin?
by Juhani Rautiainen 26 Feb '19

26 Feb '19

Hi! How do you add users to internalz with webadmin? I mean there is add a button in Administration->Users which opens 'Add Users and Groups'-window . Windows has 'Add'- and 'Add and close'- buttons in the bottom. Just can't figure out how they work. Pushing either of those Add-buttons just closes the window. -Juhani

2 2

Tracking down high writes in GlusterFS volume
by Jayme 26 Feb '19

26 Feb '19

Running an oVirt 4.3 HCI 3-way replica cluster with SSD backed storage. I've noticed that my SSD writes (smart Total_LBAs_Written) are quite high on one particular drive. Specifically I've noticed one volume is much much higher total bytes written than others (despite using less overall space). My volume is writing over 1TB of data per day (by my manual calculation, and with glusterfs profiling) and wearing my SSDs quickly, how can I best determine which VM or process is at fault here? There are 5 low use VMs using the volume in question. I'm attempting to track iostats on each of the vm's individually but so far I'm not seeing anything obvious that would account for 1TB of writes per day that the gluster volume is reporting.

2 1

Add compute nodes offline
by xilazz＠126.com 26 Feb '19

26 Feb '19

Hi, when I add compute nodes, I do not intend to add compute nodes to the engine controller without connecting to the external network: An error has occurred during installation of Host node5.test.com: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: Please verify its path and try again. Do I need to manually download some offline packages in this case?

2 2

Windows service applications migrated to the ovirt platform
by xilazz＠126.com 26 Feb '19

26 Feb '19

Hi，I now have a physical machine on which I want to migrate Windows applications to the ovirt management platform. May I ask if virt-p2v can be used for migration? Does ovirt itself have a migration tool to use?

1 0

Re: oVirt Node install failed
by Strahil 26 Feb '19

26 Feb '19

What is the output of 'hosted-engine --vm-status' from the host that is hosting the HostedEngine VM? Best Regards, Strahil NikolovOn Feb 26, 2019 05:50, kiv(a)intercom.pro wrote: > > The crown icon on the left of the second host is gray. When I try to migrate the engine, I get the error: > > Migration of VM 'HostedEngine' to host 'ovirt2' failed: VM destroyed during the startup > EVENT_ID: VM_MIGRATION_NO_VDS_TO_MIGRATE_TO(166), No available host was found to migrate VM HostedEngine to. > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/NHG7MBNCPYMSX…

3 2

Python-SDK4- Issue following links
by Don Dupuis 26 Feb '19

26 Feb '19

Hi I am trying to write some code to update the names of existing vnicprofiles in ovirt-4.2. The problem I am having is trying to follow the links to the vnicprofiles. Below is web info that I am trying to get: <network href="/ovirt-engine/api/networks/740cae1f-c49f-4563-877a-5ce173e83be4" id="740cae1f-c49f-4563-877a-5ce173e83be4"><name>ovirtmgmt</name><description>LOOKING</description><comment/><link href="/ovirt-engine/api/networks/740cae1f-c49f-4563-877a-5ce173e83be4/permissions" rel="permissions"/><link href="/ovirt-engine/api/networks/740cae1f-c49f-4563-877a-5ce173e83be4/vnicprofiles" rel="vnicprofiles"/><link href="/ovirt-engine/api/networks/740cae1f-c49f-4563-877a-5ce173e83be4/networklabels" rel="networklabels"/><mtu>0</mtu><stp>false</stp><usages><usage>vm</usage></usages><vlan id="4050"/><data_center href="/ovirt-engine/api/datacenters/1d00d32b-abdc-43cd-b990-257aaf01d514" id="1d00d32b-abdc-43cd-b990-257aaf01d514"/></network> Below is the code that I am trying to do the same thing and I want to follow the vnicprofiles link to get to the actual data that I want to change: #!/usr/bin/env python import logging import time import string import sys import os import MySQLdb import ovirtsdk4 as sdk import ovirtsdk4.types as types #logging.basicConfig(level=logging.DEBUG, filename='/tmp/addhost.log') ### Variables to be used ### #NUMANODE = 3 #MEM = 20 GB = 1024 * 1024 * 1024 #MEMORY = MEM * GB GB = 1024 * 1024 * 1024 URL = 'https://host/ovirt-engine/api' CAFILE = '/etc/pki/ovirt-engine/ca.pem' USERNAME = 'admin@internal' PASSWORD = 'password' HOSTNAME = 'rvs06' connection = sdk.Connection( url=URL, username=USERNAME, password=PASSWORD, # ca_file='ca.pem', debug='True', insecure='True', # log=logging.getLogger(), ) #dcs_service = connection.system_service().data_centers_service() #dc = dcs_service.list(search='cluster=%s-local' % HOSTNAME)[0] #network = dcs_service.service(dc.id).networks_service() networks_service = connection.system_service().networks_service() network = networks_service.list( search='name=ovirtmgmt and datacenter=%s-local' % HOSTNAME) [0] print ("Network name is %s" % network.name) print ("Network id is %s" % network.id) vnic = connection.follow_link(network.vnicprofiles) connection.close() Below is the output of my code: ./update-vnic.py Network name is ovirtmgmt Network id is 740cae1f-c49f-4563-877a-5ce173e83be4 Traceback (most recent call last): File "./update-vnic.py", line 46, in <module> vnic = connection.follow_link(network.vnicprofiles) AttributeError: 'Network' object has no attribute 'vnicprofiles' The network name and network id is correct. Any help would be appreciated on what I am missing or what I am doing wrong. The actual updating of the name with code isn't written yet as I can't get past this part. Thanks Don

2 7

Unrecognized message received error when ISO domain is put in Maintenance
by Wood Peter 26 Feb '19

26 Feb '19

Hi all, We are running oVirt 4.1.1 on engine and nodes. The ISO storage domain is NFS. Everything has been working great for years. Now I need to move the ISO and Export domains to a different storage server. When I put the ISO domain in maintenance the Master domain and the Export domain start flipping active-non active. The Events tab in the Web UI shows this message scrolling every 30 sec. or so: "Datacenter is being initialized. Please wait for initialization to complete" ... but it never completes. It also starts cycling the SPM assignment from one node to another. As soon as I activate back the ISO domain everything calms down and no more errors are recorded in the logs. In engine.log I see this "Unrecognized message received" error: 2019-02-25 19:45:20,467-08 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages Unrecognized message received 2019-02-25 19:45:20,481-08 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler6) [76363b98] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), Correlation ID: null, Call Stack: null, Custom E vent ID: -1, Message: VDSM command GetStoragePoolInfoVDS failed: Unrecognized message received 2019-02-25 19:45:20,481-08 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler6) [76363b98] ERROR, org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand, exception: VDSGenericExce ption: VDSNetworkException: Unrecognized message received , log id: 1635c439 2019-02-25 19:45:20,481-08 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler6) [76363b98] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetwor kException: Unrecognized message received In vdsm.log on the nodes I see this: 2019-02-25 19:45:29,817-0800 ERROR (upgrade/b5b7a10) [storage.StoragePool] Unhandled exception (utils:371) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 368, in wrapper return f(*a, **kw) File "/usr/lib/python2.7/site-packages/vdsm/concurrent.py", line 180, in run return func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/share/vdsm/storage/sp.py", line 232, in _upgradePoolDomain self._finalizePoolUpgradeIfNeeded() File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 77, in wrapper raise SecureError("Secured object is not in safe state") SecureError: Secured object is not in safe state And I believe that after that error it moves the SPM to another host, gets the same error and continues moving it to the next host and so on. I really need to move the ISO and Export domains to a different storage server. Any idea what is causing this or how to fix it? Appreciate any help. Thanks, -- Peter

1 0

/boot partition of oVirt node missing after reboot
by andy.law＠hactlsolutions.com 26 Feb '19

26 Feb '19

I've installed oVirt Node 4.2 on one of my servers. Recently I've upgraded the kernel version to 3.10.0-957.5.1.el7.x86_64. After such update, I've rebooted the server to take effect and then the /boot partition cannot be recognized. The server then enters emergency mode and I've tried to run the command blkid but I cannot find the uuid of /boot and /boot/efi. Before reboot: # blkid /dev/mapper/onn-var_crash: UUID="2aa920d6-c2d2-4313-8df1-8be16a5718ae" TYPE="ext4" /dev/mapper/3600508b1001cede21ec59eb753184259p3: UUID="Vy9K1K-e4uI-oM73-blSV-eU29-FnZP-3FIh4Y" TYPE="LVM2_member" PARTUUID="57cfd006-60d0-4826-8f58-6d11d4e1cb94" /dev/mapper/3600508b1001cede21ec59eb753184259p1: SEC_TYPE="msdos" UUID="7408-0A3B" TYPE="vfat" PARTLABEL="EFI System Partition" PARTUUID="56cadb64-9099-4ec8-9c0c-94596c80b2a9" /dev/mapper/3600508b1001cede21ec59eb753184259p2: UUID="3e920048-3b2e-4c09-b507-c9debe7d98f0" TYPE="ext4" PARTUUID="9ee53bdd-3051-443b-960f-9801d7245d33" /dev/mapper/onn-ovirt--node--ng--4.2.7.1--0.20181219.0+1: UUID="111ed68a-a7e8-4b17-8add-5c8fd9035bbc" TYPE="ext4" /dev/mapper/onn-swap: UUID="0fcbdcfe-92da-43d4-a773-ef6f7dac0556" TYPE="swap" /dev/mapper/onn-var_log_audit: UUID="48531956-48cc-4faa-9dfc-e7baaab89b3b" TYPE="ext4" /dev/mapper/onn-var_log: UUID="15c57452-0333-4a9a-a8e6-220155e819b3" TYPE="ext4" /dev/mapper/onn-var: UUID="772613a5-be4f-4044-8b95-c846852f5421" TYPE="ext4" /dev/mapper/onn-tmp: UUID="1ee263bf-9dcb-46e8-92f7-f21a8c87eeb5" TYPE="ext4" /dev/mapper/onn-home: UUID="738d2e6f-d7e0-4d3a-acc0-6db1392a0222" TYPE="ext4" /dev/sdc: UUID="e2pRkW-V1Vd-XxqK-5PBK-5Vtb-8Mgr-YjgB1M" TYPE="LVM2_member" /dev/mapper/360060e80122ed80050402ed800000a00: UUID="e2pRkW-V1Vd-XxqK-5PBK-5Vtb-8Mgr-YjgB1M" TYPE="LVM2_member" /dev/sdd: UUID="WlBAsN-q2YR-vYGL-Syx4-HJ30-CbVk-v2Q7yt" TYPE="LVM2_member" /dev/mapper/360060e80122ed80050402ed800000a01: UUID="WlBAsN-q2YR-vYGL-Syx4-HJ30-CbVk-v2Q7yt" TYPE="LVM2_member" /dev/sde: UUID="e2pRkW-V1Vd-XxqK-5PBK-5Vtb-8Mgr-YjgB1M" TYPE="LVM2_member" /dev/sdf: UUID="WlBAsN-q2YR-vYGL-Syx4-HJ30-CbVk-v2Q7yt" TYPE="LVM2_member" /dev/mapper/c0d0ef19--826b--44d7--a380--658adb915964-master: UUID="a409bf9f-63b6-42ac-8759-038f1bc3337f" TYPE="ext3" /dev/mapper/e399fd7f--c884--4e3d--89cf--7d8ddae16058-master: UUID="887319bd-d3e4-4dfe-9f8c-3e4ee2498ccb" SEC_TYPE="ext2" TYPE="ext3" /dev/mapper/3600508b1001cede21ec59eb753184259: PTTYPE="gpt" /dev/sdb: PTTYPE="gpt" /dev/mapper/c0d0ef19--826b--44d7--a380--658adb915964-a72e9370--0649--4e6f--b10a--1015b6b2134f: PTTYPE="dos" #cat /etc/fstab /dev/onn/ovirt-node-ng-4.2.7.1-0.20181219.0+1 / ext4 defaults,discard 1 1 UUID=3e920048-3b2e-4c09-b507-c9debe7d98f0 /boot ext4 defaults 1 2 UUID=7408-0A3B /boot/efi vfat umask=0077,shortname=winnt 0 0 /dev/mapper/onn-home /home ext4 defaults,discard 1 2 /dev/mapper/onn-tmp /tmp ext4 defaults,discard 1 2 /dev/mapper/onn-var /var ext4 defaults,discard 1 2 /dev/mapper/onn-var_log /var/log ext4 defaults,discard 1 2 /dev/mapper/onn-var_log_audit /var/log/audit ext4 defaults,discard 1 2 /dev/mapper/onn-swap swap swap defaults 0 0 Any ideas what caused this?

1 0

Stuck completing last step of 4.3 upgrade
by Jayme 25 Feb '19

25 Feb '19

Environment setup: 3 Host HCI GlusterFS setup. Identical hosts, Dell R720s w/ Intel E5-2690 CPUs 1 default data center (4.2 compat) 1 default cluster (4.2 compat) Situation: I recently upgraded my three node HCI cluster from Ovirt 4.2 to 4.3. I did so by first updating the engine to 4.3 then upgrading each ovirt-node host to 4.3 and rebooting. Currently engine and all hosts are running 4.3 and all is working fine. To complete the upgrade I need to update cluster compatibility to 4.3 and then data centre to 4.3. This is where I am stuck. The CPU type on cluster is "Intel SandyBridge IBRS Family". This option is no longer available if I select 4.3 compatibility. Any other option chosen such as SandyBridge IBRS SSBD will not allow me to switch to 4.3 as all hosts must be in maintenance mode (which is not possible w/ self hosted engine). I saw another post about this where someone else followed steps to create a second cluster on 4.3 with new CPU type then move one host to it, start engine on it then perform other steps to eventually get to 4.3 compatibility. I tried to add a 4.3 cluster with gluster service and put one of my hosts in to maintenance mode but could not move it to the new cluster, it gave me an error about the host having gluster service. If I try to import gluster config in cluster add UI it fails in engine log with "SERVER_ALREADY_EXISTS_IN_ANOTHER_CLUSTER" My question is, what is the proper procedure for me to complete upgrading my three node HCI environment to 4.3 cluster compatibility along with changing CPU type? Do I really need to create a second cluster and move host(s) to it? If so how can I move an existing host with running gluster service to a new cluster? Thanks in advance!

7 20

Re: Problem deploying self-hosted engine on ovirt 4.3.0
by Strahil 25 Feb '19

25 Feb '19

Your /var/tmp is full. Clean it up a little bit and give it a try. Best Regards, Strahil Nikolov

1 0

Re: Ovirt Glusterfs
by Strahil 25 Feb '19

25 Feb '19

Hi Sahina, Thanks for your reply. Let me share my test results with gluster v3 . I have a 3-node hyperconverged setup with 1 Gbit/s network and SSD (sata-based) for LVM caching. Testing the bricks showed higher than the network performance. 1. Tested ovirt 4.2.7/4.2.8 with fuse mounts. Using 'dd if=/dev/zero of=/default/gluster/Mount point/from/ovirt bs=1M count=5000'. Results: 56MB/s directly on the mount point, 20+-2 MB/s from a VM. Reads on fuse mount point -> 500+ MB/s Disabling sharing increased performance from the fuse mount point, nothing beneficial from a VM. Converting the bricks of a volume to 'tmpfs' does not bring any performance gain for FUSE mount. 2. Tested ovirt 4.2.7/4.2.8 with gfapi - performance in VM -> approx 30 MB/s 3. Gluster native NFS (now deprecated) on ovirt 4.2.7/4.2.8 -> 120MB/s on mount point, 100+ MB/s in VM My current setup: Storhaug + ctdb + nfs-ganesha (ovirt 4.2.7/4.2.8) -> 80+-2 MB/s in the VM. Reads are around the same speed. Sadly, I didn't have the time to test performance on gluster v5 (ovirt 4.3.0) , but I haven't noticed any performance gain for the engine. My suspicion with FUSE is that when a gluster node is also playing the role of a client -> it still uses network bandwidth to communicate to itself, but I could be wrong. According to some people on the gluster lists, the FUSE performance is expected ,but my tests with disabled sharing shows better performance. Most of the time 'gtop' does not show any spikes and iftop shows that network usage is not going over 500 Mbit/s As I hit some issues with the deployment on 4.2.7 , I decided to stop my tests for now. Best Regards, Strahil Nikolov On Feb 25, 2019 09:17, Sahina Bose <sabose(a)redhat.com> wrote: > > The options set on the gluster volume are tuned for data consistency and reliability. > > Some of the changes that you can try > 1. use gfapi - however this will not provide you HA if the server used to access the gluster volume is down. (the backup-volfile-servers are not used in case of gfapi). You can change this using the engine-config tool for your cluster level. > 2. Change the remote-dio:enable to turn on client side brick caching. Ensure that you have a power backup in place, so that you don't end up with data loss in case server goes down before data is flushed. > > If you're seeing issues with a particular version of glusterfs, please provide gluster profile output for us to help identify bottleneck. (check https://docs.gluster.org/en/latest/Administrator%20Guide/Monitoring%20Workl… on how to do this) > > On Fri, Feb 22, 2019 at 1:39 PM Sandro Bonazzola <sbonazzo(a)redhat.com> wrote: >> >> Adding Sahina >> >> Il giorno ven 22 feb 2019 alle ore 06:51 Strahil <hunter86_bg(a)yahoo.com> ha scritto: >>> >>> I have done some testing and it seems that storhaug + ctdb + nfs-ganesha is showing decent performance in a 3 node hyperconverged setup. >>> Fuse mounts are hitting some kind of limit when mounting gluster -3.12.15 volumes. >>> >>> Best Regards, >>> Strahil Nikolov >>> >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7U5J4KYDJJS4W… >> >> >> >> -- >> >> SANDRO BONAZZOLA >> >> MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV >> >> Red Hat EMEA >> >> sbonazzo(a)redhat.com

1 0

HC : JBOD or RAID5/6 for NVME SSD drives?
by Guillaume Pavese 25 Feb '19

25 Feb '19

Hi, We have been evaluating oVirt HyperConverged for 9 month now with a test cluster of 3 DELL Hosts with Hardware RAID5 on PERC card. We were not impressed with the performance... No SSD for LV Cache on these hosts but I tried anyway with LV Cache on a ram device. Perf were almost unchanged. It seems that LV Cache is its own source of bugs and problems anyway, so we are thinking going for full NVME drives when buying the production cluster. What would the recommandation be in that case, JBOD or RAID? Thanks Guillaume Pavese Ingénieur Système et Réseau Interactiv-Group

3 3

Re: HostedEngine Unreachable
by Simone Tiraboschi 25 Feb '19

25 Feb '19

On Mon, Feb 25, 2019 at 2:53 PM Sakhi Hadebe <sakhi(a)sanren.ac.za> wrote: > Hi Simone, > > The name resolution is working fine. > > Running: > getent ahosts engine.sanren.ac.za > > gives the same output: > > 192.168.x.x STREAM engine.sanren.ac.za > 192.168.x.x DGRAM > 192.168.x.x RAW > The IP address being the engine IP Address. > > The hosts are on the same subnet as the HostedEngine. I can ping the hosts > from each other. There is a NATting device, that NATs the private IP > addresses to public IP addresses. From the hosts I can reach the internet, > but I cant ping from outside (security measure). We also using this device > to VPN to the cluster > > *[root@gohan ~]# virsh -r list* > * Id Name State* > *----------------------------------------------------* > * 13 HostedEngine running* > > *[root@gohan ~]# virsh -r dumpxml HostedEngine | grep -i tlsPort > <graphics type='spice' port='5901' tlsPort='5902' autoport='yes' > listen='192.168.x.x' passwdValidTo='1970-01-01T00:00:01'>* > > *[root@gohan ~]# virsh -r vncdisplay HostedEngine* > *192.168.x.x:0* > > *[root@gohan ~]# hosted-engine --add-console-password* > *Enter password:* > > *You can now connect the hosted-engine VM with VNC at 192.168.x.x:5900* > > VNCing with the above gives me the blank black screen and a cursor (See > attached). I cant do anything on that screen. > OK, I can suggest to to power off the engine VM with hosted-engine --vm-poweroff and then start it again with hosted-engine --vm-start in order to follow the whole boot process over VNC > > > Please help > > > > On Mon, Feb 25, 2019 at 11:34 AM Simone Tiraboschi <stirabos(a)redhat.com> > wrote: > >> >> >> On Mon, Feb 25, 2019 at 10:27 AM Sakhi Hadebe <sakhi(a)sanren.ac.za> wrote: >> >>> Hi Simone, >>> >>> Thank you for your response. Executing the command below, gives this: >>> >>> [root@ovirt-host]# curl http://$(grep fqdn /etc/ovirt-hosted-engine/hosted-engine.conf >>> | cut -d= -f2)/ovirt-engine/services/health >>> curl: (7) Failed to connect to engine.sanren.ac.za:80; No route to host >>> >>> I tried to enable http traffic on the ovirt-host, but the error persists >>> >> >> Run, on your hosts, >> getent ahosts engine.sanren.ac.za >> >> and ensure that it got resolved as you wish. >> Fix name resolution and routing on your hosts in a coherent manner. >> >> > > -- > Regards, > Sakhi Hadebe > > Engineer: South African National Research Network (SANReN)Competency Area, Meraka, CSIR > > Tel: +27 12 841 2308 <+27128414213> > Fax: +27 12 841 4223 <+27128414223> > Cell: +27 71 331 9622 <+27823034657> > Email: sakhi(a)sanren.ac.za <shadebe(a)csir.co.za> > >

1 0

[oVirt 4.3.1 Test Day] cmdline HE Deployment
by Guillaume Pavese 25 Feb '19

25 Feb '19

He deployment with "hosted-engine --deploy" fails at TASK [ovirt.hosted_engine_setup : Get local VM IP] See following Error : 2019-02-25 12:46:50,154+0100 INFO otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:109 TASK [ovirt.hosted_engine_setup : Get local VM IP] 2019-02-25 12:55:26,823+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:103 {u'_ansible_parsed': True, u'stderr_lines': [], u'cmd': u"virsh -r net-dhcp-leases default | grep -i 00 :16:3e:3e:fe:28 | awk '{ print $5 }' | cut -f1 -d'/'", u'end': u'2019-02-25 12:55:26.666925', u'_ansible_no_log': False, u'stdout': u'', u'changed': True, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"virsh -r net-dhcp-leases default | grep -i 00:16:3e:3e:fe:28 | awk '{ print $5 }' | cut -f1 -d'/'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'std in': None}}, u'start': u'2019-02-25 12:55:26.584686', u'attempts': 50, u'stderr': u'', u'rc': 0, u'delta': u'0:00:00.082239', u'stdout_lines': []} 2019-02-25 12:55:26,924+0100 ERROR otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:107 fatal: [localhost]: FAILED! => {"attempts": 50, "changed": true, "cmd": "virsh -r net-dhcp-leases default | grep -i 00:16:3e:3e:fe:28 | awk '{ print $5 }' | cut -f1 -d'/'", "delta": "0:00:00.082239", "end": "2019-02-25 12:55:26.666925", "rc": 0, "start": "2019-02-25 12:55:26.584686", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Guillaume Pavese Ingénieur Système et Réseau Interactiv-Group

3 5

Gluster - performance.strict-o-direct and other performance tuning in different storage backends
by Leo David 25 Feb '19

25 Feb '19

Hello Everyone, As per some previous posts, this "performance.strict-o-direct=on" setting caused trouble or poor vm iops. I've noticed that this option is still part of default setup or automatically configured with "Optimize for virt. store" button. In the end... is this setting a good or a bad practice for setting the vm storage volume ? Does it depends ( like maybe other gluster performance options ) on the storage backend: - raid type / jbod - raid controller cache size I am usually using jbod disks attached to lsi hba card ( no cache ). Any gluster recommendations regarding this setup ? Is there any documentation for best practices on configurating ovirt's gluster for different types of storage backends ? Thank you very much ! Have a great week, Leo -- Best regards, Leo David

2 2