- Users - oVirt List Archives

Removing stale unused disks from Ovirt Storage domains?
by Jacob Green 07 Dec '18

07 Dec '18

Hello, after migrating our Fiber Channel to a new Ovirt 4.2 environment, we over the years and through experimenting and mistakes have ended up with some stale LVM's/disks on our fibre channel storage that Ovirt no longer is able to manage correctly or is unaware of. I am looking for a reliable to way to do a few different things. The first is figuring out precisely what LVM ids belong to a VM and is being used by that VM. The second is figuring out if a LVM I have found on the Storage domain is being used at all by any VM or if ovirt is even aware of it. I have fumbled around a bit. And using a combination of the following I have been able to figure out some of them. But now I am finding information that does not match or may not be correct or I am interpreting the data wrong. Anyway this is a big deal, because we want to remove the stale unused LVMs and it would obviously be disastrous if I deleted the wrong LVM from the FC. So I know its not recommend but since I am not actually telling vdsm-client to do anything other than get information I figure its harmless. So here is what I have found so far. *vdsm-client Host getVMFullList vmname=<VM_NAME_HERE> | grep volumeID* *lvs | grep <noted volumeID here>* With the above I have had some success verifying what LVMs a device is using. However now I am having trouble figuring out a particular windows server VMs LVM id's. what I want to know is there a better way? Also two more things. You could call these feature requests, however it would be nice if there was a way to see all the unused LVMs on a storage domain that are not Tied to a VM. And it would also be nice to be able to remove un-imported VMs that reside on a storage domain without importing them. Anyway trying to get rid of un-imported vms and getting rid of unused LVMs has been a chore. I wish there was an easier way. -- Jacob Green Systems Admin American Alloy Steel 713-300-5690

1 0

VM ramdomly unresponsive
by fsoyer 07 Dec '18

07 Dec '18

Hi all, I continue to try to understand my problem between (I suppose) oVirt anf Gluster. After my recents posts titled 'VMs unexpectidly restarted' that did not provide solution nor search idea, I submit to you another (related ?) problem. Parallely with the problem of VMs down (that did not reproduce since Oct 16), I have ramdomly some events in the GUI saying "VM xxxxx is not responding." For example, VM "patjoub1" on 2018-11-11 14:34. Never the same hour, not all the days, often this VM patjoub1 but not always : I had it on two others. All VMs disks are on a volume DATA02 (with leases on the same volume). Searching in engine.log, I found : 2018-11-11 14:34:32,953+01 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] VM '6116fb07-096b-4c7e-97fe-01ecc9a6bd9b'(patjoub1) moved from 'Up' --> 'NotResponding' 2018-11-11 14:34:33,116+01 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerObjectsBuilder] (EE-ManagedThreadFactory-engineScheduled-Thread-1) [] Invalid or unknown guest architecture type '' received from guest agent 2018-11-11 14:34:33,176+01 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] EVENT_ID: VM_NOT_RESPONDING(126), VM patjoub1 is not responding. ... ... 2018-11-11 14:34:48,278+01 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (EE-ManagedThreadFactory-engineScheduled-Thread-48) [] VM '6116fb07-096b-4c7e-97fe-01ecc9a6bd9b'(patjoub1) moved from 'NotResponding' --> 'Up'So it becomes up 15s after, and the VM (and the monitoring) see no downtime. At this time, I see in vdsm.log of the nodes : 2018-11-11 14:33:49,450+0100 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/glusterSD/victor.local.systea.fr:_DATA02/ffc53fd8-c5d1-4070-ae51-2e91835cd937/dom_md/metadata (monitor:498) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 496, in _pathChecked delay = result.delay() File "/usr/lib/python2.7/site-packages/vdsm/storage/check.py", line 391, in delay raise exception.MiscFileReadException(self.path, self.rc, self.err) MiscFileReadException: Internal file read failure: (u'/rhev/data-center/mnt/glusterSD/victor.local.systea.fr:_DATA02/ffc53fd8-c5d1-4070-ae51-2e91835cd937/dom_md/metadata', 1, 'Read timeout') 2018-11-11 14:33:49,450+0100 INFO (check/loop) [storage.Monitor] Domain ffc53fd8-c5d1-4070-ae51-2e91835cd937 became INVALID (monitor:469) 2018-11-11 14:33:59,451+0100 WARN (check/loop) [storage.check] Checker u'/rhev/data-center/mnt/glusterSD/victor.local.systea.fr:_DATA02/ffc53fd8-c5d1-4070-ae51-2e91835cd937/dom_md/metadata' is blocked for 20.00 seconds (check:282) 2018-11-11 14:34:09,480+0100 INFO (event/37) [storage.StoragePool] Linking /rhev/data-center/mnt/glusterSD/victor.local.systea.fr:_DATA02/ffc53fd8-c5d1-4070-ae51-2e91835cd937 to /rhev/data-center/6efda7f8-b62f-11e8-9d16-00163e263d21/ffc53fd8-c5d1-4070-ae51-2e91835cd937 (sp:1230)OK : so, DATA02 marked as blocked for 20s ? I definitly have a problem with gluster ? I'll inevitably find the reason in the gluster logs ? Uh : not at all. Please see gluster logs here : https://seafile.systea.fr/d/65df86cca9d34061a1e4/ Unfortunatly I discovered this morning that I have not the sanlock.log for this date. I don't understand why, the log rotate seems OK with "rotate 3", but I have no backups files :(. But, luck in bad luck, the same event occurs this morning ! Same VM patjoub1, 2018-11-13 08:01:37. So I have added the sanlock.log for today, maybe it can help. IMPORTANT NOTE : don't forget that Gluster log with on hour shift. For this event at 14:34, search at 13h34 in gluster logs. I recall my configuration : Gluster 3.12.13 oVirt 4.2.3 3 nodes where the third is arbiter (volumes in replica 2) The nodes are never overloaded (CPU average 5%, no peak detected at the time of the event, mem 128G used at 15% (only 10 VMs on this cluster)). Network underused, gluster is on a separate network on a bond (2 NICs) 1+1Gb mode 4 = 2Gb, used in peak at 10%. Here is the configuration for the given volume : # gluster volume status DATA02 Status of volume: DATA02 Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------ Brick victorstorage.local.systea.fr:/home/d ata02/data02/brick 49158 0 Y 4990 Brick gingerstorage.local.systea.fr:/home/d ata02/data02/brick 49153 0 Y 8460 Brick eskarinastorage.local.systea.fr:/home /data01/data02/brick 49158 0 Y 2470 Self-heal Daemon on localhost N/A N/A Y 8771 Self-heal Daemon on eskarinastorage.local.s ystea.fr N/A N/A Y 11745 Self-heal Daemon on victorstorage.local.sys tea.fr N/A N/A Y 17055 Task Status of Volume DATA02 ------------------------------------------------------------------------------ There are no active volume tasks # gluster volume info DATA02 Volume Name: DATA02 Type: Replicate Volume ID: 48bf5871-339b-4f39-bea5-9b5848809c83 Status: Started Snapshot Count: 0 Number of Bricks: 1 x (2 + 1) = 3 Transport-type: tcp Bricks: Brick1: victorstorage.local.systea.fr:/home/data02/data02/brick Brick2: gingerstorage.local.systea.fr:/home/data02/data02/brick Brick3: eskarinastorage.local.systea.fr:/home/data01/data02/brick (arbiter) Options Reconfigured: network.ping-timeout: 30 server.allow-insecure: on cluster.granular-entry-heal: enable features.shard-block-size: 64MB performance.stat-prefetch: on server.event-threads: 3 client.event-threads: 8 performance.io-thread-count: 32 storage.owner-gid: 36 storage.owner-uid: 36 user.cifs: off features.shard: on cluster.shd-wait-qlength: 10000 cluster.shd-max-threads: 8 cluster.locking-scheme: granular cluster.data-self-heal-algorithm: full cluster.server-quorum-type: server cluster.quorum-type: auto cluster.eager-lock: enable network.remote-dio: enable performance.low-prio-threads: 32 performance.io-cache: off performance.read-ahead: off performance.quick-read: off transport.address-family: inet nfs.disable: on performance.client-io-threads: off cluster.server-quorum-ratio: 51% So : is there someone around trying to make me understand what append ? Pleeease :/ -- Regards, Frank

3 4

Re: Hypconverged Gluster Setup hangs after TLS/SSL
by Sahina Bose 07 Dec '18

07 Dec '18

On Fri, 7 Dec 2018 at 5:35 PM, Matthias Barmeier < matthias.barmeier(a)sourcepark.de> wrote: > I don't think so because the known_hosts contain all host keys of all > gluster nodes before start of setup. Also, the FQDN that’s used to add the hosts to engine? Is that also in known_hosts? > > Or do I miss something ? > > > Am Freitag, den 07.12.2018, 12:17 +0530 schrieb Sahina Bose: > > I think you may be running into > > https://bugzilla.redhat.com/show_bug.cgi?id=1651516 > > > > On Thu, Dec 6, 2018 at 7:30 PM <matthias.barmeier(a)sourcepark.de> > > wrote: > > > > > > Hi, > > > > > > tried to setup hyperconverged with glusterfs. I used three i7 with > > > two 1TB Disks and two NICs. Everythin worked fine till: > > > > > > [ INFO ] TASK [Set Engine public key as authorized key without > > > validating the TLS/SSL certificates] > > > > > > appears in the wizards window. Does anyone has a hint on what to > > > do? > > > _______________________________________________ > > > Users mailing list -- users(a)ovirt.org > > > To unsubscribe send an email to users-leave(a)ovirt.org > > > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > > > oVirt Code of Conduct: https://www.ovirt.org/community/about/commun > > > ity-guidelines/ > > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.or > > > g/message/BI6Z576SKSTNQZRBCWLYMVFYTRZVZOCE/ >

2 1

DATA Domain with 1GB limit
by mohamedbehbity＠gmail.com 07 Dec '18

07 Dec '18

Once the attached the domain to a data center, the real size of the DAT domain is displayed as 1 GB

1 0

Hypconverged Gluster Setup hangs after TLS/SSL
by matthias.barmeier＠sourcepark.de 07 Dec '18

07 Dec '18

Hi, tried to setup hyperconverged with glusterfs. I used three i7 with two 1TB Disks and two NICs. Everythin worked fine till: [ INFO ] TASK [Set Engine public key as authorized key without validating the TLS/SSL certificates] appears in the wizards window. Does anyone has a hint on what to do?

2 1

vGPU
by 董青龙 07 Dec '18

07 Dec '18

Hi all, I am testing vGPU in ovirt4.2. I have a nvidia p100 GPU installed in the host and I have installed the correct dirver. I followed this page(https://www.ovirt.org/documentation/install-guide/appe-Preparing_a_Hos… but I failed. In the "Host Devices tab" I got an device called "GP100GL [Tesla P100 PCIe 16GB]". I could not find any device of "mdev type". Anyone can help me? Thanks a lot!

1 0

Centos7.6
by Demeter Tibor 06 Dec '18

06 Dec '18

Dear All, I just wondering I would like to make an upgrade from 4.2.5 to latest stable release of ovirt. Meanwhile centos7.6 was released. Will that compatible with the current release of ovirt? How is safe an upgrade now? Thanks in advance, Regards, Tibor

4 5

[ANN] oVirt 4.3.0 Second Alpha Release is now available for testing
by Sandro Bonazzola 06 Dec '18

06 Dec '18

The oVirt Project is pleased to announce the availability of the Second Alpha Release of oVirt 4.3.0, as of December 6th, 2018 This is pre-release software. This pre-release should not to be used in production. Please take a look at our community page[1] to learn how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This update is the second alpha release of the 4.3.0 version. This release brings more than 80 enhancements and more than 330 bug fixes on top of oVirt 4.2 series. What's new in oVirt 4.3.0? * Q35 chipset, support booting using UEFI and Secure Boot * Skylake-server and AMD EPYC support * New smbus driver in windows guest tools * Improved support for v2v * Tech preview for oVirt on Fedora 28 * Hundreds of bug fixes on top of oVirt 4.2 series * New VM portal details page (see a preview here: https://imgur.com/a/ExINpci) * New Cluster upgrade UI * OVN security groups * IPv6 (static host addresses) * LLDP Labeler * Support for 3.6 and 4.0 data centers, clusters and hosts were removed * Now using PostgreSQL 10 This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later * oVirt Node 4.3 (available for x86_64 only) Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included. See the release notes draft [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available for both CentOS 7 and Fedora 28 (tech preview). - oVirt Node NG is already available for both CentOS 7 - oVirt Node NG for Fedora 28 (tech preview) is facing build issues on Jenkins and will be released as soon as possible Additional Resources: * Read more about the oVirt 4.3.0 release highlights: http://www.ovirt.org/release/4.3.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.3.0/ [4] http://resources.ovirt.org/pub/ovirt-4.3-pre/iso/ -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

1 0

Re: start vm without engine
by Michal Skrivanek 06 Dec '18

06 Dec '18

> On 6 Dec 2018, at 12:30, David David <dd432690(a)gmail.com> wrote: > > > > On 29 May 2018, at 16:08, David David <dd432690(a)gmail.com <mailto:dd432690@gmail.com>> wrote: > > > > > > hi. > > > > > > How to start VM directly in hypervisor? ovirt-engine was crashed. > > > that is not supported yet > > > > > > > VM's id is known. > > > > > > vdsclient VM, hasn't argumets for starting vm. > > > Hello again > > > it does, but you need to connect storage and then supply the whole VM configuration which is not simple to do. > > Ok. How to do this ? > > I have access to FC storage, where VM placed you can use the persisted libvirt definition on host where it was running last if the host just crashed (it’s removed on clean guest shutdown though). If you have it you can connect the appropriate storage domain using vdsm-client, and then start the VM using that libvirt definition. again, it’s not very easy to do. In all other cases it would have to be generated by the engine again as the OVF_STORE OVF backup is an OVF and you need libvirt’s XML so you would have to convert it first anyway, so again nothing simple to do. In disaster recovery scenrio you can just take the whole storage domain and import it into the new clean engine installation and you’ll get all the VMs it depends what you really want to do Thanks, michal > > вт, 29 мая 2018 г. в 18:53, Michal Skrivanek <michal.skrivanek(a)redhat.com <mailto:michal.skrivanek@redhat.com>>: > > > > On 29 May 2018, at 16:08, David David <dd432690(a)gmail.com <mailto:dd432690@gmail.com>> wrote: > > > > hi. > > > > How to start VM directly in hypervisor? ovirt-engine was crashed. > > that is not supported yet > > > > > VM's id is known. > > > > vdsclient VM, hasn't argumets for starting vm. > > it does, but you need to connect storage and then supply the whole VM configuration which is not simple to do. > > > > > Thanks. > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> > > To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users-leave@ovirt.org> > > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ <https://www.ovirt.org/site/privacy-policy/> > > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ <https://www.ovirt.org/community/about/community-guidelines/> > > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/SDTALWD2CHOEE… <https://lists.ovirt.org/archives/list/users@ovirt.org/message/SDTALWD2CHOEE…> >

1 0

Cloud-init reset network configuration to default dhcp after reboot and regular run
by Mike Lykov 06 Dec '18

06 Dec '18

Hi All! I'm trying to configure network in VMs created from template, and see strange behaviour from cloud-init. cloud-init installed and enabled in template. ver cloud-init-0.7.9-24.el7.centos.1.x86_64 guest Centos 7.5 ovirt 4.2.7 from ovirt-releases-42-pre repo 1. I use "run once" with initial run - use cloud-init - networks in-guest net iface : eth0 add new - static enter address, mask, gw ipv6 none Run (once) and cloud-init configure ifcfg-eth0 for that address (successfully). 2. I shutdown that VM and use "Run" (regular) without "use cloud init" in VM properties, awaiting that above configurations are saved (and booted with it). But because "use cloud init" not checked, and cloud-init service enabled, it start, cannot find datasource and drop configuration to default (dhcp). In cloud-init.log 2018-11-20 13:53:24,153 - util.py[WARNING]: No instance datasource found! Likely bad things to come! 2018-11-20 13:53:24,153 - util.py[DEBUG]: No instance datasource found! Likely bad things to come! Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/cloudinit/cmd/main.py", line 236, in main_init init.fetch(existing=existing) File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 343, in fetch return self._get_data_source(existing=existing) File "/usr/lib/python2.7/site-packages/cloudinit/stages.py", line 253, in _get_data_source pkg_list, self.reporter) File "/usr/lib/python2.7/site-packages/cloudinit/sources/__init__.py", line 320, in find_source raise DataSourceNotFoundException(msg) DataSourceNotFoundException: Did not find any data source, searched classes: (DataSourceNoCloudNet) 2018-11-20 13:53:24,194 - stages.py[DEBUG]: applying net config names for {'version': 1, 'config': [{'subnets': [{'type': 'dhcp'}], 'type': 'physical', 'name': 'eth0', 'mac_address': '56:6f:21:4a:00:04'}]} It reverts config as in here https://lists.ovirt.org/archives/list/users@ovirt.org/thread/NE27UO4WNZIC27… 3. then I found bug https://bugzilla.redhat.com/show_bug.cgi?id=1439373#c5 and when "run once" I disable network config as in that comment. Shutdown, Run (not once) and voila! Ip address are static! 2018-11-20 15:07:31,601 - handlers.py[DEBUG]: finish: init-network/search-NoCloudNet: SUCCESS: no network data found from DataSource NoCloudNet ..... 2018-11-20 15:07:31,602 - util.py[WARNING]: No instance datasource found! Likely bad things to come! 2018-11-20 15:07:31,602 - util.py[DEBUG]: No instance datasource found! Likely bad things to come! 2018-11-20 15:07:31,639 - stages.py[DEBUG]: network config disabled by system_cfg 2018-11-20 15:07:31,639 - stages.py[INFO]: network config is disabled by system_cfg 2018-11-20 15:07:31,639 - main.py[DEBUG]: [net] Exiting without datasource in local mode 2018-11-20 15:07:31,640 - util.py[DEBUG]: Reading from /proc/uptime (quiet=False) 2018-11-20 15:07:31,640 - util.py[DEBUG]: Read 12 bytes from /proc/uptime 2018-11-20 15:07:31,640 - util.py[DEBUG]: cloud-init mode 'init' took 0.287 seconds (0.29) 2018-11-20 15:07:31,640 - handlers.py[DEBUG]: finish: init-network: SUCCESS: searching for network datasources "cloud-init used to use a "marker" file that it created on initial execution. If that "marker" file existed it would not rerun on reboot. " - are it not working in ovirt/this cloud-init version ? -- Mike

2 8