- Users - oVirt List Archives

PostgreSQL tuning in oVirt
by Hari Prasanth Loganathan 12 Mar '18

12 Mar '18

Hi Team, We increased the number of threads in Apache web server and JBoss and we are able to scale up to 500 concurrent requests in oVirt. But after the long run, we are getting the below error from PostgreSQL but the oVirt is still running successfully. org.springframework.dao.DataAccessResourceFailureException: PreparedStatementCallback; SQL [select * from getvdcoptionbyname(?, ?)]; This connection has been closed.; nested exception is org.postgresql.util.PSQLException: This connection has been closed. 1) Could somebody explain this error? 2) What are the tuning parameters for PostgreSQL? SystemConfiguration for reference : 16 GB Ram, 5GB for Ovirt Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 4 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 58 Model name: Intel(R) Core(TM) i5-3450 CPU @ 3.10GHz Stepping: 9 CPU MHz: 3369.191 BogoMIPS: 6200.27 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 6144K NUMA node0 CPU(s): 0-3 OS: Cent OS Thanks, Hari -- DISCLAIMER The information in this e-mail is confidential and may be subject to legal privilege. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized. If you have received this communication in error, please address with the subject heading "Received in error," send to it(a)msystechnologies.com, then delete the e-mail and destroy any copies of it. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. The views, opinions, conclusions and other information expressed in this electronic mail and any attachments are not given or endorsed by the company unless otherwise indicated by an authorized representative independent of this message. MSys cannot guarantee that e-mail communications are secure or error-free, as information could be intercepted, corrupted, amended, lost, destroyed, arrive late or incomplete, or contain viruses, though all reasonable precautions have been taken to ensure no viruses are present in this e-mail. As our company cannot accept responsibility for any loss or damage arising from the use of this e-mail or attachments we recommend that you subject these to your virus checking procedures prior to use

1 0

Problem with repo virtio-win-stable
by Fabrice Bacchella 12 Mar '18

12 Mar '18

--Apple-Mail=_CE333282-F5F3-4479-B392-69D17FCA599E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I'm trying to setup a local cache of the repository virtio-win-stable, = using Sonatype's nexus3. But it's a little picky about content-type and = this repository setup is not to it's taste: it's says : 2018-03-12 15:47:21,025+0100 WARN [qtp2016749412-36] *UNKNOWN = org.sonatype.nexus.repository.view.handlers.ExceptionHandler - Invalid = content: GET = /repodata/5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98= -primary.xml.gz: org.sonatype.nexus.repository.InvalidContentException: = Detected content type [application/xml, application/x-xml, text/xml], = but expected [application/x-gzip, application/gzip, application/x-tgz, = application/gzip-compressed, application/gzipped, application/x-gunzip, = application/x-gzip-compressed, gzip/document]: = repodata/5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-= primary.xml.gz And indeed: $ curl -JORLv = https://fedorapeople.org/groups/virt/virtio-win/repo/stable/repodata/50487= 16d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-primary.xml.gz= return: < Content-Encoding: gzip < Content-Type: text/plain; charset=3DUTF-8 The file content is right: $ zless = 5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-primary.x= ml.gz <?xml version=3D"1.0" encoding=3D"UTF-8"?> <metadata xmlns=3D"http://linux.duke.edu/metadata/common" = xmlns:rpm=3D"http://linux.duke.edu/metadata/rpm" packages=3D"5"> For sac-gdeploy, I get: $ curl -JORLv = https://copr-be.cloud.fedoraproject.org/results/sac/gdeploy/epel-7-x86_64/= repodata/0f79cb019e43ae53bda93bae802a611f1fb025859729da143c5459ca2b5590b6-= primary.xml.gz = <https://copr-be.cloud.fedoraproject.org/results/sac/gdeploy/epel-7-x86_64= /repodata/0f79cb019e43ae53bda93bae802a611f1fb025859729da143c5459ca2b5590b6= -primary.xml.gz> ... < Content-Type: application/x-gzip This repository is the only one broken out of 14 I already setup, from = Elastic, Postgres and other oVirt repositories. With who should I get in touch to correct that problem ? --Apple-Mail=_CE333282-F5F3-4479-B392-69D17FCA599E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = line-break: after-white-space;" class=3D"">I'm trying to setup a local = cache of the repository virtio-win-stable, using Sonatype's nexus3. But = it's a little picky about content-type and this repository setup is not = to it's taste: it's says : 2018-03-12 15:47:21,025+0100 = WARN  [qtp2016749412-36]  *UNKNOWN = org.sonatype.nexus.repository.view.handlers.ExceptionHandler - Invalid = content: = GET /repodata/5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf= 69e39ea98-primary.xml.gz: = org.sonatype.nexus.repository.InvalidContentException: Detected content = type [application/xml, application/x-xml, text/xml], but expected = [application/x-gzip, application/gzip, application/x-tgz, = application/gzip-compressed, application/gzipped, = application/x-gunzip, application/x-gzip-compressed, = gzip/document]: = repodata/5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-= primary.xml.gz And indeed: $ curl = -JORLv <a = href=3D"https://fedorapeople.org/groups/virt/virtio-win/repo/stable/repoda= ta/5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-" = class=3D"">https://fedorapeople.org/groups/virt/virtio-win/repo/stable/rep= odata/5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-</a= >primary.xml.gz return: < Content-Encoding: = gzip < Content-Type: text/plain; charset=3DUTF-8 The file content is right: $ zless = 5048716d95c37bb6e0df68263c13daea16145384c34bd950dba45bf69e39ea98-primary.x= ml.gz <?xml version=3D"1.0" encoding=3D"UTF-8"?> <metadata xmlns=3D"<a = href=3D"http://linux.duke.edu/metadata/common" = class=3D"">http://linux.duke.edu/metadata/common</a>" xmlns:rpm=3D"<a = href=3D"http://linux.duke.edu/metadata/rpm" = class=3D"">http://linux.duke.edu/metadata/rpm</a>" packages=3D"5"> <div class=3D"">For sac-gdeploy, I = get:</div><div class=3D""><div style=3D"margin: 0px; font-stretch: = normal; font-size: 11px; line-height: normal; font-family: Menlo; = background-color: rgb(255, 255, 255);" class=3D"">$ curl = -JORLv <a = href=3D"https://copr-be.cloud.fedoraproject.org/results/sac/gdeploy/epel-7= -x86_64/repodata/0f79cb019e43ae53bda93bae802a611f1fb025859729da143c5459ca2= b5590b6-primary.xml.gz" = class=3D"">https://copr-be.cloud.fedoraproject.org/results/sac/gdeploy/epe= l-7-x86_64/repodata/0f79cb019e43ae53bda93bae802a611f1fb025859729da143c5459= ca2b5590b6-primary.xml.gz</a></div></div><div style=3D"margin: = 0px; font-stretch: normal; font-size: 11px; line-height: normal; = font-family: Menlo; background-color: rgb(255, 255, 255);" = class=3D"">...</div><div style=3D"margin: 0px; font-stretch: normal; = font-size: 11px; line-height: normal; font-family: Menlo; = background-color: rgb(255, 255, 255);" class=3D"">< = Content-Type: application/x-gzip</div><div class=3D""> </div><div class=3D"">This repository is the only one broken = out of 14 I already setup, from Elastic, Postgres and other oVirt = repositories.</div><div class=3D""> </div><div = class=3D"">With who should I get in touch to correct that problem = ?</div><div class=3D""> </div></body></html>= --Apple-Mail=_CE333282-F5F3-4479-B392-69D17FCA599E--

1 0

Failure to upgrade Cluster Compatibility Version
by Jonathan Mathews 12 Mar '18

12 Mar '18

I have been upgrading my oVirt platform from 3.4 and I am trying to get to 4.2. I have managed to get the platform to 3.6, but need to upgrade the Cluster Compatibility Version. When I select 3.6 in the Cluster Compatibility Version and select OK, it highlights Compatibility Version in red, (image attached). There are no errors been displayed on screen, or in the /var/log/ovirt-engine/engine.log file. Please let me know if I am missing something and how I can resolve this? Thanks Jonathan

4 8

Weekly fstrim & Ubuntu 16.04 LTS guest freeze
by Andrei Verovski 12 Mar '18

12 Mar '18

Hi ! I have stubborn VM (Ubuntu 16.04 LTS) which randomly freezes about each 2 - 3 weeks at weekends (when load is close to zero). No updates or kernel upgrades help. Freeze is not detected by oVirt watchdog and VM is not automatically restarted. Since it happens only on weekends, I suspect some weekly cron job may cause this. Ubuntu 16.04 LTS is installed on qcow2 disk image (thin provision). is it possible that fstrim (which discards / trims unused blocks) is a source of this problem ? Thanks in advance Andrei

2 2

4.2 upgrade question
by KSNull Zero 12 Mar '18

12 Mar '18

Hello! Currently we run 4.1.9 and try to upgrade to the latest 4.2 release. Our DB server is on separate machine and run PostgreSQL 9.2.23. During upgrade the following error occurs: [WARNING] This release requires PostgreSQL server 9.5.9 but the engine database is currently hosted on PostgreSQL server 9.2.23 [ ERROR ] Please upgrade the PostgreSQL instance that serves the engine database to 9.5.9 and retry. Ok, so we need to upgrade PostgreSQL. The question is - do we need to have exact 9.5.9 version of PostgreSQL ? Because if we upgrade PostgreSQL to the latest available 9.5.12 the same error occurs saying that client and server version mismatched and upgrade terminates. Thank you.

2 1

qemu-kvm-ev-2.9.0-16.el7_4.14.1 has been released
by Sandro Bonazzola 12 Mar '18

12 Mar '18

Hi, qemu-kvm-ev-2.9.0-16.el7_4.14.1 <http://cbs.centos.org/koji/buildinfo?buildID=22232> has been tagged for release and should land on mirrors.centos.org on Monday, March 12th 2018. Here's the ChangeLog: * Thu Mar 08 2018 Sandro Bonazzola <sbonazzo(a)redhat.com> - ev-2.9.0-16.el7_4.14.1 - Removing RH branding from package name * Thu Jan 18 2018 Miroslav Rezanina <mrezanin(a)redhat.com> - rhev-2.9.0-16.el7_4.14 - kvm-fw_cfg-fix-memory-corruption-when-all-fw_cfg-slots-a.patch [bz#1534649] - kvm-mirror-Fix-inconsistent-backing-AioContext-for-after.patch [bz#1535125] - Resolves: bz#1534649 (Qemu crashes when all fw_cfg slots are used [rhel-7.4.z]) - Resolves: bz#1535125 (Mirror jobs for drives with iothreads make QEMU to abort with "block.c:1895: bdrv_attach_child: Assertion `bdrv_get_aio_context(parent_bs) == bdrv_get_aio_context(child_bs)' failed." [rhel-7.4.z]) Regards, -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

2 1

ovirt 4.2.1 pre hosted engine deploy failure
by Michael Seidel 12 Mar '18

12 Mar '18

Hi, I found the messages at http://lists.ovirt.org/pipermail/users/2018-January/086631.html in your archive and am running into a similar/identical issue when trying to install a hosted engine: After providing all of the information, the installer does create some files on the nfs share (plantfiler02:/storage/vmx/ovirt) but eventually dies with: [ INFO ] TASK [Copy configuration files to the right location on host] [ INFO ] TASK [Copy configuration archive to storage] [ ERROR ] [WARNING]: Failure using method (v2_runner_on_failed) in callback plugin [ ERROR ] (<ansible.plugins.callback.1_otopi_json.CallbackModule object at 0x25c86d0>): [ ERROR ] 'ascii' codec can't encode character u'\u2018' in position 489: ordinal not in [ ERROR ] range(128) [ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook [ INFO ] Stage: Clean up The relevant part in the logfile I believe is the following: 2018-03-09 09:05:05,762+0100 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:94 {u'_ansible_parsed': True, u'stderr_lines': [u'dd: failed to open \u2018/rhev/data-center/mnt/plantfiler02:_storage_vmx_ovirt/017fcf64-45c8-4289-87f7-c1195f7ec584/images/f36c079b-ba17-4c14-96a2-2b2beea7d989/56cd3448-4ecf-490e-99cc-ace36b977a9a\u2019: Permission denied'], u'cmd': [u'dd', u'bs=20480', u'count=1', u'oflag=direct', u'if=/var/tmp/localvmf0uaFh/56cd3448-4ecf-490e-99cc-ace36b977a9a', u'of=/rhev/data-center/mnt/plantfiler02:_storage_vmx_ovirt/017fcf64-45c8-4289-87f7-c1195f7ec584/images/f36c079b-ba17-4c14-96a2-2b2beea7d989/56cd3448-4ecf-490e-99cc-ace36b977a9a'], u'end': u'2018-03-09 09:05:05.565013', u'_ansible_no_log': False, u'stdout': u'', u'changed': True, u'start': u'2018-03-09 09:05:05.557703', u'delta': u'0:00:00.007310', u'stderr': u'dd: failed to open \u2018/rhev/data-center/mnt/plantfiler02:_storage_vmx_ovirt/017fcf64-45c8-4289-87f7-c1195f7ec584/images/f36c079b-ba17-4c14-96a2-2b2beea7d989/56cd3448-4ecf-490e-99cc-ace36b977a9a\u2019: Permission denied', u'rc': 1, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'dd bs=20480 count=1 oflag=direct if="/var/tmp/localvmf0uaFh/56cd3448-4ecf-490e-99cc-ace36b977a9a" of="/rhev/data-center/mnt/plantfiler02:_storage_vmx_ovirt/017fcf64-45c8-4289-87f7-c1195f7ec584/images/f36c079b-ba17-4c14-96a2-2b2beea7d989/56cd3448-4ecf-490e-99cc-ace36b977a9a"', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'stdout_lines': [], u'ms I did create vdsm user and kvm user and group on the NFS server and I succesfully ran the nfs-check.py script from the host where ovirt should be installed: # python nfs-check.py plantfiler02:/storage/vmx/ovirt/ Current hostname: hyena.******.de - IP addr 10.216.60.21 Trying to /bin/mount -t nfs plantfiler02:/storage/vmx/ovirt/... Executing NFS tests.. Removing vdsmTest file.. Status of tests [OK] Disconnecting from NFS Server.. Done! The target directory has following permissions: drwxr-xr-x 3 vdsm kvm 86 Mar 9 09:12 ovirt I am aware of the issue https://bugzilla.redhat.com/show_bug.cgi?id=1533500 but the underlying problem seems to be the error message issued by dd (as has been mentioned the earlier posts). Am I missing the obvious somewhere regarding permissions? Is there a known solution/workaround to this? Best, - Michael Helmholtz Zentrum Muenchen Deutsches Forschungszentrum fuer Gesundheit und Umwelt (GmbH) Ingolstaedter Landstr. 1 85764 Neuherberg www.helmholtz-muenchen.de Aufsichtsratsvorsitzende: MinDir'in Baerbel Brumme-Bothe Geschaeftsfuehrer: Prof. Dr. Guenther Wess, Heinrich Bassler, Dr. Alfons Enhsen Registergericht: Amtsgericht Muenchen HRB 6466 USt-IdNr: DE 129521671

2 2

Cannot activate storage domain
by Bruckner, Simone 11 Mar '18

11 Mar '18

--_000_2CB4E8C8E00E594EA06D4AC427E429920FE500D1fabamailserverf_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi all, we run a small oVirt installation that we also use for automated testing = (automatically creating, dropping vms). We got an inactive FC storage domain that we cannot activate any more. We s= ee several events at that time starting with: VM perftest-c17 is down with error. Exit message: Unable to get volume size= for domain b83c159c-4ad6-4613-ba16-bab95ccd10c0 volume 686376c1-4be1-44c3-= 89a3-0a8addc8fdf2. Trying to activate the strorage domain results in the following alert event= for each host: VDSM <hostname> command GetVGInfoVDS failed: Volume Group does not exist: (= u'vg_uuid: 813oRe-64r8-mloU-k9G2-LFsS-dXSG-hpN4kf',) And after those messages from all hosts we get: VDSM command ActivateStorageDomainVDS failed: Storage domain does not exist= : (u'b83c159c-4ad6-4613-ba16-bab95ccd10c0',) Failed to activate Storage Domain VMHOST_LUN_205 (Data Center Production) b= y <user> Invalid status on Data Center Production. Setting status to Non Responsive. Storage Pool Manager runs on Host vmhost003.fabagl.fabasoft.com (Address: v= mhost003.fabagl.fabasoft.com) Data Center Production. Checking the hosts with multipath -ll we see the LUN without errors. We run oVirt 4.2.1 on CentOS 7.4. Hosts are CentOS 7.4 hosts with oVirt ins= talled using oVirt engine. Hosts are connected to about 30 FC LUNs (8 TB each) on two all-flash storag= e arrays. Thank you, Simone Bruckner --_000_2CB4E8C8E00E594EA06D4AC427E429920FE500D1fabamailserverf_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"DE" link=3D"#0563C1" vlink=3D"#954F72"> <div class=3D"WordSection1"> Hi all,<o:p></o:p> <o:p> </o:p>   we run a small oVirt ins= tallation that we also use for automated testing (automatically creating, d= ropping vms).<o:p></o:p> <o:p> </o:p> We got an inactive FC storage d= omain that we cannot activate any more. We see several events at that time = starting with:<o:p></o:p> <o:p> </o:p> VM perftest-c17 is down with er= ror. Exit message: Unable to get volume size for domain b83c159c-4ad6-4613-= ba16-bab95ccd10c0 volume 686376c1-4be1-44c3-89a3-0a8addc8fdf2.<o:p></o:p></= span> <o:p> </o:p> Trying to activate the strorage= domain results in the following alert event for each host:<o:p></o:p></spa= n> <o:p> </o:p> VDSM <hostname> command G= etVGInfoVDS failed: Volume Group does not exist: (u'vg_uuid: 813oRe-64r8-ml= oU-k9G2-LFsS-dXSG-hpN4kf',)<o:p></o:p> <o:p> </o:p> And after those messages from a= ll hosts we get:<o:p></o:p> <o:p> </o:p> VDSM command ActivateStorageDom= ainVDS failed: Storage domain does not exist: (u'b83c159c-4ad6-4613-ba16-ba= b95ccd10c0',)<o:p></o:p> Failed to activate Storage Doma= in VMHOST_LUN_205 (Data Center Production) by <user><o:p></o:p></span= > Invalid status on Data Center P= roduction. Setting status to Non Responsive.<o:p></o:p> Storage Pool Manager runs on Ho= st vmhost003.fabagl.fabasoft.com (Address: vmhost003.fabagl.fabasoft.com) = Data Center Production.<o:p></o:p> <o:p> </o:p> Checking the hosts with multipa= th –ll we see the LUN without errors.<o:p></o:p> <o:p> </o:p> We run oVirt 4.2.1 on CentOS 7.= 4. Hosts are CentOS 7.4 hosts with oVirt installed using oVirt engine.<o:p>= </o:p> Hosts are connected to about 30= FC LUNs (8 TB each) on two all-flash storage arrays.<o:p></o:p> <o:p> </o:p> Thank you,<o:p></o:p> Simone Bruckner<o:p></o:p> <o:p> </o:p> <o:p> </o:p> <o:p> </o:p> </div> </body> </html> --_000_2CB4E8C8E00E594EA06D4AC427E429920FE500D1fabamailserverf_--

2 8

Faulty multipath only cleared with VDSM restart
by Bruckner, Simone 11 Mar '18

11 Mar '18

--_000_2CB4E8C8E00E594EA06D4AC427E429920FE728E2fabamailserverf_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, after rebooting SAN switches we see faulty multipath entries in VDSM. Running vdsm-client Host getStats shows multipathHealth entries "multipathHealth": { "3600601603cc04500a2f9cd597080db0e": { "valid_paths": 2, "failed_paths": [ "sdcl", "sdde" ] }, ... Running multipath -ll does not show any errors. After restarting VSDM, the multipathHealth entires from vdsm-client are emp= ty again. Is the a way to clear those multipathHealth entires without restarting VDSM= ? Thank you and all the best, Simone --_000_2CB4E8C8E00E594EA06D4AC427E429920FE728E2fabamailserverf_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"DE" link=3D"#0563C1" vlink=3D"#954F72"> <div class=3D"WordSection1"> Hi,<o:p></o:p> <o:p> </o:p>   after rebooting SAN swit= ches we see faulty multipath entries in VDSM.<o:p></o:p> <o:p> </o:p> Running vdsm-client Host getSta= ts shows multipathHealth entries<o:p></o:p> <o:p> </o:p> "multipathHealth": {<o:p></o:p>   "3600601603cc04500a2f9cd597080db0e": {<o:p>= </o:p>     "valid_paths": 2,<o:p></o:p></s= pan>     "failed_paths": [<o:p></o:p></s= pan>       "sdcl",<o:p></o:p><= /span>       "sdde"<o:p></o:p></= span>     ]<o:p></o:p>   },<o:p></o:p>   …<o:p></o:p> <o:p> </o:p> Running multipath –ll doe= s not show any errors.<o:p></o:p> <o:p> </o:p> After restarting VSDM, the mult= ipathHealth entires from vdsm-client are empty again.<o:p></o:p> <o:p> </o:p> Is the a way to clear those mul= tipathHealth entires without restarting VDSM?<o:p></o:p> <o:p> </o:p> Thank you and all the best,<o:p></o:p> Simone<o:p></o:p> <o:p> </o:p> </div> </body> </html> --_000_2CB4E8C8E00E594EA06D4AC427E429920FE728E2fabamailserverf_--

2 3

Re: [ovirt-users] Ghost Snapshot Disk
by Lionel Caignec 11 Mar '18

11 Mar '18

Ok so i reply myself, Version is 4.1.7.6-1 I just delete manually a snapshot previously created. But this is an io intensive vm, whit big disk (2,5To, and 5To). For the log, i cannot paste all my log on public list security reason, i will send you full in private. Here is an extract relevant to my error engine.log-20180210:2018-02-09 23:00:03,200+01 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-312) [44402a8c-3196-43f0-ba33-307ea78e6f49] EVENT_ID: USER_CREATE_SNAPSHOT(45), Correlation ID: 44402a8c-3196-43f0-ba33-307ea78e6f49, Job ID: 030cd310-fec9-4a89-8c3f-7888504fe973, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Snapshot 'AUTO_7D_zz_nil_20180209_220002' creation for VM 'zz_nil' was initiated by snap_user@internal. engine.log-20180210:2018-02-09 23:01:06,578+01 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler5) [] EVENT_ID: USER_CREATE_SNAPSHOT_FINISHED_SUCCESS(68), Correlation ID: 44402a8c-3196-43f0-ba33-307ea78e6f49, Job ID: 030cd310-fec9-4a89-8c3f-7888504fe973, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Snapshot 'AUTO_7D_zz_nil_20180209_220002' creation for VM 'zz_nil' has been completed. engine.log-20180220:2018-02-19 17:01:23,800+01 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-113) [] EVENT_ID: USER_REMOVE_SNAPSHOT(342), Correlation ID: 06a9efa4-1b80-4021-bf3e-41ecebe58a88, Job ID: c9a918a7-b00c-43cf-b6de-3659ac0765da, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Snapshot 'AUTO_7D_zz_nil_20180209_220002' deletion for VM 'zz_nil' was initiated by acaignec@ldap-cines-authz. engine.log-20180221:2018-02-20 22:24:45,174+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler6) [06a9efa4-1b80-4021-bf3e-41ecebe58a88] EVENT_ID: USER_REMOVE_SNAPSHOT_FINISHED_FAILURE(357), Correlation ID: 06a9efa4-1b80-4021-bf3e-41ecebe58a88, Job ID: c9a918a7-b00c-43cf-b6de-3659ac0765da, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to delete snapshot 'AUTO_7D_zz_nil_20180209_220002' for VM 'zz_nil'. 2018-02-20 22:24:46,266+01 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler3) [516079c3] SPMAsyncTask::PollTask: Polling task '34137342-4f30-476d-b16c-1cb7e0ea0ac0' (Parent Command 'DestroyImage', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') returned status 'finished', result 'success'. 2018-02-20 22:24:46,267+01 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler3) [516079c3] BaseAsyncTask::onTaskEndSuccess: Task '34137342-4f30-476d-b16c-1cb7e0ea0ac0' (Parent Command 'DestroyImage', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended successfully. 2018-02-20 22:24:46,268+01 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler3) [516079c3] CommandAsyncTask::endActionIfNecessary: All tasks of command 'fe8c91f2-386b-4b3f-bbf3-aeda8e9244c6' has ended -> executing 'endAction' 2018-02-20 22:24:46,268+01 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler3) [516079c3] CommandAsyncTask::endAction: Ending action for '1' tasks (command ID: 'fe8c91f2-386b-4b3f-bbf3-aeda8e9244c6'): calling endAction '. 2018-02-20 22:24:46,268+01 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-6-thread-20) [516079c3] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction 'DestroyImage', 2018-02-20 22:24:46,269+01 ERROR [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-6-thread-20) [516079c3] [within thread]: endAction for action type DestroyImage threw an exception.: java.lang.NullPointerException at org.ovirt.engine.core.bll.tasks.CoCoAsyncTaskHelper.endAction(CoCoAsyncTaskHelper.java:335) [bll.jar:] at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.endAction(CommandCoordinatorImpl.java:340) [bll.jar:] at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.endCommandAction(CommandAsyncTask.java:154) [bll.jar:] at org.ovirt.engine.core.bll.tasks.CommandAsyncTask.lambda$endActionIfNecessary$0(CommandAsyncTask.java:106) [bll.jar:] at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:84) [utils.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] ----- Mail original ----- De: "Shani Leviim" <sleviim(a)redhat.com> À: "Lionel Caignec" <caignec(a)cines.fr> Envoyé: Lundi 26 Février 2018 14:42:38 Objet: Re: [ovirt-users] Ghost Snapshot Disk Yes, please. Can you detail a bit more regarding the actions you've done? I'm assuming that since the snapshot had no description, trying to operate it caused the nullPointerException you've got. But I want to examine what was the cause for that. Also, can you please answer back to the list? *Regards,* *Shani Leviim* On Mon, Feb 26, 2018 at 3:37 PM, Lionel Caignec <caignec(a)cines.fr> wrote: > Version is 4.1.7.6-1 > > Do you want the log from the day i delete snapshot? > > ----- Mail original ----- > De: "Shani Leviim" <sleviim(a)redhat.com> > À: "Lionel Caignec" <caignec(a)cines.fr> > Cc: "users" <users(a)ovirt.org> > Envoyé: Lundi 26 Février 2018 14:29:16 > Objet: Re: [ovirt-users] Ghost Snapshot Disk > > Hi, > > What is your engine version, please? > I'm trying to reproduce your steps, for understanding better was is the > cause for that error. Therefore, a full engine log is needed. > Can you please attach it? > > Thanks, > > > *Shani Leviim* > > On Mon, Feb 26, 2018 at 2:48 PM, Lionel Caignec <caignec(a)cines.fr> wrote: > > > Hi > > > > 1) this is error message from ui.log > > > > 2018-02-26 13:44:10,001+01 ERROR [org.ovirt.engine.ui.frontend. > > server.gwt.OvirtRemoteLoggingService] (default task-3) [] Permutation > > name: 8C01181C3B121D0AAE1312275CC96415 > > 2018-02-26 13:44:10,001+01 ERROR [org.ovirt.engine.ui.frontend. > server.gwt.OvirtRemoteLoggingService] > > (default task-3) [] Uncaught exception: com.google.gwt.core.client. > JavaScriptException: > > (TypeError) > > __gwt$exception: <skipped>: Cannot read property 'F' of null > > at org.ovirt.engine.ui.uicommonweb.models.storage. > > DisksAllocationModel$3.$onSuccess(DisksAllocationModel.java:120) > > at org.ovirt.engine.ui.uicommonweb.models.storage. > > DisksAllocationModel$3.onSuccess(DisksAllocationModel.java:120) > > at org.ovirt.engine.ui.frontend.Frontend$2.$onSuccess( > Frontend.java:233) > > [frontend.jar:] > > at org.ovirt.engine.ui.frontend.Frontend$2.onSuccess(Frontend. > java:233) > > [frontend.jar:] > > at org.ovirt.engine.ui.frontend.communication. > > OperationProcessor$2.$onSuccess(OperationProcessor.java:139) > > [frontend.jar:] > > at org.ovirt.engine.ui.frontend.communication. > > OperationProcessor$2.onSuccess(OperationProcessor.java:139) > > [frontend.jar:] > > at org.ovirt.engine.ui.frontend.communication. > > GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider. > java:269) > > [frontend.jar:] > > at org.ovirt.engine.ui.frontend.communication. > > GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider. > java:269) > > [frontend.jar:] > > at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter. > > onResponseReceived(RequestCallbackAdapter.java:198) [gwt-servlet.jar:] > > at com.google.gwt.http.client.Request.$fireOnResponseReceived( > Request.java:237) > > [gwt-servlet.jar:] > > at com.google.gwt.http.client.RequestBuilder$1. > onReadyStateChange(RequestBuilder.java:409) > > [gwt-servlet.jar:] > > at Unknown.eval(webadmin-0.js@65) > > at com.google.gwt.core.client.impl.Impl.apply(Impl.java:296) > > [gwt-servlet.jar:] > > at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:335) > > [gwt-servlet.jar:] > > at Unknown.eval(webadmin-0.js@54) > > > > > > 2) This line seems to be about the bad disk : > > > > f242cc9a-56c1-4ae4-aef0-f75eb01f74b1 | 2018-01-17 22:02:00+01 | > > 2748779069440 | 00000000-0000-0000-0000-000000000000 | > > 00000000-0000-0000-0000-000000000000 | 4 | 2018-01-18 > > 22:01:20.5+01 | 0dd2090c-3491-4fa1-98c3-54ae88be793c > > > > > > 3) Snapshot table is empty for the concerned vm_id. > > > > ----- Mail original ----- > > De: "Shani Leviim" <sleviim(a)redhat.com> > > À: "Lionel Caignec" <caignec(a)cines.fr> > > Cc: "users" <users(a)ovirt.org> > > Envoyé: Lundi 26 Février 2018 13:31:23 > > Objet: Re: [ovirt-users] Ghost Snapshot Disk > > > > Hi Lionel, > > > > The error message you've mentioned sounds like a UI error. > > Can you please attach your ui log? > > > > Also, on the data from 'images' table you've uploaded, can you describe > > which line is the relevant disk? > > > > Finally (for now), in case the snapshot was deleted, can you please > > validate it by viewing the output of: > > $ select * from snapshots; > > > > > > > > *Regards,* > > > > *Shani Leviim* > > > > On Mon, Feb 26, 2018 at 9:20 AM, Lionel Caignec <caignec(a)cines.fr> > wrote: > > > > > Hi Shani, > > > thank you for helping me with your reply, > > > i juste make a little mistake on explanation. In fact it's the snapshot > > > does not exist anymore. This is the disk(s) relative to her wich still > > > exist, and perhaps LVM volume. > > > So can i delete manually this disk in database? what about the lvm > > volume? > > > Is it better to recreate disk sync data and destroy old one? > > > > > > > > > > > > ----- Mail original ----- > > > De: "Shani Leviim" <sleviim(a)redhat.com> > > > À: "Lionel Caignec" <caignec(a)cines.fr> > > > Cc: "users" <users(a)ovirt.org> > > > Envoyé: Dimanche 25 Février 2018 14:26:41 > > > Objet: Re: [ovirt-users] Ghost Snapshot Disk > > > > > > Hi Lionel, > > > > > > You can try to delete that snapshot directly from the database. > > > > > > In case of using psql [1], once you've logged in to your database, you > > can > > > run this query: > > > $ select * from snapshots where vm_id = '<your_vm_id>'; > > > This one would list the snapshots associated with a VM by its id. > > > > > > In case you don't have you vm_id, you can locate it by querying: > > > $ select * from vms where vm_name = 'nil'; > > > This one would show you some details about a VM by its name (including > > the > > > vm's id). > > > > > > Once you've found the relevant snapshot, you can delete it by running: > > > $ delete from snapshots where snapshot_id = '<your_snapshot_id>'; > > > This one would delete the desired snapshot from the database. > > > > > > Since it's a delete operation, I would suggest confirming the ids > before > > > executing it. > > > > > > Hope you've found it useful! > > > > > > [1] > > > https://www.ovirt.org/documentation/install-guide/ > > appe-Preparing_a_Remote_ > > > PostgreSQL_Database_for_Use_with_the_oVirt_Engine/ > > > > > > > > > *Regards,* > > > > > > *Shani Leviim* > > > > > > On Fri, Feb 23, 2018 at 9:25 AM, Lionel Caignec <caignec(a)cines.fr> > > wrote: > > > > > > > Hi, > > > > > > > > i've a problem with snapshot. On one VM i've a "snapshot" ghost > without > > > > name or uuid, only information is size (see attachment). In the > > snapshot > > > > tab there is no trace about this disk. > > > > > > > > In database (table images) i found this : > > > > f242cc9a-56c1-4ae4-aef0-f75eb01f74b1 | 2018-01-17 22:02:00+01 | > > > > 2748779069440 | 00000000-0000-0000-0000-000000000000 | > > > > 00000000-0000-0000-0000-000000000000 | 4 | 2018-01-18 > > > > 22:01:20.5+01 | 0dd2090c-3491-4fa1-98c3-54ae88be793c > > > > | 2 | 4 | 17e26476-cecb-441d-a5f7- > 46ab3ef387ee > > | > > > > 2018-01-17 22:01:29.663334+01 | 2018-01-19 08:40:14.345229+01 | f > > | > > > > 1 | 2 > > > > 1c7650fa-542b-4ec2-83a1-d2c1c31be5fd | 2018-01-17 22:02:03+01 | > > > > 5368709120000 | 00000000-0000-0000-0000-000000000000 | > > > > 00000000-0000-0000-0000-000000000000 | 4 | 2018-01-18 > > > > 22:01:20.84+01 | 0dd2090c-3491-4fa1-98c3-54ae88be793c > > > > | 2 | 4 | bf834a91-c69f-4d2c-b639- > 116ed58296d8 > > | > > > > 2018-01-17 22:01:29.836133+01 | 2018-01-19 08:40:19.083508+01 | f > > | > > > > 1 | 2 > > > > 8614b21f-c0de-40f2-b4fb-e5cf193b0743 | 2018-02-09 23:00:44+01 | > > > > 5368709120000 | 00000000-0000-0000-0000-000000000000 | > > > > 00000000-0000-0000-0000-000000000000 | 4 | 2018-02-16 > > > > 23:00:02.855+01 | 390175dc-baf4-4831-936a-5ea68fa4c969 > > > > > > > > > > > > But i does not know which line is my disk. Is it possible to delete > > > > directly into database? > > > > Or is it better to dump my disk to another new and delete the > > "corrupted > > > > one"? > > > > > > > > Another thing, when i try to move the disk to another storage > domain i > > > > always get "uncaght exeption occured ..." and no error in engine.log. > > > > > > > > > > > > Thank you for helping. > > > > > > > > -- > > > > Lionel Caignec > > > > > > > > _______________________________________________ > > > > Users mailing list > > > > Users(a)ovirt.org > > > > http://lists.ovirt.org/mailman/listinfo/users > > > > > > > > > > > > > >

3 7