backup-engine 3.6.4.1-1 Files Compressor still broken in Centos 6.7? Work around

This is a multipart message in MIME format. ------=_NextPart_000_0001_01D19828.03448130 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Been trying to run a complete backup on a fresh install to get rid of that annoying alert. engine-backup --scope=all Kept failing with the error: 2016-04-17 04:05:31 8742: Creating temp folder /tmp/engine-backup.ymrXeYZay1/tar 2016-04-17 04:05:31 8742: OUTPUT: - Files 2016-04-17 04:05:31 8742: Backing up files to /tmp/engine-backup.ymrXeYZay1/tar/files 2016-04-17 04:05:31 8742: FATAL: Failed backing up /etc/ovirt-engine Research shows a bug reported on version 3.6.0 related to the tar options https://gerrit.ovirt.org/#/c/48596/3/packaging/bin/engine-backup.sh https://bugzilla.redhat.com/show_bug.cgi?id=1282397 But a grep of the script shows the changes have been made [root@engine1 iso]# grep cpSs /usr/share/ovirt-engine/bin/engine-backup.sh [root@engine1 iso]# grep cpS /usr/share/ovirt-engine/bin/engine-backup.sh tar -C "${dir}" -cpS"${ARCHIVE_COMPRESS_OPTION}"f "${file}" . >> "${tar_log}" 2>&1 tar -C / --files-from - -cpS"${FILES_COMPRESS_OPTION}"f "${target}" || logdie "Failed backing up ${paths}" Verified I had a new version (just re-installed ovirt-engine today) ovirt-engine-3.6.4.1-1.el6.noarch Linux engine1.attlocal.net 2.6.32-573.22.1.el6.x86_64 #1 SMP Wed Mar 23 03:35:39 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux # ovirt-engine-backup - oVirt engine backup and restore utility # Copyright (C) 2013-2016 Red Hat, Inc. Then I noticed there is an option to turn off -files-compressor. Doing this I was able to get a complete backup. [root@engine1 iso]# engine-backup --mode=backup --scope=files --file=/mnt/h97m/backup_files_20160417 --log=/root/backup_files_20160417.log --files-compressor=None Backing up: Notifying engine - Files Packing into file '/mnt/h97m/backup_files_20160417' Notifying engine Done. [root@engine1 iso]# engine-backup --mode=backup --scope=all --file=/mnt/h97m/backup_all_20160417 --log=/root/backup_all_20160417.log --files-compressor=None Backing up: Notifying engine - Files - Engine database 'engine' Packing into file '/mnt/h97m/backup_all_20160417' Notifying engine Done. [root@engine1 iso]# service ovirt-engine start Passing this on in case I need the work around again ;) Jack Greene ------=_NextPart_000_0001_01D19828.03448130 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 15 = (filtered medium)"><style><!-- /* Font Definitions */ @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0in; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri",sans-serif;} a:link, span.MsoHyperlink {mso-style-priority:99; color:#0563C1; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:#954F72; text-decoration:underline;} span.EmailStyle17 {mso-style-type:personal-compose; font-family:"Calibri",sans-serif; color:windowtext;} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri",sans-serif;} @page WordSection1 {size:8.5in 11.0in; margin:1.0in 1.0in 1.0in 1.0in;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DEN-US = link=3D"#0563C1" vlink=3D"#954F72"><div class=3DWordSection1><p = class=3DMsoNormal>Been trying to run a complete backup on a fresh = install to get rid of that annoying alert.<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>engine-backup --scope=3Dall<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Kept failing = with the error:<o:p></o:p></p><p class=3DMsoNormal>2016-04-17 04:05:31 = 8742: Creating temp folder = /tmp/engine-backup.ymrXeYZay1/tar<o:p></o:p></p><p = class=3DMsoNormal>2016-04-17 04:05:31 8742: OUTPUT: - = Files<o:p></o:p></p><p class=3DMsoNormal>2016-04-17 04:05:31 8742: = Backing up files to = /tmp/engine-backup.ymrXeYZay1/tar/files<o:p></o:p></p><p = class=3DMsoNormal>2016-04-17 04:05:31 8742: FATAL: Failed backing up = /etc/ovirt-engine<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Research = shows a bug reported on version 3.6.0 related to the tar = options<o:p></o:p></p><p class=3DMsoNormal><a = href=3D"https://gerrit.ovirt.org/#/c/48596/3/packaging/bin/engine-backup.= sh">https://gerrit.ovirt.org/#/c/48596/3/packaging/bin/engine-backup.sh</= a><o:p></o:p></p><p class=3DMsoNormal><a = href=3D"https://bugzilla.redhat.com/show_bug.cgi?id=3D1282397">https://bu= gzilla.redhat.com/show_bug.cgi?id=3D1282397</a><o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>But a grep = of the script shows the changes have been made<o:p></o:p></p><p = class=3DMsoNormal>[root@engine1 iso]# grep cpSs = /usr/share/ovirt-engine/bin/engine-backup.sh<o:p></o:p></p><p = class=3DMsoNormal>[root@engine1 iso]# grep cpS = /usr/share/ovirt-engine/bin/engine-backup.sh<o:p></o:p></p><p = class=3DMsoNormal> tar -C = "${dir}" -cpS"${ARCHIVE_COMPRESS_OPTION}"f = "${file}" . >> "${tar_log}" = 2>&1<o:p></o:p></p><p = class=3DMsoNormal> &= nbsp; tar -C / --files-from - = -cpS"${FILES_COMPRESS_OPTION}"f "${target}" || = logdie "Failed backing up ${paths}"<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Verified I = had a new version (just re-installed ovirt-engine = today)<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>ovirt-engine-3.6.4.1-1.el6.noarch<o:p></o:p></p><p = class=3DMsoNormal>Linux engine1.attlocal.net 2.6.32-573.22.1.el6.x86_64 = #1 SMP Wed Mar 23 03:35:39 UTC 2016 x86_64 x86_64 x86_64 = GNU/Linux<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal># ovirt-engine-backup - oVirt engine backup and = restore utility<o:p></o:p></p><p class=3DMsoNormal># Copyright (C) = 2013-2016 Red Hat, Inc.<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Then I = noticed there is an option to turn off –files-compressor. = Doing this I was able to get a complete backup.<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>[root@engine1 iso]# engine-backup --mode=3Dbackup = --scope=3Dfiles --file=3D/mnt/h97m/backup_files_20160417 = --log=3D/root/backup_files_20160417.log = --files-compressor=3DNone<o:p></o:p></p><p class=3DMsoNormal>Backing = up:<o:p></o:p></p><p class=3DMsoNormal>Notifying engine<o:p></o:p></p><p = class=3DMsoNormal>- Files<o:p></o:p></p><p class=3DMsoNormal>Packing = into file '/mnt/h97m/backup_files_20160417'<o:p></o:p></p><p = class=3DMsoNormal>Notifying engine<o:p></o:p></p><p = class=3DMsoNormal>Done.<o:p></o:p></p><p class=3DMsoNormal>[root@engine1 = iso]# engine-backup --mode=3Dbackup --scope=3Dall = --file=3D/mnt/h97m/backup_all_20160417 = --log=3D/root/backup_all_20160417.log = --files-compressor=3DNone<o:p></o:p></p><p class=3DMsoNormal>Backing = up:<o:p></o:p></p><p class=3DMsoNormal>Notifying engine<o:p></o:p></p><p = class=3DMsoNormal>- Files<o:p></o:p></p><p class=3DMsoNormal>- Engine = database 'engine'<o:p></o:p></p><p class=3DMsoNormal>Packing into file = '/mnt/h97m/backup_all_20160417'<o:p></o:p></p><p = class=3DMsoNormal>Notifying engine<o:p></o:p></p><p = class=3DMsoNormal>Done.<o:p></o:p></p><p class=3DMsoNormal>[root@engine1 = iso]# service ovirt-engine start<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Passing this = on in case I need the work around again ;)<o:p></o:p></p><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Jack = Greene<o:p></o:p></p></div></body></html> ------=_NextPart_000_0001_01D19828.03448130--

On Sun, Apr 17, 2016 at 7:36 AM, Jack Greene <jack@sdhelp.com> wrote:
Been trying to run a complete backup on a fresh install to get rid of that annoying alert.
Well, I hope you prefer that over not be able to restore you engine if it dies :-) http://www.ovirt.org/develop/release-management/features/backupawareness/ Believe me, this was done after real people lost data and time, not because anyone found it fun to do.
engine-backup --scope=all
Kept failing with the error:
2016-04-17 04:05:31 8742: Creating temp folder /tmp/engine-backup.ymrXeYZay1/tar
2016-04-17 04:05:31 8742: OUTPUT: - Files
2016-04-17 04:05:31 8742: Backing up files to /tmp/engine-backup.ymrXeYZay1/tar/files
2016-04-17 04:05:31 8742: FATAL: Failed backing up /etc/ovirt-engine
Perhaps it's because you do not have 'xz' installed, and engine-backup defaults to use xz for the --files-compressor? It will be fixed in 3.6.5, where engine-backup is packaged separately, with proper 'Require:' lines in the spec file: https://bugzilla.redhat.com/show_bug.cgi?id=1320092 https://gerrit.ovirt.org/55045 Please try installing 'xz' and run engine-backup again. If it fails, please report back. Thanks.
Research shows a bug reported on version 3.6.0 related to the tar options
https://gerrit.ovirt.org/#/c/48596/3/packaging/bin/engine-backup.sh
https://bugzilla.redhat.com/show_bug.cgi?id=1282397
But a grep of the script shows the changes have been made
[root@engine1 iso]# grep cpSs /usr/share/ovirt-engine/bin/engine-backup.sh
[root@engine1 iso]# grep cpS /usr/share/ovirt-engine/bin/engine-backup.sh
tar -C "${dir}" -cpS"${ARCHIVE_COMPRESS_OPTION}"f "${file}" . >> "${tar_log}" 2>&1
tar -C / --files-from - -cpS"${FILES_COMPRESS_OPTION}"f "${target}" || logdie "Failed backing up ${paths}"
Verified I had a new version (just re-installed ovirt-engine today)
ovirt-engine-3.6.4.1-1.el6.noarch
Linux engine1.attlocal.net 2.6.32-573.22.1.el6.x86_64 #1 SMP Wed Mar 23 03:35:39 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
# ovirt-engine-backup - oVirt engine backup and restore utility
# Copyright (C) 2013-2016 Red Hat, Inc.
Then I noticed there is an option to turn off –files-compressor. Doing this I was able to get a complete backup.
[root@engine1 iso]# engine-backup --mode=backup --scope=files --file=/mnt/h97m/backup_files_20160417 --log=/root/backup_files_20160417.log --files-compressor=None
Backing up:
Notifying engine
- Files
Packing into file '/mnt/h97m/backup_files_20160417'
Notifying engine
Done.
That's an option too. And you do not loose much by using it, because the files tar is compressed anyway when the archive is compressed, using gzip by default. 'files' are usually very small, compared to the databases, so the difference is not significant. Best, -- Didi

Of course, I meant "annoying" in a good way ;) Yep, 'xz' was missing, libs were there but not the compressor [root@engine1 ~]# rpm -qa | grep xz xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 Installed package xz [root@engine1 ~]# rpm -qa | grep xz xz-4.999.9-0.5.beta.20091007git.el6.x86_64 xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 Backup worked like a charm. Cheers On Sun, Apr 17, 2016 at 7:36 AM, Jack Greene <jack@sdhelp.com> wrote:
Been trying to run a complete backup on a fresh install to get rid of that annoying alert.
Well, I hope you prefer that over not be able to restore you engine if it dies :-) http://www.ovirt.org/develop/release-management/features/backupawareness/ Believe me, this was done after real people lost data and time, not because anyone found it fun to do.
engine-backup --scope=all
Kept failing with the error:
2016-04-17 04:05:31 8742: Creating temp folder /tmp/engine-backup.ymrXeYZay1/tar
2016-04-17 04:05:31 8742: OUTPUT: - Files
2016-04-17 04:05:31 8742: Backing up files to /tmp/engine-backup.ymrXeYZay1/tar/files
2016-04-17 04:05:31 8742: FATAL: Failed backing up /etc/ovirt-engine
Perhaps it's because you do not have 'xz' installed, and engine-backup defaults to use xz for the --files-compressor? It will be fixed in 3.6.5, where engine-backup is packaged separately, with proper 'Require:' lines in the spec file: https://bugzilla.redhat.com/show_bug.cgi?id=1320092 https://gerrit.ovirt.org/55045 Please try installing 'xz' and run engine-backup again. If it fails, please report back. Thanks.
Research shows a bug reported on version 3.6.0 related to the tar options
https://gerrit.ovirt.org/#/c/48596/3/packaging/bin/engine-backup.sh
https://bugzilla.redhat.com/show_bug.cgi?id=1282397
But a grep of the script shows the changes have been made
[root@engine1 iso]# grep cpSs /usr/share/ovirt-engine/bin/engine-backup.sh
[root@engine1 iso]# grep cpS /usr/share/ovirt-engine/bin/engine-backup.sh
tar -C "${dir}" -cpS"${ARCHIVE_COMPRESS_OPTION}"f "${file}" .
"${tar_log}" 2>&1
tar -C / --files-from - -cpS"${FILES_COMPRESS_OPTION}"f "${target}" || logdie "Failed backing up ${paths}"
Verified I had a new version (just re-installed ovirt-engine today)
ovirt-engine-3.6.4.1-1.el6.noarch
Linux engine1.attlocal.net 2.6.32-573.22.1.el6.x86_64 #1 SMP Wed Mar 23 03:35:39 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
# ovirt-engine-backup - oVirt engine backup and restore utility
# Copyright (C) 2013-2016 Red Hat, Inc.
Then I noticed there is an option to turn off –files-compressor. Doing this I was able to get a complete backup.
[root@engine1 iso]# engine-backup --mode=backup --scope=files --file=/mnt/h97m/backup_files_20160417 --log=/root/backup_files_20160417.log --files-compressor=None
Backing up:
Notifying engine
- Files
Packing into file '/mnt/h97m/backup_files_20160417'
Notifying engine
Done.
That's an option too. And you do not loose much by using it, because the files tar is compressed anyway when the archive is compressed, using gzip by default. 'files' are usually very small, compared to the databases, so the difference is not significant. Best, -- Didi
participants (2)
-
Jack Greene
-
Yedidyah Bar David