3:08 a.m.
This is a multi-part message in MIME format...
------------=_1518685718-19759-233
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
Anton Marchukov created OVIRT-1896:
--------------------------------------
Summary: Fwd: repoman error
Key: OVIRT-1896
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1896
Project: oVirt - virtualization made easy
Issue Type: By-EMAIL
Reporter: Anton Marchukov
Assignee: infra
Opening a ticket.
Might be server utilization problem, deficiency in repoman or both.
---------- Forwarded message ---------
From: Lev Veyde <lveyde(a)redhat.com>
Date: Wed, 14 Feb 2018 at 22:18
Subject: repoman error
To: Sandro Bonazzola <sbonazzo(a)redhat.com>, Anton Marchukov <
amarchuk(a)redhat.com>
Hi guys,
got the following error while was trying to add the new packages into the
ovirt-4.2 repo:
2018-02-14 17:28:43,792::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
2018-02-14 17:33:55,267::ERROR::root::Failed to sign
Traceback (most recent call last):
File "/bin/repoman", line 10, in <module>
sys.exit(main())
File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 460, in main
exit_code = do_add(args, config, repo)
File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 360, in
do_add
repo.save()
File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 42,
in _func
return func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 201,
in save
store.save()
File
"/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py",
line 263, in save
self._save(**args)
File
"/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py",
line 305, in _save
self.sign_rpms()
File
"/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py",
line 524, in sign_rpms
pkg.sign(key_path=self.sign_key, passwd=self.sign_passphrase)
File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py",
line 272, in sign
raise exc
pexpect.TIMEOUT: Timeout exceeded in read_nonblocking().
<pexpect.spawn object at 0x566e810>
version: 2.3 ($Revision: 399 $)
command: /bin/rpmsign
args: ['/bin/rpmsign', '--resign', '-D', '_signature gpg',
'-D',
u'_gpg_name oVirt <infra(a)ovirt.org>', '-D', '__gpg
/usr/bin/gpg',
'/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm']
searcher: searcher_re:
0: re.compile("pass phrase: ")
1: re.compile("passphrase: ")
2: re.compile("Passphrase: ")
buffer (last 100 chars):
before (last 100 chars):
after: <class 'pexpect.TIMEOUT'>
match: None
match_index: None
exitstatus: None
flag_eof: False
pid: 8648
child_fd: 3
closed: False
timeout: 600
delimiter: <class 'pexpect.EOF'>
logfile: None
logfile_read: None
logfile_send: None
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 0.1
delayafterterminate: 0.1
It looks this due to too small timeout value, as the following seems to
work fine:
[root@resources02 pub]# /bin/rpmsign --resign -D _signature gpg -D
_gpg_name oVirt <infra(a)ovirt.org> -D __gpg /usr/bin/gpg
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
-bash: infra(a)ovirt.org: No such file or directory
[root@resources02 pub]# /bin/rpmsign --resign -D '_signature gpg' -D
'_gpg_name oVirt <infra(a)ovirt.org>' -D '__gpg /usr/bin/gpg'
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
Enter pass phrase:
Pass phrase is good.
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm:
However running it several times gave me some weird results - I increased
the timeout to 15 minutes in the beginning, and it was still failing
dropping out after what seemed to be like only 3.5 to 5 minutes. Quite
weird stuff.
At the end I increased the timeout to 20 minutes and it seemed to make the
trick, not sure that it's not random though (even though it failed many
times before).
Noted another issue - it looks like the files to sign appear several times
in case one runs the repoman again after failed run:
2018-02-14 19:50:45,937::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-nodectl-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 19:50:47,602::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-engine-appliance-4.2-20180214.1.el7.centos.src.rpm
2018-02-14 19:57:42,360::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180214.1.el7.centos.noarch.rpm
2018-02-14 20:05:45,487::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180214.1.el7.centos.noarch.rpm
2018-02-14 20:15:21,869::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-engine-appliance-4.2-20180214.1.el7.centos.src.rpm
2018-02-14 20:27:20,663::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/fc25/noarch/ovirt-engine-appliance-4.2-20180214.1.fc25.noarch.rpm
2018-02-14 20:39:49,348::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
2018-02-14 20:47:29,586::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-tools-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:31,821::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-tools-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:32,581::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-docs-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:33,736::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-docs-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:34,806::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-node-ng-4.2.0-0.20180214.0.el7.src.rpm
2018-02-14 20:58:44,292::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-node-ng-4.2.0-0.20180214.0.el7.src.rpm
We probably should use a set instead of list there.
Sent a patch to increase the timeout: https://gerrit.ovirt.org/#/c/87694/
(Initially I thought that the issue is due to changed password prompt of
the rpmsign, which appeared not to be the case. Despite this, the patch
also rearranges the possible password prompts to a per line list to be
future proof).
Thanks in advance,
--
Lev Veyde
Software Engineer, RHCE | RHCVA | MCITP
Red Hat Israel
<https://www.redhat.com>
lev(a)redhat.com | lveyde(a)redhat.com
<https://red.ht/sig>
TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
--
Anton Marchukov
Team Lead - Release Management - RHV DevOps - Red Hat
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100079)
------------=_1518685718-19759-233
Content-Type: text/html; charset="UTF-8"
Content-Disposition: inline
Content-Transfer-Encoding: 7bit
<html><body>
<h3>Anton Marchukov created OVIRT-1896:</h3>
<pre> Summary: Fwd: repoman error
Key: OVIRT-1896
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1896
Project: oVirt - virtualization made easy
Issue Type: By-EMAIL
Reporter: Anton Marchukov
Assignee: infra</pre>
<p>Opening a ticket.</p>
<p>Might be server utilization problem, deficiency in repoman or both.</p>
<p>---------- Forwarded message --------- From: Lev Veyde
&lt;lveyde(a)redhat.com&gt; Date: Wed, 14 Feb 2018 at 22:18 Subject: repoman error
To: Sandro Bonazzola &lt;sbonazzo(a)redhat.com&gt;, Anton Marchukov <
amarchuk(a)redhat.com&gt;</p>
<p>Hi guys,</p>
<p>got the following error while was trying to add the new packages into the
ovirt-4.2 repo:</p>
<p>2018-02-14 17:28:43,792::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
2018-02-14 17:33:55,267::ERROR::root::Failed to sign Traceback (most recent call
last):</p>
<pre>File "/bin/repoman", line 10, in <module>
sys.exit(main())
File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 460, in main
exit_code = do_add(args, config, repo)
File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 360,
in</pre>
<p>do_add</p>
<pre> repo.save()
File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line
42,</pre>
<p>in _func</p>
<pre> return func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line
201,</pre>
<p>in save</p>
<pre> store.save()
File</pre>
<p>“/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py”,
line 263, in save</p>
<pre> self._save(**args)
File</pre>
<p>“/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py”,
line 305, in _save</p>
<pre> self.sign_rpms()
File</pre>
<p>“/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py”,
line 524, in sign_rpms</p>
<pre> pkg.sign(key_path=self.sign_key, passwd=self.sign_passphrase)
File
"/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py",</pre>
<p>line 272, in sign</p>
<pre>raise exc</pre>
<p>pexpect.TIMEOUT: Timeout exceeded in read_nonblocking(). <pexpect.spawn
object at 0x566e810> version: 2.3 ($Revision: 399 $) command: /bin/rpmsign args:
['/bin/rpmsign', ‘--resign’, ‘-D’,
‘_signature gpg’, ‘-D’, u'_gpg_name oVirt
&lt;infra(a)ovirt.org&gt;', ‘-D’, ‘__gpg
/usr/bin/gpg’,
‘/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm’]
searcher: searcher_re:</p>
<pre>0: re.compile("pass phrase: ")
1: re.compile("passphrase: ")
2: re.compile("Passphrase: ")</pre>
<p>buffer (last 100 chars): before (last 100 chars): after: <class
'pexpect.TIMEOUT'> match: None match_index: None exitstatus: None flag_eof:
False pid: 8648 child_fd: 3 closed: False timeout: 600 delimiter: <class
'pexpect.EOF'> logfile: None logfile_read: None logfile_send: None maxread:
2000 ignorecase: False searchwindowsize: None delaybeforesend: 0.05 delayafterclose: 0.1
delayafterterminate: 0.1</p>
<p>It looks this due to too small timeout value, as the following seems to work
fine:</p>
<p>[root@resources02 pub]# /bin/rpmsign --resign -D _signature gpg -D _gpg_name
oVirt &lt;infra(a)ovirt.org&gt; -D __gpg /usr/bin/gpg
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
-bash: infra(a)ovirt.org: No such file or directory [root@resources02 pub]# /bin/rpmsign
--resign -D ‘_signature gpg’ -D ‘_gpg_name oVirt
&lt;infra(a)ovirt.org&gt;&rsquo; -D ‘__gpg /usr/bin/gpg’
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
Enter pass phrase: Pass phrase is good.
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm:</p>
<p>However running it several times gave me some weird results – I
increased the timeout to 15 minutes in the beginning, and it was still failing dropping
out after what seemed to be like only 3.5 to 5 minutes. Quite weird stuff.</p>
<p>At the end I increased the timeout to 20 minutes and it seemed to make the trick,
not sure that it's not random though (even though it failed many times
before).</p>
<p>Noted another issue – it looks like the files to sign appear several
times in case one runs the repoman again after failed run:</p>
<p>2018-02-14 19:50:45,937::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-nodectl-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 19:50:47,602::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-engine-appliance-4.2-20180214.1.el7.centos.src.rpm
2018-02-14 19:57:42,360::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180214.1.el7.centos.noarch.rpm
2018-02-14 20:05:45,487::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-engine-appliance-4.2-20180214.1.el7.centos.noarch.rpm
2018-02-14 20:15:21,869::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-engine-appliance-4.2-20180214.1.el7.centos.src.rpm
2018-02-14 20:27:20,663::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/fc25/noarch/ovirt-engine-appliance-4.2-20180214.1.fc25.noarch.rpm
2018-02-14 20:39:49,348::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-image-update-4.2.1.1-1.el7.centos.noarch.rpm
2018-02-14 20:47:29,586::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-tools-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:31,821::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-tools-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:32,581::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-docs-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:33,736::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/noarch/ovirt-node-ng-docs-4.2.0-0.20180214.0.el7.noarch.rpm
2018-02-14 20:47:34,806::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-node-ng-4.2.0-0.20180214.0.el7.src.rpm
2018-02-14 20:58:44,292::INFO::root::SIGNING:
/var/www/html/pub/ovirt-4.2/rpm/el7/SRPMS/ovirt-node-ng-4.2.0-0.20180214.0.el7.src.rpm</p>
<p>We probably should use a set instead of list there.</p>
<p>Sent a patch to increase the timeout: <a
href="https://gerrit.ovirt.org/#/c/87694/">https://gerrit.ov...
<p>(Initially I thought that the issue is due to changed password prompt of the
rpmsign, which appeared not to be the case. Despite this, the patch also rearranges the
possible password prompts to a per line list to be future proof).</p>
<h3>Thanks in advance,</h3>
<p>Lev Veyde</p>
<p>Software Engineer, RHCE | RHCVA | MCITP</p>
<p>Red Hat Israel</p>
<p><<a
href="https://www.redhat.com/">https://www.redhat.com</a&...
<p>lev(a)redhat.com | lveyde(a)redhat.com <<a
href="https://red.ht/sig">https://red.ht/sig</a>> TRIED. TESTED.
TRUSTED. <<a
href="https://redhat.com/trusted">https://redhat.com/trusted...
— Anton Marchukov Team Lead – Release Management – RHV
DevOps – Red Hat</p>
<p>— This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100079)</p>
<img
src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpS...
alt="" width="1" height="1" border="0"
style="height:1px !important;width:1px !important;border-width:0
!important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0
!important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0
!important;padding-right:0 !important;padding-left:0 !important;"/>
</body></html>
------------=_1518685718-19759-233--