- Infra - oVirt List Archives

[JIRA] (OVIRT-1903) awkward error on an OST change
by eyal edri (oVirt JIRA) 20 Feb '18

20 Feb '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1903?page=com.atlassian.jira.… ] eyal edri updated OVIRT-1903: ----------------------------- Resolution: Fixed Status: Done (was: To Do) > awkward error on an OST change > ------------------------------ > > Key: OVIRT-1903 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1903 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: OST > Reporter: danken > Assignee: infra > > My benign change https://gerrit.ovirt.org/#/c/87821/ caused an error that I fail to parse in OST > http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080)

1 0

[JIRA] (OVIRT-1844) jenkins_master_deploy-configs_merged failing do to missing libraries
by eyal edri (oVirt JIRA) 20 Feb '18

20 Feb '18

This is a multi-part message in MIME format... ------------=_1519136760-20242-279 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit [ https://ovirt-jira.atlassian.net/browse/OVIRT-1844?page=com.atlassian.jira.… ] eyal edri commented on OVIRT-1844: ---------------------------------- Any update? > jenkins_master_deploy-configs_merged failing do to missing libraries > -------------------------------------------------------------------- > > Key: OVIRT-1844 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1844 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > Priority: High > > Since patches related to OVIRT-1746, mainly https://gerrit.ovirt.org/85158/, got merged, jenkins configs are no longer deployed since libraries required by usrc.py are missing on the Jenkins: > http://jenkins.ovirt.org/job/jenkins_master_deploy-configs_merged/997/conso… > File "/var/lib/data/jenkins/jobs/jenkins_master_deploy-configs_merged/workspace/jenkins/scripts/usrc.py", line 13, in <module> > from xdg.BaseDirectory import xdg_cache_home > ImportError: No module named xdg.BaseDirectory -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080) ------------=_1519136760-20242-279 Content-Type: text/html; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit <html><body> <pre>[ https://ovirt-jira.atlassian.net/browse/OVIRT-1844?page=com.atlassian.jira.… ]</pre> <h3>eyal edri commented on OVIRT-1844:</h3> <p>Any update?</p> <blockquote><h3>jenkins_master_deploy-configs_merged failing do to missing libraries</h3> <pre> Key: OVIRT-1844 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1844 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra Priority: High</pre> <p>Since patches related to OVIRT-1746, mainly <a href="https://gerrit.ovirt.org/85158/">https://gerrit.ovirt.org/85158/</a>, got merged, jenkins configs are no longer deployed since libraries required by usrc.py are missing on the Jenkins: <a href="http://jenkins.ovirt.org/job/jenkins_master_deploy-configs_merged/997/conso…">http://jenkins.ovirt.org/job/jenkins_master_deploy-configs_merged/997/conso…</a></p> <pre> File "/var/lib/data/jenkins/jobs/jenkins_master_deploy-configs_merged/workspace/jenkins/scripts/usrc.py", line 13, in <module> from xdg.BaseDirectory import xdg_cache_home ImportError: No module named xdg.BaseDirectory</pre></blockquote> <p>— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080)</p> <img src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpSp2-2BJ33BSM3…" alt="" width="1" height="1" border="0" style="height:1px !important;width:1px !important;border-width:0 !important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0 !important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0 !important;padding-right:0 !important;padding-left:0 !important;"/> </body></html> ------------=_1519136760-20242-279--

1 0

[JIRA] (OVIRT-1856) Document procedure for infra upgrades
by eyal edri (oVirt JIRA) 20 Feb '18

20 Feb '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1856?page=com.atlassian.jira.… ] eyal edri reassigned OVIRT-1856: -------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > Document procedure for infra upgrades > -------------------------------------- > > Key: OVIRT-1856 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1856 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: eyal edri > Assignee: Evgheni Dereveanchin > Priority: High > > On Sun, Jan 21, 2018 at 1:01 PM, Barak Korren <bkorren(a)redhat.com> wrote: > > > > > > On 21 January 2018 at 12:50, Eyal Edri <eedri(a)redhat.com> wrote: > > > >> > >> > >> On Sun, Jan 21, 2018 at 12:47 PM, Barak Korren <bkorren(a)redhat.com> > >> wrote: > >> > >>> > >>> > >>> On 21 January 2018 at 12:39, Eyal Edri <eedri(a)redhat.com> wrote: > >>> > >>>> There is another issue, which is currently failing all CQ, and its > >>>> related to the new IBRS CPU model. > >>>> It looks like all of the lago slaves were upgraded to new Libvirt and > >>>> kernel on Friday, while we still don't have a fix on lago-ost-plugin for > >>>> that. > >>>> > >>>> I think there was a misunderstanding about what to upgrade, and it > >>>> might have been understood that only the bios upgrade breaks it and not the > >>>> kernel one. > >>>> > >>>> In any case, we're currently fixing the issue, either by downgrading > >>>> the relevant pkgs on lago slaves or adding the mapping to new CPU types > >>>> from OST. > >>>> > >>>> For future, I suggest a few updates to maintenance work on Jenkins > >>>> slaves ( VMs or BM ): > >>>> > >>>> 1. Let's avoid doing an upgrade close to a weekend ( i.e not on Thu-Sun > >>>> ), so all the team can be around to help if needed or if something > >>>> unexpected happens. > >>>> 2. When we have a system-wide upgrade scheduled, like all BM slaves or > >>>> VMs for a specific OS, let's adopt a gradual upgrade with a few days window > >>>> in between, > >>>> e.g, if we need to upgrade all Lago slaves, let's upgrade 1-2 and > >>>> wait to see if nothing breaks and continue after we verify OST runs ( > >>>> either seeing on CQ or running manually ) > >>>> > >>>> > >>>> Thoughts? > >>>> > >>>> > >>> We have a staging system - we should be using it for staging.... > >>> > >> > >> Do we have OST tests or manual job avaialble there? > >> > > > > We can add them easily, or simply run Lago manually when needed. > > > > > >> In any case, this doesn't contradict what I suggested, even if you test > >> on staging, there could be differences from the production system, so we > >> should take care when we upgrade regardless. > >> > > > > Yes, but at least we'd know we green lighted the new configuration - I'm > > sure in this case we could have found at least some of the issues on > > staging (Like the fc27 issues for example) and could have avoided expansive > > production failures. > > > > Another point when scheduling an upgrade, is to talk to infra owner or the > >> CI team and understand if we currently have a large Q in CQ or known > >> failures, so it might be best to wait a bit until its cleared. > >> > >> > > > > > Adding infra-support so we can gather this info and prepare a maintanaince > / upgrade checklist to add to the oVirt infra docs. > Let's continue the discussion, suggestion on that ticket. > > -- > > Barak Korren > > RHV DevOps team , RHCE, RHCi > > Red Hat EMEA > > redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted > > > -- > Eyal edri > MANAGER > RHV DevOps > EMEA VIRTUALIZATION R&D > Red Hat EMEA <https://www.redhat.com/> > <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > phone: +972-9-7692018 > irc: eedri (on #tlv #rhev-dev #rhev-integ) -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080)

1 0

[JIRA] (OVIRT-1905) IPv6 not enabled on FC27 slaves
by eyal edri (oVirt JIRA) 20 Feb '18

20 Feb '18

This is a multi-part message in MIME format... ------------=_1519136487-16545-290 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit [ https://ovirt-jira.atlassian.net/browse/OVIRT-1905?page=com.atlassian.jira.… ] eyal edri reassigned OVIRT-1905: -------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > IPv6 not enabled on FC27 slaves > ------------------------------- > > Key: OVIRT-1905 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1905 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Edward Haas > Assignee: Evgheni Dereveanchin > > Hello, > VDSM check-patch tests require IPv6 enabled on the slave which runs them. > It seems that one such slave does not have IPv6 enabled. > http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-fc27-x86_64/71/ > Thanks, > Edy. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080) ------------=_1519136487-16545-290 Content-Type: text/html; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit <html><body> <pre>[ https://ovirt-jira.atlassian.net/browse/OVIRT-1905?page=com.atlassian.jira.… ]</pre> <h3>eyal edri reassigned OVIRT-1905:</h3> <pre>Assignee: Evgheni Dereveanchin (was: infra)</pre> <blockquote><h3>IPv6 not enabled on FC27 slaves</h3> <pre> Key: OVIRT-1905 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1905 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Edward Haas Assignee: Evgheni Dereveanchin</pre> <p>Hello, VDSM check-patch tests require IPv6 enabled on the slave which runs them. It seems that one such slave does not have IPv6 enabled. <a href="http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-fc27-x86_64/71/">http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-fc27-x86_64/71/</a> Thanks, Edy.</p></blockquote> <p>— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080)</p> <img src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpSp2-2BJ33BSM3…" alt="" width="1" height="1" border="0" style="height:1px !important;width:1px !important;border-width:0 !important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0 !important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0 !important;padding-right:0 !important;padding-left:0 !important;"/> </body></html> ------------=_1519136487-16545-290--

1 0

[JIRA] (OVIRT-1905) IPv6 not enabled on FC27 slaves
by Edward Haas (oVirt JIRA) 20 Feb '18

20 Feb '18

This is a multi-part message in MIME format... ------------=_1519136013-18143-293 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Edward Haas created OVIRT-1905: ---------------------------------- Summary: IPv6 not enabled on FC27 slaves Key: OVIRT-1905 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1905 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Edward Haas Assignee: infra Hello, VDSM check-patch tests require IPv6 enabled on the slave which runs them. It seems that one such slave does not have IPv6 enabled. http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-fc27-x86_64/71/ Thanks, Edy. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080) ------------=_1519136013-18143-293 Content-Type: text/html; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit <html><body> <h3>Edward Haas created OVIRT-1905:</h3> <pre> Summary: IPv6 not enabled on FC27 slaves Key: OVIRT-1905 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1905 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Edward Haas Assignee: infra</pre> <p>Hello,</p> <p>VDSM check-patch tests require IPv6 enabled on the slave which runs them. It seems that one such slave does not have IPv6 enabled.</p> <p><a href="http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-fc27-x86_64/71/">http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-fc27-x86_64/71/</a></p> <p>Thanks, Edy.</p> <p>— This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100080)</p> <img src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpSp2-2BJ33BSM3…" alt="" width="1" height="1" border="0" style="height:1px !important;width:1px !important;border-width:0 !important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0 !important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0 !important;padding-right:0 !important;padding-left:0 !important;"/> </body></html> ------------=_1519136013-18143-293--

1 0

Jenkins build is back to normal : deploy-to_ovirt-4.1_tested #1136
by jenkins＠jenkins.phx.ovirt.org 20 Feb '18

20 Feb '18

See <http://jenkins.ovirt.org/job/deploy-to_ovirt-4.1_tested/1136/display/redire…>

1 0

Jenkins build is back to normal : system-sync_mirrors-fedora-base-fc27-x86_64 #405
by jenkins＠jenkins.phx.ovirt.org 20 Feb '18

20 Feb '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc27-x86_64/40…>

1 0

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1217
by jenkins＠jenkins.phx.ovirt.org 20 Feb '18

20 Feb '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1217/displ…> Changes: [Sandro Bonazzola] ovirt-provider-ovn: drop manual jobs [Dafna Ron] jenkins: adding infra(a)ovirt.org to the alert list ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision eca59747fe7f94ae8694f3e69768a4ce4a71a60f (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f eca59747fe7f94ae8694f3e69768a4ce4a71a60f Commit message: "jenkins: adding infra(a)ovirt.org to the alert list" > git rev-list --no-walk 28d0b911763057b7a04becf847853d57af4e3a25 # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins7237571100229054612.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7' Build step 'Execute shell' marked build as failure

1 1

Jenkins build became unstable: ovirt_4.2_publish-rpms_nightly #126
by jenkins＠jenkins.phx.ovirt.org 20 Feb '18

20 Feb '18

See <http://jenkins.ovirt.org/job/ovirt_4.2_publish-rpms_nightly/126/display/red…>

1 1

Jenkins build became unstable: ovirt_master_publish-rpms_nightly #879
by jenkins＠jenkins.phx.ovirt.org 20 Feb '18

20 Feb '18

See <http://jenkins.ovirt.org/job/ovirt_master_publish-rpms_nightly/879/display/…>

2 4