[ovirt-devel] Re: 51 jobs in the queue, all workers are idle

On Wed, Aug 14, 2019 at 9:14 PM Evgheni Dereveanchin <ederevea(a)redhat.com&gt; wrote: > Jenkins is back in operation after restoring configs and restarting it. > New jobs should be processed normally. Older ones that partially ran when > the restart happened may fail - please re-trigger those. > > There is still an issue with the s390x VM that we use for CI. It is > unrelated to the Jenkins outage: looks like the mainframe it's hosted on is > overloaded. > Until the load drops it won't be able to run CI jobs so some jobs that > build for this platform (mostly VDSM) may be stuck in the queue. > The VM belongs to the Fedora project and we share access to it with > several other projects. > I'll try to reach out to Fedora about this issue but if it persists we > may need to temporarily disable s390x jobs. > Indeed s390x are stuck, here is example build: https://jenkins.ovirt.org/blue/organizations/jenkins/standard-manual-runn... I posted this to disable s390x builds until the vm is functional again: https://gerrit.ovirt.org/c/102635/ > > On Wed, Aug 14, 2019 at 7:11 PM Evgheni Dereveanchin <ederevea(a)redhat.com&gt; > wrote: > >> Hi Nir, >> >> There has been an issue today caused by our configuration management >> system (puppet) that accidentally downgraded Jenkins which caused some >> plugin configs to be wiped. >> This caused the issue you see as new workers can't start and process the >> queue. I've recovered the old config from bacup and am now working on >> restoring Jenkins operation. >> >> Will update you once the problem is resolved. The tracker ticket is here: >> https://ovirt-jira.atlassian.net/browse/OVIRT-2775 >> >> Sorry for the inconvenience caused. >> >> On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer(a)redhat.com&gt; wrote: >> >>> After waiting for build-artifacts job for 36 minutes (typically finish >>> in 15 minutes) >>> I found that jeknins seems to be broken. >>> >>> We depend on CI and OST for merging patches. >>> >>> Can someone check this? >>> >>> --- >>> >>> [image: collapse] >>> <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build >>> Queue (51) >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> >>> part of standard-manual-runner #622 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/622/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30891> >>> part of jenkins_standard-check-patch #3199 >>> <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30889> >>> part of standard-manual-runner #621 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/621/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30887> >>> part of jenkins_standard-check-patch #3197 >>> <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30837> >>> part of vdsm_standard-check-patch #10405 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30832> >>> part of vdsm_standard-check-patch #10404 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30829> >>> part of vdsm_standard-check-patch #10403 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30826> >>> part of ovirt-system-tests_standard-check-patch #5206 >>> <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/520... >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30817> >>> part of ovirt-engine-ui-extensions_standard-on-merge #54 >>> <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merg... >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30814> >>> part of nmstate_nmstate_standard-check-pr #2095 >>> <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30808> >>> part of standard-manual-runner #620 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/620/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30804> >>> part of standard-manual-runner #619 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/619/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30773> >>> part of vdsm_standard-check-patch #10402 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30769> >>> part of vdsm_standard-check-patch #10401 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30765> >>> part of vdsm_standard-check-patch #10398 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30763> >>> part of vdsm_standard-check-patch #10395 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30762> >>> part of vdsm_standard-check-patch #10400 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30761> >>> part of vdsm_standard-check-patch #10394 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30760> >>> part of vdsm_standard-check-patch #10396 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30759> >>> part of vdsm_standard-check-patch #10399 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30758> >>> part of vdsm_standard-check-patch #10397 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30757> >>> part of vdsm_standard-check-patch #10386 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30749> >>> part of vdsm_standard-check-patch #10391 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30748> >>> part of vdsm_standard-check-patch #10392 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30747> >>> part of vdsm_standard-check-patch #10389 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30746> >>> part of vdsm_standard-check-patch #10388 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30745> >>> part of vdsm_standard-check-patch #10385 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30744> >>> part of vdsm_standard-check-patch #10387 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30743> >>> part of vdsm_standard-check-patch #10390 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30742> >>> part of vdsm_standard-check-patch #10393 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30741> >>> part of standard-manual-runner #618 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/618/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30730> >>> part of vdsm_standard-check-patch #10384 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30728> >>> part of vdsm_standard-check-patch #10381 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30727> >>> part of vdsm_standard-check-patch #10383 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30726> >>> part of vdsm_standard-check-patch #10382 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30725> >>> part of vdsm_standard-check-patch #10380 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30724> >>> part of vdsm_standard-check-patch #10379 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30723> >>> part of vdsm_standard-check-patch #10378 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30706> >>> part of nmstate_nmstate_standard-check-pr #2094 >>> <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30704> >>> part of ovirt-system-tests_standard-check-patch #5204 >>> <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/520... >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30691> >>> ovirt-system-tests_manual >>> <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30624> >>> part of vdsm_standard-check-patch #10376 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30623> >>> part of vdsm_standard-check-patch #10377 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30622> >>> part of repoman_standard-check-patch #205 >>> <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30617> >>> part of standard-manual-runner #617 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/617/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30615> >>> part of vdsm_standard-on-merge #1391 >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30610> >>> part of vdsm_standard-on-merge #1390 vdsm [check-merged] >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30585> >>> [image: collapse] >>> <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build >>> Executor Status <https://jenkins.ovirt.org/computer/> >>> master <https://jenkins.ovirt.org/computer/(master)/> >>> 1 Idle >>> 2 Idle >>> 3 Idle >>> 4 Idle >>> lfedora1.lf-dev.marist.edu >>> <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> >>> (offline) >>> mirrors.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> >>> 1 Idle >>> 2 Idle >>> 3 Idle >>> 4 Idle >>> 5 Idle >>> ovirt-srv18.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv19.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv21.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv22.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv23.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> >>> 1 Idle >>> vm0001.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0003.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0004.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0005.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0006.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0007.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> >>> (offline) >>> vm0008.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0009.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0010.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0011.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0012.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0013.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> >>> (offline) >>> vm0014.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0015.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0016.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0034.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0035.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0036.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0037.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0038.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0039.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0040.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0041.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0042.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0043.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0044.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0045.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0046.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> >>> (offline) >>> vm0047.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0048.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0049.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0051.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0052.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0053.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0054.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0055.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0056.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0057.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0058.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0059.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0060.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0061.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0062.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0063.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0064.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0065.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0084.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0085.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0086.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0087.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0088.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> >>> (offline) >>> vm0089.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0090.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0091.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0092.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0093.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0094.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0095.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0096.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0097.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0098.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0099.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0134.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> >>> (offline) >>> vm0135.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0136.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0137.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0138.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0139.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0140.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0141.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0142.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0143.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0144.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0145.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0146.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0147.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0148.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0149.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0151.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0152.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0153.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0154.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0155.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0156.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0157.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0158.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0159.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0160.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0161.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0162.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0163.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0164.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0165.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0200.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0201.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0203.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0204.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0205.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0206.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0207.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0208.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0215.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0216.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0217.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0218.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0219.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0220.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0221.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> >>> 1 Idle >>> _______________________________________________ >>> Devel mailing list -- devel(a)ovirt.org >>> To unsubscribe send an email to devel-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: >>> https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYG... >>> >> >> >> -- >> Regards, >> Evgheni Dereveanchin >> > > > -- > Regards, > Evgheni Dereveanchin >