Hi Nir, There has been an issue today caused by our configuration management system (puppet) that accidentally downgraded Jenkins which caused some plugin configs to be wiped. This caused the issue you see as new workers can't start and process the queue. I've recovered the old config from bacup and am now working on restoring Jenkins operation. Will update you once the problem is resolved. The tracker ticket is here: https://ovirt-jira.atlassian.net/browse/OVIRT-2775 Sorry for the inconvenience caused. On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer(a)redhat.com&gt; wrote: > After waiting for build-artifacts job for 36 minutes (typically finish in > 15 minutes) > I found that jeknins seems to be broken. > > We depend on CI and OST for merging patches. > > Can someone check this? > > --- > > [image: collapse] > <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build Queue > (51) > vdsm_standard-on-merge > <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel > this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> > vdsm_standard-on-merge > <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel > this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> > vdsm_standard-on-merge > <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel > this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> > vdsm_standard-on-merge > <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel > this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> > part of standard-manual-runner #622 > <https://jenkins.ovirt.org/job/standard-manual-runner/622/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30891> > part of jenkins_standard-check-patch #3199 > <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30889> > part of standard-manual-runner #621 > <https://jenkins.ovirt.org/job/standard-manual-runner/621/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30887> > part of jenkins_standard-check-patch #3197 > <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30837> > part of vdsm_standard-check-patch #10405 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30832> > part of vdsm_standard-check-patch #10404 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30829> > part of vdsm_standard-check-patch #10403 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30826> > part of ovirt-system-tests_standard-check-patch #5206 > <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/520... > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30817> > part of ovirt-engine-ui-extensions_standard-on-merge #54 > <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merg... > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30814> > part of nmstate_nmstate_standard-check-pr #2095 > <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30808> > part of standard-manual-runner #620 > <https://jenkins.ovirt.org/job/standard-manual-runner/620/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30804> > part of standard-manual-runner #619 > <https://jenkins.ovirt.org/job/standard-manual-runner/619/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30773> > part of vdsm_standard-check-patch #10402 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30769> > part of vdsm_standard-check-patch #10401 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30765> > part of vdsm_standard-check-patch #10398 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30763> > part of vdsm_standard-check-patch #10395 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30762> > part of vdsm_standard-check-patch #10400 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30761> > part of vdsm_standard-check-patch #10394 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30760> > part of vdsm_standard-check-patch #10396 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30759> > part of vdsm_standard-check-patch #10399 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30758> > part of vdsm_standard-check-patch #10397 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30757> > part of vdsm_standard-check-patch #10386 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30749> > part of vdsm_standard-check-patch #10391 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30748> > part of vdsm_standard-check-patch #10392 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30747> > part of vdsm_standard-check-patch #10389 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30746> > part of vdsm_standard-check-patch #10388 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30745> > part of vdsm_standard-check-patch #10385 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30744> > part of vdsm_standard-check-patch #10387 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30743> > part of vdsm_standard-check-patch #10390 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30742> > part of vdsm_standard-check-patch #10393 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30741> > part of standard-manual-runner #618 > <https://jenkins.ovirt.org/job/standard-manual-runner/618/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30730> > part of vdsm_standard-check-patch #10384 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30728> > part of vdsm_standard-check-patch #10381 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30727> > part of vdsm_standard-check-patch #10383 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30726> > part of vdsm_standard-check-patch #10382 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30725> > part of vdsm_standard-check-patch #10380 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30724> > part of vdsm_standard-check-patch #10379 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30723> > part of vdsm_standard-check-patch #10378 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30706> > part of nmstate_nmstate_standard-check-pr #2094 > <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30704> > part of ovirt-system-tests_standard-check-patch #5204 > <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/520... > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30691> > ovirt-system-tests_manual > <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30624> > part of vdsm_standard-check-patch #10376 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30623> > part of vdsm_standard-check-patch #10377 > <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30622> > part of repoman_standard-check-patch #205 > <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30617> > part of standard-manual-runner #617 > <https://jenkins.ovirt.org/job/standard-manual-runner/617/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30615> > part of vdsm_standard-on-merge #1391 > <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30610> > part of vdsm_standard-on-merge #1390 vdsm [check-merged] > <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> > <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: > cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30585> > [image: collapse] > <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build > Executor Status <https://jenkins.ovirt.org/computer/> > master <https://jenkins.ovirt.org/computer/(master)/> > 1 Idle > 2 Idle > 3 Idle > 4 Idle > lfedora1.lf-dev.marist.edu > <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> > (offline) > mirrors.phx.ovirt.org > <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> > 1 Idle > 2 Idle > 3 Idle > 4 Idle > 5 Idle > ovirt-srv18.phx.ovirt.org > <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> > 1 Idle > ovirt-srv19.phx.ovirt.org > <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> > 1 Idle > ovirt-srv21.phx.ovirt.org > <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> > 1 Idle > ovirt-srv22.phx.ovirt.org > <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> > 1 Idle > ovirt-srv23.phx.ovirt.org > <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> > 1 Idle > vm0001.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> > 1 Idle > vm0003.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> > 1 Idle > vm0004.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> > 1 Idle > vm0005.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> > 1 Idle > vm0006.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> > 1 Idle > vm0007.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> > (offline) > vm0008.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> > 1 Idle > vm0009.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> > 1 Idle > vm0010.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> > 1 Idle > vm0011.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> > 1 Idle > vm0012.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> > 1 Idle > vm0013.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> > (offline) > vm0014.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> > 1 Idle > vm0015.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> > 1 Idle > vm0016.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> > 1 Idle > vm0034.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> > 1 Idle > vm0035.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> > 1 Idle > vm0036.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> > 1 Idle > vm0037.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> > 1 Idle > vm0038.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> > 1 Idle > vm0039.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> > 1 Idle > vm0040.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> > 1 Idle > vm0041.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> > 1 Idle > vm0042.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> > 1 Idle > vm0043.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> > 1 Idle > vm0044.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> > 1 Idle > vm0045.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> > 1 Idle > vm0046.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> > (offline) > vm0047.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> > 1 Idle > vm0048.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> > 1 Idle > vm0049.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> > 1 Idle > vm0051.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> > 1 Idle > vm0052.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> > 1 Idle > vm0053.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> > 1 Idle > vm0054.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> > 1 Idle > vm0055.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> > 1 Idle > vm0056.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> > 1 Idle > vm0057.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> > 1 Idle > vm0058.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> > 1 Idle > vm0059.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> > 1 Idle > vm0060.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> > 1 Idle > vm0061.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> > 1 Idle > vm0062.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> > 1 Idle > vm0063.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> > 1 Idle > vm0064.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> > 1 Idle > vm0065.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> > 1 Idle > vm0084.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> > 1 Idle > vm0085.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> > 1 Idle > vm0086.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> > 1 Idle > vm0087.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> > 1 Idle > vm0088.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> > (offline) > vm0089.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> > 1 Idle > vm0090.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> > 1 Idle > vm0091.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> > 1 Idle > vm0092.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> > 1 Idle > vm0093.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> > 1 Idle > vm0094.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> > 1 Idle > vm0095.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> > 1 Idle > vm0096.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> > 1 Idle > vm0097.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> > 1 Idle > vm0098.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> > 1 Idle > vm0099.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> > 1 Idle > vm0134.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> > (offline) > vm0135.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> > 1 Idle > vm0136.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> > 1 Idle > vm0137.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> > 1 Idle > vm0138.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> > 1 Idle > vm0139.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> > 1 Idle > vm0140.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> > 1 Idle > vm0141.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> > 1 Idle > vm0142.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> > 1 Idle > vm0143.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> > 1 Idle > vm0144.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> > 1 Idle > vm0145.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> > 1 Idle > vm0146.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> > 1 Idle > vm0147.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> > 1 Idle > vm0148.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> > 1 Idle > vm0149.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> > 1 Idle > vm0151.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> > 1 Idle > vm0152.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> > 1 Idle > vm0153.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> > 1 Idle > vm0154.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> > 1 Idle > vm0155.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> > 1 Idle > vm0156.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> > 1 Idle > vm0157.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> > 1 Idle > vm0158.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> > 1 Idle > vm0159.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> > 1 Idle > vm0160.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> > 1 Idle > vm0161.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> > 1 Idle > vm0162.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> > 1 Idle > vm0163.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> > 1 Idle > vm0164.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> > 1 Idle > vm0165.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> > 1 Idle > vm0200.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> > 1 Idle > vm0201.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> > 1 Idle > vm0203.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> > 1 Idle > vm0204.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> > 1 Idle > vm0205.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> > 1 Idle > vm0206.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> > 1 Idle > vm0207.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> > 1 Idle > vm0208.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> > 1 Idle > vm0215.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> > 1 Idle > vm0216.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> > 1 Idle > vm0217.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> > 1 Idle > vm0218.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> > 1 Idle > vm0219.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> > 1 Idle > vm0220.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> > 1 Idle > vm0221.workers-phx.ovirt.org > <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> > 1 Idle > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYG... > -- Regards, Evgheni Dereveanchin

On Wed, Aug 14, 2019 at 9:14 PM Evgheni Dereveanchin <ederevea(a)redhat.com&gt; wrote: > Jenkins is back in operation after restoring configs and restarting it. > New jobs should be processed normally. Older ones that partially ran when > the restart happened may fail - please re-trigger those. > > There is still an issue with the s390x VM that we use for CI. It is > unrelated to the Jenkins outage: looks like the mainframe it's hosted on is > overloaded. > Until the load drops it won't be able to run CI jobs so some jobs that > build for this platform (mostly VDSM) may be stuck in the queue. > The VM belongs to the Fedora project and we share access to it with > several other projects. > I'll try to reach out to Fedora about this issue but if it persists we > may need to temporarily disable s390x jobs. > Indeed s390x are stuck, here is example build: https://jenkins.ovirt.org/blue/organizations/jenkins/standard-manual-runn... I posted this to disable s390x builds until the vm is functional again: https://gerrit.ovirt.org/c/102635/ > > On Wed, Aug 14, 2019 at 7:11 PM Evgheni Dereveanchin <ederevea(a)redhat.com&gt; > wrote: > >> Hi Nir, >> >> There has been an issue today caused by our configuration management >> system (puppet) that accidentally downgraded Jenkins which caused some >> plugin configs to be wiped. >> This caused the issue you see as new workers can't start and process the >> queue. I've recovered the old config from bacup and am now working on >> restoring Jenkins operation. >> >> Will update you once the problem is resolved. The tracker ticket is here: >> https://ovirt-jira.atlassian.net/browse/OVIRT-2775 >> >> Sorry for the inconvenience caused. >> >> On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer(a)redhat.com&gt; wrote: >> >>> After waiting for build-artifacts job for 36 minutes (typically finish >>> in 15 minutes) >>> I found that jeknins seems to be broken. >>> >>> We depend on CI and OST for merging patches. >>> >>> Can someone check this? >>> >>> --- >>> >>> [image: collapse] >>> <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build >>> Queue (51) >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> >>> vdsm_standard-on-merge >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel >>> this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> >>> part of standard-manual-runner #622 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/622/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30891> >>> part of jenkins_standard-check-patch #3199 >>> <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30889> >>> part of standard-manual-runner #621 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/621/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30887> >>> part of jenkins_standard-check-patch #3197 >>> <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30837> >>> part of vdsm_standard-check-patch #10405 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30832> >>> part of vdsm_standard-check-patch #10404 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30829> >>> part of vdsm_standard-check-patch #10403 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30826> >>> part of ovirt-system-tests_standard-check-patch #5206 >>> <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/520... >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30817> >>> part of ovirt-engine-ui-extensions_standard-on-merge #54 >>> <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merg... >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30814> >>> part of nmstate_nmstate_standard-check-pr #2095 >>> <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30808> >>> part of standard-manual-runner #620 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/620/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30804> >>> part of standard-manual-runner #619 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/619/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30773> >>> part of vdsm_standard-check-patch #10402 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30769> >>> part of vdsm_standard-check-patch #10401 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30765> >>> part of vdsm_standard-check-patch #10398 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30763> >>> part of vdsm_standard-check-patch #10395 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30762> >>> part of vdsm_standard-check-patch #10400 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30761> >>> part of vdsm_standard-check-patch #10394 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30760> >>> part of vdsm_standard-check-patch #10396 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30759> >>> part of vdsm_standard-check-patch #10399 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30758> >>> part of vdsm_standard-check-patch #10397 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30757> >>> part of vdsm_standard-check-patch #10386 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30749> >>> part of vdsm_standard-check-patch #10391 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30748> >>> part of vdsm_standard-check-patch #10392 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30747> >>> part of vdsm_standard-check-patch #10389 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30746> >>> part of vdsm_standard-check-patch #10388 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30745> >>> part of vdsm_standard-check-patch #10385 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30744> >>> part of vdsm_standard-check-patch #10387 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30743> >>> part of vdsm_standard-check-patch #10390 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30742> >>> part of vdsm_standard-check-patch #10393 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30741> >>> part of standard-manual-runner #618 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/618/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30730> >>> part of vdsm_standard-check-patch #10384 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30728> >>> part of vdsm_standard-check-patch #10381 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30727> >>> part of vdsm_standard-check-patch #10383 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30726> >>> part of vdsm_standard-check-patch #10382 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30725> >>> part of vdsm_standard-check-patch #10380 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30724> >>> part of vdsm_standard-check-patch #10379 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30723> >>> part of vdsm_standard-check-patch #10378 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30706> >>> part of nmstate_nmstate_standard-check-pr #2094 >>> <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30704> >>> part of ovirt-system-tests_standard-check-patch #5204 >>> <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/520... >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30691> >>> ovirt-system-tests_manual >>> <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30624> >>> part of vdsm_standard-check-patch #10376 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30623> >>> part of vdsm_standard-check-patch #10377 >>> <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30622> >>> part of repoman_standard-check-patch #205 >>> <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30617> >>> part of standard-manual-runner #617 >>> <https://jenkins.ovirt.org/job/standard-manual-runner/617/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30615> >>> part of vdsm_standard-on-merge #1391 >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30610> >>> part of vdsm_standard-on-merge #1390 vdsm [check-merged] >>> <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> >>> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: >>> cancel this build] >>> <https://jenkins.ovirt.org/queue/cancelItem?id=30585> >>> [image: collapse] >>> <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build >>> Executor Status <https://jenkins.ovirt.org/computer/> >>> master <https://jenkins.ovirt.org/computer/(master)/> >>> 1 Idle >>> 2 Idle >>> 3 Idle >>> 4 Idle >>> lfedora1.lf-dev.marist.edu >>> <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> >>> (offline) >>> mirrors.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> >>> 1 Idle >>> 2 Idle >>> 3 Idle >>> 4 Idle >>> 5 Idle >>> ovirt-srv18.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv19.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv21.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv22.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> >>> 1 Idle >>> ovirt-srv23.phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> >>> 1 Idle >>> vm0001.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0003.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0004.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0005.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0006.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0007.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> >>> (offline) >>> vm0008.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0009.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0010.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0011.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0012.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0013.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> >>> (offline) >>> vm0014.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0015.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0016.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0034.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0035.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0036.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0037.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0038.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0039.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0040.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0041.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0042.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0043.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0044.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0045.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0046.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> >>> (offline) >>> vm0047.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0048.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0049.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0051.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0052.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0053.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0054.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0055.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0056.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0057.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0058.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0059.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0060.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0061.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0062.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0063.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0064.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0065.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0084.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0085.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0086.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0087.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0088.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> >>> (offline) >>> vm0089.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0090.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0091.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0092.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0093.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0094.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0095.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0096.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0097.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0098.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0099.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0134.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> >>> (offline) >>> vm0135.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0136.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0137.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0138.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0139.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0140.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0141.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0142.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0143.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0144.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0145.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0146.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0147.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0148.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0149.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0151.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0152.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0153.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0154.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0155.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0156.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0157.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0158.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0159.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0160.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0161.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0162.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0163.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0164.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0165.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0200.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0201.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0203.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0204.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0205.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0206.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0207.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0208.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0215.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0216.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0217.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0218.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0219.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0220.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> >>> 1 Idle >>> vm0221.workers-phx.ovirt.org >>> <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> >>> 1 Idle >>> _______________________________________________ >>> Devel mailing list -- devel(a)ovirt.org >>> To unsubscribe send an email to devel-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: >>> https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYG... >>> >> >> >> -- >> Regards, >> Evgheni Dereveanchin >> > > > -- > Regards, > Evgheni Dereveanchin >