51 jobs in the queue, all workers are idle

After waiting for build-artifacts job for 36 minutes (typically finish in 15 minutes) I found that jeknins seems to be broken. We depend on CI and OST for merging patches. Can someone check this? --- [image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build Queue (51) vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> part of standard-manual-runner #622 <https://jenkins.ovirt.org/job/standard-manual-runner/622/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30891> part of jenkins_standard-check-patch #3199 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30889> part of standard-manual-runner #621 <https://jenkins.ovirt.org/job/standard-manual-runner/621/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30887> part of jenkins_standard-check-patch #3197 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30837> part of vdsm_standard-check-patch #10405 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30832> part of vdsm_standard-check-patch #10404 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30829> part of vdsm_standard-check-patch #10403 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30826> part of ovirt-system-tests_standard-check-patch #5206 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5206/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30817> part of ovirt-engine-ui-extensions_standard-on-merge #54 <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merge/54/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30814> part of nmstate_nmstate_standard-check-pr #2095 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30808> part of standard-manual-runner #620 <https://jenkins.ovirt.org/job/standard-manual-runner/620/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30804> part of standard-manual-runner #619 <https://jenkins.ovirt.org/job/standard-manual-runner/619/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30773> part of vdsm_standard-check-patch #10402 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30769> part of vdsm_standard-check-patch #10401 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30765> part of vdsm_standard-check-patch #10398 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30763> part of vdsm_standard-check-patch #10395 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30762> part of vdsm_standard-check-patch #10400 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30761> part of vdsm_standard-check-patch #10394 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30760> part of vdsm_standard-check-patch #10396 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30759> part of vdsm_standard-check-patch #10399 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30758> part of vdsm_standard-check-patch #10397 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30757> part of vdsm_standard-check-patch #10386 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30749> part of vdsm_standard-check-patch #10391 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30748> part of vdsm_standard-check-patch #10392 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30747> part of vdsm_standard-check-patch #10389 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30746> part of vdsm_standard-check-patch #10388 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30745> part of vdsm_standard-check-patch #10385 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30744> part of vdsm_standard-check-patch #10387 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30743> part of vdsm_standard-check-patch #10390 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30742> part of vdsm_standard-check-patch #10393 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30741> part of standard-manual-runner #618 <https://jenkins.ovirt.org/job/standard-manual-runner/618/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30730> part of vdsm_standard-check-patch #10384 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30728> part of vdsm_standard-check-patch #10381 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30727> part of vdsm_standard-check-patch #10383 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30726> part of vdsm_standard-check-patch #10382 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30725> part of vdsm_standard-check-patch #10380 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30724> part of vdsm_standard-check-patch #10379 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30723> part of vdsm_standard-check-patch #10378 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30706> part of nmstate_nmstate_standard-check-pr #2094 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30704> part of ovirt-system-tests_standard-check-patch #5204 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5204/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30691> ovirt-system-tests_manual <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30624> part of vdsm_standard-check-patch #10376 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30623> part of vdsm_standard-check-patch #10377 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30622> part of repoman_standard-check-patch #205 <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30617> part of standard-manual-runner #617 <https://jenkins.ovirt.org/job/standard-manual-runner/617/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30615> part of vdsm_standard-on-merge #1391 <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30610> part of vdsm_standard-on-merge #1390 vdsm [check-merged] <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30585> [image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build Executor Status <https://jenkins.ovirt.org/computer/> master <https://jenkins.ovirt.org/computer/(master)/> 1 Idle 2 Idle 3 Idle 4 Idle lfedora1.lf-dev.marist.edu <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> (offline) mirrors.phx.ovirt.org <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> 1 Idle 2 Idle 3 Idle 4 Idle 5 Idle ovirt-srv18.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> 1 Idle ovirt-srv19.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> 1 Idle ovirt-srv21.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> 1 Idle ovirt-srv22.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> 1 Idle ovirt-srv23.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> 1 Idle vm0001.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> 1 Idle vm0003.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> 1 Idle vm0004.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> 1 Idle vm0005.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> 1 Idle vm0006.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> 1 Idle vm0007.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> (offline) vm0008.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> 1 Idle vm0009.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> 1 Idle vm0010.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> 1 Idle vm0011.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> 1 Idle vm0012.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> 1 Idle vm0013.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> (offline) vm0014.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> 1 Idle vm0015.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> 1 Idle vm0016.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> 1 Idle vm0034.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> 1 Idle vm0035.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> 1 Idle vm0036.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> 1 Idle vm0037.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> 1 Idle vm0038.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> 1 Idle vm0039.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> 1 Idle vm0040.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> 1 Idle vm0041.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> 1 Idle vm0042.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> 1 Idle vm0043.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> 1 Idle vm0044.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> 1 Idle vm0045.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> 1 Idle vm0046.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> (offline) vm0047.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> 1 Idle vm0048.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> 1 Idle vm0049.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> 1 Idle vm0051.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> 1 Idle vm0052.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> 1 Idle vm0053.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> 1 Idle vm0054.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> 1 Idle vm0055.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> 1 Idle vm0056.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> 1 Idle vm0057.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> 1 Idle vm0058.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> 1 Idle vm0059.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> 1 Idle vm0060.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> 1 Idle vm0061.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> 1 Idle vm0062.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> 1 Idle vm0063.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> 1 Idle vm0064.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> 1 Idle vm0065.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> 1 Idle vm0084.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> 1 Idle vm0085.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> 1 Idle vm0086.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> 1 Idle vm0087.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> 1 Idle vm0088.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> (offline) vm0089.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> 1 Idle vm0090.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> 1 Idle vm0091.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> 1 Idle vm0092.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> 1 Idle vm0093.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> 1 Idle vm0094.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> 1 Idle vm0095.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> 1 Idle vm0096.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> 1 Idle vm0097.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> 1 Idle vm0098.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> 1 Idle vm0099.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> 1 Idle vm0134.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> (offline) vm0135.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> 1 Idle vm0136.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> 1 Idle vm0137.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> 1 Idle vm0138.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> 1 Idle vm0139.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> 1 Idle vm0140.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> 1 Idle vm0141.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> 1 Idle vm0142.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> 1 Idle vm0143.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> 1 Idle vm0144.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> 1 Idle vm0145.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> 1 Idle vm0146.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> 1 Idle vm0147.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> 1 Idle vm0148.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> 1 Idle vm0149.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> 1 Idle vm0151.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> 1 Idle vm0152.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> 1 Idle vm0153.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> 1 Idle vm0154.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> 1 Idle vm0155.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> 1 Idle vm0156.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> 1 Idle vm0157.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> 1 Idle vm0158.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> 1 Idle vm0159.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> 1 Idle vm0160.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> 1 Idle vm0161.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> 1 Idle vm0162.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> 1 Idle vm0163.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> 1 Idle vm0164.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> 1 Idle vm0165.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> 1 Idle vm0200.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> 1 Idle vm0201.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> 1 Idle vm0203.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> 1 Idle vm0204.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> 1 Idle vm0205.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> 1 Idle vm0206.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> 1 Idle vm0207.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> 1 Idle vm0208.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> 1 Idle vm0215.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> 1 Idle vm0216.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> 1 Idle vm0217.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> 1 Idle vm0218.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> 1 Idle vm0219.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> 1 Idle vm0220.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> 1 Idle vm0221.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> 1 Idle

Hi Nir, There has been an issue today caused by our configuration management system (puppet) that accidentally downgraded Jenkins which caused some plugin configs to be wiped. This caused the issue you see as new workers can't start and process the queue. I've recovered the old config from bacup and am now working on restoring Jenkins operation. Will update you once the problem is resolved. The tracker ticket is here: https://ovirt-jira.atlassian.net/browse/OVIRT-2775 Sorry for the inconvenience caused. On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer@redhat.com> wrote:
After waiting for build-artifacts job for 36 minutes (typically finish in 15 minutes) I found that jeknins seems to be broken.
We depend on CI and OST for merging patches.
Can someone check this?
---
[image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build Queue (51) vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> part of standard-manual-runner #622 <https://jenkins.ovirt.org/job/standard-manual-runner/622/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30891> part of jenkins_standard-check-patch #3199 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30889> part of standard-manual-runner #621 <https://jenkins.ovirt.org/job/standard-manual-runner/621/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30887> part of jenkins_standard-check-patch #3197 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30837> part of vdsm_standard-check-patch #10405 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30832> part of vdsm_standard-check-patch #10404 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30829> part of vdsm_standard-check-patch #10403 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30826> part of ovirt-system-tests_standard-check-patch #5206 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5206/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30817> part of ovirt-engine-ui-extensions_standard-on-merge #54 <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merge/54/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30814> part of nmstate_nmstate_standard-check-pr #2095 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30808> part of standard-manual-runner #620 <https://jenkins.ovirt.org/job/standard-manual-runner/620/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30804> part of standard-manual-runner #619 <https://jenkins.ovirt.org/job/standard-manual-runner/619/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30773> part of vdsm_standard-check-patch #10402 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30769> part of vdsm_standard-check-patch #10401 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30765> part of vdsm_standard-check-patch #10398 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30763> part of vdsm_standard-check-patch #10395 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30762> part of vdsm_standard-check-patch #10400 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30761> part of vdsm_standard-check-patch #10394 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30760> part of vdsm_standard-check-patch #10396 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30759> part of vdsm_standard-check-patch #10399 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30758> part of vdsm_standard-check-patch #10397 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30757> part of vdsm_standard-check-patch #10386 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30749> part of vdsm_standard-check-patch #10391 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30748> part of vdsm_standard-check-patch #10392 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30747> part of vdsm_standard-check-patch #10389 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30746> part of vdsm_standard-check-patch #10388 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30745> part of vdsm_standard-check-patch #10385 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30744> part of vdsm_standard-check-patch #10387 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30743> part of vdsm_standard-check-patch #10390 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30742> part of vdsm_standard-check-patch #10393 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30741> part of standard-manual-runner #618 <https://jenkins.ovirt.org/job/standard-manual-runner/618/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30730> part of vdsm_standard-check-patch #10384 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30728> part of vdsm_standard-check-patch #10381 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30727> part of vdsm_standard-check-patch #10383 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30726> part of vdsm_standard-check-patch #10382 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30725> part of vdsm_standard-check-patch #10380 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30724> part of vdsm_standard-check-patch #10379 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30723> part of vdsm_standard-check-patch #10378 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30706> part of nmstate_nmstate_standard-check-pr #2094 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30704> part of ovirt-system-tests_standard-check-patch #5204 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5204/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30691> ovirt-system-tests_manual <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30624> part of vdsm_standard-check-patch #10376 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30623> part of vdsm_standard-check-patch #10377 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30622> part of repoman_standard-check-patch #205 <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30617> part of standard-manual-runner #617 <https://jenkins.ovirt.org/job/standard-manual-runner/617/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30615> part of vdsm_standard-on-merge #1391 <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30610> part of vdsm_standard-on-merge #1390 vdsm [check-merged] <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30585> [image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build Executor Status <https://jenkins.ovirt.org/computer/> master <https://jenkins.ovirt.org/computer/(master)/> 1 Idle 2 Idle 3 Idle 4 Idle lfedora1.lf-dev.marist.edu <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> (offline) mirrors.phx.ovirt.org <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> 1 Idle 2 Idle 3 Idle 4 Idle 5 Idle ovirt-srv18.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> 1 Idle ovirt-srv19.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> 1 Idle ovirt-srv21.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> 1 Idle ovirt-srv22.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> 1 Idle ovirt-srv23.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> 1 Idle vm0001.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> 1 Idle vm0003.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> 1 Idle vm0004.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> 1 Idle vm0005.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> 1 Idle vm0006.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> 1 Idle vm0007.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> (offline) vm0008.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> 1 Idle vm0009.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> 1 Idle vm0010.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> 1 Idle vm0011.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> 1 Idle vm0012.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> 1 Idle vm0013.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> (offline) vm0014.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> 1 Idle vm0015.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> 1 Idle vm0016.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> 1 Idle vm0034.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> 1 Idle vm0035.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> 1 Idle vm0036.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> 1 Idle vm0037.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> 1 Idle vm0038.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> 1 Idle vm0039.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> 1 Idle vm0040.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> 1 Idle vm0041.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> 1 Idle vm0042.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> 1 Idle vm0043.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> 1 Idle vm0044.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> 1 Idle vm0045.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> 1 Idle vm0046.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> (offline) vm0047.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> 1 Idle vm0048.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> 1 Idle vm0049.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> 1 Idle vm0051.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> 1 Idle vm0052.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> 1 Idle vm0053.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> 1 Idle vm0054.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> 1 Idle vm0055.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> 1 Idle vm0056.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> 1 Idle vm0057.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> 1 Idle vm0058.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> 1 Idle vm0059.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> 1 Idle vm0060.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> 1 Idle vm0061.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> 1 Idle vm0062.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> 1 Idle vm0063.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> 1 Idle vm0064.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> 1 Idle vm0065.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> 1 Idle vm0084.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> 1 Idle vm0085.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> 1 Idle vm0086.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> 1 Idle vm0087.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> 1 Idle vm0088.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> (offline) vm0089.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> 1 Idle vm0090.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> 1 Idle vm0091.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> 1 Idle vm0092.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> 1 Idle vm0093.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> 1 Idle vm0094.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> 1 Idle vm0095.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> 1 Idle vm0096.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> 1 Idle vm0097.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> 1 Idle vm0098.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> 1 Idle vm0099.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> 1 Idle vm0134.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> (offline) vm0135.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> 1 Idle vm0136.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> 1 Idle vm0137.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> 1 Idle vm0138.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> 1 Idle vm0139.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> 1 Idle vm0140.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> 1 Idle vm0141.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> 1 Idle vm0142.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> 1 Idle vm0143.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> 1 Idle vm0144.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> 1 Idle vm0145.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> 1 Idle vm0146.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> 1 Idle vm0147.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> 1 Idle vm0148.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> 1 Idle vm0149.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> 1 Idle vm0151.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> 1 Idle vm0152.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> 1 Idle vm0153.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> 1 Idle vm0154.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> 1 Idle vm0155.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> 1 Idle vm0156.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> 1 Idle vm0157.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> 1 Idle vm0158.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> 1 Idle vm0159.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> 1 Idle vm0160.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> 1 Idle vm0161.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> 1 Idle vm0162.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> 1 Idle vm0163.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> 1 Idle vm0164.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> 1 Idle vm0165.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> 1 Idle vm0200.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> 1 Idle vm0201.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> 1 Idle vm0203.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> 1 Idle vm0204.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> 1 Idle vm0205.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> 1 Idle vm0206.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> 1 Idle vm0207.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> 1 Idle vm0208.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> 1 Idle vm0215.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> 1 Idle vm0216.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> 1 Idle vm0217.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> 1 Idle vm0218.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> 1 Idle vm0219.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> 1 Idle vm0220.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> 1 Idle vm0221.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> 1 Idle _______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYGWB4...
-- Regards, Evgheni Dereveanchin

Jenkins is back in operation after restoring configs and restarting it. New jobs should be processed normally. Older ones that partially ran when the restart happened may fail - please re-trigger those. There is still an issue with the s390x VM that we use for CI. It is unrelated to the Jenkins outage: looks like the mainframe it's hosted on is overloaded. Until the load drops it won't be able to run CI jobs so some jobs that build for this platform (mostly VDSM) may be stuck in the queue. The VM belongs to the Fedora project and we share access to it with several other projects. I'll try to reach out to Fedora about this issue but if it persists we may need to temporarily disable s390x jobs. On Wed, Aug 14, 2019 at 7:11 PM Evgheni Dereveanchin <ederevea@redhat.com> wrote:
Hi Nir,
There has been an issue today caused by our configuration management system (puppet) that accidentally downgraded Jenkins which caused some plugin configs to be wiped. This caused the issue you see as new workers can't start and process the queue. I've recovered the old config from bacup and am now working on restoring Jenkins operation.
Will update you once the problem is resolved. The tracker ticket is here: https://ovirt-jira.atlassian.net/browse/OVIRT-2775
Sorry for the inconvenience caused.
On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer@redhat.com> wrote:
After waiting for build-artifacts job for 36 minutes (typically finish in 15 minutes) I found that jeknins seems to be broken.
We depend on CI and OST for merging patches.
Can someone check this?
---
[image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build Queue (51) vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> part of standard-manual-runner #622 <https://jenkins.ovirt.org/job/standard-manual-runner/622/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30891> part of jenkins_standard-check-patch #3199 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30889> part of standard-manual-runner #621 <https://jenkins.ovirt.org/job/standard-manual-runner/621/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30887> part of jenkins_standard-check-patch #3197 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30837> part of vdsm_standard-check-patch #10405 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30832> part of vdsm_standard-check-patch #10404 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30829> part of vdsm_standard-check-patch #10403 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30826> part of ovirt-system-tests_standard-check-patch #5206 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5206/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30817> part of ovirt-engine-ui-extensions_standard-on-merge #54 <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merge/54/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30814> part of nmstate_nmstate_standard-check-pr #2095 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30808> part of standard-manual-runner #620 <https://jenkins.ovirt.org/job/standard-manual-runner/620/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30804> part of standard-manual-runner #619 <https://jenkins.ovirt.org/job/standard-manual-runner/619/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30773> part of vdsm_standard-check-patch #10402 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30769> part of vdsm_standard-check-patch #10401 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30765> part of vdsm_standard-check-patch #10398 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30763> part of vdsm_standard-check-patch #10395 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30762> part of vdsm_standard-check-patch #10400 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30761> part of vdsm_standard-check-patch #10394 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30760> part of vdsm_standard-check-patch #10396 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30759> part of vdsm_standard-check-patch #10399 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30758> part of vdsm_standard-check-patch #10397 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30757> part of vdsm_standard-check-patch #10386 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30749> part of vdsm_standard-check-patch #10391 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30748> part of vdsm_standard-check-patch #10392 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30747> part of vdsm_standard-check-patch #10389 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30746> part of vdsm_standard-check-patch #10388 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30745> part of vdsm_standard-check-patch #10385 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30744> part of vdsm_standard-check-patch #10387 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30743> part of vdsm_standard-check-patch #10390 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30742> part of vdsm_standard-check-patch #10393 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30741> part of standard-manual-runner #618 <https://jenkins.ovirt.org/job/standard-manual-runner/618/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30730> part of vdsm_standard-check-patch #10384 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30728> part of vdsm_standard-check-patch #10381 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30727> part of vdsm_standard-check-patch #10383 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30726> part of vdsm_standard-check-patch #10382 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30725> part of vdsm_standard-check-patch #10380 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30724> part of vdsm_standard-check-patch #10379 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30723> part of vdsm_standard-check-patch #10378 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30706> part of nmstate_nmstate_standard-check-pr #2094 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30704> part of ovirt-system-tests_standard-check-patch #5204 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5204/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30691> ovirt-system-tests_manual <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30624> part of vdsm_standard-check-patch #10376 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30623> part of vdsm_standard-check-patch #10377 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30622> part of repoman_standard-check-patch #205 <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30617> part of standard-manual-runner #617 <https://jenkins.ovirt.org/job/standard-manual-runner/617/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30615> part of vdsm_standard-on-merge #1391 <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30610> part of vdsm_standard-on-merge #1390 vdsm [check-merged] <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30585> [image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build Executor Status <https://jenkins.ovirt.org/computer/> master <https://jenkins.ovirt.org/computer/(master)/> 1 Idle 2 Idle 3 Idle 4 Idle lfedora1.lf-dev.marist.edu <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> (offline) mirrors.phx.ovirt.org <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> 1 Idle 2 Idle 3 Idle 4 Idle 5 Idle ovirt-srv18.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> 1 Idle ovirt-srv19.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> 1 Idle ovirt-srv21.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> 1 Idle ovirt-srv22.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> 1 Idle ovirt-srv23.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> 1 Idle vm0001.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> 1 Idle vm0003.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> 1 Idle vm0004.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> 1 Idle vm0005.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> 1 Idle vm0006.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> 1 Idle vm0007.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> (offline) vm0008.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> 1 Idle vm0009.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> 1 Idle vm0010.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> 1 Idle vm0011.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> 1 Idle vm0012.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> 1 Idle vm0013.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> (offline) vm0014.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> 1 Idle vm0015.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> 1 Idle vm0016.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> 1 Idle vm0034.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> 1 Idle vm0035.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> 1 Idle vm0036.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> 1 Idle vm0037.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> 1 Idle vm0038.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> 1 Idle vm0039.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> 1 Idle vm0040.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> 1 Idle vm0041.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> 1 Idle vm0042.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> 1 Idle vm0043.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> 1 Idle vm0044.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> 1 Idle vm0045.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> 1 Idle vm0046.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> (offline) vm0047.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> 1 Idle vm0048.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> 1 Idle vm0049.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> 1 Idle vm0051.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> 1 Idle vm0052.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> 1 Idle vm0053.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> 1 Idle vm0054.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> 1 Idle vm0055.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> 1 Idle vm0056.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> 1 Idle vm0057.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> 1 Idle vm0058.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> 1 Idle vm0059.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> 1 Idle vm0060.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> 1 Idle vm0061.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> 1 Idle vm0062.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> 1 Idle vm0063.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> 1 Idle vm0064.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> 1 Idle vm0065.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> 1 Idle vm0084.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> 1 Idle vm0085.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> 1 Idle vm0086.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> 1 Idle vm0087.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> 1 Idle vm0088.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> (offline) vm0089.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> 1 Idle vm0090.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> 1 Idle vm0091.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> 1 Idle vm0092.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> 1 Idle vm0093.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> 1 Idle vm0094.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> 1 Idle vm0095.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> 1 Idle vm0096.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> 1 Idle vm0097.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> 1 Idle vm0098.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> 1 Idle vm0099.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> 1 Idle vm0134.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> (offline) vm0135.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> 1 Idle vm0136.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> 1 Idle vm0137.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> 1 Idle vm0138.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> 1 Idle vm0139.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> 1 Idle vm0140.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> 1 Idle vm0141.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> 1 Idle vm0142.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> 1 Idle vm0143.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> 1 Idle vm0144.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> 1 Idle vm0145.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> 1 Idle vm0146.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> 1 Idle vm0147.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> 1 Idle vm0148.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> 1 Idle vm0149.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> 1 Idle vm0151.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> 1 Idle vm0152.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> 1 Idle vm0153.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> 1 Idle vm0154.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> 1 Idle vm0155.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> 1 Idle vm0156.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> 1 Idle vm0157.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> 1 Idle vm0158.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> 1 Idle vm0159.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> 1 Idle vm0160.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> 1 Idle vm0161.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> 1 Idle vm0162.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> 1 Idle vm0163.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> 1 Idle vm0164.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> 1 Idle vm0165.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> 1 Idle vm0200.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> 1 Idle vm0201.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> 1 Idle vm0203.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> 1 Idle vm0204.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> 1 Idle vm0205.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> 1 Idle vm0206.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> 1 Idle vm0207.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> 1 Idle vm0208.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> 1 Idle vm0215.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> 1 Idle vm0216.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> 1 Idle vm0217.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> 1 Idle vm0218.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> 1 Idle vm0219.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> 1 Idle vm0220.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> 1 Idle vm0221.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> 1 Idle _______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYGWB4...
-- Regards, Evgheni Dereveanchin
-- Regards, Evgheni Dereveanchin

On Wed, Aug 14, 2019 at 9:14 PM Evgheni Dereveanchin <ederevea@redhat.com> wrote:
Jenkins is back in operation after restoring configs and restarting it. New jobs should be processed normally. Older ones that partially ran when the restart happened may fail - please re-trigger those.
There is still an issue with the s390x VM that we use for CI. It is unrelated to the Jenkins outage: looks like the mainframe it's hosted on is overloaded. Until the load drops it won't be able to run CI jobs so some jobs that build for this platform (mostly VDSM) may be stuck in the queue. The VM belongs to the Fedora project and we share access to it with several other projects. I'll try to reach out to Fedora about this issue but if it persists we may need to temporarily disable s390x jobs.
Indeed s390x are stuck, here is example build: https://jenkins.ovirt.org/blue/organizations/jenkins/standard-manual-runner/... I posted this to disable s390x builds until the vm is functional again: https://gerrit.ovirt.org/c/102635/
On Wed, Aug 14, 2019 at 7:11 PM Evgheni Dereveanchin <ederevea@redhat.com> wrote:
Hi Nir,
There has been an issue today caused by our configuration management system (puppet) that accidentally downgraded Jenkins which caused some plugin configs to be wiped. This caused the issue you see as new workers can't start and process the queue. I've recovered the old config from bacup and am now working on restoring Jenkins operation.
Will update you once the problem is resolved. The tracker ticket is here: https://ovirt-jira.atlassian.net/browse/OVIRT-2775
Sorry for the inconvenience caused.
On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer@redhat.com> wrote:
After waiting for build-artifacts job for 36 minutes (typically finish in 15 minutes) I found that jeknins seems to be broken.
We depend on CI and OST for merging patches.
Can someone check this?
---
[image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build Queue (51) vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> part of standard-manual-runner #622 <https://jenkins.ovirt.org/job/standard-manual-runner/622/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30891> part of jenkins_standard-check-patch #3199 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30889> part of standard-manual-runner #621 <https://jenkins.ovirt.org/job/standard-manual-runner/621/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30887> part of jenkins_standard-check-patch #3197 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30837> part of vdsm_standard-check-patch #10405 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30832> part of vdsm_standard-check-patch #10404 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30829> part of vdsm_standard-check-patch #10403 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30826> part of ovirt-system-tests_standard-check-patch #5206 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5206/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30817> part of ovirt-engine-ui-extensions_standard-on-merge #54 <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merge/54/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30814> part of nmstate_nmstate_standard-check-pr #2095 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30808> part of standard-manual-runner #620 <https://jenkins.ovirt.org/job/standard-manual-runner/620/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30804> part of standard-manual-runner #619 <https://jenkins.ovirt.org/job/standard-manual-runner/619/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30773> part of vdsm_standard-check-patch #10402 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30769> part of vdsm_standard-check-patch #10401 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30765> part of vdsm_standard-check-patch #10398 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30763> part of vdsm_standard-check-patch #10395 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30762> part of vdsm_standard-check-patch #10400 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30761> part of vdsm_standard-check-patch #10394 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30760> part of vdsm_standard-check-patch #10396 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30759> part of vdsm_standard-check-patch #10399 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30758> part of vdsm_standard-check-patch #10397 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30757> part of vdsm_standard-check-patch #10386 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30749> part of vdsm_standard-check-patch #10391 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30748> part of vdsm_standard-check-patch #10392 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30747> part of vdsm_standard-check-patch #10389 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30746> part of vdsm_standard-check-patch #10388 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30745> part of vdsm_standard-check-patch #10385 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30744> part of vdsm_standard-check-patch #10387 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30743> part of vdsm_standard-check-patch #10390 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30742> part of vdsm_standard-check-patch #10393 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30741> part of standard-manual-runner #618 <https://jenkins.ovirt.org/job/standard-manual-runner/618/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30730> part of vdsm_standard-check-patch #10384 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30728> part of vdsm_standard-check-patch #10381 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30727> part of vdsm_standard-check-patch #10383 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30726> part of vdsm_standard-check-patch #10382 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30725> part of vdsm_standard-check-patch #10380 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30724> part of vdsm_standard-check-patch #10379 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30723> part of vdsm_standard-check-patch #10378 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30706> part of nmstate_nmstate_standard-check-pr #2094 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30704> part of ovirt-system-tests_standard-check-patch #5204 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5204/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30691> ovirt-system-tests_manual <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30624> part of vdsm_standard-check-patch #10376 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30623> part of vdsm_standard-check-patch #10377 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30622> part of repoman_standard-check-patch #205 <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30617> part of standard-manual-runner #617 <https://jenkins.ovirt.org/job/standard-manual-runner/617/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30615> part of vdsm_standard-on-merge #1391 <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30610> part of vdsm_standard-on-merge #1390 vdsm [check-merged] <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30585> [image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build Executor Status <https://jenkins.ovirt.org/computer/> master <https://jenkins.ovirt.org/computer/(master)/> 1 Idle 2 Idle 3 Idle 4 Idle lfedora1.lf-dev.marist.edu <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> (offline) mirrors.phx.ovirt.org <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> 1 Idle 2 Idle 3 Idle 4 Idle 5 Idle ovirt-srv18.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> 1 Idle ovirt-srv19.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> 1 Idle ovirt-srv21.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> 1 Idle ovirt-srv22.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> 1 Idle ovirt-srv23.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> 1 Idle vm0001.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> 1 Idle vm0003.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> 1 Idle vm0004.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> 1 Idle vm0005.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> 1 Idle vm0006.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> 1 Idle vm0007.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> (offline) vm0008.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> 1 Idle vm0009.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> 1 Idle vm0010.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> 1 Idle vm0011.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> 1 Idle vm0012.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> 1 Idle vm0013.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> (offline) vm0014.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> 1 Idle vm0015.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> 1 Idle vm0016.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> 1 Idle vm0034.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> 1 Idle vm0035.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> 1 Idle vm0036.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> 1 Idle vm0037.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> 1 Idle vm0038.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> 1 Idle vm0039.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> 1 Idle vm0040.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> 1 Idle vm0041.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> 1 Idle vm0042.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> 1 Idle vm0043.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> 1 Idle vm0044.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> 1 Idle vm0045.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> 1 Idle vm0046.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> (offline) vm0047.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> 1 Idle vm0048.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> 1 Idle vm0049.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> 1 Idle vm0051.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> 1 Idle vm0052.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> 1 Idle vm0053.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> 1 Idle vm0054.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> 1 Idle vm0055.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> 1 Idle vm0056.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> 1 Idle vm0057.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> 1 Idle vm0058.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> 1 Idle vm0059.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> 1 Idle vm0060.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> 1 Idle vm0061.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> 1 Idle vm0062.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> 1 Idle vm0063.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> 1 Idle vm0064.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> 1 Idle vm0065.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> 1 Idle vm0084.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> 1 Idle vm0085.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> 1 Idle vm0086.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> 1 Idle vm0087.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> 1 Idle vm0088.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> (offline) vm0089.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> 1 Idle vm0090.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> 1 Idle vm0091.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> 1 Idle vm0092.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> 1 Idle vm0093.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> 1 Idle vm0094.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> 1 Idle vm0095.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> 1 Idle vm0096.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> 1 Idle vm0097.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> 1 Idle vm0098.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> 1 Idle vm0099.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> 1 Idle vm0134.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> (offline) vm0135.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> 1 Idle vm0136.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> 1 Idle vm0137.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> 1 Idle vm0138.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> 1 Idle vm0139.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> 1 Idle vm0140.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> 1 Idle vm0141.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> 1 Idle vm0142.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> 1 Idle vm0143.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> 1 Idle vm0144.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> 1 Idle vm0145.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> 1 Idle vm0146.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> 1 Idle vm0147.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> 1 Idle vm0148.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> 1 Idle vm0149.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> 1 Idle vm0151.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> 1 Idle vm0152.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> 1 Idle vm0153.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> 1 Idle vm0154.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> 1 Idle vm0155.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> 1 Idle vm0156.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> 1 Idle vm0157.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> 1 Idle vm0158.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> 1 Idle vm0159.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> 1 Idle vm0160.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> 1 Idle vm0161.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> 1 Idle vm0162.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> 1 Idle vm0163.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> 1 Idle vm0164.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> 1 Idle vm0165.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> 1 Idle vm0200.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> 1 Idle vm0201.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> 1 Idle vm0203.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> 1 Idle vm0204.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> 1 Idle vm0205.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> 1 Idle vm0206.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> 1 Idle vm0207.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> 1 Idle vm0208.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> 1 Idle vm0215.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> 1 Idle vm0216.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> 1 Idle vm0217.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> 1 Idle vm0218.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> 1 Idle vm0219.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> 1 Idle vm0220.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> 1 Idle vm0221.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> 1 Idle _______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYGWB4...
-- Regards, Evgheni Dereveanchin
-- Regards, Evgheni Dereveanchin

The s390x VM seems to operate normally again. I've also cleaned up the workspace of the VM to make more space available. It's back online and running s390x builds for VDSM successfully so we can skip disabling the arch for now. On Wed, Aug 14, 2019 at 11:48 PM Nir Soffer <nsoffer@redhat.com> wrote:
On Wed, Aug 14, 2019 at 9:14 PM Evgheni Dereveanchin <ederevea@redhat.com> wrote:
Jenkins is back in operation after restoring configs and restarting it. New jobs should be processed normally. Older ones that partially ran when the restart happened may fail - please re-trigger those.
There is still an issue with the s390x VM that we use for CI. It is unrelated to the Jenkins outage: looks like the mainframe it's hosted on is overloaded. Until the load drops it won't be able to run CI jobs so some jobs that build for this platform (mostly VDSM) may be stuck in the queue. The VM belongs to the Fedora project and we share access to it with several other projects. I'll try to reach out to Fedora about this issue but if it persists we may need to temporarily disable s390x jobs.
Indeed s390x are stuck, here is example build:
https://jenkins.ovirt.org/blue/organizations/jenkins/standard-manual-runner/...
I posted this to disable s390x builds until the vm is functional again: https://gerrit.ovirt.org/c/102635/
On Wed, Aug 14, 2019 at 7:11 PM Evgheni Dereveanchin <ederevea@redhat.com> wrote:
Hi Nir,
There has been an issue today caused by our configuration management system (puppet) that accidentally downgraded Jenkins which caused some plugin configs to be wiped. This caused the issue you see as new workers can't start and process the queue. I've recovered the old config from bacup and am now working on restoring Jenkins operation.
Will update you once the problem is resolved. The tracker ticket is here: https://ovirt-jira.atlassian.net/browse/OVIRT-2775
Sorry for the inconvenience caused.
On Wed, Aug 14, 2019 at 6:58 PM Nir Soffer <nsoffer@redhat.com> wrote:
After waiting for build-artifacts job for 36 minutes (typically finish in 15 minutes) I found that jeknins seems to be broken.
We depend on CI and OST for merging patches.
Can someone check this?
---
[image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=buildQueue>Build Queue (51) vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30571> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30579> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30661> vdsm_standard-on-merge <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30707> part of standard-manual-runner #622 <https://jenkins.ovirt.org/job/standard-manual-runner/622/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30891> part of jenkins_standard-check-patch #3199 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3199/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30889> part of standard-manual-runner #621 <https://jenkins.ovirt.org/job/standard-manual-runner/621/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30887> part of jenkins_standard-check-patch #3197 <https://jenkins.ovirt.org/job/jenkins_standard-check-patch/3197/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30837> part of vdsm_standard-check-patch #10405 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10405/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30832> part of vdsm_standard-check-patch #10404 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10404/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30829> part of vdsm_standard-check-patch #10403 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10403/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30826> part of ovirt-system-tests_standard-check-patch #5206 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5206/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30817> part of ovirt-engine-ui-extensions_standard-on-merge #54 <https://jenkins.ovirt.org/job/ovirt-engine-ui-extensions_standard-on-merge/54/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30814> part of nmstate_nmstate_standard-check-pr #2095 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2095/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30808> part of standard-manual-runner #620 <https://jenkins.ovirt.org/job/standard-manual-runner/620/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30804> part of standard-manual-runner #619 <https://jenkins.ovirt.org/job/standard-manual-runner/619/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30773> part of vdsm_standard-check-patch #10402 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10402/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30769> part of vdsm_standard-check-patch #10401 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10401/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30765> part of vdsm_standard-check-patch #10398 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10398/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30763> part of vdsm_standard-check-patch #10395 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10395/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30762> part of vdsm_standard-check-patch #10400 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10400/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30761> part of vdsm_standard-check-patch #10394 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10394/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30760> part of vdsm_standard-check-patch #10396 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10396/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30759> part of vdsm_standard-check-patch #10399 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10399/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30758> part of vdsm_standard-check-patch #10397 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10397/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30757> part of vdsm_standard-check-patch #10386 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10386/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30749> part of vdsm_standard-check-patch #10391 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30748> part of vdsm_standard-check-patch #10392 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10392/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30747> part of vdsm_standard-check-patch #10389 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10389/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30746> part of vdsm_standard-check-patch #10388 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10388/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30745> part of vdsm_standard-check-patch #10385 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10385/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30744> part of vdsm_standard-check-patch #10387 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10387/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30743> part of vdsm_standard-check-patch #10390 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30742> part of vdsm_standard-check-patch #10393 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10393/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30741> part of standard-manual-runner #618 <https://jenkins.ovirt.org/job/standard-manual-runner/618/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30730> part of vdsm_standard-check-patch #10384 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10384/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30728> part of vdsm_standard-check-patch #10381 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10381/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30727> part of vdsm_standard-check-patch #10383 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10383/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30726> part of vdsm_standard-check-patch #10382 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10382/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30725> part of vdsm_standard-check-patch #10380 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10380/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30724> part of vdsm_standard-check-patch #10379 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10379/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30723> part of vdsm_standard-check-patch #10378 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10378/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30706> part of nmstate_nmstate_standard-check-pr #2094 <https://jenkins.ovirt.org/job/nmstate_nmstate_standard-check-pr/2094/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30704> part of ovirt-system-tests_standard-check-patch #5204 <https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/5204/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30691> ovirt-system-tests_manual <https://jenkins.ovirt.org/job/ovirt-system-tests_manual/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30624> part of vdsm_standard-check-patch #10376 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10376/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30623> part of vdsm_standard-check-patch #10377 <https://jenkins.ovirt.org/job/vdsm_standard-check-patch/10377/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30622> part of repoman_standard-check-patch #205 <https://jenkins.ovirt.org/job/repoman_standard-check-patch/205/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30617> part of standard-manual-runner #617 <https://jenkins.ovirt.org/job/standard-manual-runner/617/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30615> part of vdsm_standard-on-merge #1391 <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1391/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30610> part of vdsm_standard-on-merge #1390 vdsm [check-merged] <https://jenkins.ovirt.org/job/vdsm_standard-on-merge/1390/> <https://jenkins.io/redirect/troubleshooting/executor-starvation> [image: cancel this build] <https://jenkins.ovirt.org/queue/cancelItem?id=30585> [image: collapse] <https://jenkins.ovirt.org/toggleCollapse?paneId=executors>Build Executor Status <https://jenkins.ovirt.org/computer/> master <https://jenkins.ovirt.org/computer/(master)/> 1 Idle 2 Idle 3 Idle 4 Idle lfedora1.lf-dev.marist.edu <https://jenkins.ovirt.org/computer/lfedora1.lf-dev.marist.edu/> (offline) mirrors.phx.ovirt.org <https://jenkins.ovirt.org/computer/mirrors.phx.ovirt.org/> 1 Idle 2 Idle 3 Idle 4 Idle 5 Idle ovirt-srv18.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv18.phx.ovirt.org/> 1 Idle ovirt-srv19.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv19.phx.ovirt.org/> 1 Idle ovirt-srv21.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org/> 1 Idle ovirt-srv22.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv22.phx.ovirt.org/> 1 Idle ovirt-srv23.phx.ovirt.org <https://jenkins.ovirt.org/computer/ovirt-srv23.phx.ovirt.org/> 1 Idle vm0001.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0001.workers-phx.ovirt.org/> 1 Idle vm0003.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0003.workers-phx.ovirt.org/> 1 Idle vm0004.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0004.workers-phx.ovirt.org/> 1 Idle vm0005.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0005.workers-phx.ovirt.org/> 1 Idle vm0006.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0006.workers-phx.ovirt.org/> 1 Idle vm0007.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0007.workers-phx.ovirt.org/> (offline) vm0008.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0008.workers-phx.ovirt.org/> 1 Idle vm0009.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0009.workers-phx.ovirt.org/> 1 Idle vm0010.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0010.workers-phx.ovirt.org/> 1 Idle vm0011.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0011.workers-phx.ovirt.org/> 1 Idle vm0012.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0012.workers-phx.ovirt.org/> 1 Idle vm0013.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0013.workers-phx.ovirt.org/> (offline) vm0014.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0014.workers-phx.ovirt.org/> 1 Idle vm0015.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0015.workers-phx.ovirt.org/> 1 Idle vm0016.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0016.workers-phx.ovirt.org/> 1 Idle vm0034.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0034.workers-phx.ovirt.org/> 1 Idle vm0035.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0035.workers-phx.ovirt.org/> 1 Idle vm0036.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0036.workers-phx.ovirt.org/> 1 Idle vm0037.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0037.workers-phx.ovirt.org/> 1 Idle vm0038.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org/> 1 Idle vm0039.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0039.workers-phx.ovirt.org/> 1 Idle vm0040.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0040.workers-phx.ovirt.org/> 1 Idle vm0041.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0041.workers-phx.ovirt.org/> 1 Idle vm0042.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0042.workers-phx.ovirt.org/> 1 Idle vm0043.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0043.workers-phx.ovirt.org/> 1 Idle vm0044.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0044.workers-phx.ovirt.org/> 1 Idle vm0045.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0045.workers-phx.ovirt.org/> 1 Idle vm0046.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0046.workers-phx.ovirt.org/> (offline) vm0047.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0047.workers-phx.ovirt.org/> 1 Idle vm0048.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0048.workers-phx.ovirt.org/> 1 Idle vm0049.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0049.workers-phx.ovirt.org/> 1 Idle vm0051.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0051.workers-phx.ovirt.org/> 1 Idle vm0052.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0052.workers-phx.ovirt.org/> 1 Idle vm0053.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0053.workers-phx.ovirt.org/> 1 Idle vm0054.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0054.workers-phx.ovirt.org/> 1 Idle vm0055.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0055.workers-phx.ovirt.org/> 1 Idle vm0056.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0056.workers-phx.ovirt.org/> 1 Idle vm0057.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0057.workers-phx.ovirt.org/> 1 Idle vm0058.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0058.workers-phx.ovirt.org/> 1 Idle vm0059.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0059.workers-phx.ovirt.org/> 1 Idle vm0060.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0060.workers-phx.ovirt.org/> 1 Idle vm0061.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0061.workers-phx.ovirt.org/> 1 Idle vm0062.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0062.workers-phx.ovirt.org/> 1 Idle vm0063.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0063.workers-phx.ovirt.org/> 1 Idle vm0064.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0064.workers-phx.ovirt.org/> 1 Idle vm0065.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0065.workers-phx.ovirt.org/> 1 Idle vm0084.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0084.workers-phx.ovirt.org/> 1 Idle vm0085.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0085.workers-phx.ovirt.org/> 1 Idle vm0086.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0086.workers-phx.ovirt.org/> 1 Idle vm0087.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0087.workers-phx.ovirt.org/> 1 Idle vm0088.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0088.workers-phx.ovirt.org/> (offline) vm0089.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0089.workers-phx.ovirt.org/> 1 Idle vm0090.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0090.workers-phx.ovirt.org/> 1 Idle vm0091.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0091.workers-phx.ovirt.org/> 1 Idle vm0092.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0092.workers-phx.ovirt.org/> 1 Idle vm0093.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0093.workers-phx.ovirt.org/> 1 Idle vm0094.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0094.workers-phx.ovirt.org/> 1 Idle vm0095.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0095.workers-phx.ovirt.org/> 1 Idle vm0096.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0096.workers-phx.ovirt.org/> 1 Idle vm0097.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0097.workers-phx.ovirt.org/> 1 Idle vm0098.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0098.workers-phx.ovirt.org/> 1 Idle vm0099.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0099.workers-phx.ovirt.org/> 1 Idle vm0134.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0134.workers-phx.ovirt.org/> (offline) vm0135.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0135.workers-phx.ovirt.org/> 1 Idle vm0136.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0136.workers-phx.ovirt.org/> 1 Idle vm0137.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0137.workers-phx.ovirt.org/> 1 Idle vm0138.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0138.workers-phx.ovirt.org/> 1 Idle vm0139.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0139.workers-phx.ovirt.org/> 1 Idle vm0140.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0140.workers-phx.ovirt.org/> 1 Idle vm0141.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0141.workers-phx.ovirt.org/> 1 Idle vm0142.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0142.workers-phx.ovirt.org/> 1 Idle vm0143.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0143.workers-phx.ovirt.org/> 1 Idle vm0144.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0144.workers-phx.ovirt.org/> 1 Idle vm0145.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0145.workers-phx.ovirt.org/> 1 Idle vm0146.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0146.workers-phx.ovirt.org/> 1 Idle vm0147.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0147.workers-phx.ovirt.org/> 1 Idle vm0148.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0148.workers-phx.ovirt.org/> 1 Idle vm0149.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0149.workers-phx.ovirt.org/> 1 Idle vm0151.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0151.workers-phx.ovirt.org/> 1 Idle vm0152.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0152.workers-phx.ovirt.org/> 1 Idle vm0153.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0153.workers-phx.ovirt.org/> 1 Idle vm0154.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0154.workers-phx.ovirt.org/> 1 Idle vm0155.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0155.workers-phx.ovirt.org/> 1 Idle vm0156.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0156.workers-phx.ovirt.org/> 1 Idle vm0157.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0157.workers-phx.ovirt.org/> 1 Idle vm0158.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0158.workers-phx.ovirt.org/> 1 Idle vm0159.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0159.workers-phx.ovirt.org/> 1 Idle vm0160.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0160.workers-phx.ovirt.org/> 1 Idle vm0161.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0161.workers-phx.ovirt.org/> 1 Idle vm0162.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0162.workers-phx.ovirt.org/> 1 Idle vm0163.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0163.workers-phx.ovirt.org/> 1 Idle vm0164.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0164.workers-phx.ovirt.org/> 1 Idle vm0165.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0165.workers-phx.ovirt.org/> 1 Idle vm0200.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0200.workers-phx.ovirt.org/> 1 Idle vm0201.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0201.workers-phx.ovirt.org/> 1 Idle vm0203.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0203.workers-phx.ovirt.org/> 1 Idle vm0204.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0204.workers-phx.ovirt.org/> 1 Idle vm0205.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0205.workers-phx.ovirt.org/> 1 Idle vm0206.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0206.workers-phx.ovirt.org/> 1 Idle vm0207.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0207.workers-phx.ovirt.org/> 1 Idle vm0208.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0208.workers-phx.ovirt.org/> 1 Idle vm0215.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0215.workers-phx.ovirt.org/> 1 Idle vm0216.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0216.workers-phx.ovirt.org/> 1 Idle vm0217.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0217.workers-phx.ovirt.org/> 1 Idle vm0218.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0218.workers-phx.ovirt.org/> 1 Idle vm0219.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0219.workers-phx.ovirt.org/> 1 Idle vm0220.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0220.workers-phx.ovirt.org/> 1 Idle vm0221.workers-phx.ovirt.org <https://jenkins.ovirt.org/computer/vm0221.workers-phx.ovirt.org/> 1 Idle _______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/7TXF7RYGFYGWB4...
-- Regards, Evgheni Dereveanchin
-- Regards, Evgheni Dereveanchin
-- Regards, Evgheni Dereveanchin
participants (2)
-
Evgheni Dereveanchin
-
Nir Soffer