July 2017 - Infra - oVirt List Archives

review on new docs on reposync flow on OST
by Eyal Edri 25 Jul '17

25 Jul '17

All, Gal has prepared a very nice documentation on how OST reposync works, which should help in debugging future issues in oVirt CI. Please review it and add your thoughts/remarks, We'll wait until EOW and merge if no objections will be made. https://gerrit.ovirt.org/#/c/79108/7 -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

[oVirt Jenkins] system-tests_he-suite-4.1 - Build # 1 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

------=_Part_19_234847352.1500986894871 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/system-tests_he-suite-4.1/ Build: http://jenkins.ovirt.org/job/system-tests_he-suite-4.1/1/ Build Number: 1 Build Status: Failure Triggered By: Started by user Eyal Edri ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_19_234847352.1500986894871--

2 1

Build failed in Jenkins: deploy-to_ovirt-master_tested #304
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

See <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/304/display/redi…> ------------------------------------------ Started by upstream project "ovirt-master_change-queue-tester" build number 1493 originally caused by: Started by upstream project "ovirt-master_change-queue" build number 5489 originally caused by: Started by upstream project "standard-enqueue" build number 2966 originally caused by: Triggered by Gerrit: https://gerrit.ovirt.org/79545 [EnvInject] - Loading node environment variables. Building remotely on vm0164.workers-phx.ovirt.org (phx nested fc25) in workspace <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/> [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-rkvqF9j96mp4/agent.24707 SSH_AGENT_PID=24709 [ssh-agent] Started. $ ssh-add <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/@tmp/private_…> Identity added: <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/@tmp/private_…> (<http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/@tmp/private_…)> [ssh-agent] Using credentials deploy-ovirt-experimental (SSH key for deploying to the tested repo) [deploy-to_ovirt-master_tested] $ /bin/bash -xe /tmp/jenkins1078451122888517333.sh + [[ http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… == '' ]] + echo repo-extra-dir:master + echo http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… + ssh -o StrictHostKeyChecking=no deploy-ovirt-experimental(a)resources.ovirt.org Pseudo-terminal will not be allocated because stdin is not a terminal. + BASE_DIR=/srv/resources/repos/ovirt/tested + PUBLISH_MD_COPIES=50 + main + local tmp_dir + mkdir -p /srv/resources/repos/ovirt/tested ++ mktemp -d /srv/resources/repos/ovirt/tested/.deploy.XXXXXXXXXX Collecting packages + tmp_dir=/srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ + trap 'rm -rf '\''/srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ'\''' EXIT HUP + echo 'Collecting packages' + collect_packages /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ + local repoman_dst=/srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ + repoman --temp-dir generate-in-repo --option main.allowed_repo_paths=/srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ add conf:stdin 2017-07-25 09:52:16,179::INFO::repoman.cmd:: 2017-07-25 09:52:16,180::INFO::repoman.cmd::Adding artifacts to the repo /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ 2017-07-25 09:52:16,180::INFO::repoman.common.repo::Adding repo extra dir master 2017-07-25 09:52:16,182::INFO::repoman.common.stores.RPM::Loading repo /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ/master 2017-07-25 09:52:16,182::INFO::repoman.common.stores.RPM::Repo /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ/master loaded 2017-07-25 09:52:16,183::INFO::repoman.common.stores.iso::Loading repo /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ/master 2017-07-25 09:52:16,183::INFO::repoman.common.stores.iso::Repo /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ/master loaded 2017-07-25 09:52:16,191::INFO::repoman.common.repo::Resolving artifact source http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… 2017-07-25 09:52:16,559::INFO::repoman.common.sources.jenkins::Parsing jenkins URL: http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… 2017-07-25 09:52:16,608::WARNING::root:: No artifacts found 2017-07-25 09:52:16,608::INFO::root:: Done 2017-07-25 09:52:16,609::INFO::repoman.common.sources.url::Parsing URL: http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… 2017-07-25 09:52:16,834::ERROR::repoman.common.parser::No artifacts found for source http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… Traceback (most recent call last): File "/usr/bin/repoman", line 10, in <module> sys.exit(main()) File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 455, in main exit_code = do_add(args, config, repo) File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 338, in do_add repo.add_source(art_src.strip()) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 153, in add_source self.parse_source_stream(sys.stdin.readlines()) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 193, in parse_source_stream self.add_source(line.strip()) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 175, in add_source artifact_paths = self.parser.parse(artifact_source) File "/usr/lib/python2.7/site-packages/repoman/common/parser.py", line 110, in parse raise Exception(msg) Exception: No artifacts found for source http://jenkins.ovirt.org/job/ovirt-engine-api-model_master_build-artifacts-… 2017-07-25 09:52:16,837::INFO::repoman.common.repo::Cleaning up temporary dir /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ/.lago_tmp/tmplQ1r3Z/tmpx6HZT2 2017-07-25 09:52:16,837::INFO::repoman.common.repo::Cleaning up temporary dir /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ/.lago_tmp/tmplQ1r3Z + rm -rf /srv/resources/repos/ovirt/tested/.deploy.z0zm58foeQ Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 24709 killed; [ssh-agent] Stopped.

1 2

[vdsm][tag][ovirt-4.1] Vdsm tagged: v4.19.24
by Francesco Romani 25 Jul '17

25 Jul '17

Hi infra, we have a new Vdsm tag on branch ovirt-4.1 for oVirt 4.1.4: tag v4.19.24 Tagger: Francesco Romani <fromani(a)redhat.com> Date: Tue Jul 25 10:18:01 2017 +0200 Vdsm 4.19.24 for oVirt 4.1.4 commit 0636c7f0aba95477699d812237cc8bc6d951cb0b Bests, -- Francesco Romani Senior SW Eng., Virtualization R&D Red Hat IRC: fromani github: @fromanirh

3 4

Build failed in Jenkins: ovirt_4.1_publish-rpms_nightly #257
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

See <http://jenkins.ovirt.org/job/ovirt_4.1_publish-rpms_nightly/257/display/red…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building on master in workspace <http://jenkins.ovirt.org/job/ovirt_4.1_publish-rpms_nightly/ws/> [WS-CLEANUP] Deleting project workspace... [workspace] $ /bin/bash -xe /tmp/jenkins9023233419040383562.sh FATAL: command execution failed java.io.IOException: error=24, Too many open files at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.<init>(UNIXProcess.java:247) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) Caused: java.io.IOException: Cannot run program "/bin/bash" (in directory "<http://jenkins.ovirt.org/job/ovirt_4.1_publish-rpms_nightly/ws/")>: error=24, Too many open files at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at hudson.Proc$LocalProc.<init>(Proc.java:245) at hudson.Proc$LocalProc.<init>(Proc.java:214) at hudson.Launcher$LocalLauncher.launch(Launcher.java:850) at hudson.Launcher$ProcStarter.start(Launcher.java:384) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:109) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:735) at hudson.model.Build$BuildExecution.build(Build.java:206) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:490) at hudson.model.Run.execute(Run.java:1735) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:405) Build step 'Execute shell' marked build as failure SSH: Current build result is [FAILURE], not going to run.

1 1

[oVirt Jenkins] deploy-to-ovirt_experimental - Build #3797 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

Build: http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental/3797/ Build Name: 3797 ovirt-engine-api-model (4.1) Build Status: FAILURE Gerrit change: https://gerrit.ovirt.org/79788 - title: Add more detailed description to SshPublicKeys request - project: ovirt-engine-api-model - branch: model_4.1 - author: Juan Hernandez <juan.hernandez(a)redhat.com>

1 2

[oVirt Jenkins] deploy-to-ovirt_experimental - Build #3795 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

------=_Part_2_1886544267.1500974426698 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental/3795/ Build Name: 3795 ovirt-engine-api-model (4.1) Build Status: FAILURE Gerrit change: https://gerrit.ovirt.org/79787 - title: Clarify that the CloudInit type is deprecated - project: ovirt-engine-api-model - branch: model_4.1 - author: Juan Hernandez <juan.hernandez(a)redhat.com> ------=_Part_2_1886544267.1500974426698--

1 1

[oVirt Jenkins] deploy-to-ovirt_experimental - Build #3794 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

------=_Part_4_1571992509.1500974475756 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental/3794/ Build Name: 3794 ovirt-engine-api-model (master) Build Status: FAILURE Gerrit change: https://gerrit.ovirt.org/79545 - title: Clarify that the CloudInit type is deprecated - project: ovirt-engine-api-model - branch: master - author: Juan Hernandez <juan.hernandez(a)redhat.com> ------=_Part_4_1571992509.1500974475756--

1 0

'change-queue' is now in full production for the 'master' flow
by Barak Korren 25 Jul '17

25 Jul '17

Yesterday we've applied a patch with JJB that made the 'master' change queue push updates into 'tested' instead of the 'experimental' flow. This essentially means that the change queue is now the main production flow for 'master'. A quick refresher on how to find and handle issues with CQ jobs: 1. You don't really need to monitor the jobs, when the CQ suspects it found a real code issue it will send infra(a)ovirt.org an email with the suspected patch. 2. The *-tester job is what actually runs the tests. Don't worry if it fails occasionally, the CQ will run bisection and tell you exactly which change caused it. 3. The output of the *-tester job is very similar to the old 'experimental' job. 4. When you get an email, you need to check the output of the job linked to it to see if this is a race-condition kind of failure, a build failure or a real regression. Unless its a build failure, you probably need to report it and document in the table. 5. If any other CQ job besides the *-tester job fails, this is a real infra issue. When you see such an issue you need to investigate it and fix the infra. Real infra issues typically affect many jobs, so once you are done fixing it, you probably need to go back and re-trigger Gerrit merge events to get packages rebuilt and submitted to the queue. 6. One very simple kind of an infra issue, is trying to submit to a queue that does not exist. You should nag maintainers to remove jobs for versions of oVirt that we don't have queues for. Good luck! -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 0

Jenkins build is back to normal : system-sync_mirrors-centos-updates-el6-x86_64 #574
by jenkins＠jenkins.phx.ovirt.org 25 Jul '17

25 Jul '17

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el6-x86_64/…>

1 0