December 2018 - Infra - oVirt List Archives

[JIRA] (OVIRT-2639) Add support to upstream sources to be able to test github PR
by Eyal Edri (oVirt JIRA) 31 Dec '18

31 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2639?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2639: ---------------------------------- [~sradco(a)redhat.com] we have documentation adding upstream sources here [1]. [~bkorren(a)redhat.com] other than adding the upstream_sources.yaml file and adding the template for it, anything else is needed? [~grosenth(a)redhat.com] can help you with adding the CI side, she recently added such a job for OST. [1] https://ovirt-infra-docs.readthedocs.io/en/latest/CI/Build_and_test_standar… > Add support to upstream sources to be able to test github PR > ------------------------------------------------------------ > > Key: OVIRT-2639 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2639 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Shirly Radco > Assignee: infra > > Hi, > I added to ovirt-engine-metrics a github repo as upstream source. > I would like to be able to test github PR with in jenkins. > Best regards, > -- > SHIRLY RADCO > BI SENIOR SOFTWARE ENGINEER > Red Hat Israel <https://www.redhat.com/> > <https://red.ht/sig> > TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100096)

1 0

[oVirt Jenkins] ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 - Build # 41 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Dec '18

31 Dec '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-x… Build: http://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-x… Build Number: 41 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #41 [Sandro Bonazzola] automation: add devices for qemu performances ----------------- Failed Tests: ----------------- No tests ran.

1 1

[JIRA] (OVIRT-2639) Add support to upstream sources to be able to test github PR
by Shirly Radco (oVirt JIRA) 31 Dec '18

31 Dec '18

Shirly Radco created OVIRT-2639: ----------------------------------- Summary: Add support to upstream sources to be able to test github PR Key: OVIRT-2639 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2639 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Shirly Radco Assignee: infra Hi, I added to ovirt-engine-metrics a github repo as upstream source. I would like to be able to test github PR with in jenkins. Best regards, -- SHIRLY RADCO BI SENIOR SOFTWARE ENGINEER Red Hat Israel <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100096)

1 0

[JIRA] (OVIRT-2637) [VDSM] Tests fail because of network timeout
by Liora Milbaum (oVirt JIRA) 31 Dec '18

31 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2637?page=com.atlassian.jira.… ] Liora Milbaum commented on OVIRT-2637: -------------------------------------- I have looked into all failed runs of this job (current history). None of them reports of the same error. Can we somehow reproduce the error? > [VDSM] Tests fail because of network timeout > -------------------------------------------- > > Key: OVIRT-2637 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2637 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > First time I see this error. The issue seems to be network read timeout > when creating virtual env > in tox test. > If you see this error in your builds, please report. > storage-py27 create: > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27 > ERROR: invocation failed (exit code 1), logfile: > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/log/storage-py27-0.log > ERROR: actionid: storage-py27 > msg: getenv > cmdargs: ['/usr/bin/python2', '-m', 'virtualenv', > '--system-site-packages', '--python', '/usr/bin/python2.7', > 'storage-py27'] > New python executable in > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/bin/python2.7 > Also creating executable in > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/bin/python > Installing setuptools, pip, wheel... > Complete output from command > /home/jenkins/worksp...e-py27/bin/python2.7 - setuptools pip wheel: > The directory > '/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.cache/pip/http' > or its parent directory is not owned by the current user and the cache > has been disabled. Please check the permissions and owner of that > directory. If executing pip with sudo, you may want sudo's -H flag. > The directory '/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.cache/pip' > or its parent directory is not owned by the current user and caching > wheels has been disabled. check the permissions and owner of that > directory. If executing pip with sudo, you may want sudo's -H flag. > Looking in links: /usr/lib/python2.7/site-packages, > /usr/lib/python2.7/site-packages/virtualenv_support > Collecting setuptools > Downloading https://files.pythonhosted.org/packages/37/06/754589caf971b0d2d48f151c2586f… > (573kB) > Exception: > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/cli/base_command.py", > line 143, in main > status = self.run(options, args) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/commands/install.py", > line 318, in run > resolver.resolve(requirement_set) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/resolve.py", > line 102, in resolve > self._resolve_one(requirement_set, req) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/resolve.py", > line 256, in _resolve_one > abstract_dist = self._get_abstract_dist_for(req_to_install) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/resolve.py", > line 209, in _get_abstract_dist_for > self.require_hashes > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/operations/prepare.py", > line 283, in prepare_linked_requirement > progress_bar=self.progress_bar > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py", > line 836, in unpack_url > progress_bar=progress_bar > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py", > line 673, in unpack_http_url > progress_bar) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py", > line 897, in _download_http_url > _download_url(resp, link, content_file, hashes, progress_bar) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py", > line 617, in _download_url > hashes.check_against_chunks(downloaded_chunks) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/utils/hashes.py", > line 48, in check_against_chunks > for chunk in chunks: > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py", > line 585, in written_chunks > for chunk in chunks: > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/utils/ui.py", > line 159, in iter > for x in it: > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py", > line 574, in resp_read > decode_content=False): > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_vendor/urllib3/response.py", > line 465, in stream > data = self.read(amt=amt, decode_content=decode_content) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_vendor/urllib3/response.py", > line 430, in read > raise IncompleteRead(self._fp_bytes_read, self.length_remaining) > File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__ > self.gen.throw(type, value, traceback) > File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_vendor/urllib3/response.py", > line 345, in _error_catcher > raise ReadTimeoutError(self._pool, None, 'Read timed out.') > ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', > port=443): Read timed out. > ---------------------------------------- > ...Installing setuptools, pip, wheel...done. > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/virtualenv.py", line 2462, in <module> > main() > File "/usr/lib/python2.7/site-packages/virtualenv.py", line 762, in main > symlink=options.symlink, > File "/usr/lib/python2.7/site-packages/virtualenv.py", line 1015, in > create_environment > install_wheel(to_install, py_executable, search_dirs, download=download) > File "/usr/lib/python2.7/site-packages/virtualenv.py", line 968, in > install_wheel > call_subprocess(cmd, show_stdout=False, extra_env=env, stdin=SCRIPT) > File "/usr/lib/python2.7/site-packages/virtualenv.py", line 854, in > call_subprocess > raise OSError("Command {} failed with error code > {}".format(cmd_desc, proc.returncode)) > OSError: Command /home/jenkins/worksp...e-py27/bin/python2.7 - > setuptools pip wheel failed with error code 2 > Running virtualenv with interpreter /usr/bin/python2.7 > ERROR: Error creating virtualenv. Note that some special characters > (e.g. ':' and unicode symbols) in paths are not supported by > virtualenv. Error details: InvocationError('/usr/bin/python2 -m > virtualenv --system-site-packages --python /usr/bin/python2.7 > storage-py27 (see > /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/log/storage-py27-0.log)', > 1) > Build: > https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_st… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100096)

1 0

[oVirt Jenkins] ovirt-node-ng-image_master_build-artifacts-fc28-x86_64 - Build # 164 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Dec '18

31 Dec '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng-image_master_build-artifacts-fc2… Build: http://jenkins.ovirt.org/job/ovirt-node-ng-image_master_build-artifacts-fc2… Build Number: 164 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #164 [Yuval Turgeman] scripts: added iso install timeout [Gal Ben Haim] OST: Remove he-basic-ansible master job ----------------- Failed Tests: ----------------- No tests ran.

1 3

[JIRA] (OVIRT-2638) ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 #39 stuck for 2 days
by Eyal Edri (oVirt JIRA) 31 Dec '18

31 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2638?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2638: ---------------------------------- [~dbelenky(a)redhat.com] please update what filled the disk, we should add it to the slave cleaner script, We've seen more and more reports on out of space for the VM slaves, we should find out the root cause for it. > ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 #39 stuck for 2 days > ------------------------------------------------------------------------ > > Key: OVIRT-2638 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2638 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > Started 2 days 11 hr ago > Build has been executing for 2 days 11 hr on vm0038.workers-phx.ovirt.or > <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org> > https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100096)

1 0

[JIRA] (OVIRT-2533) multi-stage support in CI slaves
by Barak Korren (oVirt JIRA) 31 Dec '18

31 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2533?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2533: ------------------------------------- Roi had some success in using mock when it is configured to use systemd-nspawn instead of plain chroot. We actually had a ticket to try to enable that in our infra at some point OVIRT-2031, but this is the kind of a big change that we seem to lack the capacity to do. > multi-stage support in CI slaves > -------------------------------- > > Key: OVIRT-2533 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2533 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Roy Golan > Assignee: infra > > I would like to get multi-stage support upstream. Our default docker > packages for centos 7.5 is 1.13. For multi-stage support we need > 1.17 or > have buildah working in mock (preferable over docker, won't happen now I > guess?). > Using this method[1] to install docker-ce I was able to get 1.18 running. > Doable? > Regards, > Roy > [1] https://docs.docker.com/install/linux/docker-ce/centos/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100096)

1 0

[oVirt Jenkins] ovirt-node-ng-image_master_build-artifacts-el7-x86_64 - Build # 160 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Dec '18

31 Dec '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng-image_master_build-artifacts-el7… Build: http://jenkins.ovirt.org/job/ovirt-node-ng-image_master_build-artifacts-el7… Build Number: 160 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #160 [Yuval Turgeman] scripts: added iso install timeout ----------------- Failed Tests: ----------------- No tests ran.

1 1

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #2275
by jenkins＠jenkins.phx.ovirt.org 31 Dec '18

31 Dec '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 65b7fcabfccd9439d71f60b039775b03d81bf113 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 65b7fcabfccd9439d71f60b039775b03d81bf113 Commit message: "Add mock configs for Fedora 29" > git rev-list --no-walk 65b7fcabfccd9439d71f60b039775b03d81bf113 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins8723159838778682932.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7' Build step 'Execute shell' marked build as failure

1 1

[JIRA] (OVIRT-2638) ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 #39 stuck for 2 days
by Daniel Belenky (oVirt JIRA) 31 Dec '18

31 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2638?page=com.atlassian.jira.… ] Daniel Belenky commented on OVIRT-2638: --------------------------------------- The machine where that job ran on ran out of space. I'll update more details (as I'll have them) on the ticket https://ovirt-jira.atlassian.net/browse/OVIRT-2638 On Sun, Dec 30, 2018 at 9:45 PM Eyal Edri <eedri(a)redhat.com> wrote: > > > On Sun, Dec 30, 2018, 21:25 Yuval Turgeman <yturgema(a)redhat.com wrote: > >> Looks like livemedia-creator installed the VM correctly, but failed to >> build the final image file for some reason (disk issues?). Stdci failed >> the job on timeout, but probably can't kill the hanging process. Is it >> possible to take a look at the slave somehow ? >> > > sure, though you will need someone from the CI team to ssh in, if you > don't have access to infra servers. > > >> On Sun, Dec 30, 2018, 19:57 Nir Soffer <nsoffer(a)redhat.com wrote: >> >>> Started 2 days 11 hr ago >>> Build has been executing for 2 days 11 hr on vm0038.workers-phx.ovirt.or >>> <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org> >>> >>> >>> https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-… >>> >>> >>> _______________________________________________ >>> Devel mailing list -- devel(a)ovirt.org >>> To unsubscribe send an email to devel-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: >>> https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/FXGWNLV3ZLZSN… >>> >> _______________________________________________ >> Infra mailing list -- infra(a)ovirt.org >> To unsubscribe send an email to infra-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/infra@ovirt.org/message/46JUANKQHKPK7… >> > -- DANIEL BELENKY > ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 #39 stuck for 2 days > ------------------------------------------------------------------------ > > Key: OVIRT-2638 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2638 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > Started 2 days 11 hr ago > Build has been executing for 2 days 11 hr on vm0038.workers-phx.ovirt.or > <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org> > https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100096)

1 0