[JIRA] (OVIRT-2637) [VDSM] Tests fail because of network timeout
by Liora Milbaum (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2637?page=com.atlassian.jir... ]
Liora Milbaum commented on OVIRT-2637:
--------------------------------------
I have looked into all failed runs of this job (current history). None of them reports of the same error. Can we somehow reproduce the error?
> [VDSM] Tests fail because of network timeout
> --------------------------------------------
>
> Key: OVIRT-2637
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2637
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Nir Soffer
> Assignee: infra
>
> First time I see this error. The issue seems to be network read timeout
> when creating virtual env
> in tox test.
> If you see this error in your builds, please report.
> storage-py27 create:
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27
> ERROR: invocation failed (exit code 1), logfile:
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/log/storage-py27-0.log
> ERROR: actionid: storage-py27
> msg: getenv
> cmdargs: ['/usr/bin/python2', '-m', 'virtualenv',
> '--system-site-packages', '--python', '/usr/bin/python2.7',
> 'storage-py27']
> New python executable in
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/bin/python2.7
> Also creating executable in
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/bin/python
> Installing setuptools, pip, wheel...
> Complete output from command
> /home/jenkins/worksp...e-py27/bin/python2.7 - setuptools pip wheel:
> The directory
> '/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.cache/pip/http'
> or its parent directory is not owned by the current user and the cache
> has been disabled. Please check the permissions and owner of that
> directory. If executing pip with sudo, you may want sudo's -H flag.
> The directory '/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.cache/pip'
> or its parent directory is not owned by the current user and caching
> wheels has been disabled. check the permissions and owner of that
> directory. If executing pip with sudo, you may want sudo's -H flag.
> Looking in links: /usr/lib/python2.7/site-packages,
> /usr/lib/python2.7/site-packages/virtualenv_support
> Collecting setuptools
> Downloading https://files.pythonhosted.org/packages/37/06/754589caf971b0d2d48f151c258...
> (573kB)
> Exception:
> Traceback (most recent call last):
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/cli/base_command.py",
> line 143, in main
> status = self.run(options, args)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/commands/install.py",
> line 318, in run
> resolver.resolve(requirement_set)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/resolve.py",
> line 102, in resolve
> self._resolve_one(requirement_set, req)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/resolve.py",
> line 256, in _resolve_one
> abstract_dist = self._get_abstract_dist_for(req_to_install)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/resolve.py",
> line 209, in _get_abstract_dist_for
> self.require_hashes
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/operations/prepare.py",
> line 283, in prepare_linked_requirement
> progress_bar=self.progress_bar
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py",
> line 836, in unpack_url
> progress_bar=progress_bar
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py",
> line 673, in unpack_http_url
> progress_bar)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py",
> line 897, in _download_http_url
> _download_url(resp, link, content_file, hashes, progress_bar)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py",
> line 617, in _download_url
> hashes.check_against_chunks(downloaded_chunks)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/utils/hashes.py",
> line 48, in check_against_chunks
> for chunk in chunks:
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py",
> line 585, in written_chunks
> for chunk in chunks:
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/utils/ui.py",
> line 159, in iter
> for x in it:
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_internal/download.py",
> line 574, in resp_read
> decode_content=False):
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_vendor/urllib3/response.py",
> line 465, in stream
> data = self.read(amt=amt, decode_content=decode_content)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_vendor/urllib3/response.py",
> line 430, in read
> raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
> File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__
> self.gen.throw(type, value, traceback)
> File "/usr/lib/python2.7/site-packages/virtualenv_support/pip-18.1-py2.py3-none-any.whl/pip/_vendor/urllib3/response.py",
> line 345, in _error_catcher
> raise ReadTimeoutError(self._pool, None, 'Read timed out.')
> ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org',
> port=443): Read timed out.
> ----------------------------------------
> ...Installing setuptools, pip, wheel...done.
> Traceback (most recent call last):
> File "/usr/lib/python2.7/site-packages/virtualenv.py", line 2462, in <module>
> main()
> File "/usr/lib/python2.7/site-packages/virtualenv.py", line 762, in main
> symlink=options.symlink,
> File "/usr/lib/python2.7/site-packages/virtualenv.py", line 1015, in
> create_environment
> install_wheel(to_install, py_executable, search_dirs, download=download)
> File "/usr/lib/python2.7/site-packages/virtualenv.py", line 968, in
> install_wheel
> call_subprocess(cmd, show_stdout=False, extra_env=env, stdin=SCRIPT)
> File "/usr/lib/python2.7/site-packages/virtualenv.py", line 854, in
> call_subprocess
> raise OSError("Command {} failed with error code
> {}".format(cmd_desc, proc.returncode))
> OSError: Command /home/jenkins/worksp...e-py27/bin/python2.7 -
> setuptools pip wheel failed with error code 2
> Running virtualenv with interpreter /usr/bin/python2.7
> ERROR: Error creating virtualenv. Note that some special characters
> (e.g. ':' and unicode symbols) in paths are not supported by
> virtualenv. Error details: InvocationError('/usr/bin/python2 -m
> virtualenv --system-site-packages --python /usr/bin/python2.7
> storage-py27 (see
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/storage-py27/log/storage-py27-0.log)',
> 1)
> Build:
> https://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/vdsm_...
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100096)
5 years, 10 months
[JIRA] (OVIRT-2533) multi-stage support in CI slaves
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2533?page=com.atlassian.jir... ]
Barak Korren commented on OVIRT-2533:
-------------------------------------
Roi had some success in using mock when it is configured to use systemd-nspawn instead of plain chroot.
We actually had a ticket to try to enable that in our infra at some point OVIRT-2031, but this is the kind of a big change that we seem to lack the capacity to do.
> multi-stage support in CI slaves
> --------------------------------
>
> Key: OVIRT-2533
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2533
> Project: oVirt - virtualization made easy
> Issue Type: Improvement
> Reporter: Roy Golan
> Assignee: infra
>
> I would like to get multi-stage support upstream. Our default docker
> packages for centos 7.5 is 1.13. For multi-stage support we need > 1.17 or
> have buildah working in mock (preferable over docker, won't happen now I
> guess?).
> Using this method[1] to install docker-ce I was able to get 1.18 running.
> Doable?
> Regards,
> Roy
> [1] https://docs.docker.com/install/linux/docker-ce/centos/
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100096)
5 years, 10 months
Build failed in Jenkins:
system-sync_mirrors-centos-updates-el7-x86_64 #2275
by jenkins@jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_6...>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_6...>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 65b7fcabfccd9439d71f60b039775b03d81bf113 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 65b7fcabfccd9439d71f60b039775b03d81bf113
Commit message: "Add mock configs for Fedora 29"
> git rev-list --no-walk 65b7fcabfccd9439d71f60b039775b03d81bf113 # timeout=10
[system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins8723159838778682932.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf
Checking if mirror needs a resync
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML
local = self.cachedir + '/repomd.xml'
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda>
cachedir = property(lambda self: self._dirGetAttr('cachedir'))
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr
self.dirSetup()
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup
self._dirSetupMkdir_p(dir)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p
raise Errors.RepoError, msg
yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7'
Build step 'Execute shell' marked build as failure
5 years, 10 months
[JIRA] (OVIRT-2638)
ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 #39 stuck for 2 days
by Daniel Belenky (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2638?page=com.atlassian.jir... ]
Daniel Belenky commented on OVIRT-2638:
---------------------------------------
The machine where that job ran on ran out of space.
I'll update more details (as I'll have them) on the ticket
https://ovirt-jira.atlassian.net/browse/OVIRT-2638
On Sun, Dec 30, 2018 at 9:45 PM Eyal Edri <eedri(a)redhat.com> wrote:
>
>
> On Sun, Dec 30, 2018, 21:25 Yuval Turgeman <yturgema(a)redhat.com wrote:
>
>> Looks like livemedia-creator installed the VM correctly, but failed to
>> build the final image file for some reason (disk issues?). Stdci failed
>> the job on timeout, but probably can't kill the hanging process. Is it
>> possible to take a look at the slave somehow ?
>>
>
> sure, though you will need someone from the CI team to ssh in, if you
> don't have access to infra servers.
>
>
>> On Sun, Dec 30, 2018, 19:57 Nir Soffer <nsoffer(a)redhat.com wrote:
>>
>>> Started 2 days 11 hr ago
>>> Build has been executing for 2 days 11 hr on vm0038.workers-phx.ovirt.or
>>> <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org>
>>>
>>>
>>> https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc2...
>>>
>>>
>>> _______________________________________________
>>> Devel mailing list -- devel(a)ovirt.org
>>> To unsubscribe send an email to devel-leave(a)ovirt.org
>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>>> oVirt Code of Conduct:
>>> https://www.ovirt.org/community/about/community-guidelines/
>>> List Archives:
>>> https://lists.ovirt.org/archives/list/devel@ovirt.org/message/FXGWNLV3ZLZ...
>>>
>> _______________________________________________
>> Infra mailing list -- infra(a)ovirt.org
>> To unsubscribe send an email to infra-leave(a)ovirt.org
>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>> oVirt Code of Conduct:
>> https://www.ovirt.org/community/about/community-guidelines/
>> List Archives:
>> https://lists.ovirt.org/archives/list/infra@ovirt.org/message/46JUANKQHKP...
>>
>
--
DANIEL BELENKY
> ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 #39 stuck for 2 days
> ------------------------------------------------------------------------
>
> Key: OVIRT-2638
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2638
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Nir Soffer
> Assignee: infra
>
> Started 2 days 11 hr ago
> Build has been executing for 2 days 11 hr on vm0038.workers-phx.ovirt.or
> <https://jenkins.ovirt.org/computer/vm0038.workers-phx.ovirt.org>
> https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc2...
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100096)
5 years, 10 months