OST Network suite is failing on "OSError: [Errno 28] No space left on device"
by Edward Haas
Good morning,
We are running in the OST network suite a test module with Ansible and it
started failing during the weekend on "OSError: [Errno 28] No space left on
device" when attempting to take a lock in the mutiprocessing python module.
It smells like a slave resource problem, could someone help investigate
this?
Thanks,
Edy.
=================================== FAILURES ===================================
______________________ test_ovn_provider_create_scenario _______________________
os_client_config = None
def test_ovn_provider_create_scenario(os_client_config):
> _test_ovn_provider('create_scenario.yml')
network-suite-master/tests/test_ovn_provider.py:68:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
network-suite-master/tests/test_ovn_provider.py:78: in _test_ovn_provider
playbook.run()
network-suite-master/lib/ansiblelib.py:127: in run
self._run_playbook_executor()
network-suite-master/lib/ansiblelib.py:138: in _run_playbook_executor
pbex = PlaybookExecutor(**self._pbex_args)
/usr/lib/python2.7/site-packages/ansible/executor/playbook_executor.py:60:
in __init__
self._tqm = TaskQueueManager(inventory=inventory,
variable_manager=variable_manager, loader=loader, options=options,
passwords=self.passwords)
/usr/lib/python2.7/site-packages/ansible/executor/task_queue_manager.py:104:
in __init__
self._final_q = multiprocessing.Queue()
/usr/lib64/python2.7/multiprocessing/__init__.py:218: in Queue
return Queue(maxsize)
/usr/lib64/python2.7/multiprocessing/queues.py:63: in __init__
self._rlock = Lock()
/usr/lib64/python2.7/multiprocessing/synchronize.py:147: in __init__
SemLock.__init__(self, SEMAPHORE, 1, 1)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <Lock(owner=unknown)>, kind = 1, value = 1, maxvalue = 1
def __init__(self, kind, value, maxvalue):
> sl = self._semlock = _multiprocessing.SemLock(kind, value, maxvalue)
E OSError: [Errno 28] No space left on device
/usr/lib64/python2.7/multiprocessing/synchronize.py:75: OSError
6 years, 8 months
[JIRA] (OVIRT-1938) [OST] Build fail - mom >= 0.5.12 require, 0.5.11-1 available
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1938?page=com.atlassian.jir... ]
Barak Korren commented on OVIRT-1938:
-------------------------------------
The backing-repo you've used probably does not include the version of
mom that the version of VDSM you're testing requires.
The non-master suits typically used the official release repo is a
fallback repo, so this kind of this is to be expected as the delta
from the official release grows and dependencies change.
Please pass a more recent build of mom in the list of pacjages that
are included in the test.
On 19 March 2018 at 22:08, Nir Soffer <nsoffer(a)redhat.com> wrote:
> OST run with engine 4.2 failed with missing mom. Is this a known issue?
>
> 00:04:54.387 - STDERR
> 00:04:54.387 + yum -y install ovirt-host
> 00:04:54.387 Error: Package: vdsm-4.20.22-8.git4f691c1.el7.centos.x86_64
> (alocalsync)
> 00:04:54.388 Requires: mom >= 0.5.12
> 00:04:54.388 Available: mom-0.5.11-1.el7.centos.noarch
> (alocalsync)
> 00:04:54.389 mom = 0.5.11-1.el7.centos
> 00:04:54.390
>
>
> commit c103010f8b5ae1ccee93f5611a198162f4ccc018 (tag: v4.20.22)
> Author: Andrej Krejcir <akrejcir(a)redhat.com>
> AuthorDate: Mon Feb 26 11:37:02 2018 +0100
> Commit: Francesco Romani <fromani(a)redhat.com>
> CommitDate: Wed Mar 14 08:44:04 2018 -0400
>
> mom: Configure mom to use the new json rpc client
>
> Also updating used version of mom to 0.5.12
>
> Change-Id: I44a35129dd80f85785625b822947ee138e67da00
> Bug-Url: https://bugzilla.redhat.com/1544476
> Signed-off-by: Andrej Krejcir <akrejcir(a)redhat.com>
> (cherry picked from commit b5a036cd628763fb0770eaf4cb6595eca9c64148)
>
>
> Build:
> http://jenkins.ovirt.org/job/ovirt-system-tests_manual/2412/consoleFull
>
> Here is another build with same issue:
> http://jenkins.ovirt.org/job/ovirt-system-tests_manual/2404/console
>
> Nir
>
> _______________________________________________
> Infra mailing list
> Infra(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
--
Barak Korren
RHV DevOps team , RHCE, RHCi
Red Hat EMEA
redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted
> [OST] Build fail - mom >= 0.5.12 require, 0.5.11-1 available
> ------------------------------------------------------------
>
> Key: OVIRT-1938
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1938
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Nir Soffer
> Assignee: infra
>
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100082)
6 years, 8 months