[JIRA] (OVIRT-2166) Python's HTTP server is overloaded
by Gal Ben Haim (oVirt JIRA)
Gal Ben Haim created OVIRT-2166:
-----------------------------------
Summary: Python's HTTP server is overloaded
Key: OVIRT-2166
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2166
Project: oVirt - virtualization made easy
Issue Type: Bug
Components: OST
Reporter: Gal Ben Haim
Assignee: infra
When running `lago ovirt deploy` we experience the following error:
```
08:23:24 [basic-suit] * [Thread-3] Deploy VM lago-basic-suite-master-host-1: Success (in 0:00:20)
08:23:25 [basic-suit] Traceback (most recent call last):
08:23:25 [basic-suit] File "/usr/lib64/python2.7/SocketServer.py", line 295, in _handle_request_noblock
08:23:25 [basic-suit] self.process_request(request, client_address)
08:23:25 [basic-suit] File "/usr/lib64/python2.7/SocketServer.py", line 321, in process_request
08:23:25 [basic-suit] self.finish_request(request, client_address)
08:23:25 [basic-suit] File "/usr/lib64/python2.7/SocketServer.py", line 334, in finish_request
08:23:25 [basic-suit] self.RequestHandlerClass(request, client_address, self)
08:23:25 [basic-suit] File "/usr/lib64/python2.7/SocketServer.py", line 651, in __init__
08:23:25 [basic-suit] self.finish()
08:23:25 [basic-suit] File "/usr/lib64/python2.7/SocketServer.py", line 710, in finish
08:23:25 [basic-suit] self.wfile.close()
08:23:25 [basic-suit] File "/usr/lib64/python2.7/socket.py", line 279, in close
08:23:25 [basic-suit] self.flush()
08:23:25 [basic-suit] File "/usr/lib64/python2.7/socket.py", line 303, in flush
08:23:25 [basic-suit] self._sock.sendall(view[write_offset:write_offset+buffer_size])
08:23:25 [basic-suit] error: [Errno 32] Broken pipe
```
It seems like `yum` on the VMs close the connection to the internal repo because it's too slow.
This error doesn't fail OST, just pollute its log.
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 7 months
[JIRA] (OVIRT-2165) Use the Overlayfs mock plugin
by Barak Korren (oVirt JIRA)
Barak Korren created OVIRT-2165:
-----------------------------------
Summary: Use the Overlayfs mock plugin
Key: OVIRT-2165
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2165
Project: oVirt - virtualization made easy
Issue Type: Epic
Components: mock_runner
Reporter: Barak Korren
Assignee: infra
mock has a plugin that allows it to store chroots on overlayfs instead of the normal FS:
Details about the plugin can be found here:
https://github.com/rpm-software-management/mock/wiki/Plugin-Overlayfs
The plugin allows to quickly restore a chroot from a snapshot - this can at the very least make the CI faster by 20 seconds, by saving time spent on extracting the tarball from the chroot cache.
the plugin also adds a full snapshot and restore mechanism to mock, this can allow us to make CI much faster by adopting something like the following scheme:
# Store and use snapshots of base-OS chroots (without modifications from *.repos or *.packages files)
# Add the modifications from *.repos or *.packages files and snapshot them as well.
This will make mock and CI run quite fast even if the *.repos or *.packages files are changed.
Bottom line - this can essentially make mock run almost as fast as Docker (Almost because one case will still be slow - when we don't have a base snapshot and we need to build it, but if we decide that is an issue, we can think up ways to pre-build it)
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 7 months
[JIRA] (OVIRT-2164) Migrate repoman to STDCI v2
by Barak Korren (oVirt JIRA)
Barak Korren created OVIRT-2164:
-----------------------------------
Summary: Migrate repoman to STDCI v2
Key: OVIRT-2164
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2164
Project: oVirt - virtualization made easy
Issue Type: Bug
Components: repoman
Reporter: Barak Korren
Assignee: infra
Priority: High
Repoman CI is still using STDCI V1 ATM. Since its an infa project it should move to STDCI V2 quickly.
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 7 months