September 2018 - Devel - oVirt List Archives

[VDSM] Started getting virNetTLSContextCheckCertTimes:154 : The server certificate /etc/pki/vdsm/certs/vdsmcert.pem has expired
by Edward Haas 11 Jan '24

11 Jan '24

Hi, I have a VM which acts as an oVirt host with VDSM installed. I use it for testing without connecting it to Engine. Recently VDSM fails to come up and I see this error: Sep 26 17:58:18 localhost libvirtd: 2018-09-26 14:58:18.978+0000: 12176: error : virNetTLSContextCheckCertTimes:154 : The server certificate /etc/pki/vdsm/certs/vdsmcert.pem has expired Any hint on how to generate or fetch a new certificate without the help of Engine? Thanks, Edy.

3 5

Error Java SDK Issue??
by Geschwentner, Patrick 02 Apr '21

02 Apr '21

Dear Ladies and Gentlemen! I am currently working with the java-sdk and I encountered a problem. If I would like to retrieve the disk details, I get the following error: Disk currDisk = ovirtConnection.followLink(diskAttachment.disk()); The Error is occurring in this line: [cid:image001.png@01D44537.AF127FD0] The getResponst looks quiet ok. (I inspected: [cid:image002.png@01D44537.AF127FD0] and it looks ok). Error: wrong number of arguments The code is quiet similar to what you published on github (https://github.com/oVirt/ovirt-engine-sdk-java/blob/master/sdk/src/test/jav… ). Can you confirm the defect? Best regards Patrick

6 11

[VDSM] test_echo(1024, False) (stomp_test.StompTests) fails
by Nir Soffer 01 Dec '18

01 Dec '18

This tests used to fail in the past, but since we fixed it or the code it never failed. Maybe the slave was overloaded? *14:19:02* ======================================================================*14:19:02* ERROR: *14:19:02* ----------------------------------------------------------------------*14:19:02* Traceback (most recent call last):*14:19:02* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/testlib.py", line 143, in wrapper*14:19:02* return f(self, *args)*14:19:02* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/stomp_test.py", line 95, in test_echo*14:19:02* str(uuid4())),*14:19:02* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/lib/yajsonrpc/jsonrpcclient.py", line 77, in callMethod*14:19:02* raise exception.JsonRpcNoResponseError(method=methodName)*14:19:02* JsonRpcNoResponseError: No response for JSON-RPC request: {'method': 'echo'}*14:19:02* -------------------- >> begin captured logging << --------------------*14:19:02* 2018-06-27 14:17:54,524 DEBUG (MainThread) [vds.MultiProtocolAcceptor] Creating socket (host='::1', port=0, family=10, socketype=1, proto=6) (protocoldetector:225)*14:19:02* 2018-06-27 14:17:54,526 INFO (MainThread) [vds.MultiProtocolAcceptor] Listening at ::1:36713 (protocoldetector:183)*14:19:02* 2018-06-27 14:17:54,535 DEBUG (MainThread) [Scheduler] Starting scheduler test.Scheduler (schedule:98)*14:19:02* 2018-06-27 14:17:54,537 DEBUG (test.Scheduler) [Scheduler] START thread <Thread(test.Scheduler, started daemon 140562082535168)> (func=<bound method Scheduler._run of <vdsm.schedule.Scheduler object at 0x7fd74ca00390>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,538 DEBUG (test.Scheduler) [Scheduler] started (schedule:140)*14:19:02* 2018-06-27 14:17:54,546 DEBUG (JsonRpc (StompReactor)) [root] START thread <Thread(JsonRpc (StompReactor), started daemon 140562629256960)> (func=<bound method StompReactor.process_requests of <yajsonrpc.stompserver.StompReactor object at 0x7fd74ca006d0>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,547 DEBUG (MainThread) [Executor] Starting executor (executor:128)*14:19:02* 2018-06-27 14:17:54,549 DEBUG (MainThread) [Executor] Starting worker jsonrpc/0 (executor:286)*14:19:02* 2018-06-27 14:17:54,553 DEBUG (jsonrpc/0) [Executor] START thread <Thread(jsonrpc/0, started daemon 140562612471552)> (func=<bound method _Worker._run of <Worker name=jsonrpc/0 waiting task#=0 at 0x7fd74ca00650>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,554 DEBUG (jsonrpc/0) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,557 DEBUG (MainThread) [Executor] Starting worker jsonrpc/1 (executor:286)*14:19:02* 2018-06-27 14:17:54,558 DEBUG (MainThread) [Executor] Starting worker jsonrpc/2 (executor:286)*14:19:02* 2018-06-27 14:17:54,559 DEBUG (jsonrpc/2) [Executor] START thread <Thread(jsonrpc/2, started daemon 140562620864256)> (func=<bound method _Worker._run of <Worker name=jsonrpc/2 waiting task#=0 at 0x7fd74c9fb350>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,560 DEBUG (jsonrpc/2) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,561 DEBUG (MainThread) [Executor] Starting worker jsonrpc/3 (executor:286)*14:19:02* 2018-06-27 14:17:54,562 DEBUG (jsonrpc/3) [Executor] START thread <Thread(jsonrpc/3, started daemon 140562124498688)> (func=<bound method _Worker._run of <Worker name=jsonrpc/3 waiting task#=0 at 0x7fd74bc80290>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,563 DEBUG (jsonrpc/3) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,564 DEBUG (MainThread) [Executor] Starting worker jsonrpc/4 (executor:286)*14:19:02* 2018-06-27 14:17:54,565 DEBUG (jsonrpc/4) [Executor] START thread <Thread(jsonrpc/4, started daemon 140562116105984)> (func=<bound method _Worker._run of <Worker name=jsonrpc/4 waiting task#=0 at 0x7fd74bc80790>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,566 DEBUG (jsonrpc/4) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,568 DEBUG (jsonrpc/1) [Executor] START thread <Thread(jsonrpc/1, started daemon 140562132891392)> (func=<bound method _Worker._run of <Worker name=jsonrpc/1 waiting task#=0 at 0x7fd74c9fb690>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,569 DEBUG (jsonrpc/1) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,569 DEBUG (MainThread) [Executor] Starting worker jsonrpc/5 (executor:286)*14:19:02* 2018-06-27 14:17:54,570 DEBUG (jsonrpc/5) [Executor] START thread <Thread(jsonrpc/5, started daemon 140562107713280)> (func=<bound method _Worker._run of <Worker name=jsonrpc/5 waiting task#=0 at 0x7fd74bc80090>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,571 DEBUG (jsonrpc/5) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,572 DEBUG (MainThread) [Executor] Starting worker jsonrpc/6 (executor:286)*14:19:02* 2018-06-27 14:17:54,580 DEBUG (MainThread) [Executor] Starting worker jsonrpc/7 (executor:286)*14:19:02* 2018-06-27 14:17:54,603 DEBUG (jsonrpc/6) [Executor] START thread <Thread(jsonrpc/6, started daemon 140562099320576)> (func=<bound method _Worker._run of <Worker name=jsonrpc/6 waiting task#=0 at 0x7fd74d0dacd0>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,604 DEBUG (jsonrpc/6) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,615 DEBUG (jsonrpc/7) [Executor] START thread <Thread(jsonrpc/7, started daemon 140562090927872)> (func=<bound method _Worker._run of <Worker name=jsonrpc/7 waiting task#=0 at 0x7fd74bfe0310>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,616 DEBUG (JsonRpcServer) [root] START thread <Thread(JsonRpcServer, started daemon 140561730238208)> (func=<bound method JsonRpcServer.serve_requests of <yajsonrpc.JsonRpcServer object at 0x7fd74ca00690>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,618 DEBUG (MainThread) [vds.MultiProtocolAcceptor] Adding detector <yajsonrpc.stompserver.StompDetector instance at 0x7fd74c28cc68> (protocoldetector:210)*14:19:02* 2018-06-27 14:17:54,625 INFO (Detector thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:52432 (protocoldetector:61)*14:19:02* 2018-06-27 14:17:54,626 DEBUG (Detector thread) [ProtocolDetector.Detector] Using required_size=11 (protocoldetector:89)*14:19:02* 2018-06-27 14:17:54,627 DEBUG (jsonrpc/7) [Executor] Worker started (executor:298)*14:19:02* 2018-06-27 14:17:54,634 DEBUG (MainThread) [jsonrpc.AsyncoreClient] Sending response (stompclient:293)*14:19:02* 2018-06-27 14:17:54,634 DEBUG (Client ::1:36713) [root] START thread <Thread(Client ::1:36713, started daemon 140561713452800)> (func=<bound method Reactor.process_requests of <yajsonrpc.betterAsyncore.Reactor object at 0x7fd74bdb1d90>>, args=(), kwargs={}) (concurrent:193)*14:19:02* 2018-06-27 14:17:54,641 INFO (Detector thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:52432 (protocoldetector:125)*14:19:02* 2018-06-27 14:17:54,645 INFO (Detector thread) [Broker.StompAdapter] Processing CONNECT request (stompserver:94)*14:19:02* 2018-06-27 14:17:54,648 DEBUG (Client ::1:36713) [yajsonrpc.protocols.stomp.AsyncClient] Stomp connection established (stompclient:137)*14:19:02* 2018-06-27 14:17:54,651 DEBUG (jsonrpc/0) [jsonrpc.JsonRpcServer] Calling 'echo' in bridge with [u'Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut en'] (__init__:328)*14:19:02* 2018-06-27 14:17:54,652 DEBUG (jsonrpc/0) [jsonrpc.JsonRpcServer] Return 'echo' in bridge with Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut en (__init__:355)*14:19:02* 2018-06-27 14:17:54,653 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call echo succeeded in 0.01 seconds (__init__:311)*14:19:02* 2018-06-27 14:17:54,661 INFO (Detector thread) [Broker.StompAdapter] Subscribe command received (stompserver:123)*14:19:02* 2018-06-27 14:17:54,662 DEBUG (Detector thread) [protocoldetector.StompDetector] Stomp detected from ('::1', 52432) (stompserver:412)*14:19:02* 2018-06-27 14:18:09,649 DEBUG (MainThread) [vds.MultiProtocolAcceptor] Stopping Acceptor (protocoldetector:214)*14:19:02* 2018-06-27 14:18:09,650 INFO (MainThread) [jsonrpc.JsonRpcServer] Stopping JsonRPC Server (__init__:441)*14:19:02* 2018-06-27 14:18:09,651 DEBUG (MainThread) [Executor] Stopping executor (executor:137)*14:19:02* 2018-06-27 14:18:09,652 DEBUG (Client ::1:36713) [root] FINISH thread <Thread(Client ::1:36713, started daemon 140561713452800)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,652 DEBUG (JsonRpcServer) [root] FINISH thread <Thread(JsonRpcServer, started daemon 140561730238208)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,654 DEBUG (JsonRpc (StompReactor)) [root] FINISH thread <Thread(JsonRpc (StompReactor), started daemon 140562629256960)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,655 DEBUG (jsonrpc/2) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,658 DEBUG (jsonrpc/3) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,659 DEBUG (jsonrpc/4) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,660 DEBUG (jsonrpc/1) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,660 DEBUG (jsonrpc/5) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,660 DEBUG (jsonrpc/6) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,665 DEBUG (jsonrpc/6) [Executor] FINISH thread <Thread(jsonrpc/6, started daemon 140562099320576)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,661 DEBUG (jsonrpc/7) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,662 DEBUG (jsonrpc/2) [Executor] FINISH thread <Thread(jsonrpc/2, started daemon 140562620864256)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,663 DEBUG (jsonrpc/3) [Executor] FINISH thread <Thread(jsonrpc/3, started daemon 140562124498688)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,663 DEBUG (jsonrpc/1) [Executor] FINISH thread <Thread(jsonrpc/1, started daemon 140562132891392)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,664 DEBUG (jsonrpc/4) [Executor] FINISH thread <Thread(jsonrpc/4, started daemon 140562116105984)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,664 DEBUG (jsonrpc/0) [Executor] Worker stopped (executor:303)*14:19:02* 2018-06-27 14:18:09,665 DEBUG (jsonrpc/5) [Executor] FINISH thread <Thread(jsonrpc/5, started daemon 140562107713280)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,667 DEBUG (jsonrpc/7) [Executor] FINISH thread <Thread(jsonrpc/7, started daemon 140562090927872)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,667 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/0 (executor:290)*14:19:02* 2018-06-27 14:18:09,671 DEBUG (jsonrpc/0) [Executor] FINISH thread <Thread(jsonrpc/0, started daemon 140562612471552)> (concurrent:196)*14:19:02* 2018-06-27 14:18:09,673 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/1 (executor:290)*14:19:02* 2018-06-27 14:18:09,674 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/6 (executor:290)*14:19:02* 2018-Coverage.py warning: Module /home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/vdsm was never imported. (module-not-imported)*14:19:05* pylint installdeps: pylint==1.8*14:19:22* pylint installed: The directory '/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.,astroid==1.6.5,backports.functools-lru-cache==1.5,backports.ssl-match-hostname==3.5.0.1,blivet==0.61.15.69,chardet==2.2.1,configparser==3.5.0,coverage==4.4.1,decorator==3.4.0,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,iniparse==0.4,ioprocess==1.1.0,ipaddress==1.0.16,IPy==0.75,isort==4.3.4,kitchen==1.1.1,lazy-object-proxy==1.3.1,libvirt-python==3.9.0,Magic-file-extensions==0.2,mccabe==0.6.1,mock==2.0.0,netaddr==0.7.18,ovirt-imageio-common==1.4.1,pbr==3.1.1,pluggy==0.6.0,policycoreutils-default-encoding==0.1,pthreading==0.1.3,py==1.5.4,pycurl==7.19.0,pygpgme==0.3,pyinotify==0.9.4,pykickstart==1.99.66.18,pyliblzma==0.5.3,pylint==1.8.0,pyparted==3.9,python-augeas==0.5.0,python-dateutil==2.4.2,pyudev==0.15,pyxattr==0.5.1,PyYAML==3.10,requests==2.6.0,sanlock-python==3.6.0,seobject==0.1,sepolicy==1.1,singledispatch==3.4.0.3,six==1.11.0,subprocess32==3.2.6,tox==2.9.1,urlgrabber==3.10,urllib3==1.10.2,virtualenv==16.0.0,WebOb==1.2.3,wrapt==1.10.11,yum-metadata-parser==1.1.4*14:19:22* pylint runtests: PYTHONHASHSEED='528910716'*14:19:22* pylint runtests: commands[0] | pylint --errors-only static/usr/share/vdsm/sitecustomize.py lib/vdsm lib/vdsmclient lib/yajsonrpc*14:19:23* Problem importing module base.pyc: cannot import name get_node_last_lineno*14:19:24* Problem importing module base.py: cannot import name get_node_last_lineno*14:19:34* 06-27 14:18:09,674 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/7 (executor:290)*14:19:34* 2018-06-27 14:18:09,675 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/5 (executor:290)*14:19:34* 2018-06-27 14:18:09,675 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/2 (executor:290)*14:19:34* 2018-06-27 14:18:09,676 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/3 (executor:290)*14:19:34* 2018-06-27 14:18:09,676 DEBUG (MainThread) [Executor] Waiting for worker jsonrpc/4 (executor:290)*14:19:34* 2018-06-27 14:18:09,677 DEBUG (MainThread) [Scheduler] Stopping scheduler test.Scheduler (schedule:110)*14:19:34* 2018-06-27 14:18:09,678 DEBUG (test.Scheduler) [Scheduler] stopped (schedule:143)*14:19:34* 2018-06-27 14:18:09,679 DEBUG (test.Scheduler) [Scheduler] FINISH thread <Thread(test.Scheduler, started daemon 140562082535168)> (concurrent:196)*14:19:34* --------------------- >> end captured logging << ---------------------

4 10

Request for reviews - vdsm-tool update-volume
by Germano Veit Michel 29 Nov '18

29 Nov '18

Hi, I'm working an a tool (vdsm-tool update-volume) to make modifying SD metadata easier and more importantly, safer. This is very useful to recover from failed LSMs or snapshot issues. The plan is to use the VDSM API (modified by some of these patches) and add a tool (vdsm-tool) that talks to the API and modifies the volumes metadata as required by the user. Currently this is done manually, i.e.: looking at MD_XXX tags, doing dd, sed and then dd back to the storage. Any wrong argument (like a skip in place of a seek) can ruin the entire metadata, so this tool can be quite handy. The code is not necessarily 100% finished yet, but I've been testing this for some time and it seems ok from a functional point of view. I'm just not sure everything I did (especially inside VDSM, example 94366) is correct. Your comments on what can/should be improved are very welcome at this point. Please see this series and help reviewing it. https://gerrit.ovirt.org/#/q/topic:update-volume+(status:open+OR+status:mer… https://gerrit.ovirt.org/#/c/93258/ Thanks, Germano

2 9

[ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [ 14-09-2018 ] [ 002_bootstrap.add_hosts ]
by Dafna Ron 22 Oct '18

22 Oct '18

Hi, The previous regression was resolved and we now have a new regression. I don't think that the reported change is related so can someone from ovirt-engine take a look? The failure is add host on the upgrade suite. Please note that we have not had an engine-ovirt build for over 10 days due to several consecutive regressions and I would ask you to stop merging until we can stabilize the project and have a new package of engine. error: 2018-09-14 05:51:07,670-04 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] SSH execute 'root@lago-upgrade-from-release-suite-master-host-0' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar -b1 --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-09-14 05:51:08,550-04 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5c91fcbd] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host lago-upgrade-from-release-suite-master-host-0. Stage: Initializing. 2018-09-14 05:51:08,565-04 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (VdsDeploy) [5c91fcbd] transaction rolled back 2018-09-14 05:51:08,574-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [5c91fcbd] Error during deploy dialog 2018-09-14 05:51:08,578-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Error during host lago-upgrade-from-release-suite-master-host-0 install 2018-09-14 05:51:08,586-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host lago-upgrade-from-release-suite-master-host-0: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00. 2018-09-14 05:51:08,586-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Error during host lago-upgrade-from-release-suite-master-host-0 install, preferring first exception: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00 2018-09-14 05:51:08,586-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Host installation failed for host 'e475e93a-63b3-4573-b242-162c2ed864f0', 'lago-upgrade-from-release-suite-master-host-0': CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00 2018-09-14 05:51:08,615-04 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] START, SetVdsStatusVDSCommand(HostName = lago-upgrade-from-release-suite-master-host-0, SetVdsStatusVDSCommandParameters:{hostId='e475e93a-63b3-4573-b242-162c2ed864f0', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 146cdc08 2018-09-14 05:51:08,626-04 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] FINISH, SetVdsStatusVDSCommand, return: , log id: 146cdc08 2018-09-14 05:51:08,639-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] EVENT_ID: VDS_INSTALL_FAILED(505), Host lago-upgrade-from-release-suite-master-host-0 installation failed. CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00. 2018-09-14 05:51:08,652-04 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Lock freed to object 'EngineLock:{exclusiveLocks='[e475e93a-63b3-4573-b242-162c2ed864f0=VDS]', sharedLocks=''}' 2018-09-14 05:51:37,996-04 INFO [org.ovirt.engine.core.bll.quota.QuotaManager] (EE-ManagedThreadFactory-engineScheduled-Thread-44) [] Quota Cache updated. (19 msec) (END) Thanks, Dafna

9 30

increasingly common OST failure: Cannot setup Networks. Another Setup Networks or Host Refresh process in progress on the host. Please try later.
by Dan Kenigsberg 02 Oct '18

02 Oct '18

FYI, Ales is working on retrying setupNetwork in case there is an async getCapabilities going on the host. https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-4.2_change-q… However, the real bug is partially hidden by Lago complaining about ExtractPathNoPathError: scp: /root/fluentd: No such file or directory What is it? Is it already tracked by someone?

4 4

Help understanding vdsHeartbeatInSeconds relation to Heartbeat exceeded
by Germano Veit Michel 02 Oct '18

02 Oct '18

Hi, I've been trying to understand why we see some heartbeat exceeded messages with a last response a very short time ago, while the vdsHeartbeatInSeconds option would allow for much more before triggering the disconnect. The vdc_option vdsHeartbeatInSeconds is set to 30 by default. It is used here in the engine, the propagates to vdsm-jsonrpc-java int heartbeat = Config.<Integer> getValue(ConfigValues.vdsHeartbeatInSeconds) * 1000; TransportFactory.createVdsServer() -> JsonRpcUtils.createStompClient() -> StompClientPolicy ClientPolicy -> createClient() -> getJsonClient() -> setClientPolicy() -> setRetryPolicy() So I understand ClientPolicy.incomingHearbeat = vdsHeartbeatInSeconds*1000 = 30000ms If this is the case, why do we see messages such as this, if isIncomingHeartbeatExceeded() shouldn't return True in case the last heartbeat was less than 30000ms ago? 2018-09-17 10:46:49,891+03 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Heartbeat exceeded for host '192.168.7.235', last response arrived 1702 ms ago. if (!this.isInInit() && this.policy.isIncomingHeartbeat() && this.isIncomingHeartbeatExceeded()) { String msg = String.format("Heartbeat exceeded for host '%s', last response arrived %s ms ago.", getHostname(), getHeartbeatTime()); log.error(msg); this.disconnect(msg); } private long getHeartbeatTime() { return System.currentTimeMillis() - this.lastIncomingHeartbeat; } private boolean isIncomingHeartbeatExceeded() { return this.lastIncomingHeartbeat + this.policy.getIncomingHeartbeat() < System.currentTimeMillis(); } public ClientPolicy(int retryTimeOut, int retryNumber, int incomingHeartbeat, int outgoingHeartbeat, List<Class<? extends Exception>> retryableExceptions) { this.retryNumber = retryNumber; this.retryTimeOut = retryTimeOut; setIncomingHeartbeat(incomingHeartbeat); setOutgoingHeartbeat(outgoingHeartbeat); this.exceptions = Collections.unmodifiableList(retryableExceptions); } I used byteman to print the value stored in policy.incomingHeartbeat and it is: If vdsHeartbeatInSeconds = 45 2018-09-27 15:17:13,673+10 INFO [stdout] (SSL Stomp Reactor) policy.incomingHeartbeat: 33750 If vdsHeartbeatInSeconds = 30 (default) 2018-09-27 15:21:51,099+10 INFO [stdout] (SSL Stomp Reactor) policy.incomingHeartbeat: 22500 I was expecting 45000 and 30000. But even with 33750 and 22500, I dont understand why we see "Heartbeat exceeded" and disconnection if the last heartbeat arrived just 1700ms ago. I'm clearly missing something. Could someone please put some light on what is the missing piece? Thanks, Germano

1 1

/root/fluentd no longer exists
by Anton Marchukov 01 Oct '18

01 Oct '18

Hello Shirly, All. We used to collect fluentd artifacts in OST from /root/fluentd, but starting from around mid night today Fri Aug 31 (or maybe late evening Thu Aug 30) the tests started to fail to locate /root/fluentd. We merged a patch to disable its collection [1] so we can let other tests run, but we need to find what happened and restore fluentd collection. I open a JIRA issue [2] on this. Do you have any idea? Thanks. [1] https://gerrit.ovirt.org/#/c/94067/ [2] https://ovirt-jira.atlassian.net/browse/OVIRT-2464 -- Anton Marchukov Team Lead - Release Management - RHV DevOps - Red Hat

4 9

new dependency for vdsm 4.2
by Marcin Sobczyk 01 Oct '18

01 Oct '18

Hi, "python-enum34" has been added as a new dependency for vdsm-4.2 after merging https://gerrit.ovirt.org/#/q/topic:vdsm-api-schema-pickle+(status:open+OR+s… . Regards, Marcin

2 2

Status update on "Hyperconverged Gluster oVirt support"
by Gobinda Das 30 Sep '18

30 Sep '18

Hi All, Status update on "Hyperconverged Gluster oVirt support" Features Completed: ================ cockpit-ovirt ------------- 1- Asymmetric brick configuration.Brick can be configured per host basis i.e. If the user wanted to make use of sdb from host1, sdc from host2, and sdd from host3. 2- Dedupe and Compression integration via VDO support (see https://github.com/dm-vdo/kvdo) Gluster bricks are created on vdo devices 3- LVM cache configuration support (Configure cache by using fast block device such as SSD drive to imrove the performance of a larger and slower logical volumes) 4- Auto addition of 2nd and 3rd hosts in a 3 node setup during deployment 5- Auto creation of storage domains based on gluster volumes created during setup 6- Single node deployment support via Cockpit UI. For details on single node deployment - https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Single_node… 7- Gluster Management Dashboard (Dashboard will show the nodes in cluster,Volumes and bricks. User can expand the cluster and also can create new volume in existing cluster nodes ) oVirt ------- 1- Reset brick support from UI to allow users to replace a faulty brick 2- Create brick from engine now supports configuring an SSD device as lvmcache device when bricks are created on spinning disks 3- VDO monitoring GlusterFS --------------- Enhancements to performance with fuse by 15x 1. Cluster after eager lock change for better detection of multiple clients 2. Changing qemu option aio to "native" instead of "threads". end-to-end deployment: -------------------------------- 1- End to end deployment of a Gluster + Ovirt hyperconverged environment using ansible roles ( https://github.com/gluster/gluster-ansible/tree/master/playbooks ). The only pre-requisite is a CentOS node/oVirt node Future Plan: ========== cockpit-ovirt: 1- ansible-roles integration for deployment 2- Support for different volume types vdsm: 1- Python3 compatibility of vdsm-gluster 2- Native 4K support -- Thanks, Gobinda

4 5

[ OST Failure Report ] [ oVirt 4.2 (ovirt-engine) ] [ 27-09-20118 ] [ initialize_engine ]
by Dafna Ron 28 Sep '18

28 Sep '18

Hi, we are failing on ovirt-engine 4.1 on the upgrade suite. The issue seems to be related to this change: https://gerrit.ovirt.org/#/c/94551/ - packaging: Generate random MAC pool instead of hardcoded one Can you please have a look and issue a fix? Build log: https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3234/testReport… error: [ INFO ] Yum Verify: 100/100: ovirt-engine-tools.noarch 0:4.1.9.1-1.el7.centos - ud [ INFO ] Stage: Misc configuration [ INFO ] Upgrading CA [ INFO ] Installing PostgreSQL uuid-ossp extension into database [ INFO ] Creating/refreshing DWH database schema [ INFO ] Configuring WebSocket Proxy [ INFO ] Creating/refreshing Engine database schema [ INFO ] Creating/refreshing Engine 'internal' domain database schema Unregistering existing client registration info. [ INFO ] Creating default mac pool [ ERROR ] Failed to execute stage 'Misc configuration': insert or update on table "mac_pool_ranges" violates foreign key constraint "mac_pool_ranges_mac_pool_id_fkey" DETAIL: Key (mac_pool_id)=(58ca604b-017d-0374-0220-00000000014e) is not present in table "mac_pools". CONTEXT: SQL statement "INSERT INTO mac_pool_ranges ( mac_pool_id, from_mac, to_mac ) VALUES ( v_mac_pool_id, v_from_mac, v_to_mac )" PL/pgSQL function insertmacpoolrange(uuid,character varying,character varying) line 3 at SQL statement [ INFO ] Rolling back to the previous PostgreSQL instance (postgresql). [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20180927090017-97fd5u.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20180927090149-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed ('FATAL Internal error (main): insert or update on table "mac_pool_ranges" violates foreign key constraint "mac_pool_ranges_mac_pool_id_fkey"\nDETAIL: Key (mac_pool_id)=(58ca604b-017d-0374-0220-00000000014e) is not present in table "mac_pools".\nCONTEXT: SQL statement "INSERT INTO mac_pool_ranges (\n mac_pool_id,\n from_mac,\n to_mac\n )\n VALUES (\n v_mac_pool_id,\n v_from_mac,\n v_to_mac\n )"\nPL/pgSQL function insertmacpoolrange(uuid,character varying,character varying) line 3 at SQL statement\n',) lago.ssh: DEBUG: Command 483aadd2 on lago-upgrade-from-prevrelease-suite-4-2-engine errors: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/otopi/__main__.py", line 88, in main installer.execute() File "/usr/lib/python2.7/site-packages/otopi/main.py", line 157, in execute self.context.runSequence() File "/usr/lib/python2.7/site-packages/otopi/context.py", line 771, in runSequence util.raiseExceptionInformation(infos[0]) File "/usr/lib/python2.7/site-packages/otopi/util.py", line 81, in raiseExceptionInformation exec('raise info[1], None, info[2]') File "/usr/lib/python2.7/site-packages/otopi/context.py", line 133, in _executeMethod method['method']() File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/network/macpools.py", line 98, in _misc_db_entries self._create_new_mac_pool_range(range_prefix) File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-setup/ovirt-engine/network/macpools.py", line 73, in _create_new_mac_pool_range to_mac=range_prefix + ':ff:ff', File "/usr/share/ovirt-engine/setup/ovirt_engine_setup/engine_common/database.py", line 266, in execute args, IntegrityError: insert or update on table "mac_pool_ranges" violates foreign key constraint "mac_pool_ranges_mac_pool_id_fkey" DETAIL: Key (mac_pool_id)=(58ca604b-017d-0374-0220-00000000014e) is not present in table "mac_pools". CONTEXT: SQL statement "INSERT INTO mac_pool_ranges ( mac_pool_id, from_mac, to_mac ) VALUES ( v_mac_pool_id, v_from_mac, v_to_mac )" PL/pgSQL function insertmacpoolrange(uuid,character varying,character varying) line 3 at SQL statement Thanks, Dafna

2 4

vdsm_4.2_build-artifacts-fc28-s390x is failing - please fix before merging more changes
by Dafna Ron 28 Sep '18

28 Sep '18

Hi, vdsm changes cannot run on CQ due to failed build-artifacts job for fc28-s390 please do not merge before solving this since changes do not run on CQ when the build-artifacts job is failing. https://jenkins.ovirt.org/job/vdsm_4.2_build-artifacts-fc28-s390x/19/console The error in the job is [Errno 2] No such file or directory: '/var/cache/dnf/updates-07b7057ee4fded96/packages/python2-2.7.15-3.fc28.s390x.rpm' Thanks, Dafna

2 1

ovirt.org documentation refresh
by Greg Sheremeta 27 Sep '18

27 Sep '18

Hi all, Brian Proffitt has kindly offered to refresh the documentation on ovirt.org to version 4.2 (it's currently a mix of 4.0 + whatever people have updated since.) Other than the main 'official' documentation, I noticed that there is a lot of documentation on separate sites. For example, imageio, mom, all of the OST stuff, etc. For now there are no plans for any of this extra stuff, but in the future it should probably all look the same. Can you share ovirt documentation sites that you know of? Best wishes, Greg -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com IRC: gshereme <https://red.ht/sig>

5 4

Problem installing HE
by Hetz Ben Hamo 26 Sep '18

26 Sep '18

Hi, I've tried installing oVirt HE using the ovirt-NG node ISO (4.2.6.2) running in a nested VM using ESXI 6.7. the HE install part fails when the "TASK [Get local VM IP]" comes. I've created a bugzilla about this, as I've seen this problem on the mailing list quite few times. Link: https://bugzilla.redhat.com/show_bug.cgi?id=1633346 Could someone check if I forgot to add any log file? Thanks Hetz

1 0

'make distcheck' issues in VDSM project (regarding BZ#1297808)
by Marcin Sobczyk 26 Sep '18

26 Sep '18

Hi, I've been doing some work around making 'make distcheck' and VPATH builds successful for VDSM. Some patches have already been merged, but there is one that I've abandoned because it touches a bigger issue. When doing a VPATH build, some python sources are build-time generated from '.py.in' files (at this moment: 'lib/vdsm/common/constants.py.in', 'lib/vdsm/common/config.py.in', 'lib/vdsm/common/dsaversion.py.in', '/lib/sos/vdsm.py.in'). Suppose we do a VPATH build with: cd ${SRCROOT} && \ ./autogen.sh && \ make distclean && \ mkdir -p /tmp/ovirt-build && \ cd /tmp/ovirt-build && \ ${SRCROOT}/configure && \ make The build-generated '.py' files will land in '/tmp/ovirt-build/lib/...'. As a result, even though the build-generated python modules and the source ones refer to each other, they can't see each other. After some trial and error here are my observations: - we can't generate resulting '.py' files in $(srcdir) - 'make distcheck' purposely sets $(srcdir) to be read-only - we can't just simply add $(builddir) to PYTHONPATH - there are no '__init__.py' files in $(builddir), so i.e. 'import vdsm.common.config' will fail - we can't create dummy '__init__.py' files in $(builddir), because that would break in-tree-builds (we would have to clean regular, git-maintained files) In conclusion, I think we would need to implement a custom python module loader to make VPATH/distcheck successful. It would need to be parametrized with $(builddir)'s path, and would try to resolve unsuccessful imports by finding build-time generated files inside. However, after looking at other oVirt projects (i.e. 'ioprocess', 'ovirt-iso-uploader', 'ovirt-node-ng', 'ovirt-register'), I can see that most of them fail 'make distcheck'. They have even more severe 'makefile'-issues than importing build-time generated python files. So the question is - do we really need 'make distcheck' for VDSM to suceed? Marcin

2 1

Jenkins help
by Germano Veit Michel 25 Sep '18

25 Sep '18

Hi, I'm struggling with a check-patch failing. This is the error (I think): [7;33m************* Module vdsm.tool.update_volume [0m [1;31mE [0m: 87,16: [1;31mInstance of '_Client' has no 'Host' member [0m ( [1;31mno-member [0m) [1;31mE [0m:101,23: [1;31mInstance of '_Client' has no 'StoragePool' member [0m ( [1;31mno-member [0m) The way I understand it, the error above from [1] means that the check patch fails because the cli object does not contain Host or StoragePool. However, from reading the code it seems the Host and StoragePool members are created at runtime by parsing the API schema. So static checking for [2] and [3] fails. I see some other tools doing similar things (i,e. dump_volume_chains), but I can't find anything specific done to prevent it. Or am I missing something? Any idea on how to solve this? [1] https://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/25017/arti… [2] https://gerrit.ovirt.org/gitweb?p=vdsm.git;f=lib/vdsm/tool/update_volume.py… [3] https://gerrit.ovirt.org/gitweb?p=vdsm.git;f=lib/vdsm/tool/update_volume.py… Thanks! Germano

1 1

ovirt-engine has been tagged (ovirt-engine-4.2.7.1)
by Piotr Kliczewski 21 Sep '18

21 Sep '18

1 0

Dealing with TaskID in vdsm api
by Germano Veit Michel 21 Sep '18

21 Sep '18

Hello, I've been struggling with TaskID/FlowID when talking to the VDSM API. I am trying to write a tool that uses the vdsm-api to facilitate the troubleshooting of image issues (snapshots). This tool does a series of API calls, but I cannot find a nice way to track the taskID and clear the completed tasks after completion of the tool commands. Currently I'm clearing all Tasks that match the verb and are finished, which is not ideal. I would like to have the exact TaskID to track and dont want to leave Tasks behind. I don't want also to clear tasks from other entities (like engine!). I understand that if I want to specify the task/flow ids when calling the vdsm API, these two need to be passed as headers (http) so they end up in the context of the call. Is this correct? But using vdsm/client.py I cannot figure out how to do this, but I understand it is possible. I've been looking at vdsm/common/api.py and vdsm/client.py and trying several things but nothing seems to do it. Could anyone please put some light on this? Thanks, Germano

4 10

Re: blog post: quick(er) development / testing of GWT code using SDM
by sangeetha r 21 Sep '18

21 Sep '18

Hi Greg, I followed your post "oVirt Webadmin GWT Debug Quick Refresh" in Centos7. I am able to get the SDM compile works. But changes are not reflecting in UI Chrome/Firefox. I didn't see any error in logs as well. This is the GWT log output when I do compile [INFO] The code server is ready at http://10.149.202.159:9876/[INFO] GET /recompile/webadmin[INFO] Job org.ovirt.engine.ui.webadmin.WebAdmin_1_0[INFO] starting job: org.ovirt.engine.ui.webadmin.WebAdmin_1_0[INFO] binding: locale=en_US[INFO] binding: user.agent=safari[INFO] Compiling module org.ovirt.engine.ui.webadmin.WebAdmin[INFO] Computing all possible rebind results for 'com.gwtplatform.mvp.client.DesktopGinjector'[INFO] Rebinding com.gwtplatform.mvp.client.DesktopGinjector[INFO] Invoking generator com.google.gwt.inject.rebind.GinjectorGenerator[INFO] [WARN] Class org.ovirt.engine.ui.gwtaop.AspectJLogHandler is used in Gin, but not available in GWT client code.[INFO] info AspectJ Weaver Version 1.8.10 built on Monday Dec 12, 2016 at 19:07:48 GMT[INFO] info register classloader com.google.gwt.inject.rebind.GinBridgeClassLoader@cbbe9df[INFO] info using configuration file:/home/admin/.m2/repository/org/ovirt/engine/ui/gwt-aop/4.3.0-SNAPSHOT/gwt-aop-4.3.0-SNAPSHOT.jar!/META-INF/aop.xml[INFO] info register aspect org.ovirt.engine.ui.gwtaop.DontPrune[INFO] warning javax.* types are not being woven because the weaver option '-Xset:weaveJavaxPackages=true' has not been specified[INFO] Unification traversed 23500 fields and methods and 8802 types. 667 are considered part of the current module and 672 had all of their fields and methods traversed.[INFO] Compiling 1 permutation[INFO] Compiling permutation 0...[INFO] Linking per-type JS with 667 new/changed types.[INFO] Source Maps Enabled[INFO] Compile of permutations succeeded[INFO] Compilation succeeded -- 27.667s[INFO] Linking into /home/admin/git/ovirt-engine/frontend/webadmin/modules/webadmin/target/tmp/gwt-codeserver-671189326887964275.tmp/org.ovirt.engine.ui.webadmin.WebAdmin/compile-2/war/webadmin; Writing extras to /home/admin/git/ovirt-engine/frontend/webadmin/modules/webadmin/target/tmp/gwt-codeserver-671189326887964275.tmp/org.ovirt.engine.ui.webadmin.WebAdmin/compile-2/extras/webadmin[INFO] Link succeeded[INFO] Linking succeeded -- 4.482s[INFO] 34.746s total -- Compile completed Can you please help me on this issue. Thanks! Sangeetha S

2 1

Re: [CQ]: 94345,3 (ovirt-provider-ovn) failed "ovirt-4.2" system tests
by Dafna Ron 20 Sep '18

20 Sep '18

I am not sure since I have never opened a ticket for them. I am adding Sandro, Barak and ovirt dev so that perhaps someone with more experience can offer a better advice. On Thu, Sep 20, 2018 at 8:37 AM Miguel Duarte de Mora Barroso < mdbarroso(a)redhat.com> wrote: > On Thu, Sep 20, 2018 at 8:02 AM, Dominik Holler <dholler(a)redhat.com> > wrote: > > On Wed, 19 Sep 2018 17:53:32 +0100 > > Dafna Ron <dron(a)redhat.com> wrote: > > > >> it failed on build-artifacts: > >> http://pastebin.test.redhat.com/649015 > >> > > > > Thanks, I did not find this error message. > > > > > > 13:03:03 [build-artifacts.fc27.x86_64] Failed to synchronize cache for > repo 'mdbarroso-python-ovsdbapp', disabling. > > 13:03:03 [build-artifacts.fc27.x86_64] Last metadata expiration check: > 0:00:00 ago on Wed Sep 19 13:01:34 2018. > > 13:03:03 [build-artifacts.fc27.x86_64] No match for argument: > python2-ovsdbapp > > 13:03:03 [build-artifacts.fc27.x86_64] Error: Unable to find a match > > > > looks like > > https://copr-be.cloud.fedoraproject.org/ > > is unstable. > > Miguel, do you expect that the reference to this repo is removed next > > days, or should we ask someone from copr-be.cloud.fedoraproject.org for > > help? > > Hi Dafna, > > I'm forced to agree that copr has been unstable for the past few days. > > I'll contact the openstack release guys to get an update on the > deliver on the python2-ovsdbapp-0.12.1, but I think we should also > open the copr track. > > Can you elaborate on what needs to be done Dafna? Just drop them an > email saying this repo fails every now and then? > > > > > >> > >> On Wed, Sep 19, 2018 at 5:09 PM Dominik Holler <dholler(a)redhat.com> > >> wrote: > >> > >> > Hi Marcin, > >> > the test looks like succeeded, but the return failed. > >> > Do you have an idea why? > >> > Dominik > >> > > >> > > >> > Begin forwarded message: > >> > > >> > Date: Wed, 19 Sep 2018 16:48:45 +0100 > >> > From: Dafna Ron <dron(a)redhat.com> > >> > To: Dominik Holler <dholler(a)redhat.com> > >> > Subject: Fwd: [CQ]: 94345,3 (ovirt-provider-ovn) failed "ovirt-4.2" > >> > system tests > >> > > >> > > >> > hi, ? > >> > > >> > I am seeing that the check-merge job that failed is still broken. so > >> > guessing you guys are looking into it? > >> > > >> > Thanks, > >> > Dafna > >> > > >> > > >> > ---------- Forwarded message --------- > >> > From: oVirt Jenkins <jenkins(a)ovirt.org> > >> > Date: Wed, Sep 19, 2018 at 4:26 PM > >> > Subject: [CQ]: 94345,3 (ovirt-provider-ovn) failed "ovirt-4.2" > >> > system tests To: <infra(a)ovirt.org> > >> > > >> > > >> > Change 94345,3 (ovirt-provider-ovn) is probably the reason behind > >> > recent system > >> > test failures in the "ovirt-4.2" change queue and needs to be fixed. > >> > > >> > This change had been removed from the testing queue. Artifacts build > >> > from this > >> > change will not be released until it is fixed. > >> > > >> > For further details about the change see: > >> > https://gerrit.ovirt.org/#/c/94345/3 > >> > > >> > For failed test results see: > >> > http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3150/ > >> > _______________________________________________ > >> > Infra mailing list -- infra(a)ovirt.org > >> > To unsubscribe send an email to infra-leave(a)ovirt.org > >> > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > >> > oVirt Code of Conduct: > >> > https://www.ovirt.org/community/about/community-guidelines/ > >> > List Archives: > >> > > >> > > https://lists.ovirt.org/archives/list/infra@ovirt.org/message/VGTE6K3DMBCBM… > >> > > > >

2 1

[OST][hc-basic-suite-master] Fails on HE deployment
by Sahina Bose 19 Sep '18

19 Sep '18

xargs -I{} sudo -u vdsm dd if={} | tar -tvf - 772a3dfe-aee8-45d9-9df5-beddcbf92010.ovf\", u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'stdout_lines': [], u'stderr': u\"vdsm-client: Command Image.prepare with args {'storagepoolID': 'e90984b6-af79-11e8-a2dd-00163e24d363', 'storagedomainID': 'b4c84ead-fb7f-4478-acd2-0309d569b9aa', 'volumeID': 'b18f30b1-5625-4581-b815-94291b226c79', 'imageID': '[u7894c850-665f-47dd-8376-e4da5ae7807f]'} failed:\\n(code=201, message=Volume does not exist: (u'b18f30b1-5625-4581-b815-94291b226c79',))\\ntar: This does not look like a tar archive Is this a known issue? thanks! sahina

2 3

PLEASE READ: Stop merging to ovirt-engine master until further notice
by Dafna Ron 17 Sep '18

17 Sep '18

Hello to all, I asked to stop merging last week but it seemed to have been ignored so writing again. *please stop merging to ovirt-engine master until further notice.* the project has been failing for the last two weeks on various different regressions. You continue to merge changes which means that you are risking further regressions and making it hard to stabilize the master branch for ovirt-engine. to make it clear: 1. all changes that were merged since sept. 4th to the master branch exist only in the ovirt-engine master branch (i.e they are not included in your project package). 2. any code merged to master in the past two weeks was most likely not tested by CQ since we exit on first test failure (if your code effects anything after the reported issues ran, they would not be tested). 3. you are putting other projects at risk for regressions since they are tested with a 2 weeks old ovirt-engine packages. Thanks you. Dafna

1 1

why we only save lv that seg_start_pe=="0" in _reloadlvs
by pengyixiang 17 Sep '18

17 Sep '18

Hello, everyone! if we reload lvs, why we don't update lvs that seg_start_pe != "0" ? there's in [1] with red mark. what seg_start_pe means? If this lv is a vm template, may seg_start_pe is not zero, and we should ignore it? [1] vdsm/storage/lvm.py def _reloadlvs(self, vgName, lvNames=None): lvNames = _normalizeargs(lvNames) cmd = list(LVS_CMD) if lvNames: cmd.extend(["%s/%s" % (vgName, lvName) for lvName in lvNames]) else: cmd.append(vgName) rc, out, err = self.cmd(cmd, self._getVGDevs((vgName,))) with self._lock: if rc != 0: log.warning("lvm lvs failed: %s %s %s", str(rc), str(out), str(err)) lvNames = lvNames if lvNames else self._lvs.keys() for l in lvNames: if isinstance(self._lvs.get(l), Stub): self._lvs[l] = Unreadable(self._lvs[l].name, True) return dict(self._lvs) updatedLVs = {} for line in out: fields = [field.strip() for field in line.split(SEPARATOR)] lv = makeLV(*fields) # For LV we are only interested in its first extent if lv.seg_start_pe == "0": self._lvs[(lv.vg_name, lv.name)] = lv updatedLVs[(lv.vg_name, lv.name)] = lv # Determine if there are stale LVs if lvNames: staleLVs = (lvName for lvName in lvNames if (vgName, lvName) not in updatedLVs.iterkeys()) else: # All the LVs in the VG staleLVs = (lvName for v, lvName in self._lvs.keys() if (v == vgName) and ((vgName, lvName) not in updatedLVs.iterkeys())) for lvName in staleLVs: log.warning("Removing stale lv: %s/%s", vgName, lvName) self._lvs.pop((vgName, lvName), None) log.debug("lvs reloaded") return updatedLVs -- Cheers， Pencc

2 1

[ OST Failure Report ] [ oVirt Master (vdsm) ] [ 14-08-2018 ] [ 006_migrations.migrate_vm ]
by Dafna Ron 17 Sep '18

17 Sep '18

Hi, We have a failure in vm migration on project vdsm master branch. I think the issue is related to this change: https://gerrit.ovirt.org/#/c/94248/ - https://gerrit.ovirt.org/#/c/94248/ Can you please have a look? full logs: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10309/artifa… error: 2018-09-14 07:15:43,102-0400 ERROR (migsrc/ade7210f) [virt.vm] (vmId='ade7210f-992e-4256-a33f-1340552892c9') __init__() takes exactly 3 arguments (2 given) (migration:281) 2018-09-14 07:15:43,102-0400 DEBUG (migsrc/ade7210f) [jsonrpc.Notification] Sending event {"params": {"notify_time": 4296575510, "ade7210f-992e-4256-a33f-1340552892c9": {"status": "Up"}}, "jsonrpc": "2.0", "method": "|virt|VM_status|ade72 10f-992e-4256-a33f-1340552892c9"} (__init__:181) 2018-09-14 07:15:43,103-0400 DEBUG (JsonRpc (StompReactor)) [yajsonrpc.protocols.stomp.AsyncClient] Stomp connection established (stompclient:138) 2018-09-14 07:15:43,104-0400 DEBUG (migsrc/ade7210f) [vds] Sending notification |virt|VM_status|ade7210f-992e-4256-a33f-1340552892c9 with params {'notify_time': 4296575510, 'ade7210f-992e-4256-a33f-1340552892c9': {'status': 'Up'}} (clien tIF:225) 2018-09-14 07:15:43,104-0400 ERROR (migsrc/ade7210f) [virt.vm] (vmId='ade7210f-992e-4256-a33f-1340552892c9') Failed to migrate (migration:449) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 401, in _regular_run self._setupVdsConnection() File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 241, in _setupVdsConnection self._destServer = jsonrpcvdscli.connect(requestQueue, client) File "/usr/lib/python2.7/site-packages/vdsm/jsonrpcvdscli.py", line 259, in connect return _Server(client, xml_compat) File "/usr/lib/python2.7/site-packages/vdsm/jsonrpcvdscli.py", line 135, in __init__ self._schema = vdsmapi.Schema.vdsm_api(api_strict_mode) File "/usr/lib/python2.7/site-packages/vdsm/api/vdsmapi.py", line 155, in vdsm_api return Schema(schema_types, *args, **kwargs) TypeError: __init__() takes exactly 3 arguments (2 given)

2 3

ovirt-engine has been tagged (ovirt-engine-4.2.7)
by Tal Nisan 17 Sep '18

17 Sep '18

1 0

[CQ Failure Report] [oVirt Master - ovirt-engine] [16/9/18] [basic-suite.el7.x86_64]
by Ehud Yonasi 17 Sep '18

17 Sep '18

Hey everyone, We have a failure in CQ on the test of verify_add_hosts. Link to error: https://pastebin.com/Bwqn19Pn Link to the CQ job: http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change…

2 1

vdsm has been tagged (v4.20.40)
by Milan Zamazal 17 Sep '18

17 Sep '18

Vdsm 4.20.40 for oVirt 4.2.7 rc1

1 0

ovirt-imageio for s390x - seems to need 4k support
by Nir Soffer 14 Sep '18

14 Sep '18

I posted a patch[1] to add s390x build for ovirt-imageio, but the build reveal that direct I/O using 512 bytes alignment does not work on the test slave (or maybe this is a platform issue?). See failing tests: https://jenkins.ovirt.org/job/ovirt-imageio_standard-check-patch/414/consol… *00:05:34.273* [check-patch.fc28.s390x] func = <built-in method readinto of _io.FileIO object at 0x3ff850a2048>*00:05:34.273* [check-patch.fc28.s390x] args = (<mmap.mmap object at 0x3ff85238618>,)*00:05:34.273* [check-patch.fc28.s390x] e = IOError(22, 'Invalid argument') Increasing the default block size fixes these tests, but cause other test to fail, because the code is not ready for 4k yet: https://jenkins.ovirt.org/job/ovirt-imageio_standard-check-patch/415/consol… So adding s390x build requires more work. I open a bug[2] for this work. We should have 4k support in imageio in 4.3, but I'm not sure we will have time to work on this before that, unless someone else wants to contribute :-) [1] https://gerrit.ovirt.org/c/94095/ [2] https://bugzilla.redhat.com/1624963 Nir

2 1

[ACTION REQUIRED] ovirt-engine-nodejs update
by Greg Sheremeta 13 Sep '18

13 Sep '18

Hi, If you have a project that uses ovirt-engine-nodejs to build, would you please take a moment to test that it builds with the latest 8.x, 8.11.4? https://jenkins.ovirt.org/job/ovirt-engine-nodejs_master_check-patch-el7-x8… [We needed to update it for ovirt-web-ui because the latest patternfly requires node >= 8.9.] Best wishes, Greg -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com IRC: gshereme <https://red.ht/sig>

3 3

issue in vdsm monitoring
by Dafna Ron 13 Sep '18

13 Sep '18

Hi, I have been seeing random failures of tests in different projects caused by vdsm monitoring. I need someone from vdsm to please help debug this issue. From what I can see, the test suspend/resume vm failed because we could not query the status of the vm on the host. you can see full log from failed tests here: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10208/artifa… Here are the errors that I can see in the vdsm which seem to suggest that there is an issue getting stats on the vm which was suspended and caused the failure of the test: 2018-09-11 00:40:05,896-0400 INFO (monitor/c1fe6e6) [storage.StorageDomain] Removing remnants of deleted images [] (fileSD:734) 2018-09-11 00:40:07,957-0400 DEBUG (qgapoller/1) [vds] Not sending QEMU-GA command 'guest-get-users' to vm_id='8214433a-f233-4aaa-aeda-2ce1d31c78dc', command is not supported (qemuguestagent:192) 2018-09-11 00:40:08,068-0400 DEBUG (periodic/3) [virt.sampling.VMBulkstatsMonitor] sampled timestamp 4296118.49 elapsed 0.010 acquired True domains all (sampling:443) 2018-09-11 00:40:08,271-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Calling 'Image.prepare' in bridge with {u'allowIllegal': True, u'storagepoolID': u'e80a56d9-74da-498a-b010-4a9df287f11d', u'imageID': u'd4c831e6-02d2-4d89-b516-0ec4597 5e024', u'volumeID': u'15b07af1-625b-42e3-b62a-8e7c7a120a56', u'storagedomainID': u'f1744940-41b6-4d35-b7bf-870c4e07d995'} (__init__:329) 2018-09-11 00:40:10,846-0400 DEBUG (vmchannels) [virt.vm] (vmId='8214433a-f233-4aaa-aeda-2ce1d31c78dc') Guest connection timed out (guestagent:556) 2018-09-11 00:40:11,637-0400 DEBUG (jsonrpc/5) [jsonrpc.JsonRpcServer] Calling 'Host.getStats' in bridge with {} (__init__:329) 2018-09-11 00:40:11,637-0400 INFO (jsonrpc/5) [api.host] START getStats() from=::ffff:192.168.201.4,49184 (api:47) 2018-09-11 00:40:11,643-0400 DEBUG (jsonrpc/5) [root] cannot read eth0 speed (nic:42) 2018-09-11 00:40:11,645-0400 DEBUG (jsonrpc/5) [root] cannot read eth1 speed (nic:42) 2018-09-11 00:40:11,647-0400 DEBUG (jsonrpc/5) [root] cannot read eth2 speed (nic:42) 2018-09-11 00:40:11,649-0400 DEBUG (jsonrpc/5) [root] cannot read eth3 speed (nic:42) 2018-09-11 00:40:11,667-0400 INFO (jsonrpc/5) [api.host] FINISH getStats error=[Errno 22] Invalid argument from=::ffff:192.168.201.4,49184 (api:51) 2018-09-11 00:40:11,667-0400 ERROR (jsonrpc/5) [jsonrpc.JsonRpcServer] Internal server error (__init__:350) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 345, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 202, in _dynamicMethod result = fn(*methodArgs) File "<string>", line 2, in getStats File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 49, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1407, in getStats multipath=True)} File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 49, in get_stats decStats = stats.produce(first_sample, last_sample) File "/usr/lib/python2.7/site-packages/vdsm/host/stats.py", line 71, in produce stats.update(get_interfaces_stats()) File "/usr/lib/python2.7/site-packages/vdsm/host/stats.py", line 153, in get_interfaces_stats return net_api.network_stats() File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 63, in network_stats return netstats.report() File "/usr/lib/python2.7/site-packages/vdsm/network/netstats.py", line 31, in report stats = link_stats.report() File "/usr/lib/python2.7/site-packages/vdsm/network/link/stats.py", line 41, in report speed = vlan.speed(i.device) File "/usr/lib/python2.7/site-packages/vdsm/network/link/vlan.py", line 36, in speed dev_speed = nic.read_speed_using_sysfs(dev_name) File "/usr/lib/python2.7/site-packages/vdsm/network/link/nic.py", line 48, in read_speed_using_sysfs s = int(f.read()) IOError: [Errno 22] Invalid argument 2018-09-11 00:40:11,669-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats failed (error -32603) in 0.03 seconds (__init__:312) 2018-09-11 00:40:14,656-0400 DEBUG (jsonrpc/2) [jsonrpc.JsonRpcServer] Calling 'Host.getAllVmStats' in bridge with {} (__init__:329) 2018-09-11 00:40:14,657-0400 INFO (jsonrpc/2) [api.host] START getAllVmStats() from=::1,46772 (api:47) 2018-09-11 00:40:14,659-0400 INFO (jsonrpc/2) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,46772 (api:53) 2018-09-11 00:40:14,660-0400 DEBUG (jsonrpc/2) [jsonrpc.JsonRpcServer] Return 'Host.getAllVmStats' in bridge with (suppressed) (__init__:356) 2018-09-11 00:40:14,661-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312) 2018-09-11 00:40:14,674-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Calling 'Host.getAllVmIoTunePolicies' in bridge with {} (__init__:329) 2018-09-11 00:40:14,675-0400 INFO (jsonrpc/1) [api.host] START getAllVmIoTunePolicies() from=::1,46772 (api:47) 2018-09-11 00:40:14,675-0400 INFO (jsonrpc/1) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'8214433a-f233-4aaa-aeda-2ce1d31c78dc': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': '/rhev/data-center/mnt/blockSD/f1744940-41b6-4d35-b7bf-870c4e07d995/images/9a3659dc-339e-4b3f-a1d1-6ee3debb6168/e2570635-a798-4e9e-a0ea-88436d5b296f', 'name': 'vda'}]}}} from=::1,46772 (api:53) 2018-09-11 00:40:14,675-0400 DEBUG (jsonrpc/1) [jsonrpc.JsonRpcServer] Return 'Host.getAllVmIoTunePolicies' in bridge with {'8214433a-f233-4aaa-aeda-2ce1d31c78dc': {'policy': [], 'current_values': [{'ioTune': {'write_bytes_sec': 0L, 'total_iops_sec': 0L, 'read_iops_sec': 0L, 'read_bytes_sec': 0L, 'write_iops_sec': 0L, 'total_bytes_sec': 0L}, 'path': '/rhev/data-center/mnt/blockSD/f1744940-41b6-4d35-b7bf-870c4e07d995/images/9a3659dc-339e-4b3f-a1d1-6ee3debb6168/e2570635-a798-4e9e-a0ea-88436d5b296f', 'name': 'vda'}]}} (__init__:356) 2018-09-11 00:40:14,675-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312) 2018-09-11 00:40:16,118-0400 DEBUG (jsonrpc/7) [jsonrpc.JsonRpcServer] Calling 'Host.getAllVmStats' in bridge with {} (__init__:329) 2018-09-11 00:40:16,119-0400 INFO (jsonrpc/7) [api.host] START getAllVmStats() from=::ffff:192.168.201.4,49184 (api:47) 2018-09-11 00:40:16,121-0400 INFO (jsonrpc/7) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::ffff:192.168.201.4,49184 (api:53) 2018-09-11 00:40:16,122-0400 DEBUG (jsonrpc/7) [jsonrpc.JsonRpcServer] Return 'Host.getAllVmStats' in bridge with (suppressed) (__init__:356) 2018-09-11 00:40:16,122-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:312) 2018-09-11 00:40:17,956-0400 DEBUG (qgapoller/2) [vds] Not sending QEMU-GA command 'guest-get-users' to vm_id='8214433a-f233-4aaa-aeda-2ce1d31c78dc', command is not supported (qemuguestagent:192) 2018-09-11 00:40:18,025-0400 DEBUG (periodic/3) [virt.periodic] Looking for stale paused VMs (periodic:388) I can also see this in Super vdsm which may be related but I an not 100% sure its related to current issue: MainProcess|jsonrpc/2::DEBUG::2018-09-11 00:33:20,012::cmdutils::159::root::(exec_cmd) SUCCESS: <err> = ''; <rc> = 0 ifup/on039d2d88d8ee4::DEBUG::2018-09-11 00:33:20,238::cmdutils::159::root::(exec_cmd) FAILED: <err> = 'Running scope as unit 2f1f417d-85b9-46c0-b7d7-6082836daaae.scope.\n/etc/sysconfig/network-scripts/ifup-eth: line 321: 20715 Terminated /sbin/dhclient ${DHCLIENTARGS} ${DEVICE}\nDevice "on039d2d88d8ee4" does not exist.\nCannot find device "on039d2d88d8ee4"\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d 8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevic e "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d 8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevic e "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d 8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevic e "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\nDevice "on039d2d88d8ee4" does not exist.\n'; <rc> = 1 ifup/on039d2d88d8ee4::ERROR::2018-09-11 00:33:20,238::concurrent::202::root::(run) FINISH thread <Thread(ifup/on039d2d88d8ee4, stopped daemon 140281550731008)> failed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/concurrent.py", line 195, in run ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 948, in _exec_ifup _exec_ifup_by_name(iface.name, cgroup) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 934, in _exec_ifup_by_name raise ConfigNetworkError(ERR_FAILED_IFUP, out[-1] if out else '') ConfigNetworkError: (29, '\n') thanks, Dafna

3 12

[ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [ 11-09-2018 ] [ 002_bootstrap.add_cluster ]
by Dafna Ron 13 Sep '18

13 Sep '18

Hi, we have failures on both upgrade and basic suites for master. The patch reported as cause is: https://gerrit.ovirt.org/#/c/93345/10 - engine : Add finer grained monitoring thresholds for memory consumption on Hypervisors Ravi, can you please check this issue? You can see the logs here: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10187/artifa… Here is the error: 2018-09-11 02:08:44,511-04 WARN [org.ovirt.engine.core.bll.AddClusterCommand] (default task-2) [1362d97c-9d55-40d2-9b03-ebe93ae2fe67] Validation of action 'AddCluster' failed for user admin@internal-authz. Reasons: VAR__TYPE__CLUSTER,VAR __ACTION__CREATE,must be greater than or equal to 1,$groups [Ljava.lang.Class;@29a040fc,$message {javax.validation.constraints.Min.message},$payload [Ljava.lang.Class;@64094510,$value 1,ACTION_TYPE_FAILED_ATTRIBUTE_PATH,$path cluster.logM axMemoryUsedThreshold,$validatedValue 0 2018-09-11 02:08:44,511-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-2) [1362d97c-9d55-40d2-9b03-ebe93ae2fe67] method: runAction, params: [AddCluster, ManagementNetworkOnClusterOperationPara meters:{commandId='e5eb6cf6-4e3d-4f50-be6a-9fe18bfc4d97', user='null', commandType='Unknown'}], timeElapsed: 56ms 2018-09-11 02:08:44,516-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-2) [] Operation Failed: [must be greater than or equal to 1, Attribute: cluster.logMaxMemoryUsedThreshold] 2018-09-11 02:08:44,533-04 DEBUG [org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter] (default task-2) [] Entered SsoRestApiAuthFilter Thanks, Dafna

3 12

Issue in host deploy
by Ravi Shankar Nori 12 Sep '18

12 Sep '18

Hi, Host deploy is failing on master with errors. The issue seems to be that the opcode that is returned from vdsm has Unicode null characters in it (obtained using a break point in VdsDeploy.userVisibleLog). "Failed to execute stage 'Initializing': Invalid response opcode '\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000CONFIRM'" Resulting in below errors when the message is inserted into database. Can someone take a look 2018-09-11 13:38:11,121-04 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [669a0081] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host 192.168.122.57. Stage: Initializing. 2018-09-11 13:38:39,231-04 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (VdsDeploy) [669a0081] transaction rolled back 2018-09-11 13:38:39,231-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [669a0081] Error during deploy dialog 2018-09-11 13:38:39,246-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-11) [669a0081] Error during host 192.168.122.57 install 2018-09-11 13:38:41,791-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-11) [669a0081] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host 192.168.122.57: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte sequence for encoding "UTF8": 0x00.

2 3

[ OST Failure Report ] [ oVirt Master (ovirt-ansible-manageiq) ] [ 11-09-2018 ] [ metrics_bootstrap.metrics_and_log_collector ]
by Dafna Ron 11 Sep '18

11 Sep '18

Hi, we have a failure in basic suite for test metrics_bootstrap.metrics_and_log_collector. We failed to configure the hosts for metrics collection which causes failure in the test. The change that is reported as cause of failure is: https://github.com/oVirt/ovirt-ansible-manageiq/commit/ 6697fc98f934beb9fece6d0224c0b013411b84e6 You can see the full logs here: https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3078/artifact/b… error: PLAY RECAP ********************************************************************* lago-basic-suite-4-2-host-0 : ok=1 changed=0 unreachable=0 failed=1 lago-basic-suite-4-2-host-1 : ok=1 changed=0 unreachable=0 failed=1 localhost : ok=53 changed=24 unreachable=0 failed=0 2018-09-11 09:06:18,713::ssh.py::ssh::96::lago.ssh::DEBUG::Command d69e71be on lago-basic-suite-4-2-engine errors: [WARNING]: Could not match supplied host pattern, ignoring: metrics_store 2018-09-11 09:06:18,713::utils.py::_ret_via_queue::60::lago.utils::ERROR::Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/home/jenkins/workspace/ovirt-4.2_change-queue-tester/ovirt-system-tests/basic-suite-4.2/test-scenarios/003_00_metrics_bootstrap.py", line 54, in configure_metrics ' Exit code is %s' % result.code File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) AssertionError: Configuring ovirt machines for metrics failed. Exit code is 2 2018-09-11 09:06:38,897::ssh.py::ssh::81::lago.ssh::DEBUG::Command d648c70a on lago-basic-suite-4-2-engine returned with 0 2018-09-11 09:06:38,897::ssh.py::ssh::89::lago.ssh::DEBUG::Command d648c70a on lago-basic-suite-4-2-engine output: This command will collect system configuration and diagnostic information from this system.

2 1

failure in ost test - Invalid argument - help in debugging issue
by Dafna Ron 11 Sep '18

11 Sep '18

Hi, can someone please have a look at this ost failure? it is not related to the change that failed and I think its probably a race. you can find the logs here: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10175/artifa… The error I can see is this: https://pastebin.com/pm6x0W62 Thanks, Dafna

3 2

vdsm has been tagged (v4.20.39.1)
by Francesco Romani 07 Sep '18

07 Sep '18

Vdsm 4.20.39.1 for oVirt 4.2.6 (async) sub-branch ovirt-4.2.6 created -- Francesco Romani (@fromanirh)

1 0

[OST failure] Basic suite for 4.2 failing with "Error: Package: ovirt-imageio-daemon"
by Ales Musil 05 Sep '18

05 Sep '18

Hello, the OST CI is failing for patch [1] with: + yum -y install ovirt-host Error: Package: ovirt-imageio-daemon-1.4.2-0.201807122005.gitae0c56d.el7.noarch (alocalsync) Requires: ovirt-imageio-common = 1.4.2 Available: ovirt-imageio-common-1.4.2-0.201807122005.gitae0c56d.el7.noarch (alocalsync) ovirt-imageio-common = 1.4.2-0.201807122005.gitae0c56d.el7 Installing: ovirt-imageio-common-1.4.4-0.el7.x86_64 (alocalsync) ovirt-imageio-common = 1.4.4-0.el7 Full log [2]. Any idea what could be possibly wrong? As the patch shouldn't be related to imageio rpm. Thank you. Best regards, Ales Musil [1] https://gerrit.ovirt.org/c/93978/ [2] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1791/… -- ALES MUSIL Associate Software Engineer - rhv network Red Hat EMEA <https://www.redhat.com/> amusil(a)redhat.com IM: amusil <https://red.ht/sig>

3 4

Fwd: [rhev-devel] Error Message in HE master suite: "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM ....
by Ehud Yonasi 04 Sep '18

04 Sep '18

Hey, I see failures on hosted-engine and when i was looking at the build-artifacts jobs of he-setup: http://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_master_build-artifac… I can see a lot of triggering of old patches, so as far as i understand you restored that repository. Is the error below is the root cause of that recovery? Would appreciate a quick answer because we need to merge a patch to fix CQ failures because of that. Thanks in advance! Ehud Yonasi. ---------- Forwarded message --------- From: Yaniv Kaul <ykaul(a)redhat.com> Date: Tue, Sep 4, 2018 at 10:03 AM Subject: Re: [rhev-devel] Error Message in HE master suite: "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM .... To: Galit Rosenthal <grosenth(a)redhat.com> Cc: rhev-devel <rhev-devel(a)redhat.com> Well, looking at engine.log[1], there's NPE around: ERROR [org.ovirt.engine.core.vdsbroker.monitoring.FullListAdapter] (EE-ManagedThreadFactory-engineScheduled-Thread-74) [57b53db9] Failed during parsing configuration of VM b9c1bf34-c42f-4999-97d4-8d4895826abd (<domain type='kvm' id='1'> <name>HostedEngine</name> ... </domain> ), error is: {}: java.lang.NullPointerException at org.ovirt.engine.core.vdsbroker.libvirt.VmConverter.extractCoreGeneralInfo(VmConverter.java:47) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.libvirt.VmConverter.convert(VmConverter.java:36) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.monitoring.FullListAdapter.extractCoreInfo(FullListAdapter.java:86) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.monitoring.FullListAdapter.lambda$dumpXmls$0(FullListAdapter.java:54) [vdsbroker.jar:] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_181] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_181] Y. [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… On Tue, Sep 4, 2018 at 9:21 AM, Galit Rosenthal <grosenth(a)redhat.com> wrote: > > Hi, > > This is an example of a he basic suite master that fails on : > > Error Message: > > *00:26:36* Error while running thread > > *00:26:36* Traceback (most recent call last): > > *00:26:36* File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue > > *00:26:36* queue.put({'return': func()}) > > *00:26:36* File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4 > > *00:26:36* deploy_hosted_engine=True, > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add > > *00:26:36* return self._internal_add(host, headers, query, wait) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add > > *00:26:36* return future.wait() if wait else future > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait > > *00:26:36* return self._code(response) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback > > *00:26:36* self._check_fault(response) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault > > *00:26:36* self._raise_error(response, body) > > *00:26:36* File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error > > *00:26:36* raise error > > *00:26:36* Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409. > > > > https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… > > Who can help me with this issue? > > Thanks, > Galit > > -- > > GALIT ROSENTHAL > > SOFTWARE ENGINEER > > Red Hat > > <https://www.redhat.com/> > > galit(a)gmail.com T: 972-9-7692230 > <https://red.ht/sig> >

2 6

Failing OST Suites
by Anton Marchukov 04 Sep '18

04 Sep '18

Hello All. This is a reminder to corresponding maintainers to check the OST suits [1], there are failing ones such as: ovirt-system-tests_ansible-suite-master ovirt-system-tests_compat-3.6-suite-master ovirt-system-tests_compat-4.0-suite-master ovirt-system-tests_compat-4.1-suite-master ovirt-system-tests_compat-4.2-suite-master ovirt-system-tests_hc-basic-suite-4.2 ovirt-system-tests_he-node-ng-suite-master If everything is not needed we might also consider disabling/deleting. Thanks. [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/

3 4