- Infra - oVirt List Archives

[JIRA] (OVIRT-2202) 006_migrations.prepare_migration_attachments_ipv4 for ovirt-engine-dashboard
by Dafna Ron (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2202?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2202: ---------------------------------- Greg said that its 100% not related to his patch. I will ask someone at virt to take a look and mark this as race since it does not seem to be repeating. > 006_migrations.prepare_migration_attachments_ipv4 for ovirt-engine-dashboard > ---------------------------------------------------------------------------- > > Key: OVIRT-2202 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2202 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_code_regression, ost_failures, ost_race > > There was a failed test 006_migrations.prepare_migration_attachments_ipv4 > Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML > Build: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8208/ > patch reported: https://gerrit.ovirt.org/#/c/92238/1 - add resolutions section to force jquery and bootstrap versions > The actual error is: Unable to process messages Broken pipe: java.io.IOException: Broken pipe > this would be the error in vdsm: > '2018-06-14 04:05:34,698-0400 ERROR (jsonrpc/5) [vds] connectivity check failed (API:1537) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1534, in setupNetworks > supervdsm.getProxy().setupNetworks(networks, bondings, options) > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 56, in __call__ > return callMethod() > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 54, in <lambda> > **kwargs) > File "<string>", line 2, in setupNetworks > File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in _callmethod > raise convert_to_error(kind, result) > ConfigNetworkError: (10, 'connectivity check failed') > 2018-06-14 04:05:34,699-0400 INFO (jsonrpc/5) [api.network] FINISH setupNetworks return={'status': {'message': 'connectivity check failed', 'code': 10}} from=::ffff:192.168.201.4,50952 (api:53) > 2018-06-14 04:05:34,699-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.setupNetworks failed (error 10) in 127.20 seconds (__init__:311)' > The patch may be related so I will as Greg to take a look -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[JIRA] (OVIRT-2202) 006_migrations.prepare_migration_attachments_ipv4 for ovirt-engine-dashboard
by Dafna Ron (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2202?page=com.atlassian.jira.… ] Dafna Ron updated OVIRT-2202: ----------------------------- Labels: ost_code_regression ost_failures ost_race (was: ost_code_regression ost_failures) > 006_migrations.prepare_migration_attachments_ipv4 for ovirt-engine-dashboard > ---------------------------------------------------------------------------- > > Key: OVIRT-2202 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2202 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_code_regression, ost_failures, ost_race > > There was a failed test 006_migrations.prepare_migration_attachments_ipv4 > Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML > Build: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8208/ > patch reported: https://gerrit.ovirt.org/#/c/92238/1 - add resolutions section to force jquery and bootstrap versions > The actual error is: Unable to process messages Broken pipe: java.io.IOException: Broken pipe > this would be the error in vdsm: > '2018-06-14 04:05:34,698-0400 ERROR (jsonrpc/5) [vds] connectivity check failed (API:1537) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1534, in setupNetworks > supervdsm.getProxy().setupNetworks(networks, bondings, options) > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 56, in __call__ > return callMethod() > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 54, in <lambda> > **kwargs) > File "<string>", line 2, in setupNetworks > File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in _callmethod > raise convert_to_error(kind, result) > ConfigNetworkError: (10, 'connectivity check failed') > 2018-06-14 04:05:34,699-0400 INFO (jsonrpc/5) [api.network] FINISH setupNetworks return={'status': {'message': 'connectivity check failed', 'code': 10}} from=::ffff:192.168.201.4,50952 (api:53) > 2018-06-14 04:05:34,699-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.setupNetworks failed (error 10) in 127.20 seconds (__init__:311)' > The patch may be related so I will as Greg to take a look -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[JIRA] (OVIRT-2203) failure in update host caused patch to fail
by Dafna Ron (oVirt JIRA) 14 Jun '18

14 Jun '18

Dafna Ron created OVIRT-2203: -------------------------------- Summary: failure in update host caused patch to fail Key: OVIRT-2203 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2203 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: infra The patch failed due to failure to update the host: '2018-06-14 08:25:38,754-04 ERROR [org.ovirt.engine.core.bll.host.HostUpgradeManager] (EE-ManagedThreadFactory-commandCoordinator-Thread-1) [cb22fd71-b94d-4567-a8e4-78238868d2de] Failed to run check-update of host 'lago-basic-suite-master- host-0'' I can see that the upgrade suite also failed for not seeing repos The next metrics build succeeded successfully so there is no need to do anything I cannot be sure but I think its probably a network glitch or jenkins issue which happened during the test run. here is the info from the mail: Change 92195,2 (ovirt-engine-metrics) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/92195/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8213/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[JIRA] (OVIRT-2202) 006_migrations.prepare_migration_attachments_ipv4 for ovirt-engine-dashboard
by Dafna Ron (oVirt JIRA) 14 Jun '18

14 Jun '18

Dafna Ron created OVIRT-2202: -------------------------------- Summary: 006_migrations.prepare_migration_attachments_ipv4 for ovirt-engine-dashboard Key: OVIRT-2202 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2202 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: infra There was a failed test 006_migrations.prepare_migration_attachments_ipv4 Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML Build: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8208/ patch reported: https://gerrit.ovirt.org/#/c/92238/1 - add resolutions section to force jquery and bootstrap versions The actual error is: Unable to process messages Broken pipe: java.io.IOException: Broken pipe this would be the error in vdsm: '2018-06-14 04:05:34,698-0400 ERROR (jsonrpc/5) [vds] connectivity check failed (API:1537) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1534, in setupNetworks supervdsm.getProxy().setupNetworks(networks, bondings, options) File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 56, in __call__ return callMethod() File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 54, in <lambda> **kwargs) File "<string>", line 2, in setupNetworks File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in _callmethod raise convert_to_error(kind, result) ConfigNetworkError: (10, 'connectivity check failed') 2018-06-14 04:05:34,699-0400 INFO (jsonrpc/5) [api.network] FINISH setupNetworks return={'status': {'message': 'connectivity check failed', 'code': 10}} from=::ffff:192.168.201.4,50952 (api:53) 2018-06-14 04:05:34,699-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.setupNetworks failed (error 10) in 127.20 seconds (__init__:311)' The patch may be related so I will as Greg to take a look -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 478 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Jun '18

14 Jun '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/478/ Build Number: 478 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #477 [Andrej Krejcir] HE: Test restarting HE VM Changes for Build #478 [Andrej Krejcir] HE: Test restarting HE VM ----------------- Failed Tests: ----------------- No tests ran.

1 2

[CQ]: 92195, 2 (ovirt-engine-metrics) failed "ovirt-master" system tests
by oVirt Jenkins 14 Jun '18

14 Jun '18

Change 92195,2 (ovirt-engine-metrics) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/92195/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8213/

1 0

[JIRA] (OVIRT-2201) [regression] STDCI v2 doesn't distinguish jobs for different branches
by Barak Korren (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2201?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2201: ------------------------------------- Pasting IRC transcript of me trying to understand the user story behind this {code} <sbonazzo> bkorren: maybe there are better ways, but to me this is a regression that complicates my work experience and make me rethink about the switch to v2 <bkorren> sbonazzo, my point is, that v2 gave you certain ways to do things; but we shouldn't fixate on those, if we can examine the use case and figure out ways to deliver what you really need in a more convenient way <sbonazzo> bkorren: I need an end point in jenkins pointing me to latest successfull build per branch per project * ena has quit (Ping timeout: 622 seconds) <bkorren> sbonazzo, must it be in jenkins? if I put it in resources for example? <bkorren> sbonazzo, does it need to be the build with logs , etc, or just the artifacts? <sbonazzo> bkorren: resources may be ok too. artifacts only may be ok too, including yum repodata directory <sbonazzo> bkorren: but that will make difficult to correlate the artifact to the job <bkorren> sbonazzo, another question - will an HTML page with links be enough, or would you need predictable URLs? <bkorren> sbonazzo, that begs the question about why do you need to correlate the artifact with the job? is the job just a way to get at the patch? or do you need the build logs? <sbonazzo> bkorren: predictable urls would work far better for me. about correlation, it may be needed in the only case latest successful build results older than the packages in testing, requiring an inspection on what happened <bkorren> sbonazzo, I wonder about the root cause for all these requirements, is there a certain work process here we can revisit and modify so it becomes less labor intensive and requires less data gathering and manual correlation? <bkorren> sbonazzo, in other words - is there a way to "short-circuit" these requirements and make a system that will just deliver the end result you need instead of parts you need to gather manually? <sbonazzo> bkorren: there are cases when you merge a patch and the build keeps hanging in change queue for months before landing to tested due to some reason. I want to be aware of this happening in a shorter loop so i want to check that latest build lands in tested within the day. <sbonazzo> bkorren: I also would like to be able to have a quick look to a page (up to now it was a jenkins view) showing me that master was failing while 4.2 was fine and not the other way around <bkorren> sbonazzo, again if the point is to know what landed in 'tested' when - I'll just find one or more ways to deliver that exact info back to gerrit. <bkorren> sbonazzo, when you say 'master failing' here you mean builds for master branch of a certain project, if patches from master branch of said project are passing CQ/OST or if 'ovirt master' is OK from an OST POV? <sbonazzo> bkorren: a master jenkins job failing for a certain project. not sure you can see it, but have a look at: https://jenkins.ovirt.org/user/sbonazzo/my-views/view/Failing%20by%20releas… <bkorren> sbonazzo, what is the purpose of gathering this information? I see a whole mix of things - check patch mixed with build artifats and with check merged... <sbonazzo> bkorren: getting an insight on what's failing per target <sbonazzo> bkorren: since we are not gating the builds on check-merged I need to know if we built something which is not passing check-merged <bkorren> sbonazzo, adding gatting on check-merged to CQ would be quite a low hanging fruit from me if it means you can spend less time monitoring things manually... <bkorren> sbonazzo, I gate on build-artifacts already, actually now that I think of it - v2 already gives me that... <sbonazzo> bkorren: gating will help indeed :-) not sure how RDO managed to do it on their automation, but I really like zuul <bkorren> sbonazzo, I liked zool, until I fugure how rigid was it <bkorren> sbonazzo, but I think we're talking about different things - there is pre-merge gating and post-merge gating <bkorren> sbonazzo, pre-merge gating is VERY expensive to accomplish, and while CQ was designed with that in mind - I don't think its likely we'll go there at this point; but is we say that what you want to know is that a package or a patch that reached 'testing' had passed check-merged, then as I said, we already do that in V2. * sbonazzo is now known as sbonazzo|mtg <bkorren> sbonazzo, the issue with zuul is that it just assumes infinite hardware or very cheap tests... <sbonazzo|mtg> bkorren: so all v2 built packages landing in tested are certified passing check-merged? <bkorren> sbonazzo|mtg, yes. this is a side-effect of both check-merged and build-artifacts running within the same job as opposed to different jobs; I'm surprised this did not occur to me or I would've listed it as a benefit somewhere... :) <sbonazzo|mtg> bkorren: :-D {code} > [regression] STDCI v2 doesn't distinguish jobs for different branches > --------------------------------------------------------------------- > > Key: OVIRT-2201 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2201 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > In V1 we had jobs with different name based on branches they were building. > In V2 we have single job building all branches. > As an example for imgbased: > https://jenkins.ovirt.org/job/imgbased_standard-on-merge/lastSuccessfulBuil… > will contain randomly 4.2 or master builds. > This won't allow to filter jenkins to see which branches are failing to > build, forcing developers to check manually. > This also won't allow to check if latest build landed in tested repo > because thee build may be targeted to a different branch than the one under > check. > To me this is a regression that will make me rethink about the switching to > v2 and considering reverting to v1. > -- > SANDRO BONAZZOLA > ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[JIRA] (OVIRT-2201) [regression] STDCI v2 doesn't distinguish jobs for different branches
by sbonazzo (oVirt JIRA) 14 Jun '18

14 Jun '18

sbonazzo created OVIRT-2201: ------------------------------- Summary: [regression] STDCI v2 doesn't distinguish jobs for different branches Key: OVIRT-2201 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2201 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra In V1 we had jobs with different name based on branches they were building. In V2 we have single job building all branches. As an example for imgbased: https://jenkins.ovirt.org/job/imgbased_standard-on-merge/lastSuccessfulBuil… will contain randomly 4.2 or master builds. This won't allow to filter jenkins to see which branches are failing to build, forcing developers to check manually. This also won't allow to check if latest build landed in tested repo because thee build may be targeted to a different branch than the one under check. To me this is a regression that will make me rethink about the switching to v2 and considering reverting to v1. -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 68 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Jun '18

14 Jun '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/68/ Build Number: 68 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #68 [Gal Ben Haim] 4.2: Backport tests from master [Barak Korren] Fix mock_cleanup.sh trying to umount bad things [Barak Korren] Switch fabric-ovirt to STDCI v2 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_he_hosts Error Message: Adding HE hosts requires API v4. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-master/ovirt-system-tests/he-node-ng-suite-master/test-scenarios/002_bootstrap.py", line 360, in add_he_hosts raise RuntimeError('Adding HE hosts requires API v4.') RuntimeError: Adding HE hosts requires API v4.

1 32

[JIRA] (OVIRT-2055) failure in suspend resume vm not related to reported change - need to investigate
by Dafna Ron (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2055?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2055: ---------------------------------- I have another build that failed. https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8204/ I can see that vdsm log on node1 reports: 2018-06-14 00:39:22,368-0400 WARN (qgapoller/0) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fbd68314f50> on ['1c0ed9a0-3430-45fa-8b1e-dd535356e620'] (periodic:289) I am not seeing an actual issue and I will ask someone from virt team look at the logs. > failure in suspend resume vm not related to reported change - need to investigate > --------------------------------------------------------------------------------- > > Key: OVIRT-2055 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2055 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > Change 91507,1 (ovirt-engine-sdk-java) is probably the reason behind recent > system test failures in the "ovirt-master" change queue and needs to be fixed. > This change had been removed from the testing queue. Artifacts build from this > change will not be released until it is fixed. > For further details about the change see: > https://gerrit.ovirt.org/#/c/91507/1 > For failed test results see: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7721/ > I think the issue is on qemu/libvirt changed queries: > https://pastebin.com/afyeUAcT > https://pastebin.com/va20Y5Hp > checking his with vdsm people. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0