- Infra - oVirt List Archives

[JIRA] (OVIRT-610) Engine 4.0 build is failing
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-610?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-610: -------------------------------------------- I still see failures on some of the builds with similar symptoms: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-4.0_el7_merged/2… [~ngoldin(a)redhat.com] could some Jenkins plugin be causing these issues? I'm not very familiar with Jenkins, but maybe something got updated and was triggered by yesterdays reboot of the Jenkins VM. > Engine 4.0 build is failing > --------------------------- > > Key: OVIRT-610 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-610 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Piotr Kliczewski > Assignee: infra > > Please take a look at [1]. > [1] > http://jenkins.ovirt.org/job/ovirt-engine_4.0_check-merged-fc23-x86_64/193/… -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

2 1

[JIRA] (OVIRT-611) add SSD partitions to monitoring
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-611?page=com.atlassian.jira.p… ] Evgheni Dereveanchin updated OVIRT-611: --------------------------------------- Issue Type: Improvement (was: Bug) > add SSD partitions to monitoring > -------------------------------- > > Key: OVIRT-611 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-611 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: monitoring > Reporter: Evgheni Dereveanchin > Assignee: infra > Priority: Low > > SSDs are being attached to hypervisors for scratch disks. They are just 200GB in size each so can get full easy. We should monitor this in Nagios just as we do root partitions. The mountpoint is /var/lib/scratch and the list of machines is being updated in OVIRT-604 -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-611) add SSD partitions to monitoring
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

Evgheni Dereveanchin created OVIRT-611: ------------------------------------------ Summary: add SSD partitions to monitoring Key: OVIRT-611 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-611 Project: oVirt - virtualization made easy Issue Type: Bug Components: monitoring Reporter: Evgheni Dereveanchin Assignee: infra Priority: Low SSDs are being attached to hypervisors for scratch disks. They are just 200GB in size each so can get full easy. We should monitor this in Nagios just as we do root partitions. The mountpoint is /var/lib/scratch and the list of machines is being updated in OVIRT-604 -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[oVirt Jenkins] ovirt-engine_4.0_upgrade-from-4.0_el7_merged - Build # 201 - Failure!
by jenkins＠jenkins.phx.ovirt.org 24 Jun '16

24 Jun '16

------=_Part_7_1437181785.1466769124432 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-4.0_el7_merged/ Build: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-4.0_el7_merged/2… Build Number: 201 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59657 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_7_1437181785.1466769124432--

1 4

Engine build is failing due to infra issue
by Piotr Kliczewski 24 Jun '16

24 Jun '16

Can someone take a look at [1]? Thanks, Piotr [1] http://jenkins.ovirt.org/job/ovirt-engine_4.0_check-merged-fc23-x86_64/193/…

3 2

[JIRA] (OVIRT-610) Engine 4.0 build is failing
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-610?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-610: -------------------------------------------- There seems to have been some connectivity issue between Jenkins and its slaves between around 10:45 and 11:10 CET today and builds that started during that period failed immediately. I am still trying to identify the cause of this. I restarted the build and it succeeded: http://jenkins.ovirt.org/job/ovirt-engine_4.0_check-merged-fc23-x86_64/194/ > Engine 4.0 build is failing > --------------------------- > > Key: OVIRT-610 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-610 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Piotr Kliczewski > Assignee: infra > > Please take a look at [1]. > [1] > http://jenkins.ovirt.org/job/ovirt-engine_4.0_check-merged-fc23-x86_64/193/… -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[oVirt Jenkins] ovirt-engine_4.0_upgrade-from-3.6_el7_merged - Build # 195 - Failure!
by jenkins＠jenkins.phx.ovirt.org 24 Jun '16

24 Jun '16

------=_Part_21_758633336.1466771219385 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-3.6_el7_merged/ Build: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-3.6_el7_merged/1… Build Number: 195 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59657 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_21_758633336.1466771219385--

1 0

[JIRA] (OVIRT-610) Engine 4.0 build is failing
by Piotr Kliczewski (oVirt JIRA) 24 Jun '16

24 Jun '16

Piotr Kliczewski created OVIRT-610: -------------------------------------- Summary: Engine 4.0 build is failing Key: OVIRT-610 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-610 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Piotr Kliczewski Assignee: infra Please take a look at [1]. [1] http://jenkins.ovirt.org/job/ovirt-engine_4.0_check-merged-fc23-x86_64/193/… -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[oVirt Jenkins] ovirt-engine_4.0_upgrade-from-3.6_el7_merged - Build # 197 - Failure!
by jenkins＠jenkins.phx.ovirt.org 24 Jun '16

24 Jun '16

Project: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-3.6_el7_merged/ Build: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-3.6_el7_merged/1… Build Number: 197 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59615 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran.

1 1

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-609: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-609: -------------------------------------------- The memory dump file is 33498670080 bytes (32GB) in size. It took 11 minutes to copy it means the average speed was around 40 megabytes per second. As the logs show storage latency errors on other hosts during this time, it means the storage was overwhelmed again - just not by builds, but by this single consecutive write during snapshotting. Similar messages can be seen during snapshotting artifactory earlier the same day, but as that VM has less RAM it managed to dump RAM within 3 minutes and succeeded. > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-609: -------------------------------------------- Here are host logs. As suspected, I did not find any errors, the VM was suspended at 09:06:47 MST and resumed at 09:17:26 MST with Thread-7164775 returning successfully after copying 33498670080 bytes of RAM to the storage domain. {quote}Thread-7164775::DEBUG::2016-06-23 09:06:45,911::BindingXMLRPC::1133::vds::(wrapper) client [66.187.230.60]::call vmSnapshot with ('e7a7b735-0310-4f88-9ed9-4fed85835a01', [{'baseVolumeID': 'f37836c6-4bbe-4c8d-abf4-275cf461262e', 'domainID': 'ba023ff2-4e0e-4a32-86f3-923414206667', 'volumeID': '3b105e9b-53fe-4452-be71-2ac2182ecfec', 'imageID': '140adf46-fce4-4dba-980d-37d91416b12b'}], 'ba023ff2-4e0e-4a32-86f3-923414206667,00000002-0002-0002-0002-000000000150,2beb0ee6-b70b-4f48-bdd9-d89650383d61,daef68b9-5967-4047-9b17-1f55b68e5d8a,3580f2a1-a55a-47d0-9e67-627afbc0f2da,6c20093d-a5f3-407a-8986-ca26a488cb20') {} ... Thread-7164775::DEBUG::2016-06-23 09:06:47,459::vm::4432::vm.Vm::(snapshot) vmId=`e7a7b735-0310-4f88-9ed9-4fed85835a01`::<domainsnapshot> <disks> <disk name="vda" snapshot="external" type="file"> <source file="/rhev/data-center/00000002-0002-0002-0002-000000000150/ba023ff2-4e0e-4a32-86f3-923414206667/images/140adf46-fce4-4dba-980d-37d91416b12b/3b105e9b-53fe-4452-be71-2ac2182ecfec" type="file"/> </disk> </disks> <memory file="/rhev/data-center/00000002-0002-0002-0002-000000000150/ba023ff2-4e0e-4a32-86f3-923414206667/images/2beb0ee6-b70b-4f48-bdd9-d89650383d61/daef68b9-5967-4047-9b17-1f55b68e5d8a" snapshot="external"/> </domainsnapshot> ... libvirtEventLoop::DEBUG::2016-06-23 09:06:47,645::vm::5571::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`e7a7b735-0310-4f88-9ed9-4fed85835a01`::event Suspended detail 0 opaque None ... Thread-7164775::DEBUG::2016-06-23 09:17:26,338::outOfProcess::169::Storage.oop::(padToBlockSize) Truncating file /rhev/data-center/00000002-0002-0002-0002-000000000150/ba023ff2-4e0e-4a32-86f3-923414206667/images/2beb0ee6-b70 b-4f48-bdd9-d89650383d61/daef68b9-5967-4047-9b17-1f55b68e5d8a to 33498670080 bytes ... libvirtEventLoop::DEBUG::2016-06-23 09:17:26,317::vm::5571::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`e7a7b735-0310-4f88-9ed9-4fed85835a01`::event Resumed detail 0 opaque None ... Thread-7164775::DEBUG::2016-06-23 09:17:26,450::BindingXMLRPC::1140::vds::(wrapper) return vmSnapshot with {'status': {'message': 'Done', 'code': 0}, 'quiesce': False} {quote} On Engine the process timed out after 3 minutes and in reality it took 11 minutes. This suggests the snapshot is likely completely healthy, I'll take a sosreport from the host just in case we need to further investigate this, maybe [~landgraf] can check the logs for more clues. > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-609: -------------------------------------------- [~eedri] we're working on this with Anton in OVIRT-604 and so far the results are good. I'll prepare more hosts to make use of SSDs on them and we can proceed with Prod migration next week after deciding the safest way to do so. In any case, as the VM was already rebooted and came up, there should be no issues with the disk image chain. > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by eyal edri [Administrator] (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-609: ------------------------------------------------- I suggest to halt work on production dc until we move at least a few hypervisors to use the vdsm scratch pad hook for local disk and migrate thier vms to use it, so we'll see a significant improvement in storage performance before moving on with production dc. On Jun 24, 2016 11:01 AM, "Evgheni Dereveanchin (oVirt JIRA)" < jira(a)ovirt-jira.atlassian.net> wrote: [ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-609: -------------------------------------------- Here are some relevant messages from engine.log: {quote} grep 1394b752 /var/log/ovirt-engine/engine.log 2016-06-23 09:06:34,099 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-1) [1394b752] Lock Acquired to object EngineLock [exclusiveLocks= key: e7a7b735-0310-4f88-9ed9-4fed85835a01 value: VM 2016-06-23 09:06:35,708 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-15) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. 2016-06-23 09:09:46,038 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022) 2016-06-23 09:09:47,859 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022){quote} Looks like VDSM was slow to respond (probably due to storage slowness) while the snapshot is likely to have completed fine. I'll review host logs and share my findings. to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. for VM 'jenkins-phx-ovirt-org' was initiated by admin. 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004) _______________________________________________ Infra mailing list Infra(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/infra > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

Re: [JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Eyal Edri 24 Jun '16

24 Jun '16

I suggest to halt work on production dc until we move at least a few hypervisors to use the vdsm scratch pad hook for local disk and migrate thier vms to use it, so we'll see a significant improvement in storage performance before moving on with production dc. On Jun 24, 2016 11:01 AM, "Evgheni Dereveanchin (oVirt JIRA)" < jira(a)ovirt-jira.atlassian.net> wrote: [ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-609: -------------------------------------------- Here are some relevant messages from engine.log: {quote} grep 1394b752 /var/log/ovirt-engine/engine.log 2016-06-23 09:06:34,099 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-1) [1394b752] Lock Acquired to object EngineLock [exclusiveLocks= key: e7a7b735-0310-4f88-9ed9-4fed85835a01 value: VM 2016-06-23 09:06:35,708 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-15) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. 2016-06-23 09:09:46,038 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022) 2016-06-23 09:09:47,859 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022){quote} Looks like VDSM was slow to respond (probably due to storage slowness) while the snapshot is likely to have completed fine. I'll review host logs and share my findings. > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004) _______________________________________________ Infra mailing list Infra(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/infra

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-609: -------------------------------------------- Here are some relevant messages from engine.log: {quote} grep 1394b752 /var/log/ovirt-engine/engine.log 2016-06-23 09:06:34,099 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp--127.0.0.1-8702-1) [1394b752] Lock Acquired to object EngineLock [exclusiveLocks= key: e7a7b735-0310-4f88-9ed9-4fed85835a01 value: VM 2016-06-23 09:06:35,708 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-15) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. 2016-06-23 09:09:46,038 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022) 2016-06-23 09:09:47,859 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-14) Correlation ID: 1394b752, Job ID: a8fab0bf-d45e-46eb-8314-e22db8e6a3f4, Call Stack: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.util.concurrent.TimeoutException (Failed with error VDS_NETWORK_ERROR and code 5022){quote} Looks like VDSM was slow to respond (probably due to storage slowness) while the snapshot is likely to have completed fine. I'll review host logs and share my findings. > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-609?page=com.atlassian.jira.p… ] Evgheni Dereveanchin updated OVIRT-609: --------------------------------------- Description: [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} was: [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. 2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator. > Jenkins snapshot creation failed > -------------------------------- > > Key: OVIRT-609 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. > {quote}2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. > 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. > 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) > 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator.{quote} -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-609) Jenkins snapshot creation failed
by Evgheni Dereveanchin (oVirt JIRA) 24 Jun '16

24 Jun '16

Evgheni Dereveanchin created OVIRT-609: ------------------------------------------ Summary: Jenkins snapshot creation failed Key: OVIRT-609 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-609 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra [~ngoldin(a)redhat.com] issued a live snapshot creation on the Jenkins VM to prepare it for cluster move. This failed and it's not really clear why. Relevant event logs below, suggesting that the hypervisor started dumping VM memory to the snapshot which caused a storage slowdown. 2016-Jun-23, 18:06 Snapshot 'ngoldin_before_cluster_move' creation for VM 'jenkins-phx-ovirt-org' was initiated by admin. 2016-Jun-23, 18:09 Failed to create live snapshot 'ngoldin_before_cluster_move' for VM 'jenkins-phx-ovirt-org'. VM restart is recommended. Note that using the created snapshot might cause data inconsistency. 2016-Jun-23, 18:13 Host ovirt-srv02 has network interface which exceeded the defined threshold [95%] (em1: transmit rate[100%], receive rate [0%]) 2016-Jun-23, 18:13 Storage domain Production experienced a high latency of 18.7802 seconds from host ovirt-srv11. This may cause performance and functional issues. Please consult your Storage Administrator. -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

Migration of Jenkins VM to new Cluster failed
by Nadav Goldin 24 Jun '16

24 Jun '16

Hi Evgheni, Unfortunately migrating the Jenkins VM failed, to (my) luck its back running in the old Production cluster. so we could track this I am listing again the steps taken today: 1. around 18:00 TLV time, I triggered a snapshot of the VM. This not only failed but caused the Jenkins VM to be none-responsive for a few minutes. More distributing is that although in the 'event's in the engine it announced a failure, under 'snapshots' the new snapshot was listed under status 'ok'. this also caused few CI failures(which were re-triggered). 2. As snapshot seems like a no-option, I created a new VM in the production cluster jenkins-2.phx.ovirt.org, and downloaded the latest backup from backup.phx.ovirt.org, so in case of a failure we could change the DNS and use it(keep in mind this backup does not have any builds, only logs/configs) 3. I shut down the VM from the engine - it was hanging for a few minutes in 'shutting down' and then announced 'shutdown failed', which caused it to appear again in 'up' state but it was non responsive. virsh -r --list also stated it was up. 4. I triggered another shutdown, which succeeded. As I didn't want to risk it any more I let it boot in the same cluster, which was also successful. I've attached some parts of engine.log, from a quick look on vdsm.log I didn't see anything but could help if someone else have a look(this is ovirt-srv02). the relevant log times for the shut down failure are from '2016-06-23 16:15'. Either way until we find the problem, I'm not sure we should risk it before we have a proper recovery plan. One brute-force option is using rsync from jenkins.phx.ovirt.org:/var/lib/data/jenkins to jenkins-2, with jenkins daemon itself shut down on 'jenkins-2', then we could schedule a downtime on jenkins.phx.ovirt.org, wait that everything is synced, and stop jenkins(and puppet), then start jenkins daemon on jenkins-2 and change the DNS cname of jenkins.ovirt.org to point to it. if everything goes smooth it should run fine, and if not, we still have jenkins.phx.ovirt.org running. another option is to unmount /var/lib/data/ and mount it back to jenkins-2, though then we might be in trouble if something goes wrong on the way. Nadav.

1 0

[Attention] Jenkins maintenance today(24/06/2016 01:00 AM TLV)
by Nadav Goldin 24 Jun '16

24 Jun '16

Hi, As part of an infrastructure upgrade, in approximately one hour at 01:00 AM TLV, http://jenkins.ovirt.org will be shut down for maintenance, expected downtime is 15 minutes. Patches sent during the downtime will be checked afterwards, patches sent around 40 minutes prior to the downtime might not get checked. If patches you sent did not trigger CI, you can login after the downtime and re-trigger them manually. Thanks, Nadav.

1 1

[JIRA] (OVIRT-608) [URGENT] Half of the Jenkins slaves are offline
by Nadav Goldin (oVirt JIRA) 23 Jun '16

23 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-608?page=com.atlassian.jira.p… ] Nadav Goldin commented on OVIRT-608: ------------------------------------ quick check - all disconnected VMs were disconnected on purpose to reduce load. 22 VMs were disconnected in order to reduce load, most of them by [~dcaroest] last week, not sure how it was calculated. 2 BM slaves are offeline, most likely they lost their IP because of DHCP problem. > [URGENT] Half of the Jenkins slaves are offline > ----------------------------------------------- > > Key: OVIRT-608 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-608 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > Please check what happened, 24 jenkins slaves are down right now. > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-608) [URGENT] Half of the Jenkins slaves are offline
by Nadav Goldin (oVirt JIRA) 23 Jun '16

23 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-608?page=com.atlassian.jira.p… ] Nadav Goldin commented on OVIRT-608: ------------------------------------ During the evening I tried creating a snapshot of the Jenkins VM, which surprisingly caused the entire storage domain to slow down, the snapshot failed, and halted the Jenkins VM for a few minutes, I'll check if this might have disconnected more slaves than we intended. . > [URGENT] Half of the Jenkins slaves are offline > ----------------------------------------------- > > Key: OVIRT-608 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-608 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > Please check what happened, 24 jenkins slaves are down right now. > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-608) [URGENT] Half of the Jenkins slaves are offline
by eyal edri [Administrator] (oVirt JIRA) 23 Jun '16

23 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-608?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-608: ------------------------------------------------- Some of the slaves are offline for a reason. We have storage overload that can risk the stability of the entire DC, and until we won't move to use local disk storage we can't keep all the slaves running all the time. Having said that, if there something critical, we can start a few more vms to unlock a critical fix. On Jun 23, 2016 9:49 PM, "sbonazzo (oVirt JIRA)" < jira(a)ovirt-jira.atlassian.net> wrote: sbonazzo created OVIRT-608: ------------------------------ Summary: [URGENT] Half of the Jenkins slaves are offline Key: OVIRT-608 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-608 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra Please check what happened, 24 jenkins slaves are down right now. -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004) > [URGENT] Half of the Jenkins slaves are offline > ----------------------------------------------- > > Key: OVIRT-608 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-608 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > Please check what happened, 24 jenkins slaves are down right now. > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

Re: [JIRA] (OVIRT-608) [URGENT] Half of the Jenkins slaves are offline
by Eyal Edri 23 Jun '16

23 Jun '16

Some of the slaves are offline for a reason. We have storage overload that can risk the stability of the entire DC, and until we won't move to use local disk storage we can't keep all the slaves running all the time. Having said that, if there something critical, we can start a few more vms to unlock a critical fix. On Jun 23, 2016 9:49 PM, "sbonazzo (oVirt JIRA)" < jira(a)ovirt-jira.atlassian.net> wrote: sbonazzo created OVIRT-608: ------------------------------ Summary: [URGENT] Half of the Jenkins slaves are offline Key: OVIRT-608 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-608 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra Please check what happened, 24 jenkins slaves are down right now. -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004) _______________________________________________ Infra mailing list Infra(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/infra

1 0

[JIRA] (OVIRT-608) [URGENT] Half of the Jenkins slaves are offline
by sbonazzo (oVirt JIRA) 23 Jun '16

23 Jun '16

sbonazzo created OVIRT-608: ------------------------------ Summary: [URGENT] Half of the Jenkins slaves are offline Key: OVIRT-608 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-608 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra Please check what happened, 24 jenkins slaves are down right now. -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

planned restart of ci-templates-repo.phx.ovirt.org and glance.phx.ovirt.org
by Evgheni Dereveanchin 23 Jun '16

23 Jun '16

Hello everyone, I'll restart these two VMs to move them to the new oVirt cluster: ci-templates-repo.phx.ovirt.org glance.phx.ovirt.org The first VM is used by lago. If any jobs fail due to template unavailability please restart them. If you find any persisting issues please let me know. Regards, Evgheni Dereveanchin

1 0

[ANN] oVirt 4.0.0 Final Release is now available
by Sandro Bonazzola 23 Jun '16

23 Jun '16

The oVirt Project is pleased to announce today the general availability of oVirt 4.0.0. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO will be available soon. [4] * A new oVirt Next Generation Node will be available soon [4]. * A new oVirt Engine Appliance will be available soon. * A new oVirt Guest Tools ISO is already available [4]. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.0 release highlights: http://www.ovirt.org/release/4.0.0/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.0/ [4] http://resources.ovirt.org/pub/ovirt-4.0/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[JIRA] (OVIRT-607) sort out jobs which didn't move to std ci
by eyal edri [Administrator] (oVirt JIRA) 23 Jun '16

23 Jun '16

eyal edri [Administrator] created OVIRT-607: ----------------------------------------------- Summary: sort out jobs which didn't move to std ci Key: OVIRT-607 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-607 Project: oVirt - virtualization made easy Issue Type: New Feature Reporter: eyal edri [Administrator] Assignee: infra http://pastebin.test.redhat.com/386625 The filtered list which doesn't include projects who doesn't need to move, which are using a 'rel-eng' kind of building.. http://pastebin.test.redhat.com/386628 -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

Re: Change in ovirt-wgt[master]: Correct path to QEMU GA MSI files
by Yedidyah Bar David 23 Jun '16

23 Jun '16

On Wed, Jun 22, 2016 at 10:33 PM, Jenkins CI <gerrit2(a)gerrit.ovirt.org> wrote: > Jenkins CI has posted comments on this change. > > Change subject: Correct path to QEMU GA MSI files > ...................................................................... > > > Patch Set 3: > > Build Failed > > http://jenkins.ovirt.org/job/ovirt-wgt_master_create-rpms-fc23-x86_64_creat… : FAILURE root.log has: DEBUG util.py:417: http://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/fc23/noarch/nsis-s…: [Errno -1] Package does not match intended download. Suggestion: run yum --enablerepo=ovirt-master-snapshot clean metadata No idea what above means, so tried to manually install it on f23: [MIRROR] nsis-simple-service-plugin-1.30-1.noarch.rpm: Downloading successful, but checksum doesn't match. Calculated: 24a4a7e8aa59fe5f4ec59c868cad6aa5f499ee4147282d567bfe3544fba01075(sha256) Expected: f31f377d70f49f09862cd75552645de9ff4969b48fcb7ab226d4fe3930220744(sha256) Any idea? -- Didi

3 4

Re: ** PROBLEM Service Alert: PHX Ovirt-Srv 06/Total Processes is WARNING **
by Evgheni Dereveanchin 23 Jun '16

23 Jun '16

I started getting Nagios alerts as the number of processes on ovirt-srv06 was fluctuating around 450 which was the warning threshold. Same story is happening happens on ovirt-srv05. I've increased the threshold to 500 on these two hosts as 450 looks like a totally normal number of running proceses on EL7. Regards, Evgheni Dereveanchin ----- Original Message ----- From: "icinga" <icinga(a)monitoring.ovirt.org> To: ederevea(a)redhat.com Sent: Thursday, 23 June, 2016 7:05:37 AM Subject: ** PROBLEM Service Alert: PHX Ovirt-Srv 06/Total Processes is WARNING ** ***** Icinga ***** Notification Type: PROBLEM Service: Total Processes Host: PHX Ovirt-Srv 06 Address: 66.187.230.8 State: WARNING Date/Time: Thu Jun 23 05:05:37 UTC 2016 Additional Info: PROCS WARNING: 454 processes

1 0

[JIRA] (OVIRT-606) Trigger Permissions for user evilissimo @jenkins
by Nadav Goldin (oVirt JIRA) 23 Jun '16

23 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-606?page=com.atlassian.jira.p… ] Nadav Goldin reassigned OVIRT-606: ---------------------------------- Assignee: Nadav Goldin (was: infra) > Trigger Permissions for user evilissimo @jenkins > ------------------------------------------------ > > Key: OVIRT-606 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-606 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: Jenkins > Reporter: vfeenstr > Assignee: Nadav Goldin > > Hi, > I'd like to ask for permissions to trigger jenkins jobs for the user evilissimo on jenkins.ovirt.org > thanks. -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-606) Trigger Permissions for user evilissimo @jenkins
by vfeenstr (oVirt JIRA) 23 Jun '16

23 Jun '16

vfeenstr created OVIRT-606: ------------------------------ Summary: Trigger Permissions for user evilissimo @jenkins Key: OVIRT-606 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-606 Project: oVirt - virtualization made easy Issue Type: Task Components: Jenkins Reporter: vfeenstr Assignee: infra Hi, I'd like to ask for permissions to trigger jenkins jobs for the user evilissimo on jenkins.ovirt.org thanks. -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-605) VDSM check merged failing looks infra related)
by eyal edri [Administrator] (oVirt JIRA) 23 Jun '16

23 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-605?page=com.atlassian.jira.p… ] eyal edri [Administrator] reassigned OVIRT-605: ----------------------------------------------- Assignee: Anton Marchukov (was: infra) Anton, Please have a look. It might be related to the reposync bug we've found. If it uses reposync, lets try to disable it and see if it goes away. you can talk with [~ybronhei(a)redhat.com] who is familiar with this job. > VDSM check merged failing looks infra related) > ---------------------------------------------- > > Key: OVIRT-605 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-605 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: Anton Marchukov > > http://jenkins.ovirt.org/job/vdsm_master_check-merged-fc23-x86_64/381/ > [33mcurrent session does not belong to lago group. [0m > [36m@ Deploy oVirt environment: [0m [0m [0m > [33m # ovirt-role metadata entry will be soon deprecated, instead you > should use the vm-provider entry in the domain definiton and set it no one > of: ovirt-node, ovirt-engine, ovirt-host [0m > [36m # Deploy environment: [0m [0m [0m > [36m * [Thread-2] Deploy VM vdsm_functional_tests_host-fc23: [0m [0m [0m > [31m - STDERR > Failed to synchronize cache for repo 'localsync' from ' > http://192.168.200.1:8585/fc23/': Cannot download repomd.xml: Cannot > download repodata/repomd.xml: All mirrors were tried, disabling. > Failed to synchronize cache for repo 'localsync' from ' > http://192.168.200.1:8585/fc23/': Cannot download repomd.xml: Cannot > download repodata/repomd.xml: All mirrors were tried, disabling. > You are using pip version 7.1.0, however version 8.1.2 is available. > You should consider upgrading via the 'pip install --upgrade pip' command. > Error: ServiceOperationError: _systemctlReload failed > Job for multipathd.service invalid. > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

Fwd: Reminder: Fedora 22 end of life 2016-07-19
by Sandro Bonazzola 23 Jun '16

23 Jun '16

FYI ---------- Messaggio inoltrato ---------- Da: "Dennis Gilmore" <dennis(a)ausil.us> Data: 23/Giu/2016 06:43 Oggetto: Reminder: Fedora 22 end of life 2016-07-19 A: <devel-announce(a)lists.fedoraproject.org>, "test-announce" < test-announce(a)lists.fedoraproject.org>, "announce" < announce(a)lists.fedoraproject.org> Cc: > Greetings. > > This is a reminder email about the end of life process for Fedora 22. > > Fedora 22 will reach end of life on 2016-07-19, and no further updates > will be pushed out after that time. Additionally, with the recent > release of Fedora 24, no new packages will be added to the Fedora 22 > collection. > > Please see https://fedoraproject.org/wiki/DNF_system_upgrade for more > information on upgrading from Fedora 22 to a newer release. > > Dennis > _______________________________________________ > devel-announce mailing list > devel-announce(a)lists.fedoraproject.org > https://lists.fedoraproject.org/admin/lists/devel-announce@lists.fedoraproj…

1 0

[JIRA] (OVIRT-605) VDSM check merged failing looks infra related)
by sbonazzo (oVirt JIRA) 23 Jun '16

23 Jun '16

sbonazzo created OVIRT-605: ------------------------------ Summary: VDSM check merged failing looks infra related) Key: OVIRT-605 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-605 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra http://jenkins.ovirt.org/job/vdsm_master_check-merged-fc23-x86_64/381/ [33mcurrent session does not belong to lago group. [0m [36m@ Deploy oVirt environment: [0m [0m [0m [33m # ovirt-role metadata entry will be soon deprecated, instead you should use the vm-provider entry in the domain definiton and set it no one of: ovirt-node, ovirt-engine, ovirt-host [0m [36m # Deploy environment: [0m [0m [0m [36m * [Thread-2] Deploy VM vdsm_functional_tests_host-fc23: [0m [0m [0m [31m - STDERR Failed to synchronize cache for repo 'localsync' from ' http://192.168.200.1:8585/fc23/': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried, disabling. Failed to synchronize cache for repo 'localsync' from ' http://192.168.200.1:8585/fc23/': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried, disabling. You are using pip version 7.1.0, however version 8.1.2 is available. You should consider upgrading via the 'pip install --upgrade pip' command. Error: ServiceOperationError: _systemctlReload failed Job for multipathd.service invalid. -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.98.4#100004)

1 0

[JIRA] (OVIRT-408) migrate mailman from linode to PHX and upgrade to mailman 3
by eyal edri [Administrator] (oVirt JIRA) 22 Jun '16

22 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-408?page=com.atlassian.jira.p… ] eyal edri [Administrator] updated OVIRT-408: -------------------------------------------- Assignee: Marc Dequènes (Duck) (was: infra) Status: Accepted (was: New) starting with installing new VM in PHX lab: mail.phx.ovirt.org. > migrate mailman from linode to PHX and upgrade to mailman 3 > ----------------------------------------------------------- > > Key: OVIRT-408 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-408 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: Hosting > Reporter: eyal edri [Administrator] > Assignee: Marc Dequènes (Duck) > -- This message was sent by Atlassian JIRA (v7.2.0-OD-04-029#72002)

3 7

Build failed in Jenkins: ovirt_4.0_publish-rpms_nightly #50
by jenkins＠jenkins.phx.ovirt.org 22 Jun '16

22 Jun '16

See <http://jenkins.ovirt.org/job/ovirt_4.0_publish-rpms_nightly/50/> ------------------------------------------ Started by timer Building on master in workspace <http://jenkins.ovirt.org/job/ovirt_4.0_publish-rpms_nightly/ws/> [WS-CLEANUP] Deleting project workspace... [workspace] $ /bin/bash -xe /tmp/hudson784070292405804932.sh + rm -rf <http://jenkins.ovirt.org/job/ovirt_4.0_publish-rpms_nightly/ws/artifacts> + mkdir <http://jenkins.ovirt.org/job/ovirt_4.0_publish-rpms_nightly/ws/artifacts> Copied 6 artifacts from "ovirt-host-deploy_master_build-artifacts-el7-x86_64" build number 8 Copied 6 artifacts from "ovirt-host-deploy_master_build-artifacts-fc23-x86_64" build number 8 Copied 8 artifacts from "otopi_4.0_build-artifacts-el7-x86_64" build number 3 Copied 8 artifacts from "otopi_4.0_build-artifacts-fc23-x86_64" build number 3 Copied 8 artifacts from "ovirt-vmconsole_master_create-rpms-el7-x86_64_merged" build number 12 Copied 8 artifacts from "ovirt-vmconsole_master_create-rpms-fc23-x86_64_merged" build number 12 Copied 11 artifacts from "ovirt-imageio_master_build-artifacts-el7-x86_64" build number 27 Copied 11 artifacts from "ovirt-imageio_master_build-artifacts-fc23-x86_64" build number 28 Copied 4 artifacts from "ovirt-iso-uploader_master_build-artifacts-el7-x86_64" build number 5 Copied 4 artifacts from "ovirt-iso-uploader_master_build-artifacts-fc23-x86_64" build number 5 Copied 4 artifacts from "ovirt-log-collector_master_build-artifacts-el7-x86_64" build number 5 Copied 4 artifacts from "ovirt-log-collector_master_build-artifacts-fc23-x86_64" build number 6 Copied 4 artifacts from "ovirt-engine-cli_3.6_build-artifacts-el7-x86_64" build number 7 Copied 4 artifacts from "ovirt-engine-cli_3.6_build-artifacts-fc23-x86_64" build number 7 Copied 8 artifacts from "ovirt-engine-extension-aaa-ldap_master_create-rpms-el7-x86_64_merged" build number 11 Copied 8 artifacts from "ovirt-engine-extension-aaa-ldap_master_create-rpms-fc23-x86_64_merged" build number 11 Copied 7 artifacts from "ovirt-engine-extension-aaa-misc_master_create-rpms-el7-x86_64_merged" build number 4 Copied 7 artifacts from "ovirt-engine-extension-aaa-misc_master_create-rpms-fc23-x86_64_merged" build number 4 Copied 7 artifacts from "ovirt-engine-extension-logger-log4j_master_create-rpms-el7-x86_64_merged" build number 2 Copied 7 artifacts from "ovirt-engine-extension-logger-log4j_master_create-rpms-fc23-x86_64_merged" build number 2 Copied 5 artifacts from "ovirt-dwh_master_build-artifacts-el7-x86_64" build number 17 Copied 5 artifacts from "ovirt-dwh_master_build-artifacts-fc23-x86_64" build number 18 Copied 11 artifacts from "ovirt-engine-extension-aaa-jdbc_master_create-rpms-el7-x86_64_merged" build number 6 Copied 9 artifacts from "ovirt-engine-extension-aaa-jdbc_master_create-rpms-fc23-x86_64_merged" build number 6 Copied 4 artifacts from "ovirt-setup-lib_master_build-artifacts-el7-x86_64" build number 5 Copied 4 artifacts from "ovirt-setup-lib_master_build-artifacts-fc23-x86_64" build number 5 Copied 5 artifacts from "vdsm-jsonrpc-java_master_build-artifacts-el7-x86_64" build number 9 Copied 5 artifacts from "vdsm-jsonrpc-java_master_build-artifacts-fc23-x86_64" build number 10 Copied 25 artifacts from "ovirt-engine_4.0_build-artifacts-el7-x86_64" build number 118 Copied 25 artifacts from "ovirt-engine_4.0_build-artifacts-fc23-x86_64" build number 119 Copied 4 artifacts from "ovirt-engine-sdk_3.6_build-artifacts-el7-x86_64" build number 9 Copied 4 artifacts from "ovirt-engine-sdk_3.6_build-artifacts-fc23-x86_64" build number 9 Copied 6 artifacts from "ovirt-engine-sdk_master_build-artifacts-el7-x86_64" build number 19 Copied 7 artifacts from "ovirt-engine-sdk_master_build-artifacts-fc23-x86_64" build number 19 Copied 13 artifacts from "ovirt-engine-sdk-java_3.6_create-rpms-el7-x86_64_merged" build number 4 Copied 13 artifacts from "ovirt-engine-sdk-java_3.6_create-rpms-fc23-x86_64_merged" build number 4 Copied 3 artifacts from "ovirt-engine-sdk-java_master_build-artifacts-el7-x86_64" build number 13 Copied 3 artifacts from "ovirt-engine-sdk-java_master_build-artifacts-fc23-x86_64" build number 13 Copied 4 artifacts from "ovirt-image-uploader_master_build-artifacts-el7-x86_64" build number 7 Copied 4 artifacts from "ovirt-image-uploader_master_build-artifacts-fc23-x86_64" build number 6 Copied 4 artifacts from "ovirt-scheduler-proxy_master_build-artifacts-el7-x86_64" build number 5 Copied 4 artifacts from "ovirt-scheduler-proxy_master_build-artifacts-fc23-x86_64" build number 6 Copied 6 artifacts from "ovirt-optimizer_master_build-artifacts-el7-x86_64" build number 2 Copied 7 artifacts from "ovirt-optimizer_master_build-artifacts-fc23-x86_64" build number 2 Copied 5 artifacts from "ovirt-jboss-modules-maven-plugin_master_build-artifacts-el7-x86_64" build number 2 Copied 5 artifacts from "ovirt-jboss-modules-maven-plugin_master_build-artifacts-fc23-x86_64" build number 2 Copied 3 artifacts from "ovirt-engine-dashboard_4.0_build-artifacts-el7-x86_64" build number 2 Copied 3 artifacts from "ovirt-engine-dashboard_4.0_build-artifacts-fc23-x86_64" build number 2 Copied 6 artifacts from "ioprocess_0.16_build-artifacts-el7-x86_64" build number 1 Copied 6 artifacts from "ioprocess_0.16_build-artifacts-fc23-x86_64" build number 1 Copied 6 artifacts from "mom_master_create-rpms-el7-x86_64_merged" build number 7 Copied 6 artifacts from "mom_master_create-rpms-fc23-x86_64_merged" build number 7 Copied 49 artifacts from "vdsm_4.0_build-artifacts-el7-x86_64" build number 26 Copied 49 artifacts from "vdsm_4.0_build-artifacts-fc23-x86_64" build number 27 Copied 7 artifacts from "ovirt-hosted-engine-ha_master_create-rpms-el7-x86_64_merged" build number 16 Copied 7 artifacts from "ovirt-hosted-engine-ha_master_create-rpms-fc23-x86_64_merged" build number 15 Copied 4 artifacts from "ovirt-hosted-engine-setup_4.0_build-artifacts-el7-x86_64" build number 3 Copied 4 artifacts from "ovirt-hosted-engine-setup_4.0_build-artifacts-fc23-x86_64" build number 3 Copied 13 artifacts from "qemu_master_create-rpms-el7-x86_64_merged" build number 3 Copied 7 artifacts from "unboundid-ldapsdk_master_create-rpms-el7-x86_64_merged" build number 3 Copied 6 artifacts from "ovirt-appliance_ovirt-4.0-snapshot_build-artifacts-el7-x86_64" build number 21 Copied 7 artifacts from "ovirt-reports_master_create-rpms-el7-x86_64_merged" build number 3 Copied 9 artifacts from "ovirt-live_4.0_build-artifacts-el7-x86_64" build number 11 Copied 6 artifacts from "py2exe-py2.7_4.0_create-rpms-fc23-x86_64_merged" build number 1 Copied 6 artifacts from "pywin32-py2.7_4.0_create-rpms-fc23-x86_64_merged" build number 1 Copied 6 artifacts from "python-windows_4.0_create-rpms-fc23-x86_64_merged" build number 1 Copied 6 artifacts from "vcredist-x86_4.0_create-rpms-fc23-x86_64_merged" build number 1 Copied 6 artifacts from "nsis-simple-service-plugin_4.0_create-rpms-fc23-x86_64_merged" build number 1 ERROR: Unable to find a build for artifact copy from: ovirt-wgt_4.0_create-rpms-fc23-x86_64_merged

4 5

[oVirt Jenkins] ovirt-engine_master_upgrade-from-4.0_el7_merged - Build # 312 - Failure!
by jenkins＠jenkins.phx.ovirt.org 22 Jun '16

22 Jun '16

------=_Part_1247_1600704745.1466580681518 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build Number: 312 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59590 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_1247_1600704745.1466580681518--

1 3

[oVirt Jenkins] ovirt-engine_master_upgrade-from-master_el7_merged - Build # 772 - Failure!
by jenkins＠jenkins.phx.ovirt.org 22 Jun '16

22 Jun '16

------=_Part_1249_1654445235.1466580695421 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build Number: 772 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59590 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_1249_1654445235.1466580695421--

1 2

[oVirt Jenkins] ovirt-engine_4.0_upgrade-from-3.6_el7_merged - Build # 174 - Failure!
by jenkins＠jenkins.phx.ovirt.org 21 Jun '16

21 Jun '16

------=_Part_1221_1350723983.1466525082105 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-3.6_el7_merged/ Build: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-3.6_el7_merged/1… Build Number: 174 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59550 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #174 No changes ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_1221_1350723983.1466525082105--

1 3

[oVirt Jenkins] ovirt-engine_4.0_upgrade-from-4.0_el7_merged - Build # 180 - Failure!
by jenkins＠jenkins.phx.ovirt.org 21 Jun '16

21 Jun '16

------=_Part_1223_514527826.1466525254046 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-4.0_el7_merged/ Build: http://jenkins.ovirt.org/job/ovirt-engine_4.0_upgrade-from-4.0_el7_merged/1… Build Number: 180 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/59550 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #180 No changes ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_1223_514527826.1466525254046--

1 3

[JIRA] (OVIRT-604) partition and mount SSDs on PHX hosts
by Evgheni Dereveanchin (oVirt JIRA) 21 Jun '16

21 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-604?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-604: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > partition and mount SSDs on PHX hosts > ------------------------------------- > > Key: OVIRT-604 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-604 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > partition and mount SSDs on PHX hosts to make use of the local scratch disk hook -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

PHX updates - hypervisors in Jenkins datacenter
by Evgheni Dereveanchin 21 Jun '16

21 Jun '16

Hi all, As part of the upgrade process to 3.6 I will be rebuilding all hypervisors to CentOS7, and I'm starting with the Jenkins Datacenter. For this, I am evacuating slave VMs by shutting them down and restarting in the new cluster with CentOS hosts. I'm currently working on ovirt-srv04 so please don't schedule any VMs on that host until it's rebuilt. I found several VMs running on that host which are not listed on Jenkins so I can't mark them offline there for the update period: fc21-vm01.phx.ovirt.org el6-vm06.phx.ovirt.org If anyone knows what these VMs are used for - please tell me, otherwise I will just restart them as well. Also this VM is present on this hypervisor: artifactory.phx.ovirt.org Is it used by the slaves? Can it be shut down for a few minutes? I'm not sure I will be able to live migrate it even as the F20 hosts we have in the old cluster have issues with live migration even to other F20 hosts. Regards, Evgheni Dereveanchin

5 16

[JIRA] (OVIRT-604) partition and mount SSDs on PHX hosts
by Evgheni Dereveanchin (oVirt JIRA) 21 Jun '16

21 Jun '16

Evgheni Dereveanchin created OVIRT-604: ------------------------------------------ Summary: partition and mount SSDs on PHX hosts Key: OVIRT-604 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-604 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra partition and mount SSDs on PHX hosts to make use of the local scratch disk hook -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

[JIRA] (OVIRT-597) failing to log into jenkins.ovirt.org
by Nadav Goldin (oVirt JIRA) 21 Jun '16

21 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-597?page=com.atlassian.jira.p… ] Nadav Goldin updated OVIRT-597: ------------------------------- Resolution: Fixed Assignee: Nadav Goldin (was: infra) Status: Done (was: To Do) fixed. > failing to log into jenkins.ovirt.org > ------------------------------------- > > Key: OVIRT-597 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-597 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: danken > Assignee: Nadav Goldin > > I'd like to retrigger a failed job on gerrit; but after some times that > I did not need to, I'm now asked to login first, but my password is no > longer accepted. > Can you take a look? -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

[JIRA] (OVIRT-603) [test] please ignore
by Nadav Goldin (oVirt JIRA) 21 Jun '16

21 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-603?page=com.atlassian.jira.p… ] Nadav Goldin deleted OVIRT-603: ------------------------------- > [test] please ignore > -------------------- > > Key: OVIRT-603 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-603 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nadav Goldin > Assignee: infra > -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

[JIRA] (OVIRT-602) test-ticket
by Nadav Goldin (oVirt JIRA) 21 Jun '16

21 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-602?page=com.atlassian.jira.p… ] Nadav Goldin reassigned OVIRT-602: ---------------------------------- Assignee: Nadav Goldin (was: infra) > test-ticket > ----------- > > Key: OVIRT-602 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-602 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Nadav Goldin > Assignee: Nadav Goldin > -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

[JIRA] (OVIRT-603) [test] please ignore
by Nadav Goldin (oVirt JIRA) 21 Jun '16

21 Jun '16

Nadav Goldin created OVIRT-603: ---------------------------------- Summary: [test] please ignore Key: OVIRT-603 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-603 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Nadav Goldin Assignee: infra -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

[JIRA] (OVIRT-602) test-ticket
by Nadav Goldin (oVirt JIRA) 21 Jun '16

21 Jun '16

Nadav Goldin created OVIRT-602: ---------------------------------- Summary: test-ticket Key: OVIRT-602 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-602 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Nadav Goldin Assignee: infra -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0

[JIRA] (OVIRT-601) another incorrect CI-1
by eyal edri [Administrator] (oVirt JIRA) 21 Jun '16

21 Jun '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-601?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-601: ------------------------------------------------- [~amarchuk] please try to look into it and what are out option to exclude infra issues from reviews, so it won't give -1 > another incorrect CI-1 > ---------------------- > > Key: OVIRT-601 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-601 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: danken > Assignee: infra > > the following job failed to pull required packages. this should not be > considered as a failure. > http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/3096/console > 09:33:59 INFO: installing package(s): autoconf automake git lago lago-ovirt libguestfs-tools-c m2crypto make mom openvswitch policycoreutils-python python-blivet python-coverage python-devel python-inotify python-ioprocess python-netaddr python-nose python-pthreading python-rtslib python-setuptools python-six python34-nose python34-six python34 rpm-build sudo yum yum-utils grubby > 09:33:59 ERROR: Command failed. See logs for output. -- This message was sent by Atlassian JIRA (v1000.73.0#100002)

1 0