Hi, we have OST failing on Master Test failed: [ 004_basic_sanity.live_storage_migration ] Link to suspected patches: https://gerrit.ovirt.org/#/c/79246/ Link to Job: http://jenkins.ovirt.org/job/test-repo_ovirt_ experimental_master/7555/ Error snippet from the log: http://jenkins.ovirt.org/job/test-repo_ovirt_ experimental_master/7555/artifact/exported-artifacts/ basic-suit-master-el7/test_logs/basic-suite-master/post- 004_basic_sanity.py/ <error> [Cannot move Virtual Disk. The disk vm0_disk0 is plugged to non-Down VMs: vm0] </error> <engine log> 2017-07-12 12:19:32,547-04 INFO [org.ovirt.engine.core.bll.storage.disk.MoveDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Running command: MoveDisksCommand internal: false. Entities affected : ID: eb4127a6-cc05-4aea-9250-9792447e77e8 Type: DiskAction group CONFIGURE_DISK_STORAGE with role type USER 2017-07-12 12:19:32,552-04 INFO [org.ovirt.engine.core.bll.AddDeprecatedApiEventCommand] (default task-4) [5cb4e759] Running command: AddDeprecatedApiEventCommand internal: false. 2017-07-12 12:19:32,616-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Lock Acquired to object 'EngineLock:{exclusiveLocks='[f66c92f3-474f-4b89-8ba3-56a583ddad89=VM]', sharedLocks=''}' 2017-07-12 12:19:32,642-04 INFO [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Lock Acquired to object 'EngineLock:{exclusiveLocks='[eb4127a6-cc05-4aea-9250-9792447e77e8=DISK]', sharedLocks='[4c13d9f7-faf7-4b43-90f7-5ac7438efb80=VM]'}' 2017-07-12 12:19:32,658-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: f66c92f3-474f-4b89-8ba3-56a583ddad89 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER 2017-07-12 12:19:32,681-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateSnapshotCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage 2017-07-12 12:19:32,691-04 WARN [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Validation of action 'LiveMigrateVmDisks' failed for user admin@internal-authz. Reasons: VAR__ACTION__MOVE,VAR__TYPE__DISK,ACTION_TYPE_FAILED_DISK_PLUGGED_TO_NON_DOWN_VMS,$DiskName vm0_disk0,$VmList vm0 2017-07-12 12:19:32,692-04 INFO [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Lock freed to object 'EngineLock:{exclusiveLocks='[eb4127a6-cc05-4aea-9250-9792447e77e8=DISK]', sharedLocks='[4c13d9f7-faf7-4b43-90f7-5ac7438efb80=VM]'}' 2017-07-12 12:19:32,701-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-2) [] Operation Failed: [Cannot move Virtual Disk. The disk vm0_disk0 is plugged to non-Down VMs: vm0] <engine log> -- Regards, Evgheni Dereveanchin

https://gerrit.ovirt.org/#/c/79381/ should solve this. I'm waiting for the "regular" CI to complete before merging.

On Thu, Jul 13, 2017 at 11:35 AM, Allon Mureinik <amureini(a)redhat.com&gt; wrote: > Definitely looks like it's related to that patch series. > > I'm on it. > > On Thu, Jul 13, 2017 at 11:18 AM, Evgheni Dereveanchin < > ederevea(a)redhat.com&gt; wrote: > >> Hi, we have OST failing on Master >> >> Test failed: [ 004_basic_sanity.live_storage_migration ] >> Link to suspected patches: https://gerrit.ovirt.org/#/c/79246/ >> Link to Job: http://jenkins.ovirt.org/job/test-repo_ovirt_experiment >> al_master/7555/ >> Error snippet from the log: http://jenkins.ovirt.org/ >> job/test-repo_ovirt_experimental_master/7555/artifact/export >> ed-artifacts/basic-suit-master-el7/test_logs/basic-suite-mas >> ter/post-004_basic_sanity.py/ >> >> <error> >> >> [Cannot move Virtual Disk. The disk vm0_disk0 is plugged to non-Down VMs: vm0] >> >> </error> >> >> <engine log> >> >> 2017-07-12 12:19:32,547-04 INFO [org.ovirt.engine.core.bll.storage.disk.MoveDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Running command: MoveDisksCommand internal: false. Entities affected : ID: eb4127a6-cc05-4aea-9250-9792447e77e8 Type: DiskAction group CONFIGURE_DISK_STORAGE with role type USER >> 2017-07-12 12:19:32,552-04 INFO [org.ovirt.engine.core.bll.AddDeprecatedApiEventCommand] (default task-4) [5cb4e759] Running command: AddDeprecatedApiEventCommand internal: false. >> 2017-07-12 12:19:32,616-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Lock Acquired to object 'EngineLock:{exclusiveLocks='[f66c92f3-474f-4b89-8ba3-56a583ddad89=VM]', sharedLocks=''}' >> 2017-07-12 12:19:32,642-04 INFO [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Lock Acquired to object 'EngineLock:{exclusiveLocks='[eb4127a6-cc05-4aea-9250-9792447e77e8=DISK]', sharedLocks='[4c13d9f7-faf7-4b43-90f7-5ac7438efb80=VM]'}' >> 2017-07-12 12:19:32,658-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: f66c92f3-474f-4b89-8ba3-56a583ddad89 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >> 2017-07-12 12:19:32,681-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateSnapshotCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >> 2017-07-12 12:19:32,691-04 WARN [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Validation of action 'LiveMigrateVmDisks' failed for user admin@internal-authz. Reasons: VAR__ACTION__MOVE,VAR__TYPE__DISK,ACTION_TYPE_FAILED_DISK_PLUGGED_TO_NON_DOWN_VMS,$DiskName vm0_disk0,$VmList vm0 >> 2017-07-12 12:19:32,692-04 INFO [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Lock freed to object 'EngineLock:{exclusiveLocks='[eb4127a6-cc05-4aea-9250-9792447e77e8=DISK]', sharedLocks='[4c13d9f7-faf7-4b43-90f7-5ac7438efb80=VM]'}' >> 2017-07-12 12:19:32,701-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-2) [] Operation Failed: [Cannot move Virtual Disk. The disk vm0_disk0 is plugged to non-Down VMs: vm0] >> >> <engine log> >> >> -- >> Regards, >> Evgheni Dereveanchin >> > > _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

On Thu, Jul 13, 2017 at 1:24 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > > > On Thu, Jul 13, 2017 at 12:50 PM, Allon Mureinik <amureini(a)redhat.com&gt; > wrote: > >> https://gerrit.ovirt.org/#/c/79381/ should solve this. >> >> I'm waiting for the "regular" CI to complete before merging. >> > > Did you try running the manual job with it? [1] > > [1] http://jenkins.ovirt.org/view/oVirt%20system%20tests/job > /ovirt-system-tests_manual/ > ​I reproduced the error on my own system, and verified the fix there. If the fix is fine the manual job is great. If it isn't, and you need to debug, it's much less comfortable. Regardless - the patch is merged now, so the next OST run should be OK. Sorry for the noise.​ > > >> >> On Thu, Jul 13, 2017 at 11:35 AM, Allon Mureinik <amureini(a)redhat.com&gt; >> wrote: >> >>> Definitely looks like it's related to that patch series. >>> >>> I'm on it. >>> >>> On Thu, Jul 13, 2017 at 11:18 AM, Evgheni Dereveanchin < >>> ederevea(a)redhat.com&gt; wrote: >>> >>>> Hi, we have OST failing on Master >>>> >>>> Test failed: [ 004_basic_sanity.live_storage_migration ] >>>> Link to suspected patches: https://gerrit.ovirt.org/#/c/79246/ >>>> Link to Job: http://jenkins.ovirt.org/job/test-repo_ovirt_experiment >>>> al_master/7555/ >>>> Error snippet from the log: http://jenkins.ovirt.org/ >>>> job/test-repo_ovirt_experimental_master/7555/artifact/export >>>> ed-artifacts/basic-suit-master-el7/test_logs/basic-suite-mas >>>> ter/post-004_basic_sanity.py/ >>>> >>>> <error> >>>> >>>> [Cannot move Virtual Disk. The disk vm0_disk0 is plugged to non-Down VMs: vm0] >>>> >>>> </error> >>>> >>>> <engine log> >>>> >>>> 2017-07-12 12:19:32,547-04 INFO [org.ovirt.engine.core.bll.storage.disk.MoveDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Running command: MoveDisksCommand internal: false. Entities affected : ID: eb4127a6-cc05-4aea-9250-9792447e77e8 Type: DiskAction group CONFIGURE_DISK_STORAGE with role type USER >>>> 2017-07-12 12:19:32,552-04 INFO [org.ovirt.engine.core.bll.AddDeprecatedApiEventCommand] (default task-4) [5cb4e759] Running command: AddDeprecatedApiEventCommand internal: false. >>>> 2017-07-12 12:19:32,616-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Lock Acquired to object 'EngineLock:{exclusiveLocks='[f66c92f3-474f-4b89-8ba3-56a583ddad89=VM]', sharedLocks=''}' >>>> 2017-07-12 12:19:32,642-04 INFO [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Lock Acquired to object 'EngineLock:{exclusiveLocks='[eb4127a6-cc05-4aea-9250-9792447e77e8=DISK]', sharedLocks='[4c13d9f7-faf7-4b43-90f7-5ac7438efb80=VM]'}' >>>> 2017-07-12 12:19:32,658-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: f66c92f3-474f-4b89-8ba3-56a583ddad89 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER >>>> 2017-07-12 12:19:32,681-04 INFO [org.ovirt.engine.core.bll.snapshots.CreateSnapshotCommand] (default task-4) [568e6d7d-3a5f-4f97-bb39-8b4d2d4ae1da] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >>>> 2017-07-12 12:19:32,691-04 WARN [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Validation of action 'LiveMigrateVmDisks' failed for user admin@internal-authz. Reasons: VAR__ACTION__MOVE,VAR__TYPE__DISK,ACTION_TYPE_FAILED_DISK_PLUGGED_TO_NON_DOWN_VMS,$DiskName vm0_disk0,$VmList vm0 >>>> 2017-07-12 12:19:32,692-04 INFO [org.ovirt.engine.core.bll.storage.lsm.LiveMigrateVmDisksCommand] (default task-2) [4cbc2554-837c-4f76-94db-3e9312eee9d9] Lock freed to object 'EngineLock:{exclusiveLocks='[eb4127a6-cc05-4aea-9250-9792447e77e8=DISK]', sharedLocks='[4c13d9f7-faf7-4b43-90f7-5ac7438efb80=VM]'}' >>>> 2017-07-12 12:19:32,701-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-2) [] Operation Failed: [Cannot move Virtual Disk. The disk vm0_disk0 is plugged to non-Down VMs: vm0] >>>> >>>> <engine log> >>>> >>>> -- >>>> Regards, >>>> Evgheni Dereveanchin >>>> >>> >>> >> >> _______________________________________________ >> Devel mailing list >> Devel(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > > > -- > > Eyal edri > > > ASSOCIATE MANAGER > > RHV DevOps > > EMEA VIRTUALIZATION R&D > > > Red Hat EMEA <https://www.redhat.com/> > <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > phone: +972-9-7692018 <+972%209-769-2018> > irc: eedri (on #tlv #rhev-dev #rhev-integ) >