This might be related to the fact CentOS 7.4 is coming, Due to the way we handle yum repos in OST ( we use reposync and specify which pkgs to include/exclude per repo, so the run will be done locally and not depend on external sources ). It doesn't look consistent though, because some jobs are still working, for e.g, I just triggered the manual job and it looks OK [1] Unfortunately, we don't have a good alternative for this approach yet, so we'll need to update the list of include/exclude files in the reposync.repo file, Hopefully, this should be resolved by tomorrow once we figure out which pkgs needs to be updated in the file, you can always remove the 'include' line, but then it will sync the entire Centos repo, which might takes hours. There might be an option to skip 'reposync' but I'm not sure if its supported yet, adding Gal to be sure. [1] http://jenkins.ovirt.org/view/oVirt%20system%20tests/ job/ovirt-system-tests_manual/1145/console On Wed, Sep 13, 2017 at 5:57 PM, Marc Young <3vilpenguin(a)gmail.com&gt; wrote: > While rerunning some local tests, I encountered a new error: > > + lago ovirt deploy > @ Deploy oVirt environment: > # Deploy environment: > * [Thread-2] Deploy VM lago-vagrant-engine: > * [Thread-3] Deploy VM lago-vagrant-host-0: > * [Thread-3] Deploy VM lago-vagrant-host-0: Success (in 0:00:45) > STDERR > + MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2 > + ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3 > + NUM_LUNS=5 > + EL7='release 7\.[0-9]' > + main > + install_deps > + systemctl disable --now kdump.service > + yum install -y --downloaddir=/dev/shm nfs-utils rpcbind lvm2 targetcli > sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python > Error: Package: gssproxy-0.7.0-4.el7.x86_64 (alocalsync) > Requires: krb5-libs >= 1.15 > Installed: krb5-libs-1.14.1-27.el7_3.x86_64 (installed) > krb5-libs = 1.14.1-27.el7_3 > Available: krb5-libs-1.14.1-26.el7.i686 (base) > krb5-libs = 1.14.1-26.el7 > > - STDERR > + MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2 > + ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3 > + NUM_LUNS=5 > + EL7='release 7\.[0-9]' > + main > + install_deps > + systemctl disable --now kdump.service > + yum install -y --downloaddir=/dev/shm nfs-utils rpcbind lvm2 targetcli > sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python > Error: Package: gssproxy-0.7.0-4.el7.x86_64 (alocalsync) > Requires: krb5-libs >= 1.15 > Installed: krb5-libs-1.14.1-27.el7_3.x86_64 (installed) > krb5-libs = 1.14.1-27.el7_3 > Available: krb5-libs-1.14.1-26.el7.i686 (base) > krb5-libs = 1.14.1-26.el7 > > * [Thread-2] Deploy VM lago-vagrant-engine: ERROR (in 0:01:05) > Error while running thread > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in > _ret_via_queue > queue.put({'return': func()}) > File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1610, in > _deploy_host > (script, ret, host.name(), ), > RuntimeError: /home/myoung/repos/github/ovir > t-system-tests/deployment-vagrant/default/scripts/_home_myou > ng_repos_github_ovirt-system-tests_vagrant_.._common_ > deploy-scripts_setup_storage_unified_el7.sh failed with status 1 on > lago-vagrant-engine > Error while running thread > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in > _ret_via_queue > queue.put({'return': func()}) > File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1610, in > _deploy_host > (script, ret, host.name(), ), > RuntimeError: /home/myoung/repos/github/ovir > t-system-tests/deployment-vagrant/default/scripts/_home_myou > ng_repos_github_ovirt-system-tests_vagrant_.._common_ > deploy-scripts_setup_storage_unified_el7.sh failed with status 1 on > lago-vagrant-engine > # Deploy environment: ERROR (in 0:01:05) > @ Deploy oVirt environment: ERROR (in 0:01:05) > > Its the same error as here: http://jenkins.ovirt.org > /view/oVirt%20system%20tests/job/ovirt-system-tests_master_c > heck-patch-el7-x86_64/1683/console > > > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 <+972%209-769-2018> irc: eedri (on #tlv #rhev-dev #rhev-integ)

On Sep 13, 2017 9:38 PM, "Marc Young" <3vilpenguin(a)gmail.com&gt; wrote: I finally got it past the hurdle. fwiw this is the git diff to reposync-config.repo: https://paste.fedoraproject.org/paste/ SX6Hgnagzzhh~UE~X0PfEg

Thanks, I've also been working on sorting this out and I hope I'm almost there wrt updated packages, etc.

Y. On Wed, Sep 13, 2017 at 10:36 AM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > This might be related to the fact CentOS 7.4 is coming, > Due to the way we handle yum repos in OST ( we use reposync and specify > which pkgs to include/exclude per repo, so the run will be done locally and > not depend on external sources ). > > It doesn't look consistent though, because some jobs are still working, > for e.g, I just triggered the manual job and it looks OK [1] > > Unfortunately, we don't have a good alternative for this approach yet, so > we'll need to update the list of include/exclude files in the reposync.repo > file, > Hopefully, this should be resolved by tomorrow once we figure out which > pkgs needs to be updated in the file, you can always remove the 'include' > line, but then it will sync the entire Centos repo, > which might takes hours. > > There might be an option to skip 'reposync' but I'm not sure if its > supported yet, adding Gal to be sure. > > [1] http://jenkins.ovirt.org/view/oVirt%20system%20tests/job > /ovirt-system-tests_manual/1145/console > > > On Wed, Sep 13, 2017 at 5:57 PM, Marc Young <3vilpenguin(a)gmail.com&gt; > wrote: > >> While rerunning some local tests, I encountered a new error: >> >> + lago ovirt deploy >> @ Deploy oVirt environment: >> # Deploy environment: >> * [Thread-2] Deploy VM lago-vagrant-engine: >> * [Thread-3] Deploy VM lago-vagrant-host-0: >> * [Thread-3] Deploy VM lago-vagrant-host-0: Success (in 0:00:45) >> STDERR >> + MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2 >> + ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3 >> + NUM_LUNS=5 >> + EL7='release 7\.[0-9]' >> + main >> + install_deps >> + systemctl disable --now kdump.service >> + yum install -y --downloaddir=/dev/shm nfs-utils rpcbind lvm2 targetcli >> sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python >> Error: Package: gssproxy-0.7.0-4.el7.x86_64 (alocalsync) >> Requires: krb5-libs >= 1.15 >> Installed: krb5-libs-1.14.1-27.el7_3.x86_64 (installed) >> krb5-libs = 1.14.1-27.el7_3 >> Available: krb5-libs-1.14.1-26.el7.i686 (base) >> krb5-libs = 1.14.1-26.el7 >> >> - STDERR >> + MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2 >> + ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3 >> + NUM_LUNS=5 >> + EL7='release 7\.[0-9]' >> + main >> + install_deps >> + systemctl disable --now kdump.service >> + yum install -y --downloaddir=/dev/shm nfs-utils rpcbind lvm2 targetcli >> sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python >> Error: Package: gssproxy-0.7.0-4.el7.x86_64 (alocalsync) >> Requires: krb5-libs >= 1.15 >> Installed: krb5-libs-1.14.1-27.el7_3.x86_64 (installed) >> krb5-libs = 1.14.1-27.el7_3 >> Available: krb5-libs-1.14.1-26.el7.i686 (base) >> krb5-libs = 1.14.1-26.el7 >> >> * [Thread-2] Deploy VM lago-vagrant-engine: ERROR (in 0:01:05) >> Error while running thread >> Traceback (most recent call last): >> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in >> _ret_via_queue >> queue.put({'return': func()}) >> File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1610, in >> _deploy_host >> (script, ret, host.name(), ), >> RuntimeError: /home/myoung/repos/github/ovir >> t-system-tests/deployment-vagrant/default/scripts/_home_myou >> ng_repos_github_ovirt-system-tests_vagrant_.._common_deploy- >> scripts_setup_storage_unified_el7.sh failed with status 1 on >> lago-vagrant-engine >> Error while running thread >> Traceback (most recent call last): >> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in >> _ret_via_queue >> queue.put({'return': func()}) >> File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1610, in >> _deploy_host >> (script, ret, host.name(), ), >> RuntimeError: /home/myoung/repos/github/ovir >> t-system-tests/deployment-vagrant/default/scripts/_home_myou >> ng_repos_github_ovirt-system-tests_vagrant_.._common_deploy- >> scripts_setup_storage_unified_el7.sh failed with status 1 on >> lago-vagrant-engine >> # Deploy environment: ERROR (in 0:01:05) >> @ Deploy oVirt environment: ERROR (in 0:01:05) >> >> Its the same error as here: http://jenkins.ovirt.org >> /view/oVirt%20system%20tests/job/ovirt-system-tests_master_c >> heck-patch-el7-x86_64/1683/console >> >> >> >> _______________________________________________ >> Devel mailing list >> Devel(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > > > -- > > Eyal edri > > > ASSOCIATE MANAGER > > RHV DevOps > > EMEA VIRTUALIZATION R&D > > > Red Hat EMEA <https://www.redhat.com/> > <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > phone: +972-9-7692018 <+972%209-769-2018> > irc: eedri (on #tlv #rhev-dev #rhev-integ) > _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

On Thu, Sep 14, 2017 at 9:25 AM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > > > On Thu, Sep 14, 2017 at 8:53 AM, Yaniv Kaul <ykaul(a)redhat.com&gt; wrote: > >> >> >> On Sep 13, 2017 9:38 PM, "Marc Young" <3vilpenguin(a)gmail.com&gt; wrote: >> >> I finally got it past the hurdle. fwiw this is the git diff to >> reposync-config.repo: https://paste.fedoraproject.org/paste/ >> SX6Hgnagzzhh~UE~X0PfEg >> >> > Thanks for the help! > > >> >> Thanks, I've also been working on sorting this out and I hope I'm almost >> there wrt updated packages, etc. >> > > I'm guessing it's [1], thanks for help, let me know if I can assist as > well in it. > > [1] https://gerrit.ovirt.org/#/c/81724/ > I'm almost there, I'm stuck on: 2017-09-14 03:10:23,322-04 DEBUG [org.ovirt.otopi.dialog.MachineDialogParser] (VdsDeploy) [49acf013] nextEvent: Log ERROR Yum [u'ERROR with transaction check vs depsolve:', 'iptables = 1.4.21-18.0.1.el7.centos is needed by iptables-services-1.4.21-18.0.1.el7.centos.x86_64'] when installing the host, which doesn't make sense to me because: 1. I have both RPMs available, and can install them: [root@lago-basic-suite-master-host-0 ~]# yum install iptables iptables-services Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile Resolving Dependencies --> Running transaction check ---> Package iptables.x86_64 0:1.4.21-17.el7 will be updated ---> Package iptables.x86_64 0:1.4.21-18.0.1.el7.centos will be an update ---> Package iptables-services.x86_64 0:1.4.21-18.0.1.el7.centos will be installed --> Finished Dependency Resolution Dependencies Resolved ============================================================ ============================================================ ============================================================ =============================== Package Arch Version Repository Size ============================================================ ============================================================ ============================================================ =============================== Installing: iptables-services x86_64 1.4.21-18.0.1.el7.centos alocalsync 51 k Updating: iptables x86_64 1.4.21-18.0.1.el7.centos alocalsync 428 k Transaction Summary ============================================================ ============================================================ ============================================================ =============================== Install 1 Package Upgrade 1 Package 2. I'm not sure why we need it - or is it required still even though we've moved to firewalld? 3. I think I'll just update iptables...

Y. > > >> Y. >> >> >> On Wed, Sep 13, 2017 at 10:36 AM, Eyal Edri <eedri(a)redhat.com&gt; wrote: >> >>> This might be related to the fact CentOS 7.4 is coming, >>> Due to the way we handle yum repos in OST ( we use reposync and specify >>> which pkgs to include/exclude per repo, so the run will be done locally and >>> not depend on external sources ). >>> >>> It doesn't look consistent though, because some jobs are still working, >>> for e.g, I just triggered the manual job and it looks OK [1] >>> >>> Unfortunately, we don't have a good alternative for this approach yet, >>> so we'll need to update the list of include/exclude files in the >>> reposync.repo file, >>> Hopefully, this should be resolved by tomorrow once we figure out which >>> pkgs needs to be updated in the file, you can always remove the 'include' >>> line, but then it will sync the entire Centos repo, >>> which might takes hours. >>> >>> There might be an option to skip 'reposync' but I'm not sure if its >>> supported yet, adding Gal to be sure. >>> >>> [1] http://jenkins.ovirt.org/view/oVirt%20system%20tests/job >>> /ovirt-system-tests_manual/1145/console >>> >>> >>> On Wed, Sep 13, 2017 at 5:57 PM, Marc Young <3vilpenguin(a)gmail.com&gt; >>> wrote: >>> >>>> While rerunning some local tests, I encountered a new error: >>>> >>>> + lago ovirt deploy >>>> @ Deploy oVirt environment: >>>> # Deploy environment: >>>> * [Thread-2] Deploy VM lago-vagrant-engine: >>>> * [Thread-3] Deploy VM lago-vagrant-host-0: >>>> * [Thread-3] Deploy VM lago-vagrant-host-0: Success (in 0:00:45) >>>> STDERR >>>> + MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2 >>>> + ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3 >>>> + NUM_LUNS=5 >>>> + EL7='release 7\.[0-9]' >>>> + main >>>> + install_deps >>>> + systemctl disable --now kdump.service >>>> + yum install -y --downloaddir=/dev/shm nfs-utils rpcbind lvm2 >>>> targetcli sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python >>>> Error: Package: gssproxy-0.7.0-4.el7.x86_64 (alocalsync) >>>> Requires: krb5-libs >= 1.15 >>>> Installed: krb5-libs-1.14.1-27.el7_3.x86_64 (installed) >>>> krb5-libs = 1.14.1-27.el7_3 >>>> Available: krb5-libs-1.14.1-26.el7.i686 (base) >>>> krb5-libs = 1.14.1-26.el7 >>>> >>>> - STDERR >>>> + MAIN_NFS_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2 >>>> + ISCSI_DEV=disk/by-id/scsi-0QEMU_QEMU_HARDDISK_3 >>>> + NUM_LUNS=5 >>>> + EL7='release 7\.[0-9]' >>>> + main >>>> + install_deps >>>> + systemctl disable --now kdump.service >>>> + yum install -y --downloaddir=/dev/shm nfs-utils rpcbind lvm2 >>>> targetcli sg3_utils iscsi-initiator-utils lsscsi policycoreutils-python >>>> Error: Package: gssproxy-0.7.0-4.el7.x86_64 (alocalsync) >>>> Requires: krb5-libs >= 1.15 >>>> Installed: krb5-libs-1.14.1-27.el7_3.x86_64 (installed) >>>> krb5-libs = 1.14.1-27.el7_3 >>>> Available: krb5-libs-1.14.1-26.el7.i686 (base) >>>> krb5-libs = 1.14.1-26.el7 >>>> >>>> * [Thread-2] Deploy VM lago-vagrant-engine: ERROR (in 0:01:05) >>>> Error while running thread >>>> Traceback (most recent call last): >>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in >>>> _ret_via_queue >>>> queue.put({'return': func()}) >>>> File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1610, >>>> in _deploy_host >>>> (script, ret, host.name(), ), >>>> RuntimeError: /home/myoung/repos/github/ovir >>>> t-system-tests/deployment-vagrant/default/scripts/_home_myou >>>> ng_repos_github_ovirt-system-tests_vagrant_.._common_deploy- >>>> scripts_setup_storage_unified_el7.sh failed with status 1 on >>>> lago-vagrant-engine >>>> Error while running thread >>>> Traceback (most recent call last): >>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in >>>> _ret_via_queue >>>> queue.put({'return': func()}) >>>> File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1610, >>>> in _deploy_host >>>> (script, ret, host.name(), ), >>>> RuntimeError: /home/myoung/repos/github/ovir >>>> t-system-tests/deployment-vagrant/default/scripts/_home_myou >>>> ng_repos_github_ovirt-system-tests_vagrant_.._common_deploy- >>>> scripts_setup_storage_unified_el7.sh failed with status 1 on >>>> lago-vagrant-engine >>>> # Deploy environment: ERROR (in 0:01:05) >>>> @ Deploy oVirt environment: ERROR (in 0:01:05) >>>> >>>> Its the same error as here: http://jenkins.ovirt.org >>>> /view/oVirt%20system%20tests/job/ovirt-system-tests_master_c >>>> heck-patch-el7-x86_64/1683/console >>>> >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list >>>> Devel(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/devel >>>> >>> >>> >>> >>> -- >>> >>> Eyal edri >>> >>> >>> ASSOCIATE MANAGER >>> >>> RHV DevOps >>> >>> EMEA VIRTUALIZATION R&D >>> >>> >>> Red Hat EMEA <https://www.redhat.com/> >>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >>> <https://redhat.com/trusted> >>> phone: +972-9-7692018 <+972%209-769-2018> >>> irc: eedri (on #tlv #rhev-dev #rhev-integ) >>> >> >> >> _______________________________________________ >> Devel mailing list >> Devel(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> >> >> > > > -- > > Eyal edri > > > ASSOCIATE MANAGER > > RHV DevOps > > EMEA VIRTUALIZATION R&D > > > Red Hat EMEA <https://www.redhat.com/> > <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > phone: +972-9-7692018 <+972%209-769-2018> > irc: eedri (on #tlv #rhev-dev #rhev-integ) >

On 14 September 2017 at 10:22, Eyal Edri <eedri(a)redhat.com&gt; wrote: > > > > On Thu, Sep 14, 2017 at 10:19 AM, Yaniv Kaul <ykaul(a)redhat.com&gt; wrote: >> >> >> I'm almost there, I'm stuck on: >> 2017-09-14 03:10:23,322-04 DEBUG >> [org.ovirt.otopi.dialog.MachineDialogParser] (VdsDeploy) [49acf013] >> nextEvent: Log ERROR Yum [u'ERROR with transaction check vs depsolve:', >> 'iptables = 1.4.21-18.0.1.el7.centos is needed by >> iptables-services-1.4.21-18.0.1.el7.centos.x86_64'] Where do you get this error? From otopi?

The issue may be related to having an older iptables version pre-installed in the image >> >> >> 2. I'm not sure why we need it - or is it required still even though >> we've moved to firewalld? Firewalld is a front-end for iptables.

>> >> 3. I think I'll just update iptables... You mean in the deploy script? -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel