From alkaplan at redhat.com Tue May 1 07:54:54 2018 From: alkaplan at redhat.com (Alona Kaplan) Date: Tue, 1 May 2018 10:54:54 +0300 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer Message-ID: Hi all, Dominik Holler has been working on the oVirt project for more than 1.5 years. To share some of Dominik's great stats - ~ 120 patches related to the network backend/ui ~ 95 patches for ovirt-provider-ovn ~ 44 vdsm patches ~ 80 bug fixes He was the feature owner of 'auto sync network provider', 'lldp-reporting' and 'network-filter-parameters'. For the last few months Dominik is helping review network-backend related patches and is doing a great and thorough work. Dominik showed a deep understanding of all the parts of code that he touched or reviewed. He learns fast, thorough and uncompromising. I've reviewed most of Dominik's engine related work (code and reviews). I trust his opinion and think he will be a good addition to the maintainers team. I would like to propose Dominik as a Network backend maintainer. Thanks, Alona. -------------- next part -------------- An HTML attachment was scrubbed... URL: From masayag at redhat.com Tue May 1 11:05:25 2018 From: masayag at redhat.com (Moti Asayag) Date: Tue, 1 May 2018 14:05:25 +0300 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer In-Reply-To: References: Message-ID: On Tue, May 1, 2018 at 10:54 AM, Alona Kaplan wrote: > Hi all, > > Dominik Holler has been working on the oVirt project for more than 1.5 > years. > > To share some of Dominik's great stats - > ~ 120 patches related to the network backend/ui > ~ 95 patches for ovirt-provider-ovn > ~ 44 vdsm patches > ~ 80 bug fixes > > He was the feature owner of 'auto sync network provider', 'lldp-reporting' > and 'network-filter-parameters'. > > For the last few months Dominik is helping review network-backend related > patches and is doing a great and thorough work. > Dominik showed a deep understanding of all the parts of code that he > touched or reviewed. > He learns fast, thorough and uncompromising. > > I've reviewed most of Dominik's engine related work (code and reviews). > I trust his opinion and think he will be a good addition to the > maintainers team. > > I would like to propose Dominik as a Network backend maintainer. > > +1 > Thanks, > Alona. > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Regards, Moti -------------- next part -------------- An HTML attachment was scrubbed... URL: From emesika at redhat.com Tue May 1 11:28:37 2018 From: emesika at redhat.com (Eli Mesika) Date: Tue, 1 May 2018 14:28:37 +0300 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer In-Reply-To: References: Message-ID: +1 On Tue, May 1, 2018 at 10:54 AM, Alona Kaplan wrote: > Hi all, > > Dominik Holler has been working on the oVirt project for more than 1.5 > years. > > To share some of Dominik's great stats - > ~ 120 patches related to the network backend/ui > ~ 95 patches for ovirt-provider-ovn > ~ 44 vdsm patches > ~ 80 bug fixes > > He was the feature owner of 'auto sync network provider', 'lldp-reporting' > and 'network-filter-parameters'. > > For the last few months Dominik is helping review network-backend related > patches and is doing a great and thorough work. > Dominik showed a deep understanding of all the parts of code that he > touched or reviewed. > He learns fast, thorough and uncompromising. > > I've reviewed most of Dominik's engine related work (code and reviews). > I trust his opinion and think he will be a good addition to the > maintainers team. > > I would like to propose Dominik as a Network backend maintainer. > > > Thanks, > Alona. > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From awels at redhat.com Tue May 1 12:05:38 2018 From: awels at redhat.com (Alexander Wels) Date: Tue, 01 May 2018 08:05:38 -0400 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer In-Reply-To: References: Message-ID: <1722068.YhPVLTke3e@awels> On Tuesday, May 1, 2018 3:54:54 AM EDT Alona Kaplan wrote: > Hi all, > > Dominik Holler has been working on the oVirt project for more than 1.5 > years. > > To share some of Dominik's great stats - > ~ 120 patches related to the network backend/ui > ~ 95 patches for ovirt-provider-ovn > ~ 44 vdsm patches > ~ 80 bug fixes > > He was the feature owner of 'auto sync network provider', 'lldp-reporting' > and 'network-filter-parameters'. > > For the last few months Dominik is helping review network-backend related > patches and is doing a great and thorough work. > Dominik showed a deep understanding of all the parts of code that he > touched or reviewed. > He learns fast, thorough and uncompromising. > > I've reviewed most of Dominik's engine related work (code and reviews). > I trust his opinion and think he will be a good addition to the maintainers > team. > > I would like to propose Dominik as a Network backend maintainer. > > > Thanks, > Alona. +1 Dominik is a pleasure to work with, learns fast and promptly fixes anything found in reviews. Alexander From mperina at redhat.com Tue May 1 21:33:26 2018 From: mperina at redhat.com (Martin Perina) Date: Tue, 1 May 2018 23:33:26 +0200 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer In-Reply-To: References: Message-ID: On Tue, May 1, 2018 at 9:54 AM, Alona Kaplan wrote: > Hi all, > > Dominik Holler has been working on the oVirt project for more than 1.5 > years. > > To share some of Dominik's great stats - > ~ 120 patches related to the network backend/ui > ~ 95 patches for ovirt-provider-ovn > ~ 44 vdsm patches > ~ 80 bug fixes > > He was the feature owner of 'auto sync network provider', 'lldp-reporting' > and 'network-filter-parameters'. > > For the last few months Dominik is helping review network-backend related > patches and is doing a great and thorough work. > Dominik showed a deep understanding of all the parts of code that he > touched or reviewed. > He learns fast, thorough and uncompromising. > > I've reviewed most of Dominik's engine related work (code and reviews). > I trust his opinion and think he will be a good addition to the > maintainers team. > > I would like to propose Dominik as a Network backend maintainer. > ?+1 from me ? > > > Thanks, > Alona. > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Martin Perina Associate Manager, Software Engineering Red Hat Czech s.r.o. -------------- next part -------------- An HTML attachment was scrubbed... URL: From bkorren at redhat.com Wed May 2 07:35:46 2018 From: bkorren at redhat.com (Barak Korren) Date: Wed, 2 May 2018 10:35:46 +0300 Subject: [ovirt-devel] default maintainers plugin for other projects In-Reply-To: References: Message-ID: (adding devel because this might be interesting for others). On 1 May 2018 at 21:16, Greg Sheremeta wrote: > How would I get this plugin added to ovirt-engine-dashboard and > ovirt-engine-node* ? > Its already available for all projects in gerrit.ovirt.org. > And then how would I configure it? (Add myself as a default, at least) > Two ways: With the GUI: ----------------- In Gerrit UI go to: Admin -> Projects -> (Old UI) -> (Your project) -> Reviewers (from top bar) Fill in filter (A file glob pattern - can be '*') and reviewer (An email address ora gerrit group ) and click "Add". Don't forget to switch back to new UI from the bottom right link. >From the command line ------------------------------- In a Git clone of the relevant project do: # git fetch origin refs/meta/config:meta-config # git checkout meta-config Then you can edit the 'reviewers.config' file (Make it if it isn't there) and put in something like the following: [filter "*"] reviewer = jenkins-maintainers reviewer = dron at redhat.com Once you're done with it commit the change and push it with: # git push -u origin meta-config refs/meta/config Since we have '-u' there, the next time around you change the 'meta-config' branch you can just do: # git push -u origin And that's about it. One thing to note - every project has a '-maintainers' group, so its useful to add it it default. > ---------- Forwarded message ---------- > From: Roy Golan > Date: Mon, Jun 19, 2017 at 7:17 AM > Subject: Re: [ovirt-devel] [ENGINE][ACTION_NEEDED] - default maintainers, > per path > To: devel > > > The patch is now merged and the it should start working immediately. For > anyone who is listed as a default reviewer I suggest to test it with a test > patch by some other submitter. (except for those who used groups of course) > > Thanks everyone for the cooperation on this. > > > On Mon, May 29, 2017 at 2:24 PM Roy Golan wrote: > >> Hi all, >> >> Some time ago the infra team enabled *gerrit default reviewer plugin* >> which you probably noticed if you logged in to gerrit. >> >> What we can do is for example set the stable branch maintainers per >> branch automatically: >> >> [filter "branch:ovirt-engine-4.1"] >> reviewer = stableBranchMaintainersGroup >> >> Put people based on path: >> >> [filter "branch:master file:^frontend/.*"] >> reviewer = j.r.r.t at shire.me >> >> >> >> *Action Needed:* >> Nominate yourself, or others, by amending this patch online [1]. Once >> this patch is fully acked and agreed we will merge it. If something can't >> get consensus we will defer it from the patch till maintainers agree. >> >> [1] https://gerrit.ovirt.org/#/c/77488/ >> >> >> >> >> > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > > > > -- > > GREG SHEREMETA > > SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX > > Red Hat NA > > > > gshereme at redhat.com IRC: gshereme > > > _______________________________________________ > Infra mailing list > Infra at ovirt.org > http://lists.ovirt.org/mailman/listinfo/infra > > -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted -------------- next part -------------- An HTML attachment was scrubbed... URL: From sbonazzo at redhat.com Wed May 2 12:54:11 2018 From: sbonazzo at redhat.com (Sandro Bonazzola) Date: Wed, 2 May 2018 14:54:11 +0200 Subject: [ovirt-devel] Broken deps wihle testing master? Here some info Message-ID: Hi, ovirt-release-master enables testing repos from CentOS. Testing repos are now switching to CentOS 7.5.1804 so you now need to enable also the CR repo when testing master on CentOS. CentOS 7.5 should be released this week or in worst case next week, so this is just a temporary issue while 7.5 is being rolled out. oVirt release 4.2 uses stable repos and is not affected by this temporary glitch. Thanks, -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA sbonazzo at redhat.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From piotr.kliczewski at gmail.com Wed May 2 13:53:07 2018 From: piotr.kliczewski at gmail.com (Piotr Kliczewski) Date: Wed, 2 May 2018 15:53:07 +0200 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer In-Reply-To: References: Message-ID: +1 On Tue, May 1, 2018 at 11:33 PM, Martin Perina wrote: > > > On Tue, May 1, 2018 at 9:54 AM, Alona Kaplan wrote: >> >> Hi all, >> >> Dominik Holler has been working on the oVirt project for more than 1.5 >> years. >> >> To share some of Dominik's great stats - >> ~ 120 patches related to the network backend/ui >> ~ 95 patches for ovirt-provider-ovn >> ~ 44 vdsm patches >> ~ 80 bug fixes >> >> He was the feature owner of 'auto sync network provider', 'lldp-reporting' >> and 'network-filter-parameters'. >> >> For the last few months Dominik is helping review network-backend related >> patches and is doing a great and thorough work. >> Dominik showed a deep understanding of all the parts of code that he >> touched or reviewed. >> He learns fast, thorough and uncompromising. >> >> I've reviewed most of Dominik's engine related work (code and reviews). >> I trust his opinion and think he will be a good addition to the >> maintainers team. >> >> I would like to propose Dominik as a Network backend maintainer. > > > +1 from me > >> >> >> >> Thanks, >> Alona. >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel > > > > > -- > Martin Perina > Associate Manager, Software Engineering > Red Hat Czech s.r.o. > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel From bkorren at redhat.com Wed May 2 15:00:51 2018 From: bkorren at redhat.com (Barak Korren) Date: Wed, 2 May 2018 18:00:51 +0300 Subject: [ovirt-devel] oVirt CI now supports Fedora 28 Message-ID: Since Fedora 28 was released yesterday, we've added support for it in the oVirt CI system. To use Fedora 28 just use 'fc28' as you would for other Fedora versions in the CI YAML files and/or file extensions in the 'automation/' directory. The synchronisation for our local mirror is ongoing at this time, so until it is done, the upstream Fedora mirrors will be used, this can cause some breakage. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted From bkorren at redhat.com Wed May 2 19:00:29 2018 From: bkorren at redhat.com (bkorren at redhat.com) Date: Wed, 02 May 2018 19:00:29 +0000 Subject: [ovirt-devel] Updated invitation: oVirt STDCI v2 deep dive @ Thu May 3, 2018 11:00 - 12:00 (IDT) (devel@ovirt.org) Message-ID: <000000000000549b31056b3db3f2@google.com> This event has been changed. Title: oVirt STDCI v2 deep dive Introduction to the 2nd version of oVirt's CI standard - What is it, what can it do, how to use it and how does it work.Note: Meeting was movedTo join the Meeting:https://bluejeans.com/8705030462To join via Room System:Video Conferencing System: redhat.bjn.vc -or-199.48.152.18Meeting ID : 8705030462To join via phone :1) Dial:    408-915-6466 (United States)    (see all numbers - https://www.redhat.com/en/conference-numbers)2) Enter Conference ID : 8705030462RSVP at:https://www.eventbrite.com/e/ovirt-stdci-v2-deep-dive-tickets-45468120372 (changed) When: Thu May 3, 2018 11:00 ? 12:00 Jerusalem Where: ; https://bluejeans.com/8705030462, raanana-04-asia-8-p-vc Calendar: devel at ovirt.org Who: * bkorren at redhat.com - organizer * devel at ovirt.org * sbonazzo at redhat.com * dkenigsb at redhat.com * rbarry at redhat.com * mskrivan at redhat.com * eedri at redhat.com * tjelinek at redhat.com * tnisan at redhat.com * mperina at redhat.com * sradco at redhat.com * msivak at redhat.com * sabose at redhat.com Attachments: * ovirt-stdci-talk.pdf - https://drive.google.com/a/redhat.com/file/d/1V1zPSdNicsiYXc3PX9iX5QkWLAqpCLYs/view?usp=drive_web Event details: https://www.google.com/calendar/event?action=VIEW&eid=MHBvcmNoYWQ5YmtzNmlmdWw2M25jNzM5djMgZGV2ZWxAb3ZpcnQub3Jn&tok=MTgjYmtvcnJlbkByZWRoYXQuY29tODBiMjViYzFjZmZhYWYzMmJiNmNlNWU3NTA3OGRjOGQwYmJiNTBhOA&ctz=Asia%2FJerusalem&hl=en&es=0 Invitation from Google Calendar: https://www.google.com/calendar/ You are receiving this courtesy email at the account devel at ovirt.org because you are an attendee of this event. To stop receiving future updates for this event, decline this event. Alternatively you can sign up for a Google account at https://www.google.com/calendar/ and control your notification settings for your entire calendar. Forwarding this invitation could allow any recipient to modify your RSVP response. Learn more at https://support.google.com/calendar/answer/37135#forwarding -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 4733 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: invite.ics Type: application/ics Size: 4809 bytes Desc: not available URL: From bkorren at redhat.com Wed May 2 19:05:54 2018 From: bkorren at redhat.com (Barak Korren) Date: Wed, 2 May 2018 22:05:54 +0300 Subject: [ovirt-devel] Slides for STDCI V2 talk Message-ID: Hi all, Attached are the slids I'm going to present in my talk about oVirt's STDCI V2. Regards, -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted?? -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: ovirt-stdci-talk.pdf Type: application/pdf Size: 2322346 bytes Desc: not available URL: From bkorren at redhat.com Thu May 3 09:27:33 2018 From: bkorren at redhat.com (Barak Korren) Date: Thu, 3 May 2018 12:27:33 +0300 Subject: [ovirt-devel] Video and slides from the STDCI V2 talk Message-ID: Video is available at: https://bluejeans.com/s/JQ2ES Slides are at: https://drive.google.com/file/d/1V1zPSdNicsiYXc3PX9iX5QkWLAqpCLYs/view As well as attached to this message. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: ovirt-stdci-talk.pdf Type: application/pdf Size: 2322346 bytes Desc: not available URL: From sbonazzo at redhat.com Thu May 3 11:48:51 2018 From: sbonazzo at redhat.com (Sandro Bonazzola) Date: Thu, 3 May 2018 13:48:51 +0200 Subject: [ovirt-devel] Propose Dominik Holler as a Network-Backend Maintainer In-Reply-To: References: Message-ID: 2018-05-01 9:54 GMT+02:00 Alona Kaplan : > Hi all, > > Dominik Holler has been working on the oVirt project for more than 1.5 > years. > > To share some of Dominik's great stats - > ~ 120 patches related to the network backend/ui > ~ 95 patches for ovirt-provider-ovn > ~ 44 vdsm patches > ~ 80 bug fixes > > He was the feature owner of 'auto sync network provider', 'lldp-reporting' > and 'network-filter-parameters'. > > For the last few months Dominik is helping review network-backend related > patches and is doing a great and thorough work. > Dominik showed a deep understanding of all the parts of code that he > touched or reviewed. > He learns fast, thorough and uncompromising. > > I've reviewed most of Dominik's engine related work (code and reviews). > I trust his opinion and think he will be a good addition to the > maintainers team. > > I would like to propose Dominik as a Network backend maintainer. > I think you already got enough +1 but if needed, +1 from me as well. > > > Thanks, > Alona. > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA sbonazzo at redhat.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From mzamazal at redhat.com Thu May 3 14:31:04 2018 From: mzamazal at redhat.com (Milan Zamazal) Date: Thu, 03 May 2018 16:31:04 +0200 Subject: [ovirt-devel] OST: oVirt version used in basic-suite-4.2 Message-ID: <87d0yc3j6f.fsf@redhat.com> Hi, I wonder why is ovirt-4.2 repo, rather than ovirt-4.2-snapshot or so, used in reposync-config for basic-suite-4.2? Packages in ovirt-4.2 are relatively old and the suite may fail on bugs that are already fixed. Shouldn't a more up-to-date repo be used in basic-suite-4.2? Thanks, Milan From tgolembi at redhat.com Thu May 3 19:58:47 2018 From: tgolembi at redhat.com (=?UTF-8?B?VG9tw6HFoSBHb2xlbWJpb3Zza8O9?=) Date: Thu, 3 May 2018 21:58:47 +0200 Subject: [ovirt-devel] ovirt-host-deploy and python3 Message-ID: <20180503215847.02524bbc@fiorina> Hi, I'm trying to reinstall a CentOS host (using master-snapshot) and I noticed otopi is trying to use python3 while the ovirt-host-deploy is not yet fully python3 compatible: > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:39 SYSTEM INFORMATION - BEGIN > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:40 executable /bin/python3 > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:41 python version 3.4.8 (default, Mar 23 2018, 10:04:27) > [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:42 python /bin/python3 > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:43 platform linux > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:44 distribution ('CentOS Linux', '7.4.1708', 'Core') > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:45 host 'ovirt-host2' > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:51 uid 0 euid 0 gid 0 egid 0 > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:53 SYSTEM INFORMATION - END and then later: > 2018-05-03 21:35:56,912+0200 DEBUG otopi.context context._executeMethod:128 Stage init METHOD otopi.plugins.ovirt_host_deploy.node.detect.Plugin._init > 2018-05-03 21:35:56,914+0200 DEBUG otopi.context context._executeMethod:143 method exception > Traceback (most recent call last): > File "/tmp/ovirt-a0GNITSwX9/pythonlib/otopi/context.py", line 133, in _executeMethod > method['method']() > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", line 131, in _init > odeploycons.FileLocations.OVIRT_NODE_VARIANT_VAL) > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", line 69, in hasconf > io.StringIO('[default]\n' + f.read().decode('utf-8')) > AttributeError: 'str' object has no attribute 'decode' > 2018-05-03 21:35:56,915+0200 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Initializing': 'str' object has no attribute 'decode' There is definitely a bug (or at least weirdness) in host-deploy -- why use .decode() on object returned by codecs.open()? But also, should host-deploy be already python3 compatible and is this otopi behaviour expected? Tomas -- Tom?? Golembiovsk? From yturgema at redhat.com Fri May 4 07:17:30 2018 From: yturgema at redhat.com (Yuval Turgeman) Date: Fri, 04 May 2018 07:17:30 +0000 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: <20180503215847.02524bbc@fiorina> References: <20180503215847.02524bbc@fiorina> Message-ID: Definitely a bug, we did some work on otopi (mostly packaging) to use python3 if it exists on a system - most of the otopi code was compatible, however, we didn't get to port host-deploy just yet. If you could open a bug for this issue that would be great. Thanks, Yuval On May 3, 2018 22:59, "Tom?? Golembiovsk?" wrote: Hi, I'm trying to reinstall a CentOS host (using master-snapshot) and I noticed otopi is trying to use python3 while the ovirt-host-deploy is not yet fully python3 compatible: > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:39 SYSTEM INFORMATION - BEGIN > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:40 executable /bin/python3 > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:41 python version 3.4.8 (default, Mar 23 2018, 10:04:27) > [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info info._init:42 python /bin/python3 > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:43 platform linux > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:44 distribution ('CentOS Linux', '7.4.1708', 'Core') > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:45 host 'ovirt-host2' > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:51 uid 0 euid 0 gid 0 egid 0 > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info info._init:53 SYSTEM INFORMATION - END and then later: > 2018-05-03 21:35:56,912+0200 DEBUG otopi.context context._executeMethod:128 Stage init METHOD otopi.plugins.ovirt_host_deploy.node.detect.Plugin._init > 2018-05-03 21:35:56,914+0200 DEBUG otopi.context context._executeMethod:143 method exception > Traceback (most recent call last): > File "/tmp/ovirt-a0GNITSwX9/pythonlib/otopi/context.py", line 133, in _executeMethod > method['method']() > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", line 131, in _init > odeploycons.FileLocations.OVIRT_NODE_VARIANT_VAL) > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", line 69, in hasconf > io.StringIO('[default]\n' + f.read().decode('utf-8')) > AttributeError: 'str' object has no attribute 'decode' > 2018-05-03 21:35:56,915+0200 ERROR otopi.context context._executeMethod:152 Failed to execute stage 'Initializing': 'str' object has no attribute 'decode' There is definitely a bug (or at least weirdness) in host-deploy -- why use .decode() on object returned by codecs.open()? But also, should host-deploy be already python3 compatible and is this otopi behaviour expected? Tomas -- Tom?? Golembiovsk? _______________________________________________ Devel mailing list Devel at ovirt.org http://lists.ovirt.org/mailman/listinfo/devel -------------- next part -------------- An HTML attachment was scrubbed... URL: From sbonazzo at redhat.com Fri May 4 07:33:11 2018 From: sbonazzo at redhat.com (Sandro Bonazzola) Date: Fri, 4 May 2018 09:33:11 +0200 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: <20180503215847.02524bbc@fiorina> References: <20180503215847.02524bbc@fiorina> Message-ID: 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : > Hi, > > I'm trying to reinstall a CentOS host (using master-snapshot) and I > noticed otopi is trying to use python3 while the ovirt-host-deploy is > not yet fully python3 compatible: > How did you got python 3 on CentOS? It's not in CentOS distribution. > > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > info._init:39 SYSTEM INFORMATION - BEGIN > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > info._init:40 executable /bin/python3 > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > info._init:41 python version 3.4.8 (default, Mar 23 2018, 10:04:27) > > [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > info._init:42 python /bin/python3 > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > info._init:43 platform linux > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > info._init:44 distribution ('CentOS Linux', '7.4.1708', 'Core') > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > info._init:45 host 'ovirt-host2' > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > info._init:51 uid 0 euid 0 gid 0 egid 0 > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > info._init:53 SYSTEM INFORMATION - END > > and then later: > > > 2018-05-03 21:35:56,912+0200 DEBUG otopi.context > context._executeMethod:128 Stage init METHOD otopi.plugins.ovirt_host_ > deploy.node.detect.Plugin._init > > 2018-05-03 21:35:56,914+0200 DEBUG otopi.context > context._executeMethod:143 method exception > > Traceback (most recent call last): > > File "/tmp/ovirt-a0GNITSwX9/pythonlib/otopi/context.py", line 133, in > _executeMethod > > method['method']() > > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", > line 131, in _init > > odeploycons.FileLocations.OVIRT_NODE_VARIANT_VAL) > > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", > line 69, in hasconf > > io.StringIO('[default]\n' + f.read().decode('utf-8')) > > AttributeError: 'str' object has no attribute 'decode' > > 2018-05-03 21:35:56,915+0200 ERROR otopi.context > context._executeMethod:152 Failed to execute stage 'Initializing': 'str' > object has no attribute 'decode' > > There is definitely a bug (or at least weirdness) in host-deploy -- why > use .decode() on object returned by codecs.open()? > > But also, should host-deploy be already python3 compatible and is this > otopi behaviour expected? > > Tomas > > > -- > Tom?? Golembiovsk? > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA sbonazzo at redhat.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From tgolembi at redhat.com Fri May 4 09:07:13 2018 From: tgolembi at redhat.com (=?UTF-8?B?VG9tw6HFoSBHb2xlbWJpb3Zza8O9?=) Date: Fri, 4 May 2018 11:07:13 +0200 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> Message-ID: <20180504110713.3f26a055@fiorina> On Fri, 4 May 2018 09:33:11 +0200 Sandro Bonazzola wrote: > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : > > > Hi, > > > > I'm trying to reinstall a CentOS host (using master-snapshot) and I > > noticed otopi is trying to use python3 while the ovirt-host-deploy is > > not yet fully python3 compatible: > > > > How did you got python 3 on CentOS? > It's not in CentOS distribution. From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. Tomas > > > > > > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:39 SYSTEM INFORMATION - BEGIN > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:40 executable /bin/python3 > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:41 python version 3.4.8 (default, Mar 23 2018, 10:04:27) > > > [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:42 python /bin/python3 > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:43 platform linux > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:44 distribution ('CentOS Linux', '7.4.1708', 'Core') > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:45 host 'ovirt-host2' > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:51 uid 0 euid 0 gid 0 egid 0 > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > info._init:53 SYSTEM INFORMATION - END > > > > and then later: > > > > > 2018-05-03 21:35:56,912+0200 DEBUG otopi.context > > context._executeMethod:128 Stage init METHOD otopi.plugins.ovirt_host_ > > deploy.node.detect.Plugin._init > > > 2018-05-03 21:35:56,914+0200 DEBUG otopi.context > > context._executeMethod:143 method exception > > > Traceback (most recent call last): > > > File "/tmp/ovirt-a0GNITSwX9/pythonlib/otopi/context.py", line 133, in > > _executeMethod > > > method['method']() > > > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", > > line 131, in _init > > > odeploycons.FileLocations.OVIRT_NODE_VARIANT_VAL) > > > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", > > line 69, in hasconf > > > io.StringIO('[default]\n' + f.read().decode('utf-8')) > > > AttributeError: 'str' object has no attribute 'decode' > > > 2018-05-03 21:35:56,915+0200 ERROR otopi.context > > context._executeMethod:152 Failed to execute stage 'Initializing': 'str' > > object has no attribute 'decode' > > > > There is definitely a bug (or at least weirdness) in host-deploy -- why > > use .decode() on object returned by codecs.open()? > > > > But also, should host-deploy be already python3 compatible and is this > > otopi behaviour expected? > > > > Tomas > > > > > > -- > > Tom?? Golembiovsk? > > _______________________________________________ > > Devel mailing list > > Devel at ovirt.org > > http://lists.ovirt.org/mailman/listinfo/devel > > > > > -- > > SANDRO BONAZZOLA > > ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D > > Red Hat EMEA > > sbonazzo at redhat.com > > -- Tom?? Golembiovsk? From sbonazzo at redhat.com Fri May 4 11:09:26 2018 From: sbonazzo at redhat.com (Sandro Bonazzola) Date: Fri, 4 May 2018 13:09:26 +0200 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: <20180504110713.3f26a055@fiorina> References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : > On Fri, 4 May 2018 09:33:11 +0200 > Sandro Bonazzola wrote: > > > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : > > > > > Hi, > > > > > > I'm trying to reinstall a CentOS host (using master-snapshot) and I > > > noticed otopi is trying to use python3 while the ovirt-host-deploy is > > > not yet fully python3 compatible: > > > > > > > How did you got python 3 on CentOS? > > It's not in CentOS distribution. > > From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. > Dan, you asked for python34 packages from epel in https://gerrit.ovirt.org/#/c/55415/ Are they still needed? I don't see them required anywhere. Can we drop them? > > Tomas > > > > > > > > > > > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:39 SYSTEM INFORMATION - BEGIN > > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:40 executable /bin/python3 > > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:41 python version 3.4.8 (default, Mar 23 2018, 10:04:27) > > > > [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] > > > > 2018-05-03 21:35:56,855+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:42 python /bin/python3 > > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:43 platform linux > > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:44 distribution ('CentOS Linux', '7.4.1708', 'Core') > > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:45 host 'ovirt-host2' > > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:51 uid 0 euid 0 gid 0 egid 0 > > > > 2018-05-03 21:35:56,856+0200 DEBUG otopi.plugins.otopi.system.info > > > info._init:53 SYSTEM INFORMATION - END > > > > > > and then later: > > > > > > > 2018-05-03 21:35:56,912+0200 DEBUG otopi.context > > > context._executeMethod:128 Stage init METHOD otopi.plugins.ovirt_host_ > > > deploy.node.detect.Plugin._init > > > > 2018-05-03 21:35:56,914+0200 DEBUG otopi.context > > > context._executeMethod:143 method exception > > > > Traceback (most recent call last): > > > > File "/tmp/ovirt-a0GNITSwX9/pythonlib/otopi/context.py", line > 133, in > > > _executeMethod > > > > method['method']() > > > > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", > > > > line 131, in _init > > > > odeploycons.FileLocations.OVIRT_NODE_VARIANT_VAL) > > > > File "/tmp/ovirt-a0GNITSwX9/otopi-plugins/ovirt-host-deploy/node/detect.py", > > > > line 69, in hasconf > > > > io.StringIO('[default]\n' + f.read().decode('utf-8')) > > > > AttributeError: 'str' object has no attribute 'decode' > > > > 2018-05-03 21:35:56,915+0200 ERROR otopi.context > > > context._executeMethod:152 Failed to execute stage 'Initializing': > 'str' > > > object has no attribute 'decode' > > > > > > There is definitely a bug (or at least weirdness) in host-deploy -- why > > > use .decode() on object returned by codecs.open()? > > > > > > But also, should host-deploy be already python3 compatible and is this > > > otopi behaviour expected? > > > > > > Tomas > > > > > > > > > -- > > > Tom?? Golembiovsk? > > > _______________________________________________ > > > Devel mailing list > > > Devel at ovirt.org > > > http://lists.ovirt.org/mailman/listinfo/devel > > > > > > > > > > -- > > > > SANDRO BONAZZOLA > > > > ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D > > > > Red Hat EMEA > > > > sbonazzo at redhat.com > > > > > > > -- > Tom?? Golembiovsk? > -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA sbonazzo at redhat.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From michal.skrivanek at redhat.com Fri May 4 11:38:50 2018 From: michal.skrivanek at redhat.com (Michal Skrivanek) Date: Fri, 4 May 2018 13:38:50 +0200 Subject: [ovirt-devel] dynamic ownership changes In-Reply-To: <20180427072323.GA61744@Alexandra.local> References: <20180418081628.GA1704@Alexandra.local> <20180418111733.GA4702@Alexandra.local> <20180419120709.GB9449@Alexandra.local> <20180423125653.GA19987@Alexandra.local> <20180427072323.GA61744@Alexandra.local> Message-ID: Hi Elad, to make it easier to compare, Martin backported the change to 4.2 so it is actually comparable with a run without that patch. Would you please try that out? It would be best to have 4.2 upstream and this[1] run to really minimize the noise. Thanks, michal [1] http://jenkins.ovirt.org/job/vdsm_4.2_build-artifacts-on-demand-el7-x86_64/28/ > On 27 Apr 2018, at 09:23, Martin Polednik wrote: > > On 24/04/18 00:37 +0300, Elad Ben Aharon wrote: >> I will update with the results of the next tier1 execution on latest 4.2.3 > > That isn't master but old branch though. Could you run it against > *current* VDSM master? > >> On Mon, Apr 23, 2018 at 3:56 PM, Martin Polednik >> wrote: >> >>> On 23/04/18 01:23 +0300, Elad Ben Aharon wrote: >>> >>>> Hi, I've triggered another execution [1] due to some issues I saw in the >>>> first which are not related to the patch. >>>> >>>> The success rate is 78% which is low comparing to tier1 executions with >>>> code from downstream builds (95-100% success rates) [2]. >>>> >>> >>> Could you run the current master (without the dynamic_ownership patch) >>> so that we have viable comparision? >>> >>> From what I could see so far, there is an issue with move and copy >>>> operations to and from Gluster domains. For example [3]. >>>> >>>> The logs are attached. >>>> >>>> >>>> [1] >>>> *https://rhv-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rhv >>>> -4.2-ge-runner-tier1-after-upgrade/7/testReport/ >>>> >>> -4.2-ge-runner-tier1-after-upgrade/7/testReport/>* >>>> >>>> >>>> >>>> [2] >>>> https://rhv-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/ >>>> >>>> rhv-4.2-ge-runner-tier1-after-upgrade/7/ >>>> >>>> >>>> >>>> [3] >>>> 2018-04-22 13:06:28,316+0300 INFO (jsonrpc/7) [vdsm.api] FINISH >>>> deleteImage error=Image does not exist in domain: >>>> 'image=cabb8846-7a4b-4244-9835-5f603e682f33, >>>> domain=e5fd29c8-52ba-467e-be09-ca40ff054dd4' >>>> from=: >>>> :ffff:10.35.161.182,40936, flow_id=disks_syncAction_ba6b2630-5976-4935, >>>> task_id=3d5f2a8a-881c-409e-93e9-aaa643c10e42 (api:51) >>>> 2018-04-22 13:06:28,317+0300 ERROR (jsonrpc/7) [storage.TaskManager.Task] >>>> (Task='3d5f2a8a-881c-409e-93e9-aaa643c10e42') Unexpected error (task:875) >>>> Traceback (most recent call last): >>>> File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, >>>> in >>>> _run >>>> return fn(*args, **kargs) >>>> File "", line 2, in deleteImage >>>> File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 49, in >>>> method >>>> ret = func(*args, **kwargs) >>>> File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 1503, >>>> in >>>> deleteImage >>>> raise se.ImageDoesNotExistInSD(imgUUID, sdUUID) >>>> ImageDoesNotExistInSD: Image does not exist in domain: >>>> 'image=cabb8846-7a4b-4244-9835-5f603e682f33, >>>> domain=e5fd29c8-52ba-467e-be09-ca40ff054dd4' >>>> >>>> 2018-04-22 13:06:28,317+0300 INFO (jsonrpc/7) [storage.TaskManager.Task] >>>> (Task='3d5f2a8a-881c-409e-93e9-aaa643c10e42') aborting: Task is aborted: >>>> "Image does not exist in domain: 'image=cabb8846-7a4b-4244-9835- >>>> 5f603e682f33, domain=e5fd29c8-52ba-467e-be09-ca40ff054dd4'" - code 268 >>>> (task:1181) >>>> 2018-04-22 13:06:28,318+0300 ERROR (jsonrpc/7) [storage.Dispatcher] FINISH >>>> deleteImage error=Image does not exist in domain: >>>> 'image=cabb8846-7a4b-4244-9835-5f603e682f33, >>>> domain=e5fd29c8-52ba-467e-be09 >>>> -ca40ff054d >>>> d4' (dispatcher:82) >>>> >>>> >>>> >>>> On Thu, Apr 19, 2018 at 5:34 PM, Elad Ben Aharon >>>> wrote: >>>> >>>> Triggered a sanity tier1 execution [1] using [2], which covers all the >>>>> requested areas, on iSCSI, NFS and Gluster. >>>>> I'll update with the results. >>>>> >>>>> [1] >>>>> https://rhv-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/4.2 >>>>> _dev/job/rhv-4.2-ge-flow-storage/1161/ >>>>> >>>>> [2] >>>>> https://gerrit.ovirt.org/#/c/89830/ >>>>> vdsm-4.30.0-291.git77aef9a.el7.x86_64 >>>>> >>>>> >>>>> >>>>> On Thu, Apr 19, 2018 at 3:07 PM, Martin Polednik >>>>> wrote: >>>>> >>>>> On 19/04/18 14:54 +0300, Elad Ben Aharon wrote: >>>>>> >>>>>> Hi Martin, >>>>>>> >>>>>>> I see [1] requires a rebase, can you please take care? >>>>>>> >>>>>>> >>>>>> Should be rebased. >>>>>> >>>>>> At the moment, our automation is stable only on iSCSI, NFS, Gluster and >>>>>> >>>>>>> FC. >>>>>>> Ceph is not supported and Cinder will be stabilized soon, AFAIR, it's >>>>>>> not >>>>>>> stable enough at the moment. >>>>>>> >>>>>>> >>>>>> That is still pretty good. >>>>>> >>>>>> >>>>>> [1] https://gerrit.ovirt.org/#/c/89830/ >>>>>> >>>>>>> >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> On Wed, Apr 18, 2018 at 2:17 PM, Martin Polednik >>>>>> > >>>>>>> wrote: >>>>>>> >>>>>>> On 18/04/18 11:37 +0300, Elad Ben Aharon wrote: >>>>>>> >>>>>>>> >>>>>>>> Hi, sorry if I misunderstood, I waited for more input regarding what >>>>>>>> >>>>>>>>> areas >>>>>>>>> have to be tested here. >>>>>>>>> >>>>>>>>> >>>>>>>>> I'd say that you have quite a bit of freedom in this regard. >>>>>>>> GlusterFS >>>>>>>> should be covered by Dennis, so iSCSI/NFS/ceph/cinder with some suite >>>>>>>> that covers basic operations (start & stop VM, migrate it), snapshots >>>>>>>> and merging them, and whatever else would be important for storage >>>>>>>> sanity. >>>>>>>> >>>>>>>> mpolednik >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Apr 18, 2018 at 11:16 AM, Martin Polednik < >>>>>>>> mpolednik at redhat.com >>>>>>>> > >>>>>>>> >>>>>>>> wrote: >>>>>>>>> >>>>>>>>> On 11/04/18 16:52 +0300, Elad Ben Aharon wrote: >>>>>>>>> >>>>>>>>> >>>>>>>>>> We can test this on iSCSI, NFS and GlusterFS. As for ceph and >>>>>>>>>> cinder, >>>>>>>>>> >>>>>>>>>> will >>>>>>>>>>> have to check, since usually, we don't execute our automation on >>>>>>>>>>> them. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Any update on this? I believe the gluster tests were successful, >>>>>>>>>>> OST >>>>>>>>>>> >>>>>>>>>> passes fine and unit tests pass fine, that makes the storage >>>>>>>>>> backends >>>>>>>>>> test the last required piece. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Apr 11, 2018 at 4:38 PM, Raz Tamir >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> +Elad >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Wed, Apr 11, 2018 at 4:28 PM, Dan Kenigsberg >>>>>>>>>>> > >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Apr 11, 2018 at 12:34 PM, Nir Soffer >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Apr 11, 2018 at 12:31 PM Eyal Edri >>>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Please make sure to run as much OST suites on this patch as >>>>>>>>>>>>>> possible >>>>>>>>>>>>>> >>>>>>>>>>>>>> before merging ( using 'ci please build' ) >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> But note that OST is not a way to verify the patch. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> Such changes require testing with all storage types we support. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Nir >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, Apr 10, 2018 at 4:09 PM, Martin Polednik < >>>>>>>>>>>>>> mpolednik at redhat.com >>>>>>>>>>>>>> > >>>>>>>>>>>>>> >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hey, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I've created a patch[0] that is finally able to activate >>>>>>>>>>>>>>>> libvirt's >>>>>>>>>>>>>>>> dynamic_ownership for VDSM while not negatively affecting >>>>>>>>>>>>>>>> functionality of our storage code. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> That of course comes with quite a bit of code removal, mostly >>>>>>>>>>>>>>>> in >>>>>>>>>>>>>>>> the >>>>>>>>>>>>>>>> area of host devices, hwrng and anything that touches devices; >>>>>>>>>>>>>>>> bunch >>>>>>>>>>>>>>>> of test changes and one XML generation caveat (storage is >>>>>>>>>>>>>>>> handled >>>>>>>>>>>>>>>> by >>>>>>>>>>>>>>>> VDSM, therefore disk relabelling needs to be disabled on the >>>>>>>>>>>>>>>> VDSM >>>>>>>>>>>>>>>> level). >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Because of the scope of the patch, I welcome >>>>>>>>>>>>>>>> storage/virt/network >>>>>>>>>>>>>>>> people to review the code and consider the implication this >>>>>>>>>>>>>>>> change >>>>>>>>>>>>>>>> has >>>>>>>>>>>>>>>> on current/future features. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> [0] https://gerrit.ovirt.org/#/c/89830/ >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> In particular: dynamic_ownership was set to 0 prehistorically >>>>>>>>>>>>>>>> (as >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> part >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> of https://bugzilla.redhat.com/show_bug.cgi?id=554961 ) because >>>>>>>>>>>>> libvirt, >>>>>>>>>>>>> running as root, was not able to play properly with root-squash >>>>>>>>>>>>> nfs >>>>>>>>>>>>> mounts. >>>>>>>>>>>>> >>>>>>>>>>>>> Have you attempted this use case? >>>>>>>>>>>>> >>>>>>>>>>>>> I join to Nir's request to run this with storage QE. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Raz Tamir >>>>>>>>>>>> Manager, RHV QE >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>> >>> >>> > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From danken at redhat.com Fri May 4 12:19:47 2018 From: danken at redhat.com (Dan Kenigsberg) Date: Fri, 4 May 2018 15:19:47 +0300 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola wrote: > > > 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : > >> On Fri, 4 May 2018 09:33:11 +0200 >> Sandro Bonazzola wrote: >> >> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : >> > >> > > Hi, >> > > >> > > I'm trying to reinstall a CentOS host (using master-snapshot) and I >> > > noticed otopi is trying to use python3 while the ovirt-host-deploy is >> > > not yet fully python3 compatible: >> > > >> > >> > How did you got python 3 on CentOS? >> > It's not in CentOS distribution. >> >> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >> > > > Dan, you asked for python34 packages from epel in > https://gerrit.ovirt.org/#/c/55415/ > Are they still needed? I don't see them required anywhere. > Can we drop them? > You are perfectly right, Sandro. My attempt to support Python 3 on el7 failed. https://gerrit.ovirt.org/90912 should clean its remainders. Can anybody remind me how I trigger check-merged job on it, for verification? -------------- next part -------------- An HTML attachment was scrubbed... URL: From gshereme at redhat.com Fri May 4 13:01:19 2018 From: gshereme at redhat.com (Greg Sheremeta) Date: Fri, 4 May 2018 09:01:19 -0400 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: ci re-merge please On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg wrote: > > > On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola > wrote: > >> >> >> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >> >>> On Fri, 4 May 2018 09:33:11 +0200 >>> Sandro Bonazzola wrote: >>> >>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : >>> > >>> > > Hi, >>> > > >>> > > I'm trying to reinstall a CentOS host (using master-snapshot) and I >>> > > noticed otopi is trying to use python3 while the ovirt-host-deploy is >>> > > not yet fully python3 compatible: >>> > > >>> > >>> > How did you got python 3 on CentOS? >>> > It's not in CentOS distribution. >>> >>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>> >> >> >> Dan, you asked for python34 packages from epel in >> https://gerrit.ovirt.org/#/c/55415/ >> Are they still needed? I don't see them required anywhere. >> Can we drop them? >> > > You are perfectly right, Sandro. My attempt to support Python 3 on el7 > failed. > https://gerrit.ovirt.org/90912 should clean its remainders. > > Can anybody remind me how I trigger check-merged job on it, for > verification? > > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA gshereme at redhat.com IRC: gshereme -------------- next part -------------- An HTML attachment was scrubbed... URL: From bkorren at redhat.com Sun May 6 05:53:46 2018 From: bkorren at redhat.com (Barak Korren) Date: Sun, 6 May 2018 08:53:46 +0300 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: On 4 May 2018 at 16:01, Greg Sheremeta wrote: > ci re-merge please > > Please note that you should never run this on pre-merged patches as it runs all the post-merge code including submission in change-queue. > On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg wrote: > >> >> >> On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola >> wrote: >> >>> >>> >>> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >>> >>>> On Fri, 4 May 2018 09:33:11 +0200 >>>> Sandro Bonazzola wrote: >>>> >>>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : >>>> > >>>> > > Hi, >>>> > > >>>> > > I'm trying to reinstall a CentOS host (using master-snapshot) and I >>>> > > noticed otopi is trying to use python3 while the ovirt-host-deploy >>>> is >>>> > > not yet fully python3 compatible: >>>> > > >>>> > >>>> > How did you got python 3 on CentOS? >>>> > It's not in CentOS distribution. >>>> >>>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>>> >>> >>> >>> Dan, you asked for python34 packages from epel in >>> https://gerrit.ovirt.org/#/c/55415/ >>> Are they still needed? I don't see them required anywhere. >>> Can we drop them? >>> >> >> You are perfectly right, Sandro. My attempt to support Python 3 on el7 >> failed. >> https://gerrit.ovirt.org/90912 should clean its remainders. >> >> Can anybody remind me how I trigger check-merged job on it, for >> verification? >> >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > > > -- > > GREG SHEREMETA > > SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX > > Red Hat NA > > > > gshereme at redhat.com IRC: gshereme > > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted -------------- next part -------------- An HTML attachment was scrubbed... URL: From bkorren at redhat.com Sun May 6 09:57:27 2018 From: bkorren at redhat.com (Barak Korren) Date: Sun, 6 May 2018 12:57:27 +0300 Subject: [ovirt-devel] OST: oVirt version used in basic-suite-4.2 In-Reply-To: <87d0yc3j6f.fsf@redhat.com> References: <87d0yc3j6f.fsf@redhat.com> Message-ID: On 3 May 2018 at 17:31, Milan Zamazal wrote: > Hi, I wonder why is ovirt-4.2 repo, rather than ovirt-4.2-snapshot or > so, used in reposync-config for basic-suite-4.2? Packages in ovirt-4.2 > are relatively old and the suite may fail on bugs that are already > fixed. Shouldn't a more up-to-date repo be used in basic-suite-4.2? > > Thanks, > Milan > The idea was to have OST run on the released versions by default so it can be used by 3rd party (non ovirt-core) contributors. We've decided to change things a short while ago and the patch to do that is here: https://gerrit.ovirt.org/c/89587/ But I've had no time to actually finish it. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted -------------- next part -------------- An HTML attachment was scrubbed... URL: From danken at redhat.com Sun May 6 10:16:49 2018 From: danken at redhat.com (Dan Kenigsberg) Date: Sun, 06 May 2018 10:16:49 +0000 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: Two questions: 1. what *should* I do to trigger check-merged? 2. shouldn't you fail ci re-merge for unmerged changed on the chi side? On Sun, May 6, 2018, 01:54 Barak Korren wrote: > > > On 4 May 2018 at 16:01, Greg Sheremeta wrote: > >> ci re-merge please >> >> > Please note that you should never run this on pre-merged patches as it > runs all the post-merge code including submission in change-queue. > > > >> On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg wrote: >> >>> >>> >>> On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola >>> wrote: >>> >>>> >>>> >>>> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >>>> >>>>> On Fri, 4 May 2018 09:33:11 +0200 >>>>> Sandro Bonazzola wrote: >>>>> >>>>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : >>>>> > >>>>> > > Hi, >>>>> > > >>>>> > > I'm trying to reinstall a CentOS host (using master-snapshot) and I >>>>> > > noticed otopi is trying to use python3 while the ovirt-host-deploy >>>>> is >>>>> > > not yet fully python3 compatible: >>>>> > > >>>>> > >>>>> > How did you got python 3 on CentOS? >>>>> > It's not in CentOS distribution. >>>>> >>>>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>>>> >>>> >>>> >>>> Dan, you asked for python34 packages from epel in >>>> https://gerrit.ovirt.org/#/c/55415/ >>>> Are they still needed? I don't see them required anywhere. >>>> Can we drop them? >>>> >>> >>> You are perfectly right, Sandro. My attempt to support Python 3 on el7 >>> failed. >>> https://gerrit.ovirt.org/90912 should clean its remainders. >>> >>> Can anybody remind me how I trigger check-merged job on it, for >>> verification? >>> >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >>> >> >> >> >> -- >> >> GREG SHEREMETA >> >> SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX >> >> Red Hat NA >> >> >> >> gshereme at redhat.com IRC: gshereme >> >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > > > -- > Barak Korren > RHV DevOps team , RHCE, RHCi > Red Hat EMEA > redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bkorren at redhat.com Sun May 6 10:34:13 2018 From: bkorren at redhat.com (Barak Korren) Date: Sun, 6 May 2018 13:34:13 +0300 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: On 6 May 2018 at 13:16, Dan Kenigsberg wrote: > Two questions: > 1. what *should* I do to trigger check-merged? > merge the patch.... In other words - we need to consider anything you want to be able to run pre-merge into check-patch. With V2 and sub-stages we have a variety of options there. > 2. shouldn't you fail ci re-merge for unmerged changed on the chi side? > We have that fixed for V2 but not V1 AFAIR... > On Sun, May 6, 2018, 01:54 Barak Korren wrote: > >> >> >> On 4 May 2018 at 16:01, Greg Sheremeta wrote: >> >>> ci re-merge please >>> >>> >> Please note that you should never run this on pre-merged patches as it >> runs all the post-merge code including submission in change-queue. >> >> >> >>> On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg >>> wrote: >>> >>>> >>>> >>>> On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola >>>> wrote: >>>> >>>>> >>>>> >>>>> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >>>>> >>>>>> On Fri, 4 May 2018 09:33:11 +0200 >>>>>> Sandro Bonazzola wrote: >>>>>> >>>>>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? >>>>> >: >>>>>> > >>>>>> > > Hi, >>>>>> > > >>>>>> > > I'm trying to reinstall a CentOS host (using master-snapshot) and >>>>>> I >>>>>> > > noticed otopi is trying to use python3 while the >>>>>> ovirt-host-deploy is >>>>>> > > not yet fully python3 compatible: >>>>>> > > >>>>>> > >>>>>> > How did you got python 3 on CentOS? >>>>>> > It's not in CentOS distribution. >>>>>> >>>>>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>>>>> >>>>> >>>>> >>>>> Dan, you asked for python34 packages from epel in >>>>> https://gerrit.ovirt.org/#/c/55415/ >>>>> Are they still needed? I don't see them required anywhere. >>>>> Can we drop them? >>>>> >>>> >>>> You are perfectly right, Sandro. My attempt to support Python 3 on el7 >>>> failed. >>>> https://gerrit.ovirt.org/90912 should clean its remainders. >>>> >>>> Can anybody remind me how I trigger check-merged job on it, for >>>> verification? >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list >>>> Devel at ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/devel >>>> >>> >>> >>> >>> -- >>> >>> GREG SHEREMETA >>> >>> SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX >>> >>> Red Hat NA >>> >>> >>> >>> gshereme at redhat.com IRC: gshereme >>> >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >>> >> >> >> >> -- >> Barak Korren >> RHV DevOps team , RHCE, RHCi >> Red Hat EMEA >> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >> > -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted -------------- next part -------------- An HTML attachment was scrubbed... URL: From eedri at redhat.com Sun May 6 13:29:15 2018 From: eedri at redhat.com (Eyal Edri) Date: Sun, 6 May 2018 16:29:15 +0300 Subject: [ovirt-devel] OST: oVirt version used in basic-suite-4.2 In-Reply-To: References: <87d0yc3j6f.fsf@redhat.com> Message-ID: I've merged https://gerrit.ovirt.org/#/c/90936/. 4.2 will use tested now as first option, and only fallback to official repo. On Sun, May 6, 2018 at 12:57 PM, Barak Korren wrote: > > > On 3 May 2018 at 17:31, Milan Zamazal wrote: > >> Hi, I wonder why is ovirt-4.2 repo, rather than ovirt-4.2-snapshot or >> so, used in reposync-config for basic-suite-4.2? Packages in ovirt-4.2 >> are relatively old and the suite may fail on bugs that are already >> fixed. Shouldn't a more up-to-date repo be used in basic-suite-4.2? >> >> Thanks, >> Milan >> > > > The idea was to have OST run on the released versions by default so it can > be used by 3rd party (non ovirt-core) contributors. > > We've decided to change things a short while ago and the patch to do that > is here: > https://gerrit.ovirt.org/c/89587/ > > But I've had no time to actually finish it. > > > -- > Barak Korren > RHV DevOps team , RHCE, RHCi > Red Hat EMEA > redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- Eyal edri MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA TRIED. TESTED. TRUSTED. phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ) -------------- next part -------------- An HTML attachment was scrubbed... URL: From anastasiya.ruzhanskaya at frtk.ru Sun May 6 04:26:27 2018 From: anastasiya.ruzhanskaya at frtk.ru (Anastasiya Ruzhanskaya) Date: Sun, 6 May 2018 07:26:27 +0300 Subject: [ovirt-devel] oVirt messages from engine to vdsm Message-ID: Hello everyone! Currently I want to determine what information is included in messages passing from oVirt engine to VDSM on ovirt-node. I made up a really simple configuration with one VM representing engine, another - node, a managed to successfully launch a single VM on this node. However, I have chosen to configure everything automatically. Currently traffic is encrypted with default certificates. So, there are three options for me and no one of them really works. 1) Find the format of messages ( what the fields are, session id for example) in docs, but I didn't manage to find it; 2) Use wireshark to decrypt the traffic and the apply maybe a json -dissector to the decrypted data. I have tried many solutions ( thanks god I have rsa private and public keys but there is another session key which is generated every time engine starts to communicate with vdsm, which I cannot get with the help of sslkeylog file or ld_preload technology. Maybe someone knows the exact methodology how to do this correctly? 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for engine, according to answers on oVirt site, I should do 2 requests to the database. I was really surprised that psql was not installed by oVirt on my system. How did it then created a default database? ( I have chosen to create all locally and with default configurations). I mean these two commands : https://www.ovirt.org/develop/ developer-guide/vdsm/connecting-development-vdsm-to-engine/ . I have a following error there : psql: FATAL: Peer authentication failed for user "engine" Could you please guide my what method is the best and how should I correct my faults there? -------------- next part -------------- An HTML attachment was scrubbed... URL: From anastasiya.ruzhanskaya at frtk.ru Mon May 7 04:19:32 2018 From: anastasiya.ruzhanskaya at frtk.ru (Anastasiya Ruzhanskaya) Date: Mon, 7 May 2018 07:19:32 +0300 Subject: [ovirt-devel] oVirt RPC messages Message-ID: Hello! Do messages sent from ovirt-engine to ovirt-node in RPC format contain the session number or any user information? -------------- next part -------------- An HTML attachment was scrubbed... URL: From sbonazzo at redhat.com Mon May 7 07:15:57 2018 From: sbonazzo at redhat.com (Sandro Bonazzola) Date: Mon, 7 May 2018 09:15:57 +0200 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: 2018-05-06 7:53 GMT+02:00 Barak Korren : > > > On 4 May 2018 at 16:01, Greg Sheremeta wrote: > >> ci re-merge please >> >> > Please note that you should never run this on pre-merged patches as it > runs all the post-merge code including submission in change-queue. > I hope the code handling "ci re-merge please" is smart enough to check that the patch is merged before trying to re-merge it. If not, please fix it. > > > >> On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg wrote: >> >>> >>> >>> On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola >>> wrote: >>> >>>> >>>> >>>> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >>>> >>>>> On Fri, 4 May 2018 09:33:11 +0200 >>>>> Sandro Bonazzola wrote: >>>>> >>>>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? : >>>>> > >>>>> > > Hi, >>>>> > > >>>>> > > I'm trying to reinstall a CentOS host (using master-snapshot) and I >>>>> > > noticed otopi is trying to use python3 while the ovirt-host-deploy >>>>> is >>>>> > > not yet fully python3 compatible: >>>>> > > >>>>> > >>>>> > How did you got python 3 on CentOS? >>>>> > It's not in CentOS distribution. >>>>> >>>>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>>>> >>>> >>>> >>>> Dan, you asked for python34 packages from epel in >>>> https://gerrit.ovirt.org/#/c/55415/ >>>> Are they still needed? I don't see them required anywhere. >>>> Can we drop them? >>>> >>> >>> You are perfectly right, Sandro. My attempt to support Python 3 on el7 >>> failed. >>> https://gerrit.ovirt.org/90912 should clean its remainders. >>> >>> Can anybody remind me how I trigger check-merged job on it, for >>> verification? >>> >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >>> >> >> >> >> -- >> >> GREG SHEREMETA >> >> SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX >> >> Red Hat NA >> >> >> >> gshereme at redhat.com IRC: gshereme >> >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > > > -- > Barak Korren > RHV DevOps team , RHCE, RHCi > Red Hat EMEA > redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA sbonazzo at redhat.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From bkorren at redhat.com Mon May 7 07:43:31 2018 From: bkorren at redhat.com (Barak Korren) Date: Mon, 7 May 2018 10:43:31 +0300 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: On 7 May 2018 at 10:15, Sandro Bonazzola wrote: > > > 2018-05-06 7:53 GMT+02:00 Barak Korren : > >> >> >> On 4 May 2018 at 16:01, Greg Sheremeta wrote: >> >>> ci re-merge please >>> >>> >> Please note that you should never run this on pre-merged patches as it >> runs all the post-merge code including submission in change-queue. >> > > I hope the code handling "ci re-merge please" is smart enough to check > that the patch is merged before trying to re-merge it. > If not, please fix it. > As I wrote before, the V2 code is, the V1 code isn't, which is one more reason to switch... > > > >> >> >> >>> On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg >>> wrote: >>> >>>> >>>> >>>> On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola >>>> wrote: >>>> >>>>> >>>>> >>>>> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >>>>> >>>>>> On Fri, 4 May 2018 09:33:11 +0200 >>>>>> Sandro Bonazzola wrote: >>>>>> >>>>>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? >>>>> >: >>>>>> > >>>>>> > > Hi, >>>>>> > > >>>>>> > > I'm trying to reinstall a CentOS host (using master-snapshot) and >>>>>> I >>>>>> > > noticed otopi is trying to use python3 while the >>>>>> ovirt-host-deploy is >>>>>> > > not yet fully python3 compatible: >>>>>> > > >>>>>> > >>>>>> > How did you got python 3 on CentOS? >>>>>> > It's not in CentOS distribution. >>>>>> >>>>>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>>>>> >>>>> >>>>> >>>>> Dan, you asked for python34 packages from epel in >>>>> https://gerrit.ovirt.org/#/c/55415/ >>>>> Are they still needed? I don't see them required anywhere. >>>>> Can we drop them? >>>>> >>>> >>>> You are perfectly right, Sandro. My attempt to support Python 3 on el7 >>>> failed. >>>> https://gerrit.ovirt.org/90912 should clean its remainders. >>>> >>>> Can anybody remind me how I trigger check-merged job on it, for >>>> verification? >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list >>>> Devel at ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/devel >>>> >>> >>> >>> >>> -- >>> >>> GREG SHEREMETA >>> >>> SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX >>> >>> Red Hat NA >>> >>> >>> >>> gshereme at redhat.com IRC: gshereme >>> >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >>> >> >> >> >> -- >> Barak Korren >> RHV DevOps team , RHCE, RHCi >> Red Hat EMEA >> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > > > -- > > SANDRO BONAZZOLA > > ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D > > Red Hat EMEA > > sbonazzo at redhat.com > > > -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted -------------- next part -------------- An HTML attachment was scrubbed... URL: From msivak at redhat.com Mon May 7 07:53:37 2018 From: msivak at redhat.com (Martin Sivak) Date: Mon, 7 May 2018 09:53:37 +0200 Subject: [ovirt-devel] oVirt RPC messages In-Reply-To: References: Message-ID: Hi, we send a correlation id with the commands to be able to pair the engine.log commands with vdsm commands. I am pretty sure we do not send any user identification to the node. Best regards Martin Sivak On Mon, May 7, 2018 at 6:19 AM, Anastasiya Ruzhanskaya wrote: > Hello! > Do messages sent from ovirt-engine to ovirt-node in RPC format contain the > session number or any user information? > > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel From anastasiya.ruzhanskaya at frtk.ru Mon May 7 07:59:52 2018 From: anastasiya.ruzhanskaya at frtk.ru (Anastasiya Ruzhanskaya) Date: Mon, 7 May 2018 10:59:52 +0300 Subject: [ovirt-devel] oVirt RPC messages In-Reply-To: References: Message-ID: So, then by analyzing traffic from ovirt-engine to ovirt-node ( vdsm) and then from vdsm to libvirt I am not able to find out which user is executing the actions ( for example shut down VM or make snapshot)? 2018-05-07 10:53 GMT+03:00 Martin Sivak : > Hi, > > we send a correlation id with the commands to be able to pair the > engine.log commands with vdsm commands. I am pretty sure we do not > send any user identification to the node. > > Best regards > > Martin Sivak > > On Mon, May 7, 2018 at 6:19 AM, Anastasiya Ruzhanskaya > wrote: > > Hello! > > Do messages sent from ovirt-engine to ovirt-node in RPC format contain > the > > session number or any user information? > > > > > > _______________________________________________ > > Devel mailing list > > Devel at ovirt.org > > http://lists.ovirt.org/mailman/listinfo/devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From msivak at redhat.com Mon May 7 08:00:46 2018 From: msivak at redhat.com (Martin Sivak) Date: Mon, 7 May 2018 10:00:46 +0200 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: Hi, I think what you are looking for is mostly this: https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml The best way to see what the traffic is is to disable SSL. The postgres database is installed and accessible using the postgres user (the engine user is not allowed to access it directly). You might also be interested in the vdsm fake project we use as node simulator. Its readme will tell you exactly how to do this: https://github.com/oVirt/ovirt-vdsmfake I wrote an article some time ago that explained how to setup a development environment without real hosts: https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ Might I ask what you goal is? Best regards -- Martin Sivak SLA / oVirt On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya wrote: > Hello everyone! > Currently I want to determine what information is included in messages > passing from oVirt engine to VDSM on ovirt-node. > > I made up a really simple configuration with one VM representing engine, > another - node, a managed to successfully launch a single VM on this node. > However, I have chosen to configure everything automatically. Currently > traffic is encrypted with default certificates. > So, there are three options for me and no one of them really works. > > 1) Find the format of messages ( what the fields are, session id for > example) in docs, but I didn't manage to find it; > 2) Use wireshark to decrypt the traffic and the apply maybe a json > -dissector to the decrypted data. I have tried many solutions ( thanks god I > have rsa private and public keys but there is another session key which is > generated every time engine starts to communicate with vdsm, which I cannot > get with the help of sslkeylog file or ld_preload technology. > Maybe someone knows the exact methodology how to do this correctly? > > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for engine, > according to answers on oVirt site, I should do 2 requests to the database. > I was really surprised that psql was not installed by oVirt on my system. > How did it then created a default database? ( I have chosen to create all > locally and with default configurations). > I mean these two commands : > https://www.ovirt.org/develop/developer-guide/vdsm/connecting-development-vdsm-to-engine/ > . I have a following error there : > psql: FATAL: Peer authentication failed for user "engine" > > Could you please guide my what method is the best and how should I correct > my faults there? > > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel From msivak at redhat.com Mon May 7 08:05:46 2018 From: msivak at redhat.com (Martin Sivak) Date: Mon, 7 May 2018 10:05:46 +0200 Subject: [ovirt-devel] oVirt RPC messages In-Reply-To: References: Message-ID: Hi, no, the traffic is not enough. All the information is present in the both audit log and engine log. You can even forward your audit log messages to email for example: https://www.ovirt.org/documentation/admin-guide/chap-Event_Notifications/ Best regards Martin Sivak On Mon, May 7, 2018 at 9:59 AM, Anastasiya Ruzhanskaya wrote: > So, then by analyzing traffic from ovirt-engine to ovirt-node ( vdsm) and > then from vdsm to libvirt I am not able to find out which user is executing > the actions ( for example shut down VM or make snapshot)? > > 2018-05-07 10:53 GMT+03:00 Martin Sivak : >> >> Hi, >> >> we send a correlation id with the commands to be able to pair the >> engine.log commands with vdsm commands. I am pretty sure we do not >> send any user identification to the node. >> >> Best regards >> >> Martin Sivak >> >> On Mon, May 7, 2018 at 6:19 AM, Anastasiya Ruzhanskaya >> wrote: >> > Hello! >> > Do messages sent from ovirt-engine to ovirt-node in RPC format contain >> > the >> > session number or any user information? >> > >> > >> > _______________________________________________ >> > Devel mailing list >> > Devel at ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/devel > > From anastasiya.ruzhanskaya at frtk.ru Mon May 7 08:11:10 2018 From: anastasiya.ruzhanskaya at frtk.ru (Anastasiya Ruzhanskaya) Date: Mon, 7 May 2018 11:11:10 +0300 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: As a part of my university diploma, we are making kind of access control tool as a firewall without dependence on oVirt roles ( this tool should actually work for all libvirt based virtualization products for KVM). It should be similar to Hytrust products or these ones http://en.securitycode.ru/vGate//. So my work is to find out what information I can use from the RPC calls and from where I can get an information about the user. 2018-05-07 11:00 GMT+03:00 Martin Sivak : > Hi, > > I think what you are looking for is mostly this: > https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml > > The best way to see what the traffic is is to disable SSL. The > postgres database is installed and accessible using the postgres user > (the engine user is not allowed to access it directly). > > You might also be interested in the vdsm fake project we use as node > simulator. Its readme will tell you exactly how to do this: > https://github.com/oVirt/ovirt-vdsmfake > > I wrote an article some time ago that explained how to setup a > development environment without real hosts: > https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ > > Might I ask what you goal is? > > Best regards > > -- > Martin Sivak > SLA / oVirt > > On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya > wrote: > > Hello everyone! > > Currently I want to determine what information is included in messages > > passing from oVirt engine to VDSM on ovirt-node. > > > > I made up a really simple configuration with one VM representing engine, > > another - node, a managed to successfully launch a single VM on this > node. > > However, I have chosen to configure everything automatically. Currently > > traffic is encrypted with default certificates. > > So, there are three options for me and no one of them really works. > > > > 1) Find the format of messages ( what the fields are, session id for > > example) in docs, but I didn't manage to find it; > > 2) Use wireshark to decrypt the traffic and the apply maybe a json > > -dissector to the decrypted data. I have tried many solutions ( thanks > god I > > have rsa private and public keys but there is another session key which > is > > generated every time engine starts to communicate with vdsm, which I > cannot > > get with the help of sslkeylog file or ld_preload technology. > > Maybe someone knows the exact methodology how to do this correctly? > > > > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for > engine, > > according to answers on oVirt site, I should do 2 requests to the > database. > > I was really surprised that psql was not installed by oVirt on my system. > > How did it then created a default database? ( I have chosen to create all > > locally and with default configurations). > > I mean these two commands : > > https://www.ovirt.org/develop/developer-guide/vdsm/ > connecting-development-vdsm-to-engine/ > > . I have a following error there : > > psql: FATAL: Peer authentication failed for user "engine" > > > > Could you please guide my what method is the best and how should I > correct > > my faults there? > > > > > > _______________________________________________ > > Devel mailing list > > Devel at ovirt.org > > http://lists.ovirt.org/mailman/listinfo/devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From sbonazzo at redhat.com Mon May 7 08:29:25 2018 From: sbonazzo at redhat.com (Sandro Bonazzola) Date: Mon, 7 May 2018 10:29:25 +0200 Subject: [ovirt-devel] ovirt-host-deploy and python3 In-Reply-To: References: <20180503215847.02524bbc@fiorina> <20180504110713.3f26a055@fiorina> Message-ID: 2018-05-07 9:43 GMT+02:00 Barak Korren : > > > On 7 May 2018 at 10:15, Sandro Bonazzola wrote: > >> >> >> 2018-05-06 7:53 GMT+02:00 Barak Korren : >> >>> >>> >>> On 4 May 2018 at 16:01, Greg Sheremeta wrote: >>> >>>> ci re-merge please >>>> >>>> >>> Please note that you should never run this on pre-merged patches as it >>> runs all the post-merge code including submission in change-queue. >>> >> >> I hope the code handling "ci re-merge please" is smart enough to check >> that the patch is merged before trying to re-merge it. >> If not, please fix it. >> > > As I wrote before, the V2 code is, the V1 code isn't, which is one more > reason to switch... > Looks like a good reason to enforce the switch. Yuval, can you please work with Asaf and Gal Z. about this for integration and node? > > > >> >> >> >>> >>> >>> >>>> On Fri, May 4, 2018 at 8:19 AM, Dan Kenigsberg >>>> wrote: >>>> >>>>> >>>>> >>>>> On Fri, May 4, 2018 at 2:09 PM, Sandro Bonazzola >>>>> wrote: >>>>> >>>>>> >>>>>> >>>>>> 2018-05-04 11:07 GMT+02:00 Tom?? Golembiovsk? : >>>>>> >>>>>>> On Fri, 4 May 2018 09:33:11 +0200 >>>>>>> Sandro Bonazzola wrote: >>>>>>> >>>>>>> > 2018-05-03 21:58 GMT+02:00 Tom?? Golembiovsk? >>>>>> >: >>>>>>> > >>>>>>> > > Hi, >>>>>>> > > >>>>>>> > > I'm trying to reinstall a CentOS host (using master-snapshot) >>>>>>> and I >>>>>>> > > noticed otopi is trying to use python3 while the >>>>>>> ovirt-host-deploy is >>>>>>> > > not yet fully python3 compatible: >>>>>>> > > >>>>>>> > >>>>>>> > How did you got python 3 on CentOS? >>>>>>> > It's not in CentOS distribution. >>>>>>> >>>>>>> From EPEL. We have 'python34*' listed in our ovirt-*-epel repos. >>>>>>> >>>>>> >>>>>> >>>>>> Dan, you asked for python34 packages from epel in >>>>>> https://gerrit.ovirt.org/#/c/55415/ >>>>>> Are they still needed? I don't see them required anywhere. >>>>>> Can we drop them? >>>>>> >>>>> >>>>> You are perfectly right, Sandro. My attempt to support Python 3 on el7 >>>>> failed. >>>>> https://gerrit.ovirt.org/90912 should clean its remainders. >>>>> >>>>> Can anybody remind me how I trigger check-merged job on it, for >>>>> verification? >>>>> >>>>> >>>>> _______________________________________________ >>>>> Devel mailing list >>>>> Devel at ovirt.org >>>>> http://lists.ovirt.org/mailman/listinfo/devel >>>>> >>>> >>>> >>>> >>>> -- >>>> >>>> GREG SHEREMETA >>>> >>>> SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX >>>> >>>> Red Hat NA >>>> >>>> >>>> >>>> gshereme at redhat.com IRC: gshereme >>>> >>>> >>>> _______________________________________________ >>>> Devel mailing list >>>> Devel at ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/devel >>>> >>> >>> >>> >>> -- >>> Barak Korren >>> RHV DevOps team , RHCE, RHCi >>> Red Hat EMEA >>> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >>> >> >> >> >> -- >> >> SANDRO BONAZZOLA >> >> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D >> >> Red Hat EMEA >> >> sbonazzo at redhat.com >> >> >> > > > > -- > Barak Korren > RHV DevOps team , RHCE, RHCi > Red Hat EMEA > redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted > -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA sbonazzo at redhat.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From anastasiya.ruzhanskaya at frtk.ru Mon May 7 08:40:01 2018 From: anastasiya.ruzhanskaya at frtk.ru (Anastasiya Ruzhanskaya) Date: Mon, 7 May 2018 11:40:01 +0300 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: If the engine user is not accessible directly, why then in this command you use it?: psql -U engine engine -c "UPDATE vdc_options set option_value = 'false' WHERE option_name = 'SSLEnabled';" I am not really good in managing databases, I also didn't have postgresql installed after finishing oVirt engine installation and even managing to deploy everything. Does it mean that no database was created at all? I have chosen automatic and local creation in all fields related to database while installing oVirt engine. 2018-05-07 11:00 GMT+03:00 Martin Sivak : > Hi, > > I think what you are looking for is mostly this: > https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml > > The best way to see what the traffic is is to disable SSL. The > postgres database is installed and accessible using the postgres user > (the engine user is not allowed to access it directly). > > You might also be interested in the vdsm fake project we use as node > simulator. Its readme will tell you exactly how to do this: > https://github.com/oVirt/ovirt-vdsmfake > > I wrote an article some time ago that explained how to setup a > development environment without real hosts: > https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ > > Might I ask what you goal is? > > Best regards > > -- > Martin Sivak > SLA / oVirt > > On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya > wrote: > > Hello everyone! > > Currently I want to determine what information is included in messages > > passing from oVirt engine to VDSM on ovirt-node. > > > > I made up a really simple configuration with one VM representing engine, > > another - node, a managed to successfully launch a single VM on this > node. > > However, I have chosen to configure everything automatically. Currently > > traffic is encrypted with default certificates. > > So, there are three options for me and no one of them really works. > > > > 1) Find the format of messages ( what the fields are, session id for > > example) in docs, but I didn't manage to find it; > > 2) Use wireshark to decrypt the traffic and the apply maybe a json > > -dissector to the decrypted data. I have tried many solutions ( thanks > god I > > have rsa private and public keys but there is another session key which > is > > generated every time engine starts to communicate with vdsm, which I > cannot > > get with the help of sslkeylog file or ld_preload technology. > > Maybe someone knows the exact methodology how to do this correctly? > > > > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for > engine, > > according to answers on oVirt site, I should do 2 requests to the > database. > > I was really surprised that psql was not installed by oVirt on my system. > > How did it then created a default database? ( I have chosen to create all > > locally and with default configurations). > > I mean these two commands : > > https://www.ovirt.org/develop/developer-guide/vdsm/ > connecting-development-vdsm-to-engine/ > > . I have a following error there : > > psql: FATAL: Peer authentication failed for user "engine" > > > > Could you please guide my what method is the best and how should I > correct > > my faults there? > > > > > > _______________________________________________ > > Devel mailing list > > Devel at ovirt.org > > http://lists.ovirt.org/mailman/listinfo/devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From mzamazal at redhat.com Mon May 7 09:19:15 2018 From: mzamazal at redhat.com (Milan Zamazal) Date: Mon, 07 May 2018 11:19:15 +0200 Subject: [ovirt-devel] OST: oVirt version used in basic-suite-4.2 In-Reply-To: (Eyal Edri's message of "Sun, 6 May 2018 16:29:15 +0300") References: <87d0yc3j6f.fsf@redhat.com> Message-ID: <87o9hrx1po.fsf@redhat.com> Eyal Edri writes: > I've merged https://gerrit.ovirt.org/#/c/90936/. > 4.2 will use tested now as first option, and only fallback to official repo. Great, thank you! > On Sun, May 6, 2018 at 12:57 PM, Barak Korren wrote: > >> >> >> On 3 May 2018 at 17:31, Milan Zamazal wrote: >> >>> Hi, I wonder why is ovirt-4.2 repo, rather than ovirt-4.2-snapshot or >>> so, used in reposync-config for basic-suite-4.2? Packages in ovirt-4.2 >>> are relatively old and the suite may fail on bugs that are already >>> fixed. Shouldn't a more up-to-date repo be used in basic-suite-4.2? >>> >>> Thanks, >>> Milan >>> >> >> >> The idea was to have OST run on the released versions by default so it can >> be used by 3rd party (non ovirt-core) contributors. >> >> We've decided to change things a short while ago and the patch to do that >> is here: >> https://gerrit.ovirt.org/c/89587/ >> >> But I've had no time to actually finish it. >> >> >> -- >> Barak Korren >> RHV DevOps team , RHCE, RHCi >> Red Hat EMEA >> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> From emesika at redhat.com Mon May 7 09:20:52 2018 From: emesika at redhat.com (Eli Mesika) Date: Mon, 7 May 2018 12:20:52 +0300 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: On Mon, May 7, 2018 at 11:00 AM, Martin Sivak wrote: > Hi, > > I think what you are looking for is mostly this: > https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml > > The best way to see what the traffic is is to disable SSL. The > postgres database is installed and accessible using the postgres user > (the engine user is not allowed to access it directly). > > You might also be interested in the vdsm fake project we use as node > simulator. Its readme will tell you exactly how to do this: > https://github.com/oVirt/ovirt-vdsmfake ?I don't think that vdsm fake is aligned to latest master , I have tried to use it before few months ?and it had lot of problems. I am afraid that vsm fake is a dead project since AFAIK no maintainer is updating it or testing it in a regular basis The last person I know that touched its code an tried to fix it was Roy Golan, but work is not completed yet > > > I wrote an article some time ago that explained how to setup a > development environment without real hosts: > https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ > > Might I ask what you goal is? > > Best regards > > -- > Martin Sivak > SLA / oVirt > > On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya > wrote: > > Hello everyone! > > Currently I want to determine what information is included in messages > > passing from oVirt engine to VDSM on ovirt-node. > > > > I made up a really simple configuration with one VM representing engine, > > another - node, a managed to successfully launch a single VM on this > node. > > However, I have chosen to configure everything automatically. Currently > > traffic is encrypted with default certificates. > > So, there are three options for me and no one of them really works. > > > > 1) Find the format of messages ( what the fields are, session id for > > example) in docs, but I didn't manage to find it; > > 2) Use wireshark to decrypt the traffic and the apply maybe a json > > -dissector to the decrypted data. I have tried many solutions ( thanks > god I > > have rsa private and public keys but there is another session key which > is > > generated every time engine starts to communicate with vdsm, which I > cannot > > get with the help of sslkeylog file or ld_preload technology. > > Maybe someone knows the exact methodology how to do this correctly? > > > > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for > engine, > > according to answers on oVirt site, I should do 2 requests to the > database. > > I was really surprised that psql was not installed by oVirt on my system. > > How did it then created a default database? ( I have chosen to create all > > locally and with default configurations). > > I mean these two commands : > > https://www.ovirt.org/develop/developer-guide/vdsm/ > connecting-development-vdsm-to-engine/ > > . I have a following error there : > > psql: FATAL: Peer authentication failed for user "engine" > > > > Could you please guide my what method is the best and how should I > correct > > my faults there? > > > > > > _______________________________________________ > > Devel mailing list > > Devel at ovirt.org > > http://lists.ovirt.org/mailman/listinfo/devel > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From msivak at redhat.com Mon May 7 09:22:14 2018 From: msivak at redhat.com (Martin Sivak) Date: Mon, 7 May 2018 11:22:14 +0200 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: Hi, you must have postgresql installed or the engine would not work. I see I used the engine user there (the second engine is the database name), but both vdsm fake and my personal notes say to use postgres user. sudo -i -u postgres export ENGINE_DB=dbname psql $ENGINE_DB -c "UPDATE vdc_options set option_value = 'false' WHERE option_name = 'SSLEnabled';" psql $ENGINE_DB -c "UPDATE vdc_options set option_value = 'false' WHERE option_name = 'EncryptHostCommunication';" So I must have done something differently at that time (the article was written in 2016). Best regards Martin Sivak On Mon, May 7, 2018 at 10:40 AM, Anastasiya Ruzhanskaya wrote: > If the engine user is not accessible directly, why then in this command you > use it?: > > psql -U engine engine -c "UPDATE vdc_options set option_value = 'false' > WHERE option_name = > 'SSLEnabled';" > > I am not really good in managing databases, I also didn't have postgresql > installed after finishing oVirt engine installation and even managing to > deploy everything. Does it mean that no database was created at all? I have > chosen automatic and local creation in all fields related to database while > installing oVirt engine. > > > 2018-05-07 11:00 GMT+03:00 Martin Sivak : >> >> Hi, >> >> I think what you are looking for is mostly this: >> https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml >> >> The best way to see what the traffic is is to disable SSL. The >> postgres database is installed and accessible using the postgres user >> (the engine user is not allowed to access it directly). >> >> You might also be interested in the vdsm fake project we use as node >> simulator. Its readme will tell you exactly how to do this: >> https://github.com/oVirt/ovirt-vdsmfake >> >> I wrote an article some time ago that explained how to setup a >> development environment without real hosts: >> https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ >> >> Might I ask what you goal is? >> >> Best regards >> >> -- >> Martin Sivak >> SLA / oVirt >> >> On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya >> wrote: >> > Hello everyone! >> > Currently I want to determine what information is included in messages >> > passing from oVirt engine to VDSM on ovirt-node. >> > >> > I made up a really simple configuration with one VM representing engine, >> > another - node, a managed to successfully launch a single VM on this >> > node. >> > However, I have chosen to configure everything automatically. Currently >> > traffic is encrypted with default certificates. >> > So, there are three options for me and no one of them really works. >> > >> > 1) Find the format of messages ( what the fields are, session id for >> > example) in docs, but I didn't manage to find it; >> > 2) Use wireshark to decrypt the traffic and the apply maybe a json >> > -dissector to the decrypted data. I have tried many solutions ( thanks >> > god I >> > have rsa private and public keys but there is another session key which >> > is >> > generated every time engine starts to communicate with vdsm, which I >> > cannot >> > get with the help of sslkeylog file or ld_preload technology. >> > Maybe someone knows the exact methodology how to do this correctly? >> > >> > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for >> > engine, >> > according to answers on oVirt site, I should do 2 requests to the >> > database. >> > I was really surprised that psql was not installed by oVirt on my >> > system. >> > How did it then created a default database? ( I have chosen to create >> > all >> > locally and with default configurations). >> > I mean these two commands : >> > >> > https://www.ovirt.org/develop/developer-guide/vdsm/connecting-development-vdsm-to-engine/ >> > . I have a following error there : >> > psql: FATAL: Peer authentication failed for user "engine" >> > >> > Could you please guide my what method is the best and how should I >> > correct >> > my faults there? >> > >> > >> > _______________________________________________ >> > Devel mailing list >> > Devel at ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/devel > > From emesika at redhat.com Mon May 7 09:22:27 2018 From: emesika at redhat.com (Eli Mesika) Date: Mon, 7 May 2018 12:22:27 +0300 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: On Mon, May 7, 2018 at 11:40 AM, Anastasiya Ruzhanskaya < anastasiya.ruzhanskaya at frtk.ru> wrote: > If the engine user is not accessible directly, why then in this command > you use it?: > > psql -U engine engine -c "UPDATE vdc_options set option_value = 'false' > WHERE option_name = 'SSLEnabled';" > > I am not really good in managing databases, I also didn't have postgresql > installed after finishing oVirt engine installation and even managing to > deploy everything. Does it mean that no database was created at all? I have > chosen automatic and local creation in all fields related to database while > installing oVirt engine. > ?Can you paste the output of the following command rpm -qa |grep postgres ? > > > 2018-05-07 11:00 GMT+03:00 Martin Sivak : > >> Hi, >> >> I think what you are looking for is mostly this: >> https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml >> >> The best way to see what the traffic is is to disable SSL. The >> postgres database is installed and accessible using the postgres user >> (the engine user is not allowed to access it directly). >> >> You might also be interested in the vdsm fake project we use as node >> simulator. Its readme will tell you exactly how to do this: >> https://github.com/oVirt/ovirt-vdsmfake >> >> I wrote an article some time ago that explained how to setup a >> development environment without real hosts: >> https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ >> >> Might I ask what you goal is? >> >> Best regards >> >> -- >> Martin Sivak >> SLA / oVirt >> >> On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya >> wrote: >> > Hello everyone! >> > Currently I want to determine what information is included in messages >> > passing from oVirt engine to VDSM on ovirt-node. >> > >> > I made up a really simple configuration with one VM representing engine, >> > another - node, a managed to successfully launch a single VM on this >> node. >> > However, I have chosen to configure everything automatically. Currently >> > traffic is encrypted with default certificates. >> > So, there are three options for me and no one of them really works. >> > >> > 1) Find the format of messages ( what the fields are, session id for >> > example) in docs, but I didn't manage to find it; >> > 2) Use wireshark to decrypt the traffic and the apply maybe a json >> > -dissector to the decrypted data. I have tried many solutions ( thanks >> god I >> > have rsa private and public keys but there is another session key which >> is >> > generated every time engine starts to communicate with vdsm, which I >> cannot >> > get with the help of sslkeylog file or ld_preload technology. >> > Maybe someone knows the exact methodology how to do this correctly? >> > >> > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for >> engine, >> > according to answers on oVirt site, I should do 2 requests to the >> database. >> > I was really surprised that psql was not installed by oVirt on my >> system. >> > How did it then created a default database? ( I have chosen to create >> all >> > locally and with default configurations). >> > I mean these two commands : >> > https://www.ovirt.org/develop/developer-guide/vdsm/connectin >> g-development-vdsm-to-engine/ >> > . I have a following error there : >> > psql: FATAL: Peer authentication failed for user "engine" >> > >> > Could you please guide my what method is the best and how should I >> correct >> > my faults there? >> > >> > >> > _______________________________________________ >> > Devel mailing list >> > Devel at ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/devel >> > > > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From anastasiya.ruzhanskaya at frtk.ru Mon May 7 12:21:05 2018 From: anastasiya.ruzhanskaya at frtk.ru (Anastasiya Ruzhanskaya) Date: Mon, 7 May 2018 08:21:05 -0400 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: rpm -qa |grep postgres rh-postgresql95-postgresql-libs-9.5.9-1.el7.x86_64 postgresql-libs-9.2.23-3.el7_4.x86_64 rh-postgresql95-runtime-2.2-2.el7.x86_64 rh-postgresql95-postgresql-9.5.9-1.el7.x86_64 postgresql-jdbc-9.2.1002-5.el7.noarch postgresql-contrib-9.2.23-3.el7_4.x86_64 rh-postgresql95-postgresql-server-9.5.9-1.el7.x86_64 postgresql-9.2.23-3.el7_4.x86_64 rh-postgresql95-postgresql-contrib-9.5.9-1.el7.x86_64 collectd-postgresql-5.8.0-2.el7.x86_64 postgresql-server-9.2.23-3.el7_4.x86_64 [skotti at localhost ~]$ psql -U postgres psql: FATAL: Peer authentication failed for user "postgres" But I actually installed it manually, still no succeed. But ovirt engine is working. 2018-05-07 5:22 GMT-04:00 Eli Mesika : > > > On Mon, May 7, 2018 at 11:40 AM, Anastasiya Ruzhanskaya < > anastasiya.ruzhanskaya at frtk.ru> wrote: > >> If the engine user is not accessible directly, why then in this command >> you use it?: >> >> psql -U engine engine -c "UPDATE vdc_options set option_value = 'false' >> WHERE option_name = 'SSLEnabled';" >> >> I am not really good in managing databases, I also didn't have postgresql >> installed after finishing oVirt engine installation and even managing to >> deploy everything. Does it mean that no database was created at all? I have >> chosen automatic and local creation in all fields related to database while >> installing oVirt engine. >> > > ?Can you paste the output of the following command > > rpm -qa |grep postgres ? > > > > >> >> >> 2018-05-07 11:00 GMT+03:00 Martin Sivak : >> >>> Hi, >>> >>> I think what you are looking for is mostly this: >>> https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml >>> >>> The best way to see what the traffic is is to disable SSL. The >>> postgres database is installed and accessible using the postgres user >>> (the engine user is not allowed to access it directly). >>> >>> You might also be interested in the vdsm fake project we use as node >>> simulator. Its readme will tell you exactly how to do this: >>> https://github.com/oVirt/ovirt-vdsmfake >>> >>> I wrote an article some time ago that explained how to setup a >>> development environment without real hosts: >>> https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-wit >>> hout-cluster/ >>> >>> Might I ask what you goal is? >>> >>> Best regards >>> >>> -- >>> Martin Sivak >>> SLA / oVirt >>> >>> On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya >>> wrote: >>> > Hello everyone! >>> > Currently I want to determine what information is included in messages >>> > passing from oVirt engine to VDSM on ovirt-node. >>> > >>> > I made up a really simple configuration with one VM representing >>> engine, >>> > another - node, a managed to successfully launch a single VM on this >>> node. >>> > However, I have chosen to configure everything automatically. Currently >>> > traffic is encrypted with default certificates. >>> > So, there are three options for me and no one of them really works. >>> > >>> > 1) Find the format of messages ( what the fields are, session id for >>> > example) in docs, but I didn't manage to find it; >>> > 2) Use wireshark to decrypt the traffic and the apply maybe a json >>> > -dissector to the decrypted data. I have tried many solutions ( thanks >>> god I >>> > have rsa private and public keys but there is another session key >>> which is >>> > generated every time engine starts to communicate with vdsm, which I >>> cannot >>> > get with the help of sslkeylog file or ld_preload technology. >>> > Maybe someone knows the exact methodology how to do this correctly? >>> > >>> > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for >>> engine, >>> > according to answers on oVirt site, I should do 2 requests to the >>> database. >>> > I was really surprised that psql was not installed by oVirt on my >>> system. >>> > How did it then created a default database? ( I have chosen to create >>> all >>> > locally and with default configurations). >>> > I mean these two commands : >>> > https://www.ovirt.org/develop/developer-guide/vdsm/connectin >>> g-development-vdsm-to-engine/ >>> > . I have a following error there : >>> > psql: FATAL: Peer authentication failed for user "engine" >>> > >>> > Could you please guide my what method is the best and how should I >>> correct >>> > my faults there? >>> > >>> > >>> > _______________________________________________ >>> > Devel mailing list >>> > Devel at ovirt.org >>> > http://lists.ovirt.org/mailman/listinfo/devel >>> >> >> >> _______________________________________________ >> Devel mailing list >> Devel at ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From michal.skrivanek at redhat.com Mon May 7 12:53:14 2018 From: michal.skrivanek at redhat.com (Michal Skrivanek) Date: Mon, 7 May 2018 14:53:14 +0200 Subject: [ovirt-devel] dynamic ownership changes In-Reply-To: References: <20180418081628.GA1704@Alexandra.local> <20180418111733.GA4702@Alexandra.local> <20180419120709.GB9449@Alexandra.local> <20180423125653.GA19987@Alexandra.local> <20180427072323.GA61744@Alexandra.local> <88BE8ADC-C0BE-4EF7-A8D2-7D725CE1355C@redhat.com> Message-ID: Hi Elad, why did you install vdsm-hook-allocate_net? adding Dan as I think the hook is not supposed to fail this badly in any case Thanks, michal > On 5 May 2018, at 19:22, Elad Ben Aharon wrote: > > Start VM fails on: > > 2018-05-05 17:53:27,399+0300 INFO (vm/e6ce66ce) [virt.vm] (vmId='e6ce66ce-852f-48c5-9997-5d2959432a27') drive 'vda' path: 'dev=/rhev/data-center/mnt/blockSD/db5a6696-d907-4938-9a78-bdd13a843c62/images/6cdabfe5- > d1ca-40af-ae63-9834f235d1c8/7ef97445-30e6-4435-8425-f35a01928211' -> u'*dev=/rhev/data-center/mnt/blockSD/db5a6696-d907-4938-9a78-bdd13a843c62/images/6cdabfe5-d1ca-40af-ae63-9834f235d1c8/7ef97445-30e6-4435-8425- > f35a01928211' (storagexml:334) > 2018-05-05 17:53:27,888+0300 INFO (jsonrpc/1) [vdsm.api] START getSpmStatus(spUUID='940fe6f3-b0c6-4d0c-a921-198e7819c1cc', options=None) from=::ffff:10.35.161.127,53512, task_id=c70ace39-dbfe-4f5c-ae49-a1e3a82c > 2758 (api:46) > 2018-05-05 17:53:27,909+0300 INFO (vm/e6ce66ce) [root] /usr/libexec/vdsm/hooks/before_device_create/10_allocate_net: rc=2 err=vm net allocation hook: [unexpected error]: Traceback (most recent call last): > File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 105, in > main() > File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 93, in main > allocate_random_network(device_xml) > File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 62, in allocate_random_network > net = _get_random_network() > File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 50, in _get_random_network > available_nets = _parse_nets() > File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 46, in _parse_nets > return [net for net in os.environ[AVAIL_NETS_KEY].split()] > File "/usr/lib64/python2.7/UserDict.py", line 23, in __getitem__ > raise KeyError(key) > KeyError: 'equivnets' > > > (hooks:110) > 2018-05-05 17:53:27,915+0300 ERROR (vm/e6ce66ce) [virt.vm] (vmId='e6ce66ce-852f-48c5-9997-5d2959432a27') The vm start process failed (vm:943) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 872, in _startUnderlyingVm > self._run() > File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2861, in _run > domxml = hooks.before_vm_start(self._buildDomainXML(), > File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2254, in _buildDomainXML > dom, self.id , self._custom['custom']) > File "/usr/lib/python2.7/site-packages/vdsm/virt/domxml_preprocess.py", line 240, in replace_device_xml_with_hooks_xml > dev_custom) > File "/usr/lib/python2.7/site-packages/vdsm/common/hooks.py", line 134, in before_device_create > params=customProperties) > File "/usr/lib/python2.7/site-packages/vdsm/common/hooks.py", line 120, in _runHooksDir > raise exception.HookError(err) > HookError: Hook Error: ('vm net allocation hook: [unexpected error]: Traceback (most recent call last):\n File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 105, in \n main()\n > File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 93, in main\n allocate_random_network(device_xml)\n File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 62, i > n allocate_random_network\n net = _get_random_network()\n File "/usr/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 50, in _get_random_network\n available_nets = _parse_nets()\n File "/us > r/libexec/vdsm/hooks/before_device_create/10_allocate_net", line 46, in _parse_nets\n return [net for net in os.environ[AVAIL_NETS_KEY].split()]\n File "/usr/lib64/python2.7/UserDict.py", line 23, in __getit > em__\n raise KeyError(key)\nKeyError: \'equivnets\'\n\n\n',) > > > > Hence, the success rate was 28% against 100% running with d/s (d/s). If needed, I'll compare against the latest master, but I think you get the picture with d/s. > > vdsm-4.20.27-3.gitfee7810.el7.centos.x86_64 > libvirt-3.9.0-14.el7_5.3.x86_64 > qemu-kvm-rhev-2.10.0-21.el7_5.2.x86_64 > kernel 3.10.0-862.el7.x86_64 > rhel7.5 > > > Logs attached > > On Sat, May 5, 2018 at 1:26 PM, Elad Ben Aharon > wrote: > nvm, found gluster 3.12 repo, managed to install vdsm > > On Sat, May 5, 2018 at 1:12 PM, Elad Ben Aharon > wrote: > No, vdsm requires it: > > Error: Package: vdsm-4.20.27-3.gitfee7810.el7.centos.x86_64 (/vdsm-4.20.27-3.gitfee7810.el7.centos.x86_64) > Requires: glusterfs-fuse >= 3.12 > Installed: glusterfs-fuse-3.8.4-54.8.el7.x86_64 (@rhv-4.2.3) > > Therefore, vdsm package installation is skipped upon force install. > > On Sat, May 5, 2018 at 11:42 AM, Michal Skrivanek > wrote: > > >> On 5 May 2018, at 00:38, Elad Ben Aharon > wrote: >> >> Hi guys, >> >> The vdsm build from the patch requires glusterfs-fuse > 3.12. This is while the latest 4.2.3-5 d/s build requires 3.8.4 (3.4.0.59rhs-1.el7) > > because it is still oVirt, not a downstream build. We can?t really do downstream builds with unmerged changes:/ > >> Trying to get this gluster-fuse build, so far no luck. >> Is this requirement intentional? > > it should work regardless, I guess you can force install it without the dependency > >> >> On Fri, May 4, 2018 at 2:38 PM, Michal Skrivanek > wrote: >> Hi Elad, >> to make it easier to compare, Martin backported the change to 4.2 so it is actually comparable with a run without that patch. Would you please try that out? >> It would be best to have 4.2 upstream and this[1] run to really minimize the noise. >> >> Thanks, >> michal >> >> [1] http://jenkins.ovirt.org/job/vdsm_4.2_build-artifacts-on-demand-el7-x86_64/28/ >> >>> On 27 Apr 2018, at 09:23, Martin Polednik > wrote: >>> >>> On 24/04/18 00:37 +0300, Elad Ben Aharon wrote: >>>> I will update with the results of the next tier1 execution on latest 4.2.3 >>> >>> That isn't master but old branch though. Could you run it against >>> *current* VDSM master? >>> >>>> On Mon, Apr 23, 2018 at 3:56 PM, Martin Polednik > >>>> wrote: >>>> >>>>> On 23/04/18 01:23 +0300, Elad Ben Aharon wrote: >>>>> >>>>>> Hi, I've triggered another execution [1] due to some issues I saw in the >>>>>> first which are not related to the patch. >>>>>> >>>>>> The success rate is 78% which is low comparing to tier1 executions with >>>>>> code from downstream builds (95-100% success rates) [2]. >>>>>> >>>>> >>>>> Could you run the current master (without the dynamic_ownership patch) >>>>> so that we have viable comparision? >>>>> >>>>> From what I could see so far, there is an issue with move and copy >>>>>> operations to and from Gluster domains. For example [3]. >>>>>> >>>>>> The logs are attached. >>>>>> >>>>>> >>>>>> [1] >>>>>> *https://rhv-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rhv >>>>>> -4.2-ge-runner-tier1-after-upgrade/7/testReport/ >>>>>> >>>>>> -4.2-ge-runner-tier1-after-upgrade/7/testReport/>* >>>>>> >>>>>> >>>>>> >>>>>> [2] >>>>>> https://rhv-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/ >>>>>> >>>>>> rhv-4.2-ge-runner-tier1-after-upgrade/7/ >>>>>> >>>>>> >>>>>> >>>>>> [3] >>>>>> 2018-04-22 13:06:28,316+0300 INFO (jsonrpc/7) [vdsm.api] FINISH >>>>>> deleteImage error=Image does not exist in domain: >>>>>> 'image=cabb8846-7a4b-4244-9835-5f603e682f33, >>>>>> domain=e5fd29c8-52ba-467e-be09-ca40ff054dd4' >>>>>> from=: >>>>>> :ffff:10.35.161.182,40936, flow_id=disks_syncAction_ba6b2630-5976-4935, >>>>>> task_id=3d5f2a8a-881c-409e-93e9-aaa643c10e42 (api:51) >>>>>> 2018-04-22 13:06:28,317+0300 ERROR (jsonrpc/7) [storage.TaskManager.Task] >>>>>> (Task='3d5f2a8a-881c-409e-93e9-aaa643c10e42') Unexpected error (task:875) >>>>>> Traceback (most recent call last): >>>>>> File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, >>>>>> in >>>>>> _run >>>>>> return fn(*args, **kargs) >>>>>> File "", line 2, in deleteImage >>>>>> File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 49, in >>>>>> method >>>>>> ret = func(*args, **kwargs) >>>>>> File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 1503, >>>>>> in >>>>>> deleteImage >>>>>> raise se.ImageDoesNotExistInSD(imgUUID, sdUUID) >>>>>> ImageDoesNotExistInSD: Image does not exist in domain: >>>>>> 'image=cabb8846-7a4b-4244-9835-5f603e682f33, >>>>>> domain=e5fd29c8-52ba-467e-be09-ca40ff054dd4' >>>>>> >>>>>> 2018-04-22 13:06:28,317+0300 INFO (jsonrpc/7) [storage.TaskManager.Task] >>>>>> (Task='3d5f2a8a-881c-409e-93e9-aaa643c10e42') aborting: Task is aborted: >>>>>> "Image does not exist in domain: 'image=cabb8846-7a4b-4244-9835- >>>>>> 5f603e682f33, domain=e5fd29c8-52ba-467e-be09-ca40ff054dd4'" - code 268 >>>>>> (task:1181) >>>>>> 2018-04-22 13:06:28,318+0300 ERROR (jsonrpc/7) [storage.Dispatcher] FINISH >>>>>> deleteImage error=Image does not exist in domain: >>>>>> 'image=cabb8846-7a4b-4244-9835-5f603e682f33, >>>>>> domain=e5fd29c8-52ba-467e-be09 >>>>>> -ca40ff054d >>>>>> d4' (dispatcher:82) >>>>>> >>>>>> >>>>>> >>>>>> On Thu, Apr 19, 2018 at 5:34 PM, Elad Ben Aharon > >>>>>> wrote: >>>>>> >>>>>> Triggered a sanity tier1 execution [1] using [2], which covers all the >>>>>>> requested areas, on iSCSI, NFS and Gluster. >>>>>>> I'll update with the results. >>>>>>> >>>>>>> [1] >>>>>>> https://rhv-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/4.2 >>>>>>> _dev/job/rhv-4.2-ge-flow-storage/1161/ >>>>>>> >>>>>>> [2] >>>>>>> https://gerrit.ovirt.org/#/c/89830/ >>>>>>> vdsm-4.30.0-291.git77aef9a.el7.x86_64 >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Thu, Apr 19, 2018 at 3:07 PM, Martin Polednik > >>>>>>> wrote: >>>>>>> >>>>>>> On 19/04/18 14:54 +0300, Elad Ben Aharon wrote: >>>>>>>> >>>>>>>> Hi Martin, >>>>>>>>> >>>>>>>>> I see [1] requires a rebase, can you please take care? >>>>>>>>> >>>>>>>>> >>>>>>>> Should be rebased. >>>>>>>> >>>>>>>> At the moment, our automation is stable only on iSCSI, NFS, Gluster and >>>>>>>> >>>>>>>>> FC. >>>>>>>>> Ceph is not supported and Cinder will be stabilized soon, AFAIR, it's >>>>>>>>> not >>>>>>>>> stable enough at the moment. >>>>>>>>> >>>>>>>>> >>>>>>>> That is still pretty good. >>>>>>>> >>>>>>>> >>>>>>>> [1] https://gerrit.ovirt.org/#/c/89830/ >>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> >>>>>>>>> On Wed, Apr 18, 2018 at 2:17 PM, Martin Polednik >>>>>>>>> > >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>> On 18/04/18 11:37 +0300, Elad Ben Aharon wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>> Hi, sorry if I misunderstood, I waited for more input regarding what >>>>>>>>>> >>>>>>>>>>> areas >>>>>>>>>>> have to be tested here. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> I'd say that you have quite a bit of freedom in this regard. >>>>>>>>>> GlusterFS >>>>>>>>>> should be covered by Dennis, so iSCSI/NFS/ceph/cinder with some suite >>>>>>>>>> that covers basic operations (start & stop VM, migrate it), snapshots >>>>>>>>>> and merging them, and whatever else would be important for storage >>>>>>>>>> sanity. >>>>>>>>>> >>>>>>>>>> mpolednik >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Wed, Apr 18, 2018 at 11:16 AM, Martin Polednik < >>>>>>>>>> mpolednik at redhat.com >>>>>>>>>> > >>>>>>>>>> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>> On 11/04/18 16:52 +0300, Elad Ben Aharon wrote: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> We can test this on iSCSI, NFS and GlusterFS. As for ceph and >>>>>>>>>>>> cinder, >>>>>>>>>>>> >>>>>>>>>>>> will >>>>>>>>>>>>> have to check, since usually, we don't execute our automation on >>>>>>>>>>>>> them. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Any update on this? I believe the gluster tests were successful, >>>>>>>>>>>>> OST >>>>>>>>>>>>> >>>>>>>>>>>> passes fine and unit tests pass fine, that makes the storage >>>>>>>>>>>> backends >>>>>>>>>>>> test the last required piece. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Apr 11, 2018 at 4:38 PM, Raz Tamir > >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> +Elad >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Wed, Apr 11, 2018 at 4:28 PM, Dan Kenigsberg >>>>>>>>>>>>>> > >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Wed, Apr 11, 2018 at 12:34 PM, Nir Soffer > >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Wed, Apr 11, 2018 at 12:31 PM Eyal Edri > >>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Please make sure to run as much OST suites on this patch as >>>>>>>>>>>>>>>> possible >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> before merging ( using 'ci please build' ) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> But note that OST is not a way to verify the patch. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Such changes require testing with all storage types we support. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Nir >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Tue, Apr 10, 2018 at 4:09 PM, Martin Polednik < >>>>>>>>>>>>>>>> mpolednik at redhat.com >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Hey, >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> I've created a patch[0] that is finally able to activate >>>>>>>>>>>>>>>>>> libvirt's >>>>>>>>>>>>>>>>>> dynamic_ownership for VDSM while not negatively affecting >>>>>>>>>>>>>>>>>> functionality of our storage code. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> That of course comes with quite a bit of code removal, mostly >>>>>>>>>>>>>>>>>> in >>>>>>>>>>>>>>>>>> the >>>>>>>>>>>>>>>>>> area of host devices, hwrng and anything that touches devices; >>>>>>>>>>>>>>>>>> bunch >>>>>>>>>>>>>>>>>> of test changes and one XML generation caveat (storage is >>>>>>>>>>>>>>>>>> handled >>>>>>>>>>>>>>>>>> by >>>>>>>>>>>>>>>>>> VDSM, therefore disk relabelling needs to be disabled on the >>>>>>>>>>>>>>>>>> VDSM >>>>>>>>>>>>>>>>>> level). >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Because of the scope of the patch, I welcome >>>>>>>>>>>>>>>>>> storage/virt/network >>>>>>>>>>>>>>>>>> people to review the code and consider the implication this >>>>>>>>>>>>>>>>>> change >>>>>>>>>>>>>>>>>> has >>>>>>>>>>>>>>>>>> on current/future features. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> [0] https://gerrit.ovirt.org/#/c/89830/ >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> In particular: dynamic_ownership was set to 0 prehistorically >>>>>>>>>>>>>>>>>> (as >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> part >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> of https://bugzilla.redhat.com/show_bug.cgi?id=554961 ) because >>>>>>>>>>>>>>> libvirt, >>>>>>>>>>>>>>> running as root, was not able to play properly with root-squash >>>>>>>>>>>>>>> nfs >>>>>>>>>>>>>>> mounts. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Have you attempted this use case? >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I join to Nir's request to run this with storage QE. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Raz Tamir >>>>>>>>>>>>>> Manager, RHV QE >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>> >>>>> >>>>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >>> >>> >> >> > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From cma at cmadams.net Mon May 7 15:46:10 2018 From: cma at cmadams.net (Chris Adams) Date: Mon, 7 May 2018 10:46:10 -0500 Subject: [ovirt-devel] Tracking down a vdsm memory leak Message-ID: <20180507154610.GA19303@cmadams.net> I have a problem with a memory leak in vdsm. I have a dev cluster that right now is: - two nodes - CentOS 7.4 (up to date) - oVirt 4.2.2 (installed as 3.5 and upgraded version by version) - hosted engine (no other running VM at the moment) - iSCSI storage I have a script that writes the vdsm RSS to a file every five minutes, and on the node holding the hosted engine, vdsm RSS grows around 300-1500KB every snapshot. I maintain several oVirt clusters for others, and they all seem to have this problem. The production clusters are all still on oVirt 4.1, but they all have this problem too, so I guess it is something about how I set them up? On a couple I just checked, the vdsm RSS is over 1G. Any tips on instrumenting vdsm to track this down? I am unfortunately only passingly familiar with python (I can make small changes, but not knowledgeable enough to figure this out). -- Chris Adams From michal.skrivanek at redhat.com Mon May 7 15:56:38 2018 From: michal.skrivanek at redhat.com (Michal Skrivanek) Date: Mon, 7 May 2018 17:56:38 +0200 Subject: [ovirt-devel] Tracking down a vdsm memory leak In-Reply-To: <20180507154610.GA19303@cmadams.net> References: <20180507154610.GA19303@cmadams.net> Message-ID: <01DB9BDC-BF56-4FC7-8CA2-97731B48625D@redhat.com> > On 7 May 2018, at 17:46, Chris Adams wrote: > > I have a problem with a memory leak in vdsm. I have a dev cluster that > right now is: > > - two nodes > - CentOS 7.4 (up to date) > - oVirt 4.2.2 (installed as 3.5 and upgraded version by version) > - hosted engine (no other running VM at the moment) > - iSCSI storage > > I have a script that writes the vdsm RSS to a file every five minutes, > and on the node holding the hosted engine, vdsm RSS grows around > 300-1500KB every snapshot. so it?s not happening on other nodes which are empty, and it?s not happening when other nodes are running some VM, as long as it is not the HE VM? > > I maintain several oVirt clusters for others, and they all seem to have > this problem. The production clusters are all still on oVirt 4.1, but > they all have this problem too, so I guess it is something about how I > set them up? On a couple I just checked, the vdsm RSS is over 1G. > > Any tips on instrumenting vdsm to track this down? I am unfortunately > only passingly familiar with python (I can make small changes, but not > knowledgeable enough to figure this out). > > -- > Chris Adams > _______________________________________________ > Devel mailing list > Devel at ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > > From cma at cmadams.net Mon May 7 16:03:56 2018 From: cma at cmadams.net (Chris Adams) Date: Mon, 7 May 2018 11:03:56 -0500 Subject: [ovirt-devel] Tracking down a vdsm memory leak In-Reply-To: <01DB9BDC-BF56-4FC7-8CA2-97731B48625D@redhat.com> References: <20180507154610.GA19303@cmadams.net> <01DB9BDC-BF56-4FC7-8CA2-97731B48625D@redhat.com> Message-ID: <20180507160356.GA19606@cmadams.net> Once upon a time, Michal Skrivanek said: > so it?s not happening on other nodes which are empty, and it?s not happening when other nodes are running some VM, as long as it is not the HE VM? Correct. I just simplified in my dev setup to not running any other VMs to make is easier to verify (nobody is trying to use any of the dev VMs right now). -- Chris Adams From msivak at redhat.com Mon May 7 16:22:09 2018 From: msivak at redhat.com (Martin Sivak) Date: Mon, 7 May 2018 18:22:09 +0200 Subject: [ovirt-devel] oVirt messages from engine to vdsm In-Reply-To: References: Message-ID: Hi, that sure looks like postgresql SCL packages. Software collections are installed into /opt and need to be enabled using the `scl enable ` command to allow their usage. Best regards Martin Sivak On Mon, May 7, 2018 at 2:21 PM, Anastasiya Ruzhanskaya wrote: > rpm -qa |grep postgres > rh-postgresql95-postgresql-libs-9.5.9-1.el7.x86_64 > postgresql-libs-9.2.23-3.el7_4.x86_64 > rh-postgresql95-runtime-2.2-2.el7.x86_64 > rh-postgresql95-postgresql-9.5.9-1.el7.x86_64 > postgresql-jdbc-9.2.1002-5.el7.noarch > postgresql-contrib-9.2.23-3.el7_4.x86_64 > rh-postgresql95-postgresql-server-9.5.9-1.el7.x86_64 > postgresql-9.2.23-3.el7_4.x86_64 > rh-postgresql95-postgresql-contrib-9.5.9-1.el7.x86_64 > collectd-postgresql-5.8.0-2.el7.x86_64 > postgresql-server-9.2.23-3.el7_4.x86_64 > [skotti at localhost ~]$ psql -U postgres > psql: FATAL: Peer authentication failed for user "postgres" > > But I actually installed it manually, still no succeed. But ovirt engine is > working. > > 2018-05-07 5:22 GMT-04:00 Eli Mesika : >> >> >> >> On Mon, May 7, 2018 at 11:40 AM, Anastasiya Ruzhanskaya >> wrote: >>> >>> If the engine user is not accessible directly, why then in this command >>> you use it?: >>> >>> psql -U engine engine -c "UPDATE vdc_options set option_value = 'false' >>> WHERE option_name = >>> 'SSLEnabled';" >>> >>> I am not really good in managing databases, I also didn't have postgresql >>> installed after finishing oVirt engine installation and even managing to >>> deploy everything. Does it mean that no database was created at all? I have >>> chosen automatic and local creation in all fields related to database while >>> installing oVirt engine. >> >> >> Can you paste the output of the following command >> >> rpm -qa |grep postgres >> >> >> >>> >>> >>> >>> 2018-05-07 11:00 GMT+03:00 Martin Sivak : >>>> >>>> Hi, >>>> >>>> I think what you are looking for is mostly this: >>>> https://github.com/oVirt/vdsm/blob/master/lib/vdsm/api/vdsm-api.yml >>>> >>>> The best way to see what the traffic is is to disable SSL. The >>>> postgres database is installed and accessible using the postgres user >>>> (the engine user is not allowed to access it directly). >>>> >>>> You might also be interested in the vdsm fake project we use as node >>>> simulator. Its readme will tell you exactly how to do this: >>>> https://github.com/oVirt/ovirt-vdsmfake >>>> >>>> I wrote an article some time ago that explained how to setup a >>>> development environment without real hosts: >>>> >>>> https://www.ovirt.org/blog/2016/11/testing-ovirt-changes-without-cluster/ >>>> >>>> Might I ask what you goal is? >>>> >>>> Best regards >>>> >>>> -- >>>> Martin Sivak >>>> SLA / oVirt >>>> >>>> On Sun, May 6, 2018 at 6:26 AM, Anastasiya Ruzhanskaya >>>> wrote: >>>> > Hello everyone! >>>> > Currently I want to determine what information is included in messages >>>> > passing from oVirt engine to VDSM on ovirt-node. >>>> > >>>> > I made up a really simple configuration with one VM representing >>>> > engine, >>>> > another - node, a managed to successfully launch a single VM on this >>>> > node. >>>> > However, I have chosen to configure everything automatically. >>>> > Currently >>>> > traffic is encrypted with default certificates. >>>> > So, there are three options for me and no one of them really works. >>>> > >>>> > 1) Find the format of messages ( what the fields are, session id for >>>> > example) in docs, but I didn't manage to find it; >>>> > 2) Use wireshark to decrypt the traffic and the apply maybe a json >>>> > -dissector to the decrypted data. I have tried many solutions ( thanks >>>> > god I >>>> > have rsa private and public keys but there is another session key >>>> > which is >>>> > generated every time engine starts to communicate with vdsm, which I >>>> > cannot >>>> > get with the help of sslkeylog file or ld_preload technology. >>>> > Maybe someone knows the exact methodology how to do this correctly? >>>> > >>>> > 3) Turn off ssl in oVirt. It is simple to do that for vdsm, but for >>>> > engine, >>>> > according to answers on oVirt site, I should do 2 requests to the >>>> > database. >>>> > I was really surprised that psql was not installed by oVirt on my >>>> > system. >>>> > How did it then created a default database? ( I have chosen to create >>>> > all >>>> > locally and with default configurations). >>>> > I mean these two commands : >>>> > >>>> > https://www.ovirt.org/develop/developer-guide/vdsm/connecting-development-vdsm-to-engine/ >>>> > . I have a following error there : >>>> > psql: FATAL: Peer authentication failed for user "engine" >>>> > >>>> > Could you please guide my what method is the best and how should I >>>> > correct >>>> > my faults there? >>>> > >>>> > >>>> > _______________________________________________ >>>> > Devel mailing list >>>> > Devel at ovirt.org >>>> > http://lists.ovirt.org/mailman/listinfo/devel >>> >>> >>> >>> _______________________________________________ >>> Devel mailing list >>> Devel at ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/devel >> >> >