July 2016 - Devel - oVirt List Archives

Strange issues with com.google.gwt.i18n.client.Messages.AlternateMessage [bz#1358837]
by Ramesh Nachimuthu 01 Aug '16

01 Aug '16

Hi, We have a strange issue with the com.google.gwt.i18n.client.Messages.AlternateMessage in UIMessages.java. We have defined some alternate messages using @Messages.Select with Enums. But its doesn't work any more. We have following messages in the UIMessages.java. @Messages.AlternateMessage(value = { "UNKNOWN" , "None" , "INTERVAL" , "Minute" , "HOURLY" , "Hourly" , "DAILY" , "Daily" , "WEEKLY" , "Weekly" , "MONTHLY" , "Monthly" }) String recurrenceType((a)Messages.Select GlusterVolumeSnapshotScheduleRecurrence recurrence); @Messages.AlternateMessage(value = { "BYTES" , "{0} B" , "KiB" , "{0} KiB" , "MiB" , "{0} MiB" , "GiB" , "{0} GiB" , "TiB" , "{0} TiB" }) String sizeUnitString(String size, @Messages.Select SizeConverter.SizeUnit sizeUnit); But the generated UIMessages_.java doesn't use any of the enum conditions. public java.lang.String recurrenceType(org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeSnapshotScheduleRecurrence arg0) { java.lang.String returnVal = null; int arg0_ordinal = -1; if (arg0 != null) { arg0_ordinal = arg0.ordinal(); } if (returnVal != null) { return returnVal; } return "Incorrect enum"; } public java.lang.String sizeUnitString(java.lang.String arg0,org.ovirt.engine.core.common.utils.SizeConverter.SizeUnit arg1) { java.lang.String returnVal = null; int arg1_ordinal = -1; if (arg1 != null) { arg1_ordinal = arg1.ordinal(); } if (returnVal != null) { return returnVal; } return arg0 + " TiB"; } It used to work earlier. Is there any known issue in the current GWT Version? or Am I missing something?. Regards, Ramesh

5 7

execCmd() and storing stdout and stderr in log file
by Tomáš Golembiovský 29 Jul '16

29 Jul '16

Hi, I had a need recently to run a command with execCmd() and store it's output and error to a log file, while still receiving it in the calling code. Redirecting the error to output stream to have all in one stream is also useful feature. All this can be done in the calling code: a) On the shell level, by modyfing the command. This can be intentionally dangerous because things like quoting of arguments has to be considered and also could cause problems when wrappers (sudo, nice, ...) are used. b) By handling the writing to files in a code. This would add unnecessary code duplication in a long run. (I don't think I'm the only one who can see a potential in this.) Also for asynchronous process runs, when storing both stderr & stdout in one file, it requires polling and some stream magic. It would be better to have this done right and only once so it can be properly tested. That's why I think having it present in execCmd() ready for everyone's use is the best solution. Unfortunately it seems that the code is a) essential on many places in vdsm and b) not properly covered by tests. Which makes it hard to touch. Also apparently some refactoring is either planned or already underway. What is the situation about refactoring that code area? Anyone working on it? Do we have an estimation of time-frame for it? Any suggestions/ideas? Tomas -- Tomáš Golembiovský <tgolembi(a)redhat.com>

5 23

Is there some guideline how to replace Linux Bridge with ovs on vdsm?
by lifuqiong 27 Jul '16

27 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_012C_01D1E818.185185B0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, I want to using ovs replace with Linux bridge, Is there some guideline or advice? If I want to use dpdk vhost-user port, how can I do that? Thank you Mark ------=_NextPart_000_012C_01D1E818.185185B0 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1>Hi, = <o:p></o:p>         I want to = using ovs replace with Linux bridge, Is there some guideline or advice? = If I want to use dpdk vhost-user port, how can I do = that?<o:p></o:p><o:p> </o:p>Thank you<o:p></o:p>Mark<o:p></o:p></div></body></html> ------=_NextPart_000_012C_01D1E818.185185B0--

2 1

[ANN] oVirt 4.0.2 Seconf Release Candidate is now available
by Sandro Bonazzola 27 Jul '16

27 Jul '16

The oVirt Project is pleased to announce the availability of the Second Release Candidate of oVirt 4.0.2 for testing, as of July 27st, 2016. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 This is pre-release software. Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This pre-release should not to be used in production. This update is the first release candidate of the second in a series of stabilization updates to the 4.0 series. 4.0.2 brings 12 enhancements and nearly 100 bugfixes, including 43 high or urgent severity fixes, on top of oVirt 4.0 series See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is available. [4] * A new oVirt Next Generation Node is available [4]. * A new oVirt Engine Appliance is already available. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.2 release highlights: http://www.ovirt.org/release/4.0.2/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.2/ [4] http://resources.ovirt.org/pub/ovirt-4.0-pre/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

Seeing a memory issue in 4.0.1.1-1.el7.centos
by Lynn Dixon 27 Jul '16

27 Jul '16

Hello all. I hope I am sending this to the proper mailing list. If not, please let me know. I just installed the latest oVirt engine onto a RHEL7.2 machine last night. I haven't built any VM's yet, but noticed that 27gig of memory was being consumed in the Dashboard. I did a quick check on top and noticed this: http://i.imgur.com/j9LB4q9.jpg The two java processes seem to be using a heavy amount of ram and reservations. How shall I troubleshoot this to find out whats going on? *Lynn Dixon* | Red Hat Certified Architect #100-006-188 *Sr. Cloud Consultant* | Cloud Management Practice Google Voice: 423-618-1414 Cell/Text: 423-774-3188 Click here to view my Certification Portfolio <http://red.ht/1XMX2Mi>

3 2

[VDSM] Using INFO log by default
by Nir Soffer 27 Jul '16

27 Jul '16

Hi all, We are using now INFO log level by default. This has two important effects: - We are not generating huge logs filling your disk - Some flows may not be logged properly now Please check that your code is logged properly - basically any state change in the system must be logged using log.info(). To increase log level temporarily, use: vdsClient -s 0 setLogLevel LEVEL [logger] logger is one of vdsm logger, see /etc/vdsm/logger.conf for the names. Without logger, the root logger is modified. To change logging level permanently, edit /etc/vdsm/logger.conf. Nir

2 1

Reply: [ovirt-users] Some question about vdsm rpc
by lifuqiong 27 Jul '16

27 Jul '16

Thank you very much for your helpful reply . The error of my question 4 is solved after I stopping debug vdsm code, just using print log info instead. On Tue, Jul 26, 2016 at 12:46 PM, lifuqiong <lifuqiong(a)cncloudsec.com> wrote: > 1. We know that xmlrpc and jsonrpc are enabled default in vdsm, vdsm > supply these two service in one port or two? What’s the port number > and how we can change it? > We use single port for both protocols. There is a code which peeks the data stream and decides which part of the code should handle the connection. In config.py you can find 'management_port' option which defines which port will be used. > > > 2. How can we know a vdsm host can supply an xmlrpc service or a > jsonrpc service? > In config.py we have 'xmlrpc_enable' and 'jsonrpc_enable' which determine protocols available during runtime. With the latest vdsm both are enabled but keep in mind that xmlrpc is deprecated and will be removed soon. > > > 3. I found that while ovirt engine installing a vdsm host, engine will > check whether we are connecting to vdsm which supports xmlrpc only, > engine send a ‘Host.ping’ jsonrpc request, why the code will enter > into bindingxmlrpc.py? > > Did both jsonrpc and xmlrpc will call bindingxmlrpc.py? > During host installation we attempt to connect to a host using jsonrpc first and if it fails we we attempt to use xmlrpc. Older vdsms provide only xmlrpc so this behavior is for backward compatibility. There are two binding modules bindingjsonrpc.py and bindingxmlrpc.py. Common module for both bindings is API.py > > > 4. Then, I just get an json return with code = 0 or code = 99. What > does these error code mean ? I can’t find detail in rpcjson > Specification(http://www.jsonrpc.org/specification) > There is a time when vdsm is not able to handle requests due to recovery logic which may take several seconds during this time we return code 99. Once the recovery is done vdsm returns correct codes like 0. Recovery occurs only during start of vdsm. > > > 5. When installing vdsm, I got an “Host server117 installation failed. > Host is not reachable” error. Debugging code as follows: > > Bindingxmlrpc.py > > line637 def ping(self): > > line638 # print 'os.getuid()',os.getuid() = 0 > > line639 # print 'os.getegit()',os.getegid() =0 > > line640 api = API.Global() > > line641 return api.ping() > Can you share the logs with above failure? > > > the api.ping() just open an file and update the file updating time, > why these will throw an error code 0 or 99? And I see the ping() > function created file /var/run/vdsm/client.log already exists in os, > ping verb was reused to detect whether vdsm is able to use jsonrpc. This verb originally is used to make sure that any network reconfiguration did not break connection to the engine. During the process of reconfiguration engine call ping and vdsm based on file update time can restore old network configuration in case of failure. > the only difference is the file is owned by root:root , not the vdsm:kvm? > Why? > There are 2 vdsm processes running with different user permissions. > > > Thank you. > > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users >

1 0

Some question about vdsm rpc
by lifuqiong 27 Jul '16

27 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_00F7_01D1E76E.0E1E4A60 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit 1. We know that xmlrpc and jsonrpc are enabled default in vdsm, vdsm supply these two service in one port or two? What's the port number and how we can change it? 2. How can we know a vdsm host can supply an xmlrpc service or a jsonrpc service? 3. I found that while ovirt engine installing a vdsm host, engine will check whether we are connecting to vdsm which supports xmlrpc only, engine send a 'Host.ping' jsonrpc request, why the code will enter into bindingxmlrpc.py? Did both jsonrpc and xmlrpc will call bindingxmlrpc.py? 4. Then, I just get an json return with code = 0 or code = 99. What does these error code mean ? I can't find detail in rpcjson Specification(http://www.jsonrpc.org/specification) 5. When installing vdsm, I got an "Host server117 installation failed. Host is not reachable" error. Debugging code as follows: Bindingxmlrpc.py line637 def ping(self): line638 # print 'os.getuid()',os.getuid() = 0 line639 # print 'os.getegit()',os.getegid() =0 line640 api = API.Global() line641 return api.ping() the api.ping() just open an file and update the file updating time, why these will throw an error code 0 or 99? And I see the ping() function created file /var/run/vdsm/client.log already exists in os, the only difference is the file is owned by root:root , not the vdsm:kvm? Why? Thank you. ------=_NextPart_000_00F7_01D1E76E.0E1E4A60 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1><![if !supportLists]>1.       = <![endif]>We know that xmlrpc = and jsonrpc are enabled default in vdsm, vdsm supply these two service = in one port or two? What’s the port number and how we can change = it?<o:p></o:p><o:p> </o:p><![if !supportLists]>2.       = <![endif]>How can we know a vdsm = host can supply an xmlrpc service or a jsonrpc = service?<o:p></o:p><o:p> </o:p> = <o:p></o:p><![if !supportLists]>3.       = <![endif]>I found that while = ovirt engine installing a vdsm host, engine will check whether we are = connecting to vdsm which supports xmlrpc only, engine send a = ‘Host.ping’ jsonrpc request,  why the code will enter = into bindingxmlrpc.py?<o:p></o:p>Did both jsonrpc and xmlrpc will call = bindingxmlrpc.py?<o:p></o:p><o:p> </o:p><![if !supportLists]>4.       = <![endif]>Then, I just get an = json return with code =3D 0 or code =3D 99. What does these error code = mean ? I can’t find detail in rpcjson Specification(<a = href=3D"http://www.jsonrpc.org/specification">http://www.jsonrpc.org/spec= ification</a>)<o:p></o:p><o:p> </o:p><![if !supportLists]>5.       = <![endif]>When installing vdsm, = I got an “Host server117 installation failed. Host is not = reachable” error. Debugging code as = follows:<o:p></o:p>Bindingxmlrpc.py<o:p></o:p>line637  def = ping(self):<o:p></o:p>line638       # print = 'os.getuid()',os.getuid() =3D 0<o:p></o:p>line639       # print = 'os.getegit()',os.getegid() =3D0<o:p></o:p>line640        api =3D = API.Global()<o:p></o:p>line641        return = api.ping()<o:p></o:p><o:p> </o:p>the api.ping() just open an file and update the file = updating time, why these will throw an error code 0 or 99? And I see the = ping() function created file /var/run/vdsm/client.log already exists in = os, <o:p></o:p>the = only difference is the file is owned by root:root , not the vdsm:kvm? = Why?<o:p></o:p><o:p> </o:p>Thank you.<o:p></o:p><o:p> </o:p></div></body></html> ------=_NextPart_000_00F7_01D1E76E.0E1E4A60--

2 1

Debug vdsm 4.0.0 report error: libvirt: XML-RPC error : Failed to connect socket to '/var/run/libvirt/libvirt-sock': Permission denied
by lifuqiong 26 Jul '16

26 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_001E_01D1E509.19780F20 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit I debugged vdsm with PyCharm, And I logged on my Centos 7.2 with root, and get an error as follows: Problem: Traceback (most recent call last): File "/usr/share/vdsm/vdsm", line 149, in run serve_clients(log) File "/usr/share/vdsm/vdsm", line 104, in serve_clients cif = clientIF.getInstance(irs, log, scheduler) File "/usr/share/vdsm/clientIF.py", line 204, in getInstance cls._instance = clientIF(irs, log, scheduler) File "/usr/share/vdsm/clientIF.py", line 106, in __init__ secret.clear() File "/usr/lib/python2.7/site-packages/vdsm/virt/secret.py", line 92, in clear con = libvirtconnection.get() File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 163, in get password) File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 99, in open_connection return utils.retry(libvirtOpen, timeout=10, sleep=0.2) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 546, in retry return func() File "/usr/lib64/python2.7/site-packages/libvirt.py", line 105, in openAuth if ret is None:raise libvirtError('virConnectOpenAuth() failed') libvirtError: Failed to connect socket to '/var/run/libvirt/libvirt-sock': Permission denied Investitate: According to the traceback above, the code in libvirt.py as below, and os.geteuid() get '0' which shows the current user is root; def openAuth(uri, auth, flags=0): #print os.geteuid() ret = libvirtmod.virConnectOpenAuth(uri, auth, flags) if ret is None:raise libvirtError('virConnectOpenAuth() failed') return virConnect(_obj=ret) [root@server117 libvirt]# ll /var/run/libvirt/libvirt-sock srwxrwx---. 1 root qemu 0 Jul 19 23:43 /var/run/libvirt/libvirt-sock According that, root should not get an Permission denied error ? But why? And I setenforce=0 , and still show Perssion denied error. What's the reason? And how to solve it? Thank you. ------=_NextPart_000_001E_01D1E509.19780F20 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1>I debugged = vdsm with PyCharm, And I logged on my Centos 7.2 with root,  and = get an error as follows:<o:p></o:p><o:p> </o:p>Problem:<o:p></o:p><o:p> </o:p>Traceback (most recent call last):<o:p></o:p>  File = "/usr/share/vdsm/vdsm", line 149, in = run<o:p></o:p>    = serve_clients(log)<o:p></o:p>  File "/usr/share/vdsm/vdsm", line 104, in = serve_clients<o:p></o:p>    cif =3D clientIF.getInstance(irs, log, = scheduler)<o:p></o:p>  File "/usr/share/vdsm/clientIF.py", line = 204, in getInstance<o:p></o:p>    cls._instance =3D clientIF(irs, log, = scheduler)<o:p></o:p>  File "/usr/share/vdsm/clientIF.py", line = 106, in __init__<o:p></o:p>    secret.clear()<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/virt/secret.py", line = 92, in clear<o:p></o:p>    con =3D = libvirtconnection.get()<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", = line 163, in get<o:p></o:p>    password)<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", = line 99, in open_connection<o:p></o:p>    return = utils.retry(libvirtOpen, timeout=3D10, = sleep=3D0.2)<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 546, in = retry<o:p></o:p>    return func()<o:p></o:p>  File = "/usr/lib64/python2.7/site-packages/libvirt.py", line 105, in = openAuth<o:p></o:p>    if ret is None:raise = libvirtError('virConnectOpenAuth() failed')<o:p></o:p>libvirtError: Failed to connect = socket to '/var/run/libvirt/libvirt-sock': Permission = denied<o:p></o:p><o:p> </o:p>Investitate:<o:p></o:p>According to the traceback above, = the code in libvirt.py as below, and  os.geteuid() get = ‘0’ which shows the current user is = root;<o:p></o:p><o:p> </o:p>def openAuth(uri, auth, flags=3D0):<o:p></o:p>         #print = os.geteuid()<o:p></o:p>    ret =3D = libvirtmod.virConnectOpenAuth(uri, auth, flags)<o:p></o:p>    if ret is = None:raise libvirtError('virConnectOpenAuth() = failed')<o:p></o:p>return = virConnect(_obj=3Dret)<o:p></o:p><o:p> </o:p>[root@server117 libvirt]# ll = /var/run/libvirt/libvirt-sock<o:p></o:p>srwxrwx---. 1 root qemu 0 Jul 19 = 23:43 /var/run/libvirt/libvirt-sock<o:p></o:p><o:p> </o:p>According that, root should not get = an Permission denied error ? But why?<o:p></o:p><o:p> </o:p>And I setenforce=3D0 , and still = show Perssion denied error.<o:p></o:p><o:p> </o:p>What’s the reason? And how to = solve it?<o:p></o:p><o:p> </o:p>Thank you.<o:p></o:p></div></body></html> ------=_NextPart_000_001E_01D1E509.19780F20--

5 9

Type Safety on the Frontend (refactoring of all async queries)
by Martin Betak 26 Jul '16

26 Jul '16

Hi All, today a *major* frontend refactoring was merged [1]. Its purpose was to remove some of the most significant artifacts of legacy C# code. Huge thanks to Vojtech and Alex for heavenly patience during code review! For a complete description please see the commit message, but here are some highlights for programmers that need to touch FE code: 1) AsyncQuery, AsyncCallback and Converter are now generic and typesafe (formerly INewAsyncCallback and IAsyncConverter). 2) It is no longer possible (or desirable) to PASS MODEL to queries. From within Model sublasses `new AsyncQuery<>(...)` will have the correct value set (see patch for impl details) and if you want to run a query on a different model (so the infrastructure would set the progress spinner on that model instead), usually for the purpose of a ListModel showing a popup window - where we want to display the spinner on the dialog window instead, you can use the `myWindowModel.asyncQuery(...)` helper factory to create query with model set to myWindowModel. // note: this also has the nice side-effect of eliminating the harmful pattern of using // the model value from within callbacks by casting it to surrounding model type (while that // value is already available by feature of java inner classes) 3) AsyncDataProvider's API methods now deal with strongly typed queries. This is facilitated through usage of strongly typed Converters (please see some defined converters -> usually you just need a CastingConverter<> or a ListConverter<>). Please use this architectural layer of strongly typed AsyncDataProvider to your advantage. (as plain Fronted.runQuery does not provide any guarantees and leaves you at risk of mis-casting the return value). If you have any more questions please feel free to ask me or look at the patch for details (warning: it's quite big!). This kind of major change necessarily touched all areas of the code (those issuing queries...) and there is of course some probability that something may break. But I believe this risk is well outweight by the benefits. Nevertheless if you find any issue please let me know and we can fix it together. Thanks again to anyone who contributed to this noble effort. Best regards :-) Martin [1] https://gerrit.ovirt.org/#/c/60822/

2 1

[ACTION REQUIRED] VDSM: vdsClientTests.CannonizeHostPortTest failing on master
by Sandro Bonazzola 26 Jul '16

26 Jul '16

*http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/4639/console <http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/4639/console>* *00:06:34.315* *00:06:34.315* ======================================================================*00:06:34.315* FAIL: testNoArguments (vdsClientTests.CannonizeHostPortTest)*00:06:34.315* ----------------------------------------------------------------------*00:06:34.316* Traceback (most recent call last):*00:06:34.316* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 494, in testNoArguments*00:06:34.316* self._assertIsIpAddressWithPort(vdscli.cannonizeHostPort())*00:06:34.316* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 548, in _assertIsIpAddressWithPort*00:06:34.316* self._assertValidAddress(addr)*00:06:34.317* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 555, in _assertValidAddress*00:06:34.317* addr)*00:06:34.317* AssertionError: ('invalid IPv4 address: %s', 'ovirt-srv19.phx.ovirt.org')*00:06:34.317* *00:06:34.317* ======================================================================*00:06:34.317* FAIL: testNoneArgument (vdsClientTests.CannonizeHostPortTest)*00:06:34.318* ----------------------------------------------------------------------*00:06:34.318* Traceback (most recent call last):*00:06:34.318* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 497, in testNoneArgument*00:06:34.318* self._assertIsIpAddressWithPort(vdscli.cannonizeHostPort(None))*00:06:34.318* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 548, in _assertIsIpAddressWithPort*00:06:34.319* self._assertValidAddress(addr)*00:06:34.319* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 555, in _assertValidAddress*00:06:34.319* addr)*00:06:34.319* AssertionError: ('invalid IPv4 address: %s', 'ovirt-srv19.phx.ovirt.org')*00:06:34.319* *00:06:34.319* ======================================================================*00:06:34.319* FAIL: testNoneArgumentAndPort (vdsClientTests.CannonizeHostPortTest)*00:06:34.320* ----------------------------------------------------------------------*00:06:34.320* Traceback (most recent call last):*00:06:34.320* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 502, in testNoneArgumentAndPort*00:06:34.320* self._assertIsIpAddressWithPort(res)*00:06:34.320* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 548, in _assertIsIpAddressWithPort*00:06:34.321* self._assertValidAddress(addr)*00:06:34.321* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 555, in _assertValidAddress*00:06:34.321* addr)*00:06:34.321* AssertionError: ('invalid IPv4 address: %s', 'ovirt-srv19.phx.ovirt.org')*00:06:34.321* *00:06:34.321* Name Stmts Miss Cover Missing*00:06:34.322* --------- -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 2

VDSM retired from Fedora distribution
by Sandro Bonazzola 26 Jul '16

26 Jul '16

Hi, just an heads up about VDSM been retired from Fedora distribution due to broken dependency. If you want to get it back there you'll have to start again with the package review process. Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 1

[ACTION REQUIRED] oVirt 4.0.2 rc2 build starting in 1 hour
by Sandro Bonazzola 26 Jul '16

26 Jul '16

Fyi oVirt products maintainers, An oVirt build for an official release is going to start in one hour If you're a maintainer for any of the projects included in oVirt distribution and you have changes in your package ready to be released please: - bump version and release to be GA ready - tag your release within git (implies a GitHub Release to be automatically created) - build your packages within jenkins / koji / copr / whatever - verify all bugs on MODIFIED have target release and target milestone set. - add your builds to releng-tools/releases/ovirt-4.0.2_rc2.conf withini releng-tools project -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

DRBD Integration with oVirt
by Hayley Swimelar 26 Jul '16

26 Jul '16

Hello all, A DRBD integration into oVirt is currently being planned. DRBD provides replicated, highly available block storage. For those unfamiliar with DRBD more information can be found here: https://www.drbd.org/en/comp/drbd-linux-driver DRBD 9 is the latest version of DRBD and interacts with DRBD Manage which is a daemon exposed via a D-Bus api. More information can be found here: https://www.drbd.org/en/comp/drbdmanage DRBD Manage handles the creation, assignment, etc. of DRBD volumes and is the interface through which Cinder manages DRBD. We are looking for advice on how best to have oVirt communicate with DRBD Manage and we have come to two options: 1) Use Cinder. Although we are integrated into Cinder, there are concerns about the need to set up a complete Cinder instance to provide access to DRBD. 2) The alternative to Cinder would be to have the oVirt Engine communicate directly to DRBD Manage via D-Bus. Any advice on the best way to achieve this would be much appreciated. -- Hayley Swimelar LINBIT | Keeping the Digital World Running DRBD — Corosync — Pacemaker +1-503-573-1262 x212

5 11

When debug vdsm branch 4.0, why there has some code will call function ping(self) in bindingxmlrpc.py cycle? Even the vdsm is not managed by ovirt-engine?
by lifuqiong 26 Jul '16

26 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_00BE_01D1E741.42F55580 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, I setup a breakpoint in Line 637 in bindingxmlrpc.py , which as follows: (branch:4.0; code url is: https://github.com/oVirt/vdsm/tree/ovirt-4.0) 636 def ping(self): 637 api = API.Global() 638 return api.ping() But even the vdsm is not managed by any ovirt-engine , the line 637 will be called many times, I thought the ping() function will be called only when the ovirt-engine will create connection with vdsm, so why it will be called cycle? Thank you ------=_NextPart_000_00BE_01D1E741.42F55580 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1>Hi, = <o:p></o:p>         I setup a = breakpoint in Line 637 in bindingxmlrpc.py , which as follows:  = (branch:4.0; code url is: = https://github.com/oVirt/vdsm/tree/ovirt-4.0)<o:p></o:p>636  def = ping(self):<o:p></o:p>637     api =3D = API.Global()<o:p></o:p>638     return = api.ping()<o:p></o:p><o:p> </o:p>         But even = the vdsm is not managed by any ovirt-engine ,  the line 637 will be = called many times, <o:p></o:p><o:p> </o:p>         I thought = the ping() function will be called only when the ovirt-engine will = create connection with vdsm, so why it will be called = cycle?<o:p></o:p><o:p> </o:p>Thank you<o:p></o:p><o:p> </o:p><o:p> </o:p></div></body></html> ------=_NextPart_000_00BE_01D1E741.42F55580--

2 1

How to build and install oVirt on Product Environment
by Dewey Du 25 Jul '16

25 Jul '16

To build and install ovirt-engine execute the folllowing command: $ make clean install-dev PREFIX="${PREFIX}" What about installing it on Product Environment. Is the folllowing command right? $ make clean install PREFIX="${PREFIX}"

2 1

Blog post: Monitoring Improvements in oVirt
by Arik Hadas 25 Jul '16

25 Jul '16

Hi all, I wrote a blog post that summarizes the recent improvements in the code that monitors virtual machines in oVirt. It describes the changes that were done and shows a comparison of different aspects of oVirt with these changes (based on the master branch) vs oVirt 3.6 without these changes: http://ahadas.github.io/monitoring-improvements-in-ovirt/ It is mostly a technical post. However, users might find it interesting as well. Note that the measurements were taken on an environment with 1 host and 6000 running VMs (in a pool). Each VM had a network interface and was diskless. Obviously, this is not a typical setup but it was useful to easily expose some of weak sides of the monitoring. Your feedback is always welcome! Regards, Arik

2 2

anonymous upgrade script instead of tmp function ceremony
by Roy Golan 25 Jul '16

25 Jul '16

We all use the pattern of temporary creating a function for upgrade script, declaring it (copy pasting from last script) and then calling it, then deleting it. This very verbose can be replaced with DO instruction which does essentially the same. # existing declaration ```sql CREATE OR REPLACE FUNCTION __tmp_count() RETURNS VOID AS $procedure$ DECLARE i int; BEGIN i:= (select count(*) from vms) -- useless count just for the demo END; $procedure$ LANGUAGE plpgsql; SELECT __tmp_count(); DROP FUNCTION __tmp_acount(); ``` Can be replaced with ```sql DO $$ DECLARE i int; BEGIN i := (select count(*) from vms) -- useless count for demo END $$; ``` Not tested but tons of less lines to code. Exist in version 9.0.23 and above

1 0

[ANN] oVirt 4.0.2 Release Candidate is now available
by Sandro Bonazzola 21 Jul '16

21 Jul '16

The oVirt Project is pleased to announce the availability of the First Release Candidate of oVirt 4.0.2 for testing, as of July 21st, 2016. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 This is pre-release software. Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This pre-release should not to be used in production. This update is the first release candidate of the second in a series of stabilization updates to the 4.0 series. 4.0.2 brings 5 enhancements and nearly 100 bugfixes, including 38 high or urgent severity fixes, on top of oVirt 4.0 series See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is available. [4] * A new oVirt Next Generation Node is available [4]. * A new oVirt Engine Appliance is already available. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.2 release highlights: http://www.ovirt.org/release/4.0.2/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.2/ [4] http://resources.ovirt.org/pub/ovirt-4.0-pre/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

changing engine domain name
by Paul Dyer 20 Jul '16

20 Jul '16

Hi, back in 2015, with the first install of ovirt, I used a domain of xxxportal.com. Since the client has an xxxcentral.com wildcard certificate, I added changed the hostname and domainname, and added the cert/cacert to the apache webpage. The pki on ovirt and vdsm (host) both still have the original xxxportal.com domain. I am looking for a way to wipe away the old domain. Do I need to remove the host (not hosted engine), drop the datacenter/cluster, and build from a clean db? Thanks, Paul -- Paul Dyer, Mercury Consulting Group, RHCE 504-302-8750

3 8

New SDM verb: SDM.copy_data
by Adam Litke 20 Jul '16

20 Jul '16

Hi oVirt! I wanted to take a moment to update you on a new storage verb we have in vdsm called SDM.copy_data. The purpose of this verb is to allow copying of data between various endpoints* on hosts that are not necessarily the SPM. This will allow us in the future to spread the load created by this data-intensive operation across multiple hosts while providing a better user experience than the current SPM-driven flow can. Current status (Sprint 1): - Basic SDM.copy_data is merged to vdsm - We still use the SPM host for creating the destination disk and to serially copy all volumes. - The engine Move Disk flow is being adapted to use the new verb. Patches should be merged in the next day or two. https://gerrit.ovirt.org/#/c/61087/ - New code paths must be activated by setting a config variable: "update vdc_options set option_value = true \ where option_name = 'DataOperationsByHSM';" - Currently positive flows are implemented Next steps: - Copy progress reporting in UI - Support negative flows (eg. lost contact with host) - Use this verb for live storage migration flows - Vdsm-side locking - Select a non-SPM host (when available) for copying Farther out: - Support for copy in parallel - Implement other data path verbs (eg. wipe_volume, sparsify_volume) -- Adam Litke

1 0

Vdsm/virt conversion to etree
by Milan Zamazal 20 Jul '16

20 Jul '16

We have been planning switching from minidom to etree in Vdsm for long time. There are several good reasons why to make the change: - We currently use both minidom and etree, we should use a single library. - etree has apparently better performance in the sense of CPU time and RAM usage. - etree has a simpler and more convenient API (e.g. limited XPath support). After various discussions and trying different draft approaches, there is now available a complete series of patches migrating virt usage of minidom to etree. It starts with patch https://gerrit.ovirt.org/55769 and you can follow the whole vm-etree topic from there. Please read the commit message in the initial patch, it explains the overall approach. I tried to make the series reviewer friendly, for patch-by-patch review. It's still draft, not finished, missing many tests, etc., but it already basically works. If you have any serious problems with the approach to the conversion or its general directions, tell me before we start discussing details. Just don't forget we must perform the conversion in some reasonably safe way and it must be possible to review it. Please note the series doesn't try to solve all the world/Vdsm problems, it focuses just on the etree conversion. Further changes may be implemented in followup patches. I already implemented some post-refactoring in vm-etree-refact topic starting with https://gerrit.ovirt.org/60940. Thanks to Francesco Romani for cooperation and help with the work.

1 0

Engine 4.0.2 stable branch created
by Tal Nisan 20 Jul '16

20 Jul '16

Hi everyone, A branch for 4.0.2 was created today (ovirt-engine-4.0.2). Note that all patches for 4.0.2 bugs are to be backported twice (4.0 and then 4.0.2), 4.0.3 bugs can now be backported as well to 4.0 only. T.

1 0

[VDSM] vdsm_master_verify-error-codes_created running on master - why?
by Nir Soffer 20 Jul '16

20 Jul '16

Hi all, Since yesterday, vdsm_master_verify-error-codes_created job is running on master. I guess that this was a unintended change in jenkins - please revert this change. If someone want to add a job for vdsm master, it must be approved by vdsm maintainers first. The best would be to run everything from the automation scripts, so vdsm maintainers have full control on the way patches are checked. Thanks, Nir

3 5

[RFE][4.1][F24] Fedora 24 support
by Sandro Bonazzola 19 Jul '16

19 Jul '16

Hi, as you know Fedora 24 has been released last month. I pushed a pull request[1] describing the feature support effort. Of the detailied description, the following items have been already implemented: - Support building on Fedora 24 - Create Jenkins jobs for automated build and testing on Fedora 24 - Create Fedora 24 Jenkins slaves the following item is still to be done: - Verify that all the components have no regressions only due to Fedora 24 How you can help: - Review / comment the pull request for the feature [1] - Test oVirt master nightly[2] on Fedora 24 - Open bugs on issue you see while running master on Fedora 24 - Verify test cases[4] on Fedora 24 Please use [F24] in the subject if you provide feedback on the mailing list, it will help tracking discussions related to this feature. [1] https://github.com/oVirt/ovirt-site/pull/368 [2] http://www.ovirt.org/develop/dev-process/install-nightly-snapshot/ [3] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [4] http://www.ovirt.org/develop/infra/testing/test-cases/ -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

Arrays.asList and GWT
by Roman Mohr 19 Jul '16

19 Jul '16

Hi List, Seems like GWT can't handle Arrays.asList not very well. Sharing this in case others have similar issues: I was working on a very strange deserialization bug in combination with GWT [1]. We had a deserialization problem after loading a VM and trying to send the VM back to the backend. The error looked like this: 2016-06-28 12:17:36,206 ERROR [io.undertow.servlet] (default task-58) Exception while dispatching incoming RPC call: java.lang.NumberFormatException: For input string: "undefined" It turned out that GWT could serialize an ArrayList backed by an Integer[] array but it could not deserialize it afterwards. In my case a list returned by ResultSet#getArray in the DAO layer was sent to GWT: entity.setCpuIds(Arrays.asList((Integer[]) rs.getArray("cpu_core_ids").getArray())); After copying the content over into a regular ArrayList everything worked fine again. entity.setCpuIds(new ArrayList<Integer>(Arrays.asList((Integer[]) rs.getArray("cpu_core_ids").getArray()))) Here is also the gerrit patch set [2]. So if you see strange GWT RPC errors like the one above look out for "Arrays.asList" in you code :). Best Regards, Roman [1] https://bugzilla.redhat.com/show_bug.cgi?id=1350861 [2] https://gerrit.ovirt.org/#/c/61038/2

1 0

oVirt 4.0.2 RC1 merge / branch / tag / bugzilla reminder
by Sandro Bonazzola 19 Jul '16

19 Jul '16

All stable branch maintainers, please make sure to - merge all relevant open bugs until Wednesday morning 11:00 AM TLV time. For each package that need to be built (i.e oVirt product) please make sure every bug in MODIFIED has the right Target Release and Target Milestone. A Target release should state the version of the package you're building and should include the same version you used for the tag you just used for this build. (e.g. for ovirt-engine, tag: ovirt-engine-4.0.2, tr: 4.0.2) A list of bugs that require attention is here: - https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_milestone%3A4.0.… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

oVirt 4.0.2 RC1 build planned
by Sandro Bonazzola 19 Jul '16

19 Jul '16

Fyi oVirt developers, An oVirt build is planned for this Wednesday 11:00 AM TLV time (10:00 AM CEST). Taking into consideration the time it takes for Jenkins to run a full CI everything need to be backported by Tuesday 11PM. Please make sure to mark as verified and CR +2 so it will be ready for merging Wednesday morning. A new branch ovirt-engine-4.0.2 will be created just before the build, an announce will be sent to remind to backport to that branch after its creation. A list of pending blockers is available here: https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_milestone%3A4.0.… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[ANN] oVirt 4.0.1 Final Release is now available
by Sandro Bonazzola 19 Jul '16

19 Jul '16

The oVirt Project is pleased to announce today the general availability of oVirt 4.0.1. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This update is the first in a series of stabilization updates to the 4.0 series. 4.0.1 brings 10 enhancements and more than 200 bugfixes[6], including 70 high or urgent severity fixes, on top of oVirt 4.0 series and is a recommended update for everyone running 4.0.0. See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is available. [4] * A new oVirt Next Generation Node will be available soon [4]. * A new oVirt Engine Appliance is already available. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.1 release highlights: http://www.ovirt.org/release/4.0.1/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.1/ [4] http://resources.ovirt.org/pub/ovirt-4.0/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors [6] https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_milestone%3Aovir… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[VDSM] all check-patch jobs fail on fedora
by Nir Soffer 16 Jul '16

16 Jul '16

Hi infra, Vdsm tests fails now on fedora since they are running now on fedora 24, while vdsm automation was not updated yet to fedora 24. See http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc24-x86_64/ The problem patch seems to be: commit 4a40459191b39bafb6d14c34d6346bb152bc55da Author: Sandro Bonazzola <sbonazzo(a)redhat.com> Date: Thu Jul 14 13:58:44 2016 +0200 vdsm: move from fc22 to fc24 - dropped fc22 gone EOL - moved master to fc24 Change-Id: Ifce815087c649404b44f657911702735c53f75c3 Signed-off-by: Sandro Bonazzola <sbonazzo(a)redhat.com> Please revert this patch. We must add support for fedora 24 to vdsm first. When the tests are stable we can switch to fedora 24. Thanks, Nir

2 2

ovirt-engine housekeeping
by Sandro Bonazzola 15 Jul '16

15 Jul '16

Hi, as we did for 3.5, I'm going to do some housekeeping on ovirt-engine git repo. Unless a good reason is given I'm going to drop the following branches on Firday July 15th, being all of them still reachable by tags. ovirt-engine-3.6.0 e55a3b57c7541a60383a8d55f02a6ddeb6ae2ea6 ovirt-engine-3.6.1 81deade7478d1f1b55fd5cbc80a3b3003d9d1a18 ovirt-engine-3.6.2 7db5d96e4ca9a0c4896f627ba4a8835fd395e0b1 ovirt-engine-3.6.3 cb35e8c0070fd666f6a59b2e51993daa94e8ce6a ovirt-engine-3.6.4 e25f112ba2bac541b0e37d3cb60a1eda346b1ed9 ovirt-engine-3.6.5 cd869286db412bbc2d750838eef6f246b229aae2 ovirt-engine-3.6.6 d37fcd09f558d8884b804f8e774f9545b0981fc5 ovirt-engine-3.6.7 f94c8a7131ab2b23219916ee05030b499aec6252 Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 1

oVirt metrics
by Yaniv Bronheim 14 Jul '16

14 Jul '16

Hi, In oVirt-4.0 we introduced integration with metrics collectors, In [1] you will find a guide for utilizing your environment to retrieve visualized reports about hosts and vms statistics. I encourage to try that out and send us requests for additional valuable metrics that you think vdsm should publish. This area is still work in progress and we plan to support more technologies and different architectures for metrics collections as describes in the post. This will follow by additional links in the post ([1]) that describe how to do so.. stay tuned. [1] https://bronhaim.wordpress.com/2016/06/26/ovirt-metrics <https://bronhaim.wordpress.com/2016/06/26/ovirt-metrics/>-- *Yaniv Bronhaim.*

4 3

[ACTION REQUIRED] broken dependency with vdsm git6e84643
by Sandro Bonazzola 13 Jul '16

13 Jul '16

DEBUG util.py:417: Error: Package: vdsm-4.18.999-232.git6e84643.el7.centos.x86_64 (ovirt-master-snapshot) DEBUG util.py:417: Requires: safelease >= 1.0-7 DEBUG util.py:417: Available: safelease-1.0-5.el7.x86_64 (centos-epel) DEBUG util.py:417: safelease = 1.0-5.el7 -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

5 7

[ANN] oVirt 4.0.1 Second Release candidate is now available for testing
by Sandro Bonazzola 13 Jul '16

13 Jul '16

The oVirt Project is pleased to announce the availability of the Second Release Candidate of oVirt 4.0.1 for testing, as of July 13th, 2016. This is pre-release software. Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This pre-release should not to be used in production. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 See the release notes draft [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is already available [4]. * A new oVirt Next Generation Node will be available soon [4] * A new oVirt Engine Appliance wil be available soon. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.1 release candidate highlights: http://www.ovirt.org/release/4.0.1/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.1/ [4] http://resources.ovirt.org/pub/ovirt-4.0-pre/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[ACTION REQUIRED] oVirt 4.0.1 RC2 build starting
by Sandro Bonazzola 12 Jul '16

12 Jul '16

Fyi oVirt products maintainers, An oVirt build for an official release is going to start right now. If you're a maintainer for any of the projects included in oVirt distribution and you have changes in your package ready to be released please: - bump version and release to be GA ready - tag your release within git (implies a GitHub Release to be automatically created) - build your packages within jenkins / koji / copr / whatever - verify all bugs on MODIFIED have target release and target milestone set. - add your builds to releng-tools/releases/ovirt-4.0.1_rc2.conf within releng-tools project Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

Caching of data from the database done properly
by Roman Mohr 12 Jul '16

12 Jul '16

Hi Everyone, I wanted to discuss a practice which seems to be pretty common in the engine which I find very limiting, dangerous and for some things it can even be a blocker. There are several places in the engine where we are using maps as cache in singletons to avoid reloading data from the database. Two prominent ones are the QuotaManager[1] and the MacPoolPerCluster[2]. While it looks tempting to just use a map as cache, add some locks around it and create an injectable singleton, this has some drawbacks: 1) We have an autoritative source for our data and it offers transactions to take care of inconsistencies or parallel updates. Doing all that in a service again duplicates this. 2) Caching on the service layer is definitely not a good idea. It can introduce unwanted side effects when someone invokes the DAOs directly. 3) The point is more about the question if a cache is really needed: Do I just want that cache because I find it convenient to do a #getMacPoolForCluster(Guid clusterId) in a loop instead of just loading it once before the loop, or do my usage requirements really force me to use a cache? If you really need a cache, consider the following: 1) Do the caching on the DAO layer. This guarantees the best consistency across the data. 2) Yes this means either locking in the DAOs or a transactional cache. But before you complain, think about what in [1] and [2] is done. We do exactly that there, so the complexity is already introduced anyway. 3) Since we are working with transactions, a custom cache should NEVER cache writes (really just talking about our use case here). This makes checks for existing IDs before adding an entity or similar checks unnecessary, don't duplicate constraint checks like in [2]. 4) There should always be a way to disable the cache (even if it is just for testing). 5) If I can't convince you to move the cache to the DAO layer, still add a way to disable the cache. For as long as there is no general caching solution with something like ehcache or infinispan, in my eyes such small things matter a lot to keep a project maintainable. That are some of the best practices I have seen around caching database data. It would be great if we could agree on something like that. Maybe there is already an agreement on something and I am just not aware of it. Looking forward to hear your feedback. Roman [1] https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b… [2] https://github.com/oVirt/ovirt-engine/blob/master/backend/manager/modules/b…

4 6

oVirt 4.0.1 rc2 merge / branch / tag / bugzilla reminder
by Sandro Bonazzola 11 Jul '16

11 Jul '16

All stable branch maintainers, please make sure to - merge all relevant open bugs until Tuesday morning 11:00 AM TLV time. For each package that need to be built (i.e oVirt product) please make sure every bug in MODIFIED has the right Target Release and Target Milestone. A Target release should state the version of the package you're building and should include the same version you used for the tag you just used for this build. (e.g. for ovirt-engine, tag: ovirt-engine-4.0.1.1, tr: 4.0.1.1) A list of bugs that require attention is here: - https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_milestone%3A4.0.… Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

oVirt 4.0.1 RC2 build planned
by Sandro Bonazzola 11 Jul '16

11 Jul '16

Fyi oVirt developers, An oVirt build is planned for this Tuesday 11:00 AM TLV time (10:00 AM CEST). Taking into consideration the time it takes for Jenkins to run a full CI everything need to be backported by Monday 11PM. Please make sure to mark as verified and CR +2 so it will be ready for merging Tuesday morning. A list of pending blockers is available here: https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_milestone%3A4.0.… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

Weekly bug status for ovirt-system-tests (using Lago) [ 11/07/16 ]
by Eyal Edri 11 Jul '16

11 Jul '16

*Open bugs:* https://goo.gl/eUaPUY *Open issues:* HE 4.0 support - patch under review - https://gerrit.ovirt.org/#/c/59717/ Initial documentation in progress - https://gerrit.ovirt.org/#/c/59870/ *Open patches:* (reviews are welcome) https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:open *Jenkins jobs:* http://jenkins.ovirt.org/view/oVirt%20system%20tests/ * Jobs were failing on add host, most failures were due to missing support on new F24 slaves, fixed. * There was an issue with using 3.6 ovirt stable repo in some tests, seems it was leftover from early days, replacing repo with 3.6 nighties as we do in 4.0 and master solved it. * 4 more slaves added to run tests, running F24 * We hit a libvirt bug [1] that forced us to manually enable the service for now. [1] https://bugzilla.redhat.com/show_bug.cgi?id=1290357 *Recently merged patches:* https://gerrit.ovirt.org/#/q/project:ovirt-system-tests+status:merged+since… -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

python-paramiko availability
by Paul Dyer 11 Jul '16

11 Jul '16

Hi, I am trying to install the ovirt-4.0 engine to a fresh install of RHEL 7.2. There is a dependency for python-paramiko, but it appears that rpm was removed from RHEL between 6 and 7... The dependency appears when I install ovirt-engine: Error: Package: ovirt-engine-setup-base-4.0.0.6-1.el7.centos.noarch (ovirt-4.0) Requires: python-paramiko This doc notes the package removal: https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/ht… Does anyone know where to source this package? Thanks, Paul -- Paul Dyer, Mercury Consulting Group, RHCE 504-302-8750

3 6

gerrit.ovirt.org migration
by Shlomo Ben David 10 Jul '16

10 Jul '16

Hi All, Today we are planning to migrate gerrit.ovirt.org server to a new bigger instance on Amazon to improve performance. - The migration will start at 18:00 IDT - Estimate migration end time 19:00 IDT. - During the migration the server will not be available (you won't be able to send patches or review code) - The server will be down for about an hour, but if we'll be able to restore it before we'll let you know. - An email will be sent at the end of the migration process. Best Regards, Shlomi Ben-David | Software Engineer | Red Hat ISRAEL Phone: +972-54-8008858 IRC: shlomibendavid (on #rhev-integ, #rhev-dev, #rhev-ci) OPEN SOURCE - 1 4 011 && 011 4 1

6 7

oVirt master moving to F24
by Eyal Edri 10 Jul '16

10 Jul '16

FYI, We encourage all maintainers to switch their projects builds for master to F24, as oVirt project builds usually only latest release (unless there are issues that prevents it). ovirt-engine & mom already moved, this usually requires a single patch to jenkins yaml file for your standard CI project, see [1] for e.g on engine and also you'll need to update the master publisher to take the f24 rpms instead, see [2] for e.g feel free to contact infra list if you need help. [1] https://gerrit.ovirt.org/#/c/60232/ [2] https://gerrit.ovirt.org/#/c/60392/ -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

(MASTER) exception on server.log: ERROR: insert or update on table "host_device" violates foreign key constraint "fk_host_device_parent_name"
by Yaniv Kaul 07 Jul '16

07 Jul '16

Caused by: org.postgresql.util.PSQLException: ERROR: insert or update on table "host_device" violates foreign key constraint "fk_host_device_parent_name" Detail: Key (host_id, parent_device_name)=(767142d5-6242-4bb1-bcbd-095595c3b7f1, scsi_host2) is not present in table "host_device". at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2157) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1886) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255) at org.postgresql.jdbc2.AbstractJdbc2Connection.executeTransactionCommand(AbstractJdbc2Connection.java:793) at org.postgresql.jdbc2.AbstractJdbc2Connection.commit(AbstractJdbc2Connection.java:817) at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:96) Seen on ovirt-engine-4.1.0-0.0.master.20160701111322.gitf1c9a5c.el7.centos.noarch Y.

3 3

[FYI] Jenkins maintenance today 18:30 TLV
by Nadav Goldin 06 Jul '16

06 Jul '16

Hi, http://jenkins.ovirt.org will be restarted for plugin updates today at 18:30 TLV time, expected downtime is 30 minutes. Patches sent 30 minutes before might not get checked, patches sent during the downtime will get checked when Jenkins is back. If patches you sent did not trigger CI, you can login after the downtime and re-trigger them manually. Thanks, Nadav.

1 1

oVirt Community Newsletter: June 2016
by Brian Proffitt 06 Jul '16

06 Jul '16

Not only was June the occasion of the Red Hat Summit event in San Francisco, where oVirt was well-represented in the event and within Community Central, but it was also the month where the year's biggest release, oVirt 4.0! The latest release of oVirt features: * A New Administration Portal * Improved Live-Migration Performance * Improved Image Features * Container Support * New and Improved oVirt Node Check out oVirt 4.0 today, and in the meantime, here's what happened in June, 2016: ----------------- Software Releases ----------------- oVirt 4.0.0 Final Release is now available http://lists.ovirt.org/pipermail/announce/2016-June/000268.html New oVirt-Live (4.0.0) is available for download http://lists.ovirt.org/pipermail/users/2016-June/040577.html oVirt 3.6.7 Fifth Release Candidate is now available for testing http://lists.ovirt.org/pipermail/announce/2016-June/000265.html ---------------- In the Community ---------------- oVirt 4.0 is released! http://www.ovirt.org/blog/2016/06/ovirt-40-release/ Go Upstream at Summit Community Central http://red.ht/29ipa6z oVirt Meetup Boston - MA http://www.meetup.com/Boston-oVirt-Community/ A New oVirt Dashboard for Disaster Recovery https://bitbucket.org/chocomango/ovirt-dashboard P.L. Ferrari Deploys Red Hat Enterprise Virtualization for a More Efficient IT Infrastructure http://red.ht/1V12049 Red Hat Summit Community Track Day One http://red.ht/29mAH5m oVirt 4.0 mit neuem Dashboard (Deutsch) http://www.pro-linux.de/news/1/23702/ovirt-40-mit-neuem-dashboard.html ------------------------------------ Deep Dives and Technical Discussions ------------------------------------ Supercharge Your Network Throughput via Single Root I/O Virtualization (SR-IOV) http://red.ht/1RX3Qkx oVirt Release 4.0: New opportunities [Russian] [Video] https://youtu.be/I4hQAH08Dlg How to Install oVirt (Open Virtualisation) on Centos 7 [Indonesian] [Video] https://youtu.be/eO0tzmQ9LCk Fedora 24 Server & oVirt 4.0 [Video Playlist] http://bit.ly/29iqDtk Creating a KVM VM through oVirt 4.0 with Intel Skull Canyon [Video] https://youtu.be/AjmstE30sM0 Unedited Install of Windows 2012 R2 on KVM oVirt with Nuctastic Intel Skull Canyon [Video] https://youtu.be/DnhutZdLYT4 3 Minute Provisioning VM from KVM oVirt Template [Video] https://youtu.be/uH7QraPPFnw Restart of KVM Ovirt Windows 2016 VM in less than 2 seconds [Video] https://youtu.be/Ea_QeOv9mD8 -- Brian Proffitt Principal Community Analyst Open Source and Standards @TheTechScribe 574.383.9BKP

1 0

SPM or SDM for a new verb?
by Shmuel Melamud 05 Jul '16

05 Jul '16

Hi! I'm writing code for a new verb (sparsifyInplace) in VDSM and got two different opinions about whether to use SPM or SDM for it: 1) SDM is the new correct approach, need to use it. 2) SDM is on early stage and may be changed significantly, so it is better to use SPM as mature and reliable approach. What's your opinion? Shmuel

2 1

Ovirt Node Next 4.0.0 host networking setup attempts to bridge an Infiniband interface
by Giorgio Biacchi 05 Jul '16

05 Jul '16

Hello list, currently I have an up and running Ovirt 3.6 installation where every hypervisor access the data domain via NFS over infiniband. All is working as expected, with a couple of hooks I can set connected mode on ib0 and an MTU of 65520. Now I'm testing Ovirt Node Next, but the behavior is different. When I try to set up host networking the procedure attempts to bridge the network "ibstorage", defined in Networks tab, with ib0 interface but a non ethernet interface cannot be bridged that way. There's any way I can obtain the desired result? Or somehow tell to the hypervisor to not bridge that connection and to use ib0 directly? Thanks -- gb PGP Key: http://pgp.mit.edu/ Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34

2 1

update - no infra support for the next 2 days
by Eyal Edri 05 Jul '16

05 Jul '16

FYI, Due to various holidays, PTOs and an on going 3.6.8 build there is not infra support for the next two days. If there are urgent issues, please open a ticket to infra-support(a)ovirt.org and we'll do our best to handle it if possible. -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)

1 0

Integration tests future (and very nice alternative for the DAO fixture file)
by Roman Mohr 04 Jul '16

04 Jul '16

Hi all, In [1] you can find some patches which are meant to improve the test writing experience in ovirt-engine. They provide the following things: A) Domain Object builders which can be used for creating and/or persisting domain objects [2] B) DAO testing without writing fixtures because of the builders C) Integration testing for commands in conjunction with a real database Arquillian, injectable commands and the builders [3] # How to run what? A) In normal unit tests just create a new instance of a builder and use it. This should help us to get rid of all the small createDefaultVm(), createHostWithX() helper methods in our tests. B) In dao tests just inject them and go ahead. The advantage of not using the fixture file is that we can now set up clean scenarios for every test in a setup method. See example 2 below on how easy it is to set up a new cluster. C) Arquillian integration tests need to be marked with "@Category(IntegrationTest.class)" and can inherit from TransactionalTestBase. The @Category annotation makes sure that the integration tests are only run when mvn clean verify -DskipITs=false is invoked. Note that these tests are then executed in the integration test phase of maven. For them we use the maven-failsafe-plugin[5] which will also make sure that the testing database is up to date. See [4] for more details. # Examples 1) Add a running VM to a host, persist everything to the database and load all VMs which are running on the host: VDS host = vdsBuilder.cluster(persistedCluster).persist(); vmBuilder.host(host).up().persist(); List<VM> vms = vmDao.getAllRunningForVds(host.getId()); 2) Add 10 hosts with 1 GB of RAM to a cluster, persist the hosts to the database in a DAO test: public class MyHostDaoTest extends BaseDaoTestCase { @Inject private VdsBuilder vdsBuilder; @Test public void createHosts() { VdsBuilder builder = vdsBuilder.cluster(persistedCluster).physicalMemory(1000); for (int x =0; x < 10; x++){ builder.id(Guid.newGuid()).persist(); } } } 3) Full integration test with arquillian and the database @Category(IntegrationTest.class) public class VmDaoIntegrationTest extends TransactionalTestBase { @Inject VmDao vmDao; private final Guid VM1_GUID = Guid.createGuidFromString("0fe4bc81-5999-4ab6-80f8-7a4a2d4bfacd"); @Deployment public static JavaArchive deploy(){ return createDeployment(); } @Test public void shouldFailOnExistingEntity() { vmBuilder.id(VM1_GUID).cluster(clusterBuilder.reset().persist()).persist(); // This uses assertThat from assertj: assertThat(vmDao.get(VM1_GUID)).isNotNull(); } } 4) Using the builders in a normal unit test without a database: VM vm = new VmBuilder().id(Guid.newGuid()).up().build(); # How to add your own Domain objects? There are just a few simple rules: 1) Your builder should extend org.ovirt.engine.core.builder.AbstractBuilder 2) Make sure that you only access DAOs injected into the builder during #prePersist() and #persist(). This allows to use the #build() method also without injections 3) #prePersist() should set all fields which are necessary to suffice database constraints. The fields should only be set if they are not already set before by the builder. When following this rule we can always persist new objects to the database by simply calling myBuilder.reset().persist(). 4) Mark your builder with @Repository to make them useable for our Spring DAO tests and our Arquillian integration tests. So have a look at the patches at [1] and let me know what you think about them. Best Regards and happy testing, Roman [1] https://gerrit.ovirt.org/#/q/topic:integration [2] https://gerrit.ovirt.org/#/c/47008/17 [3] https://gerrit.ovirt.org/#/c/47007/10 [4] https://gerrit.ovirt.org/#/c/47008/17 [5] https://maven.apache.org/surefire/maven-failsafe-plugin/

5 7

drop-in directories for vdsm configuration
by Irit Goihman 04 Jul '16

04 Jul '16

Hi, A drop-in directories feature has been added to vdsm-4.18.4. This allows the user to put partial configurations into a drop-in file and create new parameters or override default ones. The semantics of the directories is as follows: - /etc/vdsm/vdsm.conf: For default configuration. We install this file if missing, and never touch this file during upgrade. - /etc/vdsm/vdsm.conf.d/ - / run/vdsm/vdsm.conf.d/ - /usr/lib/vdsm/vdsm.conf.d/ Files with a .conf suffix can be placed into any of the vdsm.conf.d drop-in directories. The default configuration file is read before all other files and has the lowest priority. The priority of configuration files under vdsm.conf.d is determined by lexicographic order of file names, so the lexicographic latest file name takes precedence. It is highly recommended to prefix all file names with a two-digit number in order to keep the ordering simple. -- Irit Goihman Software Engineer Red Hat Israel Ltd.

1 0