July 2016 - Devel - oVirt List Archives

Strange issues with com.google.gwt.i18n.client.Messages.AlternateMessage [bz#1358837]
by Ramesh Nachimuthu 01 Aug '16

01 Aug '16

Hi, We have a strange issue with the com.google.gwt.i18n.client.Messages.AlternateMessage in UIMessages.java. We have defined some alternate messages using @Messages.Select with Enums. But its doesn't work any more. We have following messages in the UIMessages.java. @Messages.AlternateMessage(value = { "UNKNOWN" , "None" , "INTERVAL" , "Minute" , "HOURLY" , "Hourly" , "DAILY" , "Daily" , "WEEKLY" , "Weekly" , "MONTHLY" , "Monthly" }) String recurrenceType((a)Messages.Select GlusterVolumeSnapshotScheduleRecurrence recurrence); @Messages.AlternateMessage(value = { "BYTES" , "{0} B" , "KiB" , "{0} KiB" , "MiB" , "{0} MiB" , "GiB" , "{0} GiB" , "TiB" , "{0} TiB" }) String sizeUnitString(String size, @Messages.Select SizeConverter.SizeUnit sizeUnit); But the generated UIMessages_.java doesn't use any of the enum conditions. public java.lang.String recurrenceType(org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeSnapshotScheduleRecurrence arg0) { java.lang.String returnVal = null; int arg0_ordinal = -1; if (arg0 != null) { arg0_ordinal = arg0.ordinal(); } if (returnVal != null) { return returnVal; } return "Incorrect enum"; } public java.lang.String sizeUnitString(java.lang.String arg0,org.ovirt.engine.core.common.utils.SizeConverter.SizeUnit arg1) { java.lang.String returnVal = null; int arg1_ordinal = -1; if (arg1 != null) { arg1_ordinal = arg1.ordinal(); } if (returnVal != null) { return returnVal; } return arg0 + " TiB"; } It used to work earlier. Is there any known issue in the current GWT Version? or Am I missing something?. Regards, Ramesh

5 7

execCmd() and storing stdout and stderr in log file
by Tomáš Golembiovský 29 Jul '16

29 Jul '16

Hi, I had a need recently to run a command with execCmd() and store it's output and error to a log file, while still receiving it in the calling code. Redirecting the error to output stream to have all in one stream is also useful feature. All this can be done in the calling code: a) On the shell level, by modyfing the command. This can be intentionally dangerous because things like quoting of arguments has to be considered and also could cause problems when wrappers (sudo, nice, ...) are used. b) By handling the writing to files in a code. This would add unnecessary code duplication in a long run. (I don't think I'm the only one who can see a potential in this.) Also for asynchronous process runs, when storing both stderr & stdout in one file, it requires polling and some stream magic. It would be better to have this done right and only once so it can be properly tested. That's why I think having it present in execCmd() ready for everyone's use is the best solution. Unfortunately it seems that the code is a) essential on many places in vdsm and b) not properly covered by tests. Which makes it hard to touch. Also apparently some refactoring is either planned or already underway. What is the situation about refactoring that code area? Anyone working on it? Do we have an estimation of time-frame for it? Any suggestions/ideas? Tomas -- Tomáš Golembiovský <tgolembi(a)redhat.com>

5 23

Is there some guideline how to replace Linux Bridge with ovs on vdsm?
by lifuqiong 27 Jul '16

27 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_012C_01D1E818.185185B0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, I want to using ovs replace with Linux bridge, Is there some guideline or advice? If I want to use dpdk vhost-user port, how can I do that? Thank you Mark ------=_NextPart_000_012C_01D1E818.185185B0 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1>Hi, = <o:p></o:p>         I want to = using ovs replace with Linux bridge, Is there some guideline or advice? = If I want to use dpdk vhost-user port, how can I do = that?<o:p></o:p><o:p> </o:p>Thank you<o:p></o:p>Mark<o:p></o:p></div></body></html> ------=_NextPart_000_012C_01D1E818.185185B0--

2 1

[ANN] oVirt 4.0.2 Seconf Release Candidate is now available
by Sandro Bonazzola 27 Jul '16

27 Jul '16

The oVirt Project is pleased to announce the availability of the Second Release Candidate of oVirt 4.0.2 for testing, as of July 27st, 2016. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 This is pre-release software. Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This pre-release should not to be used in production. This update is the first release candidate of the second in a series of stabilization updates to the 4.0 series. 4.0.2 brings 12 enhancements and nearly 100 bugfixes, including 43 high or urgent severity fixes, on top of oVirt 4.0 series See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is available. [4] * A new oVirt Next Generation Node is available [4]. * A new oVirt Engine Appliance is already available. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.2 release highlights: http://www.ovirt.org/release/4.0.2/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.2/ [4] http://resources.ovirt.org/pub/ovirt-4.0-pre/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

Seeing a memory issue in 4.0.1.1-1.el7.centos
by Lynn Dixon 27 Jul '16

27 Jul '16

Hello all. I hope I am sending this to the proper mailing list. If not, please let me know. I just installed the latest oVirt engine onto a RHEL7.2 machine last night. I haven't built any VM's yet, but noticed that 27gig of memory was being consumed in the Dashboard. I did a quick check on top and noticed this: http://i.imgur.com/j9LB4q9.jpg The two java processes seem to be using a heavy amount of ram and reservations. How shall I troubleshoot this to find out whats going on? *Lynn Dixon* | Red Hat Certified Architect #100-006-188 *Sr. Cloud Consultant* | Cloud Management Practice Google Voice: 423-618-1414 Cell/Text: 423-774-3188 Click here to view my Certification Portfolio <http://red.ht/1XMX2Mi>

3 2

[VDSM] Using INFO log by default
by Nir Soffer 27 Jul '16

27 Jul '16

Hi all, We are using now INFO log level by default. This has two important effects: - We are not generating huge logs filling your disk - Some flows may not be logged properly now Please check that your code is logged properly - basically any state change in the system must be logged using log.info(). To increase log level temporarily, use: vdsClient -s 0 setLogLevel LEVEL [logger] logger is one of vdsm logger, see /etc/vdsm/logger.conf for the names. Without logger, the root logger is modified. To change logging level permanently, edit /etc/vdsm/logger.conf. Nir

2 1

Reply: [ovirt-users] Some question about vdsm rpc
by lifuqiong 27 Jul '16

27 Jul '16

Thank you very much for your helpful reply . The error of my question 4 is solved after I stopping debug vdsm code, just using print log info instead. On Tue, Jul 26, 2016 at 12:46 PM, lifuqiong <lifuqiong(a)cncloudsec.com> wrote: > 1. We know that xmlrpc and jsonrpc are enabled default in vdsm, vdsm > supply these two service in one port or two? What’s the port number > and how we can change it? > We use single port for both protocols. There is a code which peeks the data stream and decides which part of the code should handle the connection. In config.py you can find 'management_port' option which defines which port will be used. > > > 2. How can we know a vdsm host can supply an xmlrpc service or a > jsonrpc service? > In config.py we have 'xmlrpc_enable' and 'jsonrpc_enable' which determine protocols available during runtime. With the latest vdsm both are enabled but keep in mind that xmlrpc is deprecated and will be removed soon. > > > 3. I found that while ovirt engine installing a vdsm host, engine will > check whether we are connecting to vdsm which supports xmlrpc only, > engine send a ‘Host.ping’ jsonrpc request, why the code will enter > into bindingxmlrpc.py? > > Did both jsonrpc and xmlrpc will call bindingxmlrpc.py? > During host installation we attempt to connect to a host using jsonrpc first and if it fails we we attempt to use xmlrpc. Older vdsms provide only xmlrpc so this behavior is for backward compatibility. There are two binding modules bindingjsonrpc.py and bindingxmlrpc.py. Common module for both bindings is API.py > > > 4. Then, I just get an json return with code = 0 or code = 99. What > does these error code mean ? I can’t find detail in rpcjson > Specification(http://www.jsonrpc.org/specification) > There is a time when vdsm is not able to handle requests due to recovery logic which may take several seconds during this time we return code 99. Once the recovery is done vdsm returns correct codes like 0. Recovery occurs only during start of vdsm. > > > 5. When installing vdsm, I got an “Host server117 installation failed. > Host is not reachable” error. Debugging code as follows: > > Bindingxmlrpc.py > > line637 def ping(self): > > line638 # print 'os.getuid()',os.getuid() = 0 > > line639 # print 'os.getegit()',os.getegid() =0 > > line640 api = API.Global() > > line641 return api.ping() > Can you share the logs with above failure? > > > the api.ping() just open an file and update the file updating time, > why these will throw an error code 0 or 99? And I see the ping() > function created file /var/run/vdsm/client.log already exists in os, > ping verb was reused to detect whether vdsm is able to use jsonrpc. This verb originally is used to make sure that any network reconfiguration did not break connection to the engine. During the process of reconfiguration engine call ping and vdsm based on file update time can restore old network configuration in case of failure. > the only difference is the file is owned by root:root , not the vdsm:kvm? > Why? > There are 2 vdsm processes running with different user permissions. > > > Thank you. > > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users >

1 0

Some question about vdsm rpc
by lifuqiong 27 Jul '16

27 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_00F7_01D1E76E.0E1E4A60 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit 1. We know that xmlrpc and jsonrpc are enabled default in vdsm, vdsm supply these two service in one port or two? What's the port number and how we can change it? 2. How can we know a vdsm host can supply an xmlrpc service or a jsonrpc service? 3. I found that while ovirt engine installing a vdsm host, engine will check whether we are connecting to vdsm which supports xmlrpc only, engine send a 'Host.ping' jsonrpc request, why the code will enter into bindingxmlrpc.py? Did both jsonrpc and xmlrpc will call bindingxmlrpc.py? 4. Then, I just get an json return with code = 0 or code = 99. What does these error code mean ? I can't find detail in rpcjson Specification(http://www.jsonrpc.org/specification) 5. When installing vdsm, I got an "Host server117 installation failed. Host is not reachable" error. Debugging code as follows: Bindingxmlrpc.py line637 def ping(self): line638 # print 'os.getuid()',os.getuid() = 0 line639 # print 'os.getegit()',os.getegid() =0 line640 api = API.Global() line641 return api.ping() the api.ping() just open an file and update the file updating time, why these will throw an error code 0 or 99? And I see the ping() function created file /var/run/vdsm/client.log already exists in os, the only difference is the file is owned by root:root , not the vdsm:kvm? Why? Thank you. ------=_NextPart_000_00F7_01D1E76E.0E1E4A60 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1><![if !supportLists]>1.       = <![endif]>We know that xmlrpc = and jsonrpc are enabled default in vdsm, vdsm supply these two service = in one port or two? What’s the port number and how we can change = it?<o:p></o:p><o:p> </o:p><![if !supportLists]>2.       = <![endif]>How can we know a vdsm = host can supply an xmlrpc service or a jsonrpc = service?<o:p></o:p><o:p> </o:p> = <o:p></o:p><![if !supportLists]>3.       = <![endif]>I found that while = ovirt engine installing a vdsm host, engine will check whether we are = connecting to vdsm which supports xmlrpc only, engine send a = ‘Host.ping’ jsonrpc request,  why the code will enter = into bindingxmlrpc.py?<o:p></o:p>Did both jsonrpc and xmlrpc will call = bindingxmlrpc.py?<o:p></o:p><o:p> </o:p><![if !supportLists]>4.       = <![endif]>Then, I just get an = json return with code =3D 0 or code =3D 99. What does these error code = mean ? I can’t find detail in rpcjson Specification(<a = href=3D"http://www.jsonrpc.org/specification">http://www.jsonrpc.org/spec= ification</a>)<o:p></o:p><o:p> </o:p><![if !supportLists]>5.       = <![endif]>When installing vdsm, = I got an “Host server117 installation failed. Host is not = reachable” error. Debugging code as = follows:<o:p></o:p>Bindingxmlrpc.py<o:p></o:p>line637  def = ping(self):<o:p></o:p>line638       # print = 'os.getuid()',os.getuid() =3D 0<o:p></o:p>line639       # print = 'os.getegit()',os.getegid() =3D0<o:p></o:p>line640        api =3D = API.Global()<o:p></o:p>line641        return = api.ping()<o:p></o:p><o:p> </o:p>the api.ping() just open an file and update the file = updating time, why these will throw an error code 0 or 99? And I see the = ping() function created file /var/run/vdsm/client.log already exists in = os, <o:p></o:p>the = only difference is the file is owned by root:root , not the vdsm:kvm? = Why?<o:p></o:p><o:p> </o:p>Thank you.<o:p></o:p><o:p> </o:p></div></body></html> ------=_NextPart_000_00F7_01D1E76E.0E1E4A60--

2 1

Debug vdsm 4.0.0 report error: libvirt: XML-RPC error : Failed to connect socket to '/var/run/libvirt/libvirt-sock': Permission denied
by lifuqiong 26 Jul '16

26 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_001E_01D1E509.19780F20 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit I debugged vdsm with PyCharm, And I logged on my Centos 7.2 with root, and get an error as follows: Problem: Traceback (most recent call last): File "/usr/share/vdsm/vdsm", line 149, in run serve_clients(log) File "/usr/share/vdsm/vdsm", line 104, in serve_clients cif = clientIF.getInstance(irs, log, scheduler) File "/usr/share/vdsm/clientIF.py", line 204, in getInstance cls._instance = clientIF(irs, log, scheduler) File "/usr/share/vdsm/clientIF.py", line 106, in __init__ secret.clear() File "/usr/lib/python2.7/site-packages/vdsm/virt/secret.py", line 92, in clear con = libvirtconnection.get() File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 163, in get password) File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 99, in open_connection return utils.retry(libvirtOpen, timeout=10, sleep=0.2) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 546, in retry return func() File "/usr/lib64/python2.7/site-packages/libvirt.py", line 105, in openAuth if ret is None:raise libvirtError('virConnectOpenAuth() failed') libvirtError: Failed to connect socket to '/var/run/libvirt/libvirt-sock': Permission denied Investitate: According to the traceback above, the code in libvirt.py as below, and os.geteuid() get '0' which shows the current user is root; def openAuth(uri, auth, flags=0): #print os.geteuid() ret = libvirtmod.virConnectOpenAuth(uri, auth, flags) if ret is None:raise libvirtError('virConnectOpenAuth() failed') return virConnect(_obj=ret) [root@server117 libvirt]# ll /var/run/libvirt/libvirt-sock srwxrwx---. 1 root qemu 0 Jul 19 23:43 /var/run/libvirt/libvirt-sock According that, root should not get an Permission denied error ? But why? And I setenforce=0 , and still show Perssion denied error. What's the reason? And how to solve it? Thank you. ------=_NextPart_000_001E_01D1E509.19780F20 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1>I debugged = vdsm with PyCharm, And I logged on my Centos 7.2 with root,  and = get an error as follows:<o:p></o:p><o:p> </o:p>Problem:<o:p></o:p><o:p> </o:p>Traceback (most recent call last):<o:p></o:p>  File = "/usr/share/vdsm/vdsm", line 149, in = run<o:p></o:p>    = serve_clients(log)<o:p></o:p>  File "/usr/share/vdsm/vdsm", line 104, in = serve_clients<o:p></o:p>    cif =3D clientIF.getInstance(irs, log, = scheduler)<o:p></o:p>  File "/usr/share/vdsm/clientIF.py", line = 204, in getInstance<o:p></o:p>    cls._instance =3D clientIF(irs, log, = scheduler)<o:p></o:p>  File "/usr/share/vdsm/clientIF.py", line = 106, in __init__<o:p></o:p>    secret.clear()<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/virt/secret.py", line = 92, in clear<o:p></o:p>    con =3D = libvirtconnection.get()<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", = line 163, in get<o:p></o:p>    password)<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", = line 99, in open_connection<o:p></o:p>    return = utils.retry(libvirtOpen, timeout=3D10, = sleep=3D0.2)<o:p></o:p>  File = "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 546, in = retry<o:p></o:p>    return func()<o:p></o:p>  File = "/usr/lib64/python2.7/site-packages/libvirt.py", line 105, in = openAuth<o:p></o:p>    if ret is None:raise = libvirtError('virConnectOpenAuth() failed')<o:p></o:p>libvirtError: Failed to connect = socket to '/var/run/libvirt/libvirt-sock': Permission = denied<o:p></o:p><o:p> </o:p>Investitate:<o:p></o:p>According to the traceback above, = the code in libvirt.py as below, and  os.geteuid() get = ‘0’ which shows the current user is = root;<o:p></o:p><o:p> </o:p>def openAuth(uri, auth, flags=3D0):<o:p></o:p>         #print = os.geteuid()<o:p></o:p>    ret =3D = libvirtmod.virConnectOpenAuth(uri, auth, flags)<o:p></o:p>    if ret is = None:raise libvirtError('virConnectOpenAuth() = failed')<o:p></o:p>return = virConnect(_obj=3Dret)<o:p></o:p><o:p> </o:p>[root@server117 libvirt]# ll = /var/run/libvirt/libvirt-sock<o:p></o:p>srwxrwx---. 1 root qemu 0 Jul 19 = 23:43 /var/run/libvirt/libvirt-sock<o:p></o:p><o:p> </o:p>According that, root should not get = an Permission denied error ? But why?<o:p></o:p><o:p> </o:p>And I setenforce=3D0 , and still = show Perssion denied error.<o:p></o:p><o:p> </o:p>What’s the reason? And how to = solve it?<o:p></o:p><o:p> </o:p>Thank you.<o:p></o:p></div></body></html> ------=_NextPart_000_001E_01D1E509.19780F20--

5 9

Type Safety on the Frontend (refactoring of all async queries)
by Martin Betak 26 Jul '16

26 Jul '16

Hi All, today a *major* frontend refactoring was merged [1]. Its purpose was to remove some of the most significant artifacts of legacy C# code. Huge thanks to Vojtech and Alex for heavenly patience during code review! For a complete description please see the commit message, but here are some highlights for programmers that need to touch FE code: 1) AsyncQuery, AsyncCallback and Converter are now generic and typesafe (formerly INewAsyncCallback and IAsyncConverter). 2) It is no longer possible (or desirable) to PASS MODEL to queries. From within Model sublasses `new AsyncQuery<>(...)` will have the correct value set (see patch for impl details) and if you want to run a query on a different model (so the infrastructure would set the progress spinner on that model instead), usually for the purpose of a ListModel showing a popup window - where we want to display the spinner on the dialog window instead, you can use the `myWindowModel.asyncQuery(...)` helper factory to create query with model set to myWindowModel. // note: this also has the nice side-effect of eliminating the harmful pattern of using // the model value from within callbacks by casting it to surrounding model type (while that // value is already available by feature of java inner classes) 3) AsyncDataProvider's API methods now deal with strongly typed queries. This is facilitated through usage of strongly typed Converters (please see some defined converters -> usually you just need a CastingConverter<> or a ListConverter<>). Please use this architectural layer of strongly typed AsyncDataProvider to your advantage. (as plain Fronted.runQuery does not provide any guarantees and leaves you at risk of mis-casting the return value). If you have any more questions please feel free to ask me or look at the patch for details (warning: it's quite big!). This kind of major change necessarily touched all areas of the code (those issuing queries...) and there is of course some probability that something may break. But I believe this risk is well outweight by the benefits. Nevertheless if you find any issue please let me know and we can fix it together. Thanks again to anyone who contributed to this noble effort. Best regards :-) Martin [1] https://gerrit.ovirt.org/#/c/60822/

2 1

[ACTION REQUIRED] VDSM: vdsClientTests.CannonizeHostPortTest failing on master
by Sandro Bonazzola 26 Jul '16

26 Jul '16

*http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/4639/console <http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/4639/console>* *00:06:34.315* *00:06:34.315* ======================================================================*00:06:34.315* FAIL: testNoArguments (vdsClientTests.CannonizeHostPortTest)*00:06:34.315* ----------------------------------------------------------------------*00:06:34.316* Traceback (most recent call last):*00:06:34.316* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 494, in testNoArguments*00:06:34.316* self._assertIsIpAddressWithPort(vdscli.cannonizeHostPort())*00:06:34.316* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 548, in _assertIsIpAddressWithPort*00:06:34.316* self._assertValidAddress(addr)*00:06:34.317* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 555, in _assertValidAddress*00:06:34.317* addr)*00:06:34.317* AssertionError: ('invalid IPv4 address: %s', 'ovirt-srv19.phx.ovirt.org')*00:06:34.317* *00:06:34.317* ======================================================================*00:06:34.317* FAIL: testNoneArgument (vdsClientTests.CannonizeHostPortTest)*00:06:34.318* ----------------------------------------------------------------------*00:06:34.318* Traceback (most recent call last):*00:06:34.318* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 497, in testNoneArgument*00:06:34.318* self._assertIsIpAddressWithPort(vdscli.cannonizeHostPort(None))*00:06:34.318* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 548, in _assertIsIpAddressWithPort*00:06:34.319* self._assertValidAddress(addr)*00:06:34.319* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 555, in _assertValidAddress*00:06:34.319* addr)*00:06:34.319* AssertionError: ('invalid IPv4 address: %s', 'ovirt-srv19.phx.ovirt.org')*00:06:34.319* *00:06:34.319* ======================================================================*00:06:34.319* FAIL: testNoneArgumentAndPort (vdsClientTests.CannonizeHostPortTest)*00:06:34.320* ----------------------------------------------------------------------*00:06:34.320* Traceback (most recent call last):*00:06:34.320* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 502, in testNoneArgumentAndPort*00:06:34.320* self._assertIsIpAddressWithPort(res)*00:06:34.320* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 548, in _assertIsIpAddressWithPort*00:06:34.321* self._assertValidAddress(addr)*00:06:34.321* File "/home/jenkins/workspace/vdsm_master_check-patch-el7-x86_64/vdsm/tests/vdsClientTests.py", line 555, in _assertValidAddress*00:06:34.321* addr)*00:06:34.321* AssertionError: ('invalid IPv4 address: %s', 'ovirt-srv19.phx.ovirt.org')*00:06:34.321* *00:06:34.321* Name Stmts Miss Cover Missing*00:06:34.322* --------- -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 2

VDSM retired from Fedora distribution
by Sandro Bonazzola 26 Jul '16

26 Jul '16

Hi, just an heads up about VDSM been retired from Fedora distribution due to broken dependency. If you want to get it back there you'll have to start again with the package review process. Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 1

[ACTION REQUIRED] oVirt 4.0.2 rc2 build starting in 1 hour
by Sandro Bonazzola 26 Jul '16

26 Jul '16

Fyi oVirt products maintainers, An oVirt build for an official release is going to start in one hour If you're a maintainer for any of the projects included in oVirt distribution and you have changes in your package ready to be released please: - bump version and release to be GA ready - tag your release within git (implies a GitHub Release to be automatically created) - build your packages within jenkins / koji / copr / whatever - verify all bugs on MODIFIED have target release and target milestone set. - add your builds to releng-tools/releases/ovirt-4.0.2_rc2.conf withini releng-tools project -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

DRBD Integration with oVirt
by Hayley Swimelar 26 Jul '16

26 Jul '16

Hello all, A DRBD integration into oVirt is currently being planned. DRBD provides replicated, highly available block storage. For those unfamiliar with DRBD more information can be found here: https://www.drbd.org/en/comp/drbd-linux-driver DRBD 9 is the latest version of DRBD and interacts with DRBD Manage which is a daemon exposed via a D-Bus api. More information can be found here: https://www.drbd.org/en/comp/drbdmanage DRBD Manage handles the creation, assignment, etc. of DRBD volumes and is the interface through which Cinder manages DRBD. We are looking for advice on how best to have oVirt communicate with DRBD Manage and we have come to two options: 1) Use Cinder. Although we are integrated into Cinder, there are concerns about the need to set up a complete Cinder instance to provide access to DRBD. 2) The alternative to Cinder would be to have the oVirt Engine communicate directly to DRBD Manage via D-Bus. Any advice on the best way to achieve this would be much appreciated. -- Hayley Swimelar LINBIT | Keeping the Digital World Running DRBD — Corosync — Pacemaker +1-503-573-1262 x212

5 11

When debug vdsm branch 4.0, why there has some code will call function ping(self) in bindingxmlrpc.py cycle? Even the vdsm is not managed by ovirt-engine?
by lifuqiong 26 Jul '16

26 Jul '16

This is a multipart message in MIME format. ------=_NextPart_000_00BE_01D1E741.42F55580 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, I setup a breakpoint in Line 637 in bindingxmlrpc.py , which as follows: (branch:4.0; code url is: https://github.com/oVirt/vdsm/tree/ovirt-4.0) 636 def ping(self): 637 api = API.Global() 638 return api.ping() But even the vdsm is not managed by any ovirt-engine , the line 637 will be called many times, I thought the ping() function will be called only when the ovirt-engine will create connection with vdsm, so why it will be called cycle? Thank you ------=_NextPart_000_00BE_01D1E741.42F55580 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1>Hi, = <o:p></o:p>         I setup a = breakpoint in Line 637 in bindingxmlrpc.py , which as follows:  = (branch:4.0; code url is: = https://github.com/oVirt/vdsm/tree/ovirt-4.0)<o:p></o:p>636  def = ping(self):<o:p></o:p>637     api =3D = API.Global()<o:p></o:p>638     return = api.ping()<o:p></o:p><o:p> </o:p>         But even = the vdsm is not managed by any ovirt-engine ,  the line 637 will be = called many times, <o:p></o:p><o:p> </o:p>         I thought = the ping() function will be called only when the ovirt-engine will = create connection with vdsm, so why it will be called = cycle?<o:p></o:p><o:p> </o:p>Thank you<o:p></o:p><o:p> </o:p><o:p> </o:p></div></body></html> ------=_NextPart_000_00BE_01D1E741.42F55580--

2 1

How to build and install oVirt on Product Environment
by Dewey Du 25 Jul '16

25 Jul '16

To build and install ovirt-engine execute the folllowing command: $ make clean install-dev PREFIX="${PREFIX}" What about installing it on Product Environment. Is the folllowing command right? $ make clean install PREFIX="${PREFIX}"

2 1

Blog post: Monitoring Improvements in oVirt
by Arik Hadas 25 Jul '16

25 Jul '16

Hi all, I wrote a blog post that summarizes the recent improvements in the code that monitors virtual machines in oVirt. It describes the changes that were done and shows a comparison of different aspects of oVirt with these changes (based on the master branch) vs oVirt 3.6 without these changes: http://ahadas.github.io/monitoring-improvements-in-ovirt/ It is mostly a technical post. However, users might find it interesting as well. Note that the measurements were taken on an environment with 1 host and 6000 running VMs (in a pool). Each VM had a network interface and was diskless. Obviously, this is not a typical setup but it was useful to easily expose some of weak sides of the monitoring. Your feedback is always welcome! Regards, Arik

2 2

anonymous upgrade script instead of tmp function ceremony
by Roy Golan 25 Jul '16

25 Jul '16

We all use the pattern of temporary creating a function for upgrade script, declaring it (copy pasting from last script) and then calling it, then deleting it. This very verbose can be replaced with DO instruction which does essentially the same. # existing declaration ```sql CREATE OR REPLACE FUNCTION __tmp_count() RETURNS VOID AS $procedure$ DECLARE i int; BEGIN i:= (select count(*) from vms) -- useless count just for the demo END; $procedure$ LANGUAGE plpgsql; SELECT __tmp_count(); DROP FUNCTION __tmp_acount(); ``` Can be replaced with ```sql DO $$ DECLARE i int; BEGIN i := (select count(*) from vms) -- useless count for demo END $$; ``` Not tested but tons of less lines to code. Exist in version 9.0.23 and above

1 0

[ANN] oVirt 4.0.2 Release Candidate is now available
by Sandro Bonazzola 21 Jul '16

21 Jul '16

The oVirt Project is pleased to announce the availability of the First Release Candidate of oVirt 4.0.2 for testing, as of July 21st, 2016. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 This is pre-release software. Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This pre-release should not to be used in production. This update is the first release candidate of the second in a series of stabilization updates to the 4.0 series. 4.0.2 brings 5 enhancements and nearly 100 bugfixes, including 38 high or urgent severity fixes, on top of oVirt 4.0 series See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is available. [4] * A new oVirt Next Generation Node is available [4]. * A new oVirt Engine Appliance is already available. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.2 release highlights: http://www.ovirt.org/release/4.0.2/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.2/ [4] http://resources.ovirt.org/pub/ovirt-4.0-pre/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

changing engine domain name
by Paul Dyer 20 Jul '16

20 Jul '16

Hi, back in 2015, with the first install of ovirt, I used a domain of xxxportal.com. Since the client has an xxxcentral.com wildcard certificate, I added changed the hostname and domainname, and added the cert/cacert to the apache webpage. The pki on ovirt and vdsm (host) both still have the original xxxportal.com domain. I am looking for a way to wipe away the old domain. Do I need to remove the host (not hosted engine), drop the datacenter/cluster, and build from a clean db? Thanks, Paul -- Paul Dyer, Mercury Consulting Group, RHCE 504-302-8750

3 8

New SDM verb: SDM.copy_data
by Adam Litke 20 Jul '16

20 Jul '16

Hi oVirt! I wanted to take a moment to update you on a new storage verb we have in vdsm called SDM.copy_data. The purpose of this verb is to allow copying of data between various endpoints* on hosts that are not necessarily the SPM. This will allow us in the future to spread the load created by this data-intensive operation across multiple hosts while providing a better user experience than the current SPM-driven flow can. Current status (Sprint 1): - Basic SDM.copy_data is merged to vdsm - We still use the SPM host for creating the destination disk and to serially copy all volumes. - The engine Move Disk flow is being adapted to use the new verb. Patches should be merged in the next day or two. https://gerrit.ovirt.org/#/c/61087/ - New code paths must be activated by setting a config variable: "update vdc_options set option_value = true \ where option_name = 'DataOperationsByHSM';" - Currently positive flows are implemented Next steps: - Copy progress reporting in UI - Support negative flows (eg. lost contact with host) - Use this verb for live storage migration flows - Vdsm-side locking - Select a non-SPM host (when available) for copying Farther out: - Support for copy in parallel - Implement other data path verbs (eg. wipe_volume, sparsify_volume) -- Adam Litke

1 0

Vdsm/virt conversion to etree
by Milan Zamazal 20 Jul '16

20 Jul '16

We have been planning switching from minidom to etree in Vdsm for long time. There are several good reasons why to make the change: - We currently use both minidom and etree, we should use a single library. - etree has apparently better performance in the sense of CPU time and RAM usage. - etree has a simpler and more convenient API (e.g. limited XPath support). After various discussions and trying different draft approaches, there is now available a complete series of patches migrating virt usage of minidom to etree. It starts with patch https://gerrit.ovirt.org/55769 and you can follow the whole vm-etree topic from there. Please read the commit message in the initial patch, it explains the overall approach. I tried to make the series reviewer friendly, for patch-by-patch review. It's still draft, not finished, missing many tests, etc., but it already basically works. If you have any serious problems with the approach to the conversion or its general directions, tell me before we start discussing details. Just don't forget we must perform the conversion in some reasonably safe way and it must be possible to review it. Please note the series doesn't try to solve all the world/Vdsm problems, it focuses just on the etree conversion. Further changes may be implemented in followup patches. I already implemented some post-refactoring in vm-etree-refact topic starting with https://gerrit.ovirt.org/60940. Thanks to Francesco Romani for cooperation and help with the work.

1 0

Engine 4.0.2 stable branch created
by Tal Nisan 20 Jul '16

20 Jul '16

Hi everyone, A branch for 4.0.2 was created today (ovirt-engine-4.0.2). Note that all patches for 4.0.2 bugs are to be backported twice (4.0 and then 4.0.2), 4.0.3 bugs can now be backported as well to 4.0 only. T.

1 0

[VDSM] vdsm_master_verify-error-codes_created running on master - why?
by Nir Soffer 20 Jul '16

20 Jul '16

Hi all, Since yesterday, vdsm_master_verify-error-codes_created job is running on master. I guess that this was a unintended change in jenkins - please revert this change. If someone want to add a job for vdsm master, it must be approved by vdsm maintainers first. The best would be to run everything from the automation scripts, so vdsm maintainers have full control on the way patches are checked. Thanks, Nir

3 5

[RFE][4.1][F24] Fedora 24 support
by Sandro Bonazzola 19 Jul '16

19 Jul '16

Hi, as you know Fedora 24 has been released last month. I pushed a pull request[1] describing the feature support effort. Of the detailied description, the following items have been already implemented: - Support building on Fedora 24 - Create Jenkins jobs for automated build and testing on Fedora 24 - Create Fedora 24 Jenkins slaves the following item is still to be done: - Verify that all the components have no regressions only due to Fedora 24 How you can help: - Review / comment the pull request for the feature [1] - Test oVirt master nightly[2] on Fedora 24 - Open bugs on issue you see while running master on Fedora 24 - Verify test cases[4] on Fedora 24 Please use [F24] in the subject if you provide feedback on the mailing list, it will help tracking discussions related to this feature. [1] https://github.com/oVirt/ovirt-site/pull/368 [2] http://www.ovirt.org/develop/dev-process/install-nightly-snapshot/ [3] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [4] http://www.ovirt.org/develop/infra/testing/test-cases/ -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0