April 2016 - Kimchi-devel - oVirt List Archives

[PATCH] [Kimchi] Disable Template when it has invalid parameters
by peterpnns＠gmail.com 05 May '16

05 May '16

From: peterpennings <peterpnns(a)gmail.com> This patch adds a block behavior on the action to select invalid templates when creating a guest peterpennings (1): Disable Template when it has invalid parameters ui/css/kimchi.css | 28 ++++++++++++++++++--- ui/css/src/modules/_guests.scss | 6 +++++ ui/css/src/modules/_templates.scss | 18 +++++++++++--- ui/js/src/kimchi.guest_add_main.js | 8 ++++++ ui/js/src/kimchi.network_add_main.js | 48 +++++++++++++++++++++++++----------- ui/js/src/kimchi.template_main.js | 9 +++++-- ui/pages/guest-add.html.tmpl | 7 +++--- ui/pages/tabs/templates.html.tmpl | 6 +++-- 8 files changed, 102 insertions(+), 28 deletions(-) -- 2.5.0

2 4

Wok Debian/Ubuntu integration
by Frederic Bonnard 03 May '16

03 May '16

Hi, with the new version 2.1.0 of wok/kimchi/gingerbase, I updated my packaging. I'm still having a few issues and as there is a github issue concerning having wok related projects inside Ubuntu, I'd like to share some concerns so far. Here are the details : https://github.com/kimchi-project/wok/issues/25#issuecomment-211483696 - For the "relative URLs" issue, I've got some packages done and installed. Anyone could help on fixing those ? I've got a server I can give access to a wok developer, or I can send the .deb to someone willing to install them on his machine. - For the second issue, is it worth I send an updated patch against wok, or do you see other ways of doing to disable launching a specific instance of nginx ? F.

2 1

[PATCH v2] [Kimchi] Disable Template when it has invalid parameters
by sguimaraes943＠gmail.com 03 May '16

03 May '16

From: Samuel Guimarães <sguimaraes943(a)gmail.com> This patch adds a block behavior on the action to select invalid templates when creating a guest peterpennings (1): Disable Template when it has invalid parameters Samuel Guimarães (1): Disable Template when it has invalid parameters v2: - Removed reference to kimchi.network_add_main.js - Fixed warning icon position in list and gallery views - Remoed tooltip when template is valid - Added front-end form validation when user attempts to save invalid storage pool (must apply "Enabled .has-feedback icons" patch sent to Wok first) - Added form control error class when template has invalid cdrom (reported issue #933 for vm-image not showing in invalid key) ui/css/kimchi.css | 97 ++++++++++++++++++++++++++++++++-- ui/css/src/modules/_guests.scss | 6 +++ ui/css/src/modules/_iso-list.scss | 22 +++++++- ui/css/src/modules/_templates.scss | 53 +++++++++++++++++-- ui/js/src/kimchi.guest_add_main.js | 7 +++ ui/js/src/kimchi.template_edit_main.js | 52 ++++++++++++++---- ui/js/src/kimchi.template_main.js | 9 +++- ui/pages/guest-add.html.tmpl | 11 ++-- ui/pages/i18n.json.tmpl | 1 + ui/pages/tabs/templates.html.tmpl | 24 +++++---- ui/pages/template-edit.html.tmpl | 6 ++- 11 files changed, 255 insertions(+), 33 deletions(-) -- 1.9.3

2 3

[PATCH] [Wok] Form validation: Enabled .has-feedback icons
by sguimaraes943＠gmail.com 02 May '16

02 May '16

From: Samuel Guimarães <sguimaraes943(a)gmail.com> This patch enables Font-Awesome icons when a .from-group has .has-feedback and .has-error or .has-warning classes. This is required to "Disable Template when it has invalid parameters" v2 that will be sent in this list. Samuel Guimarães (1): Enabled .has-feedback icons ui/css/src/modules/_wok-forms.scss | 6 ++++++ ui/css/wok.css | 6 ++++++ 2 files changed, 12 insertions(+) -- 1.9.3

2 2

[PATCH][Wok] Sort user request log output
by Rodrigo Trujillo 30 Apr '16

30 Apr '16

There is an issue in user request log output when you have backup files in your system. The values from backup logs are included in the return list and showed before latest events. Then user has to use UI sort buttons in order to see what is happening. This patch sorts the output, ensuring that latest events will be returned on 'top' of the list and be showed firstly in the UI. Signed-off-by: Rodrigo Trujillo <rodrigo.trujillo(a)linux.vnet.ibm.com> --- src/wok/reqlogger.py | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/src/wok/reqlogger.py b/src/wok/reqlogger.py index 1294be1..1145dbd 100644 --- a/src/wok/reqlogger.py +++ b/src/wok/reqlogger.py @@ -105,7 +105,9 @@ class RequestParser(object): filename = ".".join([self.baseFile, str(count + 1)]) records.extend(self.getRecordsFromFile(filename)) - return records + # Return ordered by latest events first + return sorted(records, key=lambda k: k['date'] + k['time'], + reverse=True) def getRecordsFromFile(self, filename): """ -- 2.1.0

3 2

[PATCH][Wok] Move local log path from 'log' to 'data/logs'
by Rodrigo Trujillo 30 Apr '16

30 Apr '16

When run wok from local build (not installed), use data/logs as the default log directory. Signed-off-by: Rodrigo Trujillo <rodrigo.trujillo(a)linux.vnet.ibm.com> --- src/wok/config.py.in | 2 +- tests/test_config.py.in | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/src/wok/config.py.in b/src/wok/config.py.in index 6bc0c1e..0c3acdd 100644 --- a/src/wok/config.py.in +++ b/src/wok/config.py.in @@ -91,7 +91,7 @@ class Paths(object): else: self.nginx_conf_dir = self.add_prefix('src/nginx') self.state_dir = self.add_prefix('data') - self.log_dir = self.add_prefix('log') + self.log_dir = self.add_prefix('data/logs') self.conf_dir = self.add_prefix('src') self.src_dir = self.add_prefix('src/wok') self.plugins_dir = self.add_prefix('src/wok/plugins') diff --git a/tests/test_config.py.in b/tests/test_config.py.in index 3020c53..1e7cc72 100644 --- a/tests/test_config.py.in +++ b/tests/test_config.py.in @@ -57,7 +57,7 @@ class ConfigTests(unittest.TestCase): Paths.get_prefix = lambda self: '/home/user/wok' paths = Paths() self.assertEquals(paths.state_dir, '/home/user/wok/data') - self.assertEquals(paths.log_dir, '/home/user/wok/log') + self.assertEquals(paths.log_dir, '/home/user/wok/data/logs') self.assertEquals(paths.conf_dir, '/home/user/wok/src') self.assertEquals(paths.src_dir, '/home/user/wok/src/wok') self.assertEquals(paths.plugins_dir, '/home/user/wok/src/wok/plugins') -- 2.1.0

3 2

[PATCH][Kimchi] Fix logging and error messages in objectstore upgrade
by Rodrigo Trujillo 30 Apr '16

30 Apr '16

There are bugs in excepts in objectstore upgrade functions: - wok_log is in wrong position, after raise, and is never called; - log message misses '%s' operator Signed-off-by: Rodrigo Trujillo <rodrigo.trujillo(a)linux.vnet.ibm.com> --- utils.py | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/utils.py b/utils.py index 3837e74..c4cd07d 100644 --- a/utils.py +++ b/utils.py @@ -111,8 +111,8 @@ def upgrade_objectstore_data(item, old_uri, new_uri): except sqlite3.Error, e: if conn: conn.rollback() + wok_log.error("Error while upgrading objectstore data: %s", e.args[0]) raise OperationFailed("KCHUTILS0006E") - wok_log.error("Error while upgrading objectstore data:", e.args[0]) finally: if conn: conn.close() @@ -157,8 +157,8 @@ def upgrade_objectstore_template_disks(libv_conn): except sqlite3.Error, e: if conn: conn.rollback() + wok_log.error("Error while upgrading objectstore data: %s", e.args[0]) raise OperationFailed("KCHUTILS0006E") - wok_log.error("Error while upgrading objectstore data:", e.args[0]) finally: if conn: conn.close() @@ -200,8 +200,8 @@ def upgrade_objectstore_memory(): except sqlite3.Error, e: if conn: conn.rollback() + wok_log.error("Error while upgrading objectstore data: %s", e.args[0]) raise OperationFailed("KCHUTILS0006E") - wok_log.error("Error while upgrading objectstore data:", e.args[0]) finally: if conn: conn.close() -- 2.1.0

3 2

[PATCH v3] [Wok] Changes in wok.list.js widget to allow multiple selection
by sguimaraes943＠gmail.com 28 Apr '16

28 Apr '16

From: Samuel Guimarães <sguimaraes943(a)gmail.com> This patch updates wok.list.js widget to allow multiple selection in Debug Reports and Repositories in Gingerbase. Another patch was sent to Ginger Dev List covering the changes necessary. This patch also includes changes in Wok SCSS and CSS aiming accessibility and responsive design. v2 - Displays checkbox on all screen sizes and platforms. Fixed spinner icon position when generating a new log. v3 - Fixed spinner position in desktop. Samuel Guimarães (1): Changes in wok.list.js widget to allow multiple selection ui/css/bootstrap.custom.css | 8 +- ui/css/src/modules/_buttons.scss | 8 ++ ui/css/src/modules/_wok-forms.scss | 1 + ui/css/src/modules/_wok-grid.scss | 250 +++++++++++++++++++++++++++----- ui/css/src/modules/_wok-variables.scss | 4 +- ui/css/wok.css | 254 ++++++++++++++++++++++++++++----- ui/js/src/wok.list.js | 174 +++++++++++----------- 7 files changed, 531 insertions(+), 168 deletions(-) -- 1.9.3

3 4

[PATCH v3] [Wok] Changes in wok.list.js widget to allow multiple selection
by sguimaraes943＠gmail.com 28 Apr '16

28 Apr '16

From: Samuel Guimarães <sguimaraes943(a)gmail.com> This patch updates wok.list.js widget to allow multiple selection in Debug Reports and Repositories in Gingerbase. Another patch was sent to Ginger Dev List covering the changes necessary. This patch also includes changes in Wok SCSS and CSS aiming accessibility and responsive design. v2 - Displays checkbox on all screen sizes and platforms. Fixed spinner icon position when generating a new log. v3 - Fixed spinner position in desktop. Samuel Guimarães (1): Changes in wok.list.js widget to allow multiple selection ui/css/bootstrap.custom.css | 8 +- ui/css/src/modules/_buttons.scss | 8 ++ ui/css/src/modules/_wok-forms.scss | 1 + ui/css/src/modules/_wok-grid.scss | 250 +++++++++++++++++++++++++++----- ui/css/src/modules/_wok-variables.scss | 4 +- ui/css/wok.css | 254 ++++++++++++++++++++++++++++----- ui/js/src/wok.list.js | 174 +++++++++++----------- 7 files changed, 531 insertions(+), 168 deletions(-) -- 1.9.3

2 2

[RFC] Issue 201 - Kimchi should handle libvirt connection failures
by Paulo Ricardo Paz Vital 28 Apr '16

28 Apr '16

Today, Kimchi (and Ginger) has a strong dependency with Libvirt, well described in the kimchid.service.{fedora,ubuntu} file that extends the wokd.service configuration to make it dependent of libvirt service. The current configuration stops wokd service automatically if libvirt service is stopped. To prevent wokd to stop automatically if libvirt stops, a new configuration must be set up and loaded, making wokd service still available to user. This is the easiest part to solve this issue. The real issue is that most of the Kimchi operations need to connect to libvirt service and the current implementation, simple stops the cherrypy server if a connection is not available (after 10 seconds trying to connect), causing a "502 bad gateway" error from NGINX. With this implementation from Kimchi, Wok and GingerBase (and Ginger if installed) will not be available to user even though they don't depend on the libvirt service. Basically, the proposal to solve the issue is: 1) Modify the kimchid.service.{fedora,ubuntu} files to "reduce" the dependency on libvirt service while wokd is already running - none change will modify the start up dependency; and 2) Modify how Kimchi handle the missing libvirt connection to no stop the cherrypy server and provide information to user by Virtualization tab and its sub-tabs, keeping all other plugins enabled and operating. Feel free to make any suggestion. Patches will be submitted by the end of this week. Thanks and best regards, -- Paulo Ricardo Paz Vital Linux Technology Center, IBM Systems http://www.ibm.com/linux/ltc/

3 6

[Wok][RFC] Issue 104 Multi-culture support for formatting numbers and datetime
by Pooja Kulkarni 28 Apr '16

28 Apr '16

Hi Team, In order to provide multi-culture support, we must format the numbers and datetime data as per the user's locale. For example, when a french user selects the UI language as English, he/she must still see the numbers and datetime in french format. The user's locale may be obtained in two ways: 1. Fetch the language setting of user's browser: This approach involves fetching the language setting of user's browser either by using 'accept-language' header that is sent to the server or navigator.language 2. Have another drop down menu for user's locale: This approach involves having two drop down menus, one for the translation language and another for the locale. The locale drop down menu can contain languages that may or may not be included in the translation language drop down menu. By default, the language selected in the translation drop down can be selected in the locale drop down as well. However, the first approach is not reliable and may vary from one browser to another (some may not support navigator method). So I would prefer the second approach. Any thoughts or comments? Regards Pooja

2 1

[PATCH v2] [Wok] Changes in wok.list.js widget to allow multiple selection
by sguimaraes943＠gmail.com 28 Apr '16

28 Apr '16

From: Samuel Guimarães <sguimaraes943(a)gmail.com> This patch updates wok.list.js widget to allow multiple selection in Debug Reports and Repositories in Gingerbase. Another patch was sent to Ginger Dev List covering the changes necessary. This patch also includes changes in Wok SCSS and CSS aiming accessibility and responsive design. v2 - Displays checkbox on all screen sizes and platforms. Fixed spinner icon position when generating a new log. No need to update patch sent to Gingerbase mailing list for now. Samuel Guimarães (1): Changes in wok.list.js widget to allow multiple selection ui/css/bootstrap.custom.css | 8 +- ui/css/src/modules/_buttons.scss | 8 ++ ui/css/src/modules/_wok-forms.scss | 1 + ui/css/src/modules/_wok-grid.scss | 250 +++++++++++++++++++++++++++----- ui/css/src/modules/_wok-variables.scss | 4 +- ui/css/wok.css | 254 ++++++++++++++++++++++++++++----- ui/js/src/wok.list.js | 174 +++++++++++----------- 7 files changed, 531 insertions(+), 168 deletions(-) -- 1.9.3

3 3

[PATCH ][Wok]Issue # 317 : Ginger should NOT depeden on
by atreyee＠linux.vnet.ibm.com 28 Apr '16

28 Apr '16

From: Atreyee Mukhopadhyay <atreyee(a)linux.vnet.ibm.com> This change will make any plugin UI extended by another. Gingers390x related changes will be imported dynamically to ginger when ginger390x plugin is installed. Atreyee Mukhopadhyay (1): Issue # 317: Ginger should NOT depeden on Ginger s390x src/wok/root.py | 8 ++++++++ src/wok/template.py | 2 +- 2 files changed, 9 insertions(+), 1 deletion(-) -- 2.1.0

3 4

[PATCH V6] [Kimchi 0/4] Issue #372: Add support to netboot installation.
by pvital＠linux.vnet.ibm.com 27 Apr '16

27 Apr '16

From: Paulo Vital <pvital(a)linux.vnet.ibm.com> V6: * Make sure only valid information is stored in objectstore * Modified VMTemplate constructor to receive one new argument: netboot=False V5: * Improved the changes in API for source_media * Added two new test cases * Updated UI to reflect the changes in template API V4: * Changed API of source_media to be a dictionary with type and path * Adapted source code to the new API V3: * set network as third default option to boot order V2: * Adapted patch to new template API (automatic detection of cdrom) V1: This patchset adds support in backend to create templates and guests to netboot without setting a cdrom path or URL as image to install. Once created a guest to boot via network, the guest will request DHCP/TFTP/(NFS/HTTP/FTP) network installation servers to download the configured images and start the install. Reference: http://miud.in/1Ht3 To test, use the curl commands (look the parameters used): $ curl -k -u test -H "Content-Type: application/json" -H \ "Accept: application/json" 'https://localhost:8001/plugins/kimchi/templates' \ -X POST -d '{"name": "test-netboot", "source_media": {"type": "netboot", "path": "/var/lib/libvirt/images/netboot"}}' Enter host password for user 'test': { "cpu_info":{ "maxvcpus":1, "vcpus":1 }, "graphics":{ "type":"vnc", "listen":"127.0.0.1" }, "cdrom":null, "networks":[ "default" ], "icon":"plugins/kimchi/images/icon-vm.png", "os_distro":"unknown", "name":"test-netboot", "disks":[ { "index":0, "format":"qcow2", "pool":{ "type":"dir", "name":"/plugins/kimchi/storagepools/default" }, "size":10 } ], "invalid":{}, "os_version":"unknown", "memory":{ "current":1024, "maxmemory":1024 }, "folder":[] } $ curl -k -u test -H "Content-Type: application/json" -H \ "Accept: application/json" 'https://localhost:8001/plugins/kimchi/vms' -X POST \ -d '{"name":"1netboot-test","template":"/plugins/kimchi/templates/test-netboot"}' Enter host password for user 'test': { "status":"running", "message":"Provisioning storages for new VM", "id":"1", "target_uri":"/plugins/kimchi/vms/1netboot-test" } $ sudo virsh dumpxml 1netboot-test <domain type='kvm'> <name>1netboot-test</name> <uuid>5c9fa5b3-3203-4c93-92d6-2b4103fe7b40</uuid> <metadata> <kimchi:metadata xmlns:kimchi="https://github.com/kimchi-project/kimchi"> <kimchi:os version="unknown" distro="unknown"/> </kimchi:metadata> </metadata> <memory unit='KiB'>1048576</memory> <currentMemory unit='KiB'>1048576</currentMemory> <memtune> <hard_limit unit='KiB'>2097152</hard_limit> </memtune> <vcpu placement='static'>1</vcpu> <os> <type arch='x86_64' machine='pc-i440fx-2.4'>hvm</type> <boot dev='hd'/> <boot dev='cdrom'/> <boot dev='network'/> </os> <acpi/> <apic/> <pae/> </features> <cpu> <numa> <cell id='0' cpus='0' memory='1048576' unit='KiB'/> </numa> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/bin/qemu-kvm</emulator> <disk type='file' device='disk'> <driver name='qemu' type='qcow2' cache='none'/> <source file='/var/lib/libvirt/images/5c9fa5b3-3203-4c93-92d6-2b4103fe7b40-0.img'/> <target dev='hda' bus='ide'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <controller type='usb' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'/> <controller type='ide' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <interface type='network'> <mac address='52:54:00:ea:7e:ad'/> <source network='default'/> <model type='e1000'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> <serial type='pty'> <target port='0'/> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <input type='mouse' bus='ps2'/> <input type='keyboard' bus='ps2'/> <graphics type='vnc' port='-1' autoport='yes' listen='127.0.0.1'> <listen type='address' address='127.0.0.1'/> </graphics> <sound model='ich6'> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </sound> <video> <model type='cirrus' vram='16384' heads='1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </video> <memballoon model='virtio'> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </memballoon> </devices> </domain> Paulo Vital (4): Add support to create netboot templates. Add support to create guests to netboot. Update test cases to support netboot. Update UI to reflect modifications in template API API.json | 18 +++++-- model/templates.py | 16 +++++- tests/test_authorization.py | 4 +- tests/test_mockmodel.py | 15 ++++-- tests/test_model.py | 73 ++++++++++++++++++++------- tests/test_rest.py | 95 ++++++++++++++++++++++++++++++----- tests/test_template.py | 53 ++++++++++++++----- tests/test_vmtemplate.py | 17 +++++++ ui/js/src/kimchi.template_add_main.js | 4 +- vmtemplate.py | 39 ++++++++------ xmlutils/bootorder.py | 39 ++++++++++++++ 11 files changed, 304 insertions(+), 69 deletions(-) create mode 100644 xmlutils/bootorder.py -- 2.5.5

2 5

[PATCH][Kimchi] Issue #931 Error when editing a template created using a disk image
by Ramon Medeiros 27 Apr '16

27 Apr '16

UI wasn't passing path to image disk when updating it, so the backend was losing the disk. Signed-off-by: Ramon Medeiros <ramonn(a)linux.vnet.ibm.com> --- ui/js/src/kimchi.template_edit_main.js | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/ui/js/src/kimchi.template_edit_main.js b/ui/js/src/kimchi.template_edit_main.js index de72452..8b5abfb 100644 --- a/ui/js/src/kimchi.template_edit_main.js +++ b/ui/js/src/kimchi.template_edit_main.js @@ -20,6 +20,7 @@ kimchi.template_edit_main = function() { var origDisks; var origNetworks; var templateDiskSize; + var baseImageTemplate; $('#template-name', templateEditMain).val(kimchi.selectedTemplate); $('#edit-template-tabs a[data-toggle="tab"]').on('shown.bs.tab', function (e) { $('.tab-content').css('overflow','hidden'); @@ -89,6 +90,7 @@ kimchi.template_edit_main = function() { } return false; } + baseImageTemplate = isImageBasedTemplate; enableSpice(); $('#template-edit-graphics').selectpicker(); @@ -334,7 +336,9 @@ kimchi.template_edit_main = function() { var data = {}; var disks = $('.template-tab-body .item', '#form-template-storage'); var disksForUpdate = new Array(); + $.each(disks, function(index, diskEntity) { + var newDisk = { 'index' : index, 'pool' : {'name': '/plugins/kimchi/storagepools/' + $(diskEntity).find('.template-storage-name').val()}, @@ -342,6 +346,11 @@ kimchi.template_edit_main = function() { 'format' : $(diskEntity).find('.template-storage-disk-format').val() }; + // image based template: add base to dictionary + if ((baseImageTemplate()) && (index == 0)) { + newDisk["base"] = $('#template-edit-vmimage-textbox').val(); + } + var storageType = $(diskEntity).find('.template-storage-type').val(); if(storageType === 'iscsi' || storageType === 'scsi') { newDisk['volume'] = newDisk['pool']['name'].split('/').pop(); -- 2.5.5

3 2

[PATCH] [Kimchi] Do not use systemd private tmp dir
by Jose Ricardo Ziviani 27 Apr '16

27 Apr '16

- systemd improves daemon security by creating an isolated tmp directory, however it breaks programs that are not yet aware and, in Kimchi particular case, all directories created under tmp are randomized, meaning that a possible attacker cannot easily guess which file/dir will be created beforehand. https://access.redhat.com/blogs/766093/posts/1976243 Signed-off-by: Jose Ricardo Ziviani <joserz(a)linux.vnet.ibm.com> --- contrib/kimchid.service.fedora | 2 +- contrib/kimchid.service.ubuntu | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/contrib/kimchid.service.fedora b/contrib/kimchid.service.fedora index cd8e137..d7b10d2 100644 --- a/contrib/kimchid.service.fedora +++ b/contrib/kimchid.service.fedora @@ -4,4 +4,4 @@ After=libvirtd.service wokd.service [Service] Nice=0 -PrivateTmp=yes +PrivateTmp=no diff --git a/contrib/kimchid.service.ubuntu b/contrib/kimchid.service.ubuntu index 1c7d63f..f865987 100644 --- a/contrib/kimchid.service.ubuntu +++ b/contrib/kimchid.service.ubuntu @@ -4,4 +4,4 @@ After=libvirt-bin.service wokd.service [Service] Nice=0 -PrivateTmp=yes +PrivateTmp=no -- 2.7.4

2 1

[PATCH] [Kimchi] Make libguestfs uses direct backend instead of libvirt
by Jose Ricardo Ziviani 27 Apr '16

27 Apr '16

- there is an issue regarding libvirt socket permissions that make libguestfs fails when trying to access an image. If libguestfs access the same image directly, instead of using libvirt, it works. http://libguestfs.org/guestfs-faq.1.html Signed-off-by: Jose Ricardo Ziviani <joserz(a)linux.vnet.ibm.com> --- imageinfo.py | 1 + 1 file changed, 1 insertion(+) diff --git a/imageinfo.py b/imageinfo.py index 8874917..5a25bb7 100644 --- a/imageinfo.py +++ b/imageinfo.py @@ -50,6 +50,7 @@ def probe_image(image_path): g = guestfs.GuestFS(python_return_dict=True) g.add_drive_opts(image_path, readonly=1) + g.set_backend('direct') g.launch() try: roots = g.inspect_os() -- 2.7.4

2 2

[PATCH] [Wok] Changes in wok.list.js widget to allow multiple selection
by sguimaraes943＠gmail.com 27 Apr '16

27 Apr '16

From: Samuel Guimarães <sguimaraes943(a)gmail.com> This patch updates wok.list.js widget to allow multiple selection in Debug Reports and Repositories in Gingerbase. Another patch was sent to Ginger Dev List covering the changes necessary. This patch also includes changes in Wok SCSS and CSS aiming accessibility and responsive design. Samuel Guimarães (1): Changes in wok.list.js widget to allow multiple selection ui/css/bootstrap.custom.css | 8 +- ui/css/src/modules/_buttons.scss | 8 + ui/css/src/modules/_wok-forms.scss | 1 + ui/css/src/modules/_wok-grid.scss | 254 +++++++++++++++++++++++++++----- ui/css/src/modules/_wok-variables.scss | 4 +- ui/css/wok.css | 257 ++++++++++++++++++++++++++++----- ui/js/src/wok.list.js | 174 +++++++++++----------- 7 files changed, 538 insertions(+), 168 deletions(-) -- 1.9.3

4 5

[PATCH V5] [Kimchi 0/4] Issue #372: Add support to netboot installation.
by pvital＠linux.vnet.ibm.com 27 Apr '16

27 Apr '16

From: Paulo Vital <pvital(a)linux.vnet.ibm.com> V5: * Improved the changes in API for source_media * Added two new test cases * Updated UI to reflect the changes in template API V4: * Changed API of source_media to be a dictionary with type and path * Adapted source code to the new API V3: * set network as third default option to boot order V2: * Adapted patch to new template API (automatic detection of cdrom) V1: This patchset adds support in backend to create templates and guests to netboot without setting a cdrom path or URL as image to install. Once created a guest to boot via network, the guest will request DHCP/TFTP/(NFS/HTTP/FTP) network installation servers to download the configured images and start the install. Reference: http://miud.in/1Ht3 To test, use the curl commands (look the parameters used): $ curl -k -u test -H "Content-Type: application/json" -H \ "Accept: application/json" 'https://localhost:8001/plugins/kimchi/templates' \ -X POST -d '{"name": "test-netboot", "source_media": {"type": "netboot", "path": "/var/lib/libvirt/images/netboot"}}' Enter host password for user 'test': { "cpu_info":{ "maxvcpus":1, "vcpus":1 }, "graphics":{ "type":"vnc", "listen":"127.0.0.1" }, "cdrom":null, "networks":[ "default" ], "icon":"plugins/kimchi/images/icon-vm.png", "os_distro":"unknown", "name":"test-netboot", "disks":[ { "index":0, "format":"qcow2", "pool":{ "type":"dir", "name":"/plugins/kimchi/storagepools/default" }, "size":10 } ], "invalid":{}, "os_version":"unknown", "memory":{ "current":1024, "maxmemory":1024 }, "folder":[] } $ curl -k -u test -H "Content-Type: application/json" -H \ "Accept: application/json" 'https://localhost:8001/plugins/kimchi/vms' -X POST \ -d '{"name":"1netboot-test","template":"/plugins/kimchi/templates/test-netboot"}' Enter host password for user 'test': { "status":"running", "message":"Provisioning storages for new VM", "id":"1", "target_uri":"/plugins/kimchi/vms/1netboot-test" } $ sudo virsh dumpxml 1netboot-test <domain type='kvm'> <name>1netboot-test</name> <uuid>5c9fa5b3-3203-4c93-92d6-2b4103fe7b40</uuid> <metadata> <kimchi:metadata xmlns:kimchi="https://github.com/kimchi-project/kimchi"> <kimchi:os version="unknown" distro="unknown"/> </kimchi:metadata> </metadata> <memory unit='KiB'>1048576</memory> <currentMemory unit='KiB'>1048576</currentMemory> <memtune> <hard_limit unit='KiB'>2097152</hard_limit> </memtune> <vcpu placement='static'>1</vcpu> <os> <type arch='x86_64' machine='pc-i440fx-2.4'>hvm</type> <boot dev='hd'/> <boot dev='cdrom'/> <boot dev='network'/> </os> <acpi/> <apic/> <pae/> </features> <cpu> <numa> <cell id='0' cpus='0' memory='1048576' unit='KiB'/> </numa> </cpu> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>restart</on_crash> <devices> <emulator>/usr/bin/qemu-kvm</emulator> <disk type='file' device='disk'> <driver name='qemu' type='qcow2' cache='none'/> <source file='/var/lib/libvirt/images/5c9fa5b3-3203-4c93-92d6-2b4103fe7b40-0.img'/> <target dev='hda' bus='ide'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <controller type='usb' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'/> <controller type='ide' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <interface type='network'> <mac address='52:54:00:ea:7e:ad'/> <source network='default'/> <model type='e1000'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> <serial type='pty'> <target port='0'/> </serial> <console type='pty'> <target type='serial' port='0'/> </console> <input type='mouse' bus='ps2'/> <input type='keyboard' bus='ps2'/> <graphics type='vnc' port='-1' autoport='yes' listen='127.0.0.1'> <listen type='address' address='127.0.0.1'/> </graphics> <sound model='ich6'> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </sound> <video> <model type='cirrus' vram='16384' heads='1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </video> <memballoon model='virtio'> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </memballoon> </devices> </domain> Paulo Vital (4): Add support to create netboot templates. Add support to create guests to netboot. Update test cases to support netboot. Update UI to reflect modifications in template API API.json | 18 +++++-- model/templates.py | 14 +++++- tests/test_authorization.py | 4 +- tests/test_mockmodel.py | 15 ++++-- tests/test_model.py | 73 ++++++++++++++++++++------- tests/test_rest.py | 95 ++++++++++++++++++++++++++++++----- tests/test_template.py | 53 ++++++++++++++----- tests/test_vmtemplate.py | 18 +++++++ ui/js/src/kimchi.template_add_main.js | 4 +- vmtemplate.py | 28 +++++++---- xmlutils/bootorder.py | 39 ++++++++++++++ 11 files changed, 298 insertions(+), 63 deletions(-) create mode 100644 xmlutils/bootorder.py -- 2.5.5

4 8

[PATCH] [Kimchi 0/2] Add VEPA network tests
by Lucio Correia 26 Apr '16

26 Apr '16

Lucio Correia (2): Update mockmodel to have one more NIC available Add VEPA network tests mockmodel.py | 41 ++++++++++++++++++++++++++++++++++++++++- tests/test_mock_network.py | 13 +++++++++++++ tests/test_model_network.py | 2 ++ 3 files changed, 55 insertions(+), 1 deletion(-) -- 1.9.1

2 4

[PATCH v2][Kimchi] Issue #931 Error when editing a template created using a disk image
by Ramon Medeiros 26 Apr '16

26 Apr '16

UI wasn't passing path to image disk when updating it, so the backend was losing the disk. Signed-off-by: Ramon Medeiros <ramonn(a)linux.vnet.ibm.com> --- Changes: v2: Put result from isImageBasedTemplate() in a variable, instead of pass the pointer to the function ui/js/src/kimchi.template_edit_main.js | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/ui/js/src/kimchi.template_edit_main.js b/ui/js/src/kimchi.template_edit_main.js index de72452..bc3c2ef 100644 --- a/ui/js/src/kimchi.template_edit_main.js +++ b/ui/js/src/kimchi.template_edit_main.js @@ -20,6 +20,7 @@ kimchi.template_edit_main = function() { var origDisks; var origNetworks; var templateDiskSize; + var baseImageTemplate; $('#template-name', templateEditMain).val(kimchi.selectedTemplate); $('#edit-template-tabs a[data-toggle="tab"]').on('shown.bs.tab', function (e) { $('.tab-content').css('overflow','hidden'); @@ -89,6 +90,7 @@ kimchi.template_edit_main = function() { } return false; } + baseImageTemplate = isImageBasedTemplate(); enableSpice(); $('#template-edit-graphics').selectpicker(); @@ -342,6 +344,11 @@ kimchi.template_edit_main = function() { 'format' : $(diskEntity).find('.template-storage-disk-format').val() }; + // image based template: add base to dictionary + if ((baseImageTemplate) && (index == 0)) { + newDisk["base"] = $('#template-edit-vmimage-textbox').val(); + } + var storageType = $(diskEntity).find('.template-storage-type').val(); if(storageType === 'iscsi' || storageType === 'scsi') { newDisk['volume'] = newDisk['pool']['name'].split('/').pop(); -- 2.5.5

2 1

[PATCH][Kimchi] Fix typo and integer values validation in Guest edit UI
by Rodrigo Trujillo 26 Apr '16

26 Apr '16

- UI was measuring string values instead of integer values, this was causing errors; - Changes typo in error return: thEn by thAn. Signed-off-by: Rodrigo Trujillo <rodrigo.trujillo(a)linux.vnet.ibm.com> --- ui/js/src/kimchi.guest_edit_main.js | 4 ++-- ui/pages/i18n.json.tmpl | 4 ++-- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/ui/js/src/kimchi.guest_edit_main.js b/ui/js/src/kimchi.guest_edit_main.js index ef6d650..66edbcb 100644 --- a/ui/js/src/kimchi.guest_edit_main.js +++ b/ui/js/src/kimchi.guest_edit_main.js @@ -746,14 +746,14 @@ kimchi.guest_edit_main = function() { } // Test memory values before submit. Avoid requests we know are going to fail - if ($('#guest-edit-memory-textbox').val() > $('#guest-edit-max-memory-textbox').val()) { + if (parseInt($('#guest-edit-memory-textbox').val()) > parseInt($('#guest-edit-max-memory-textbox').val())) { wok.message.error(i18n['KCHVM0002E'], '#alert-modal-container'); $(saveButton).prop('disabled', false); return; } // Test CPU values before submit. Avoid requests we know are going to fail - if ($('#guest-edit-cores-textbox').val() > $('#guest-edit-max-processor-textbox').val()) { + if (parseInt($('#guest-edit-cores-textbox').val()) > parseInt($('#guest-edit-max-processor-textbox').val())) { wok.message.error(i18n['KCHVM0003E'], '#alert-modal-container'); $(saveButton).prop('disabled', false); return; diff --git a/ui/pages/i18n.json.tmpl b/ui/pages/i18n.json.tmpl index cb7b2a8..8da568a 100644 --- a/ui/pages/i18n.json.tmpl +++ b/ui/pages/i18n.json.tmpl @@ -66,8 +66,8 @@ "KCHVM6009M": "$_("This virtual machine is not persistent. Power Off will delete it. Continue?")", "KCHVM0001E": "$_("Input is not a number")", - "KCHVM0002E": "$_("Memory value cannot be higher then Max Memory value")", - "KCHVM0003E": "$_("Current CPUs value cannot be higher then Max CPU value")", + "KCHVM0002E": "$_("Memory value cannot be higher than Max Memory value")", + "KCHVM0003E": "$_("Current CPUs value cannot be higher than Max CPU value")", "KCHVMCD6001M": "$_("This CDROM will be detached permanently and you can re-attach it. Continue to detach it?")", "KCHVMCD6003M": "$_("Attaching...")", -- 2.1.0

3 3

[PATCH] [Kimchi] Bug fix: Convert CPU and memory values to number before doing any data validation
by Aline Manera 26 Apr '16

26 Apr '16

The value entered for CPUs must not be greater than maximum CPUs value; and the value entered for memory must not be greater than the maximum memory value. But the input boxes return the data in string format which may cause issues while doing data validation. So convert the inputed values to number to do the input validation. Signed-off-by: Aline Manera <alinefm(a)linux.vnet.ibm.com> --- ui/js/src/kimchi.guest_edit_main.js | 24 ++++++++++++++++-------- 1 file changed, 16 insertions(+), 8 deletions(-) diff --git a/ui/js/src/kimchi.guest_edit_main.js b/ui/js/src/kimchi.guest_edit_main.js index ef6d650..47c8422 100644 --- a/ui/js/src/kimchi.guest_edit_main.js +++ b/ui/js/src/kimchi.guest_edit_main.js @@ -746,17 +746,25 @@ kimchi.guest_edit_main = function() { } // Test memory values before submit. Avoid requests we know are going to fail - if ($('#guest-edit-memory-textbox').val() > $('#guest-edit-max-memory-textbox').val()) { - wok.message.error(i18n['KCHVM0002E'], '#alert-modal-container'); - $(saveButton).prop('disabled', false); - return; + var memValue = Number($('#guest-edit-memory-textbox').val()); + var maxmemValue = Number($('#guest-edit-max-memory-textbox').val()); + if (memValue !== undefined && memValue !== "" && maxmemValue !== undefined && maxmemValue !== "") { + if (memValue > maxmemValue) { + wok.message.error(i18n['KCHVM0002E'], '#alert-modal-container'); + $(saveButton).prop('disabled', false); + return; + } } // Test CPU values before submit. Avoid requests we know are going to fail - if ($('#guest-edit-cores-textbox').val() > $('#guest-edit-max-processor-textbox').val()) { - wok.message.error(i18n['KCHVM0003E'], '#alert-modal-container'); - $(saveButton).prop('disabled', false); - return; + var coresValue = Number($('#guest-edit-cores-textbox').val()); + var maxprocessorValue = Number($('#guest-edit-max-processor-textbox').val()); + if (coresValue !== undefined && coresValue !== "" && maxprocessorValue !== undefined && maxprocessorValue !== "") { + if (coresValue > maxprocessorValue) { + wok.message.error(i18n['KCHVM0003E'], '#alert-modal-container'); + $(saveButton).prop('disabled', false); + return; + } } if (data['vcpus'] !== undefined) { -- 2.5.5

2 2

[PATCH][Wok] Return collection list without resource with lookup problems
by Rodrigo Trujillo 25 Apr '16

25 Apr '16

When a collection receives a GET request, it is going to fetch all resources names, in a list, and perform a lookup for each resource, building the return list with all data. There is a potencial race condition problem in this approach. If a given resource is removed between list of names creation and its lookup call, wok is going to fail and the exception is not treated. This patch fix this problem catching the exception, logging the problem and completing the GET request. So, the resource with problem is discarted and other resources are returned. Signed-off-by: Rodrigo Trujillo <rodrigo.trujillo(a)linux.vnet.ibm.com> --- src/wok/control/base.py | 11 +++++++++-- 1 file changed, 9 insertions(+), 2 deletions(-) diff --git a/src/wok/control/base.py b/src/wok/control/base.py index 7aeb844..f314d18 100644 --- a/src/wok/control/base.py +++ b/src/wok/control/base.py @@ -34,7 +34,7 @@ from wok.exception import InvalidOperation, InvalidParameter from wok.exception import MissingParameter, NotFoundError from wok.exception import OperationFailed, UnauthorizedError, WokException from wok.reqlogger import RequestRecord -from wok.utils import get_plugin_from_request, utf8_dict +from wok.utils import get_plugin_from_request, utf8_dict, wok_log # Default request log messages @@ -364,7 +364,14 @@ class Collection(object): # internal text, get_list changes ident to unicode for sorted args = self.resource_args + [ident] res = self.resource(self.model, *args) - res.lookup() + try: + res.lookup() + except Exception as e: + # In case of errors when fetching a resource info, pass and + # log the error, so, other resources are returned + wok_log.error("Problem in lookup of resource '%s'. " + "Detail: %s" % (ident, e.message)) + continue res_list.append(res) return res_list except AttributeError: -- 2.1.0

3 2

[PATCH] [Wok] Added utils method for handling locale based formating of number along with Measurement format.
by archus＠linux.vnet.ibm.com 25 Apr '16

25 Apr '16

From: Archana Singh <archus(a)linux.vnet.ibm.com> Added formatNumber method which set the passed locale to method and does formatting of number, and revert back the locale setting. Added formatMeasurement method which format number measurement also format as per locale. Signed-off-by: Archana Singh <archus(a)linux.vnet.ibm.com> --- src/wok/utils.py | 88 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 88 insertions(+) diff --git a/src/wok/utils.py b/src/wok/utils.py index 0e8ec05..b37518f 100644 --- a/src/wok/utils.py +++ b/src/wok/utils.py @@ -33,6 +33,7 @@ import subprocess import sys import traceback import xml.etree.ElementTree as ET +import locale from cherrypy.lib.reprconf import Parser from datetime import datetime, timedelta @@ -646,3 +647,90 @@ def decode_value(val): if not isinstance(val, unicode): val = val.decode('utf-8') return val + + +def formatMeasurement(number, settings): + ''' + Refer to "Units of information" ( + http://en.wikipedia.org/wiki/Units_of_information + ) for more information about measurement units. + + @param number The number to be normalized. + @param settings + base Measurement base, accepts 2 or 10. defaults to 2. + unit The unit of the measurement, e.g., B, Bytes/s, bps, etc. + fixed The number of digits after the decimal point. + locale The locale for formating the number if not passed + format is done as per current locale. + @returns [object] + v The number part of the measurement. + s The suffix part of the measurement including multiple and unit. + e.g., kB/s means 1000B/s, KiB/s for 1024B/s. + ''' + unitBaseMapping = {2: [{"us": 'Ki', "v": 1024}, + {"us": 'Mi', "v": 1048576}, + {"us": 'Gi', "v": 1073741824}, + {"us": 'Ti', "v": 1099511627776}, + {"us": 'Pi', "v": 1125899906842624}], + 10: [{"us": 'k', "v": 1000}, + {"us": 'M', "v": 1000000}, + {"us": 'G', "v": 1000000000}, + {"us": 'T', "v": 1000000000000}, + {"us": 'P', "v": 1000000000000000}]} + + if(not number): + return number + settings = settings or {} + unit = settings['unit'] if 'unit' in settings else 'B' + base = settings['base'] if 'base' in settings else 2 + + new_locale = settings['locale'] if 'locale' in settings else '' + + if(base != 2 and base != 10): + return encode_value(number) + unit + + fixed = settings['fixed'] + + unitMapping = unitBaseMapping[base] + for mapping in reversed(unitMapping): + suffix = mapping['us'] + startingValue = mapping['v'] + if(number < startingValue): + continue + + formatted = float(number) / startingValue + formatted = formatNumber(formatted, fixed, new_locale) + return formatted + suffix + unit + + formatted_number = formatNumber(number, fixed, new_locale) + return formatted_number+unit + + +def formatNumber(number, fixed, format_locale): + ''' + Format the number based on format_locale passed. + ''' + + # get the current locale + current_locale = locale.getlocale() + new_locale = '' + # set passed locale and set new_locale to same value. + if format_locale: + new_locale = locale.setlocale(locale.LC_ALL, format_locale) + + # Based on type of number use the correct formatter + if isinstance(number, float): + if fixed: + formatted = locale.format('%' + '.%df' % fixed, number, True) + else: + formatted = locale.format('%f', number, True) + if isinstance(number, int): + formatted = locale.format('%d', number, True) + # After formatting is done as per locale, reset the locale if changed. + if (new_locale and not current_locale[0] and not current_locale[1]): + locale.setlocale(locale.LC_ALL, 'C') + elif (new_locale): + locale.setlocale(locale.LC_ALL, current_locale[0] + "." + + current_locale[1]) + + return formatted -- 2.5.0

3 2