- Users - oVirt List Archives

Network/Storage design
by Josep Manel Andrés Moscardó 11 Nov '18

11 Nov '18

Hi, I am new to oVirt and trying to deploy a cluster to see whether we can move from VMWare to oVirt, but my first stopper is how to do a proper design for the infrastructure, how many networks do I need?, I have 2x10Gb SFP+ and 4x1Gb ethernet. For storage we have NFS coming from Netapp and ceph. Could someone point me in the right direction? Thanks.

4 5

libgfapi support are "false" by default in ovirt 4.2 ?
by Mike Lykov 09 Nov '18

09 Nov '18

Hi All I'm try to set up last ovirt version : ovirt-release42-pre.rpm repository Then, I install these (and many deps) rpms: ovirt-hosted-engine-setup-2.2.30-1.el7.noarch ovirt-engine-appliance-4.2-20181026.1.el7.noarch vdsm-4.20.43-1.el7.x86_64 vdsm-gluster-4.20.43-1.el7.x86_64 vdsm-network-4.20.43-1.el7.x86_64 All from that repository, and use webui installer for create glusterfs volumes (default suggested engine, data, vmstore) and then install hosted engine on that "engine" volume. In cluster I want to use libgfapi gluster storage access method, but when I import storages, created by installer at first step, VDSM mount it on hosts with FUSE. For Example ovirtstor1.miac:/engine on /rhev/data-center/mnt/glusterSD/ovirtstor1.miac:_engine type fuse.glusterfs (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072) ovirtnode1.miac:/data on /rhev/data-center/mnt/glusterSD/ovirtnode1.miac:_data type fuse.glusterfs (rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072) I see in config, And it is disabled (false) [root@ovirtengine ~]# engine-config -a | grep -i libgf LibgfApiSupported: false version: 3.6 LibgfApiSupported: false version: 4.0 LibgfApiSupported: false version: 4.1 LibgfApiSupported: false version: 4.2 Why? Its is needed to enable it by hand? Like as in this presentation? https://www.slideshare.net/DenisChapligin/improving-hyperconverged-performa…

5 7

ovirt 4.2.7 nested not importing she domain
by Gianluca Cecchi 09 Nov '18

09 Nov '18

Hello, I'm configuring a nested self hosted engine environment with 4.2.7 and CentOS 7.5. Domain type is NFS. I deployed with hosted-engine --deploy --noansible All went apparently good but after creating the master storage domain I see that the hosted engine domain is not automatically imported At the moment I have only one host. ovirt-ha-agent status gives every 10 seconds: Nov 09 00:36:30 ovirtdemo01.localdomain.local ovirt-ha-agent[18407]: ovirt-ha-agent ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config.vm ERROR Unable to identify the OVF_STORE volume, falling back to initial vm.conf. Please ensure you already added your first data domain for regular VMs In engine.log I see every 15 seconds a dumpxml output ad the message: 2018-11-09 00:31:52,822+01 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerObjectsBuilder] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [7fcce3cb] null architecture type, replacing with x86_64, VM [HostedEngine] see full below. Any hint? Thanks Gianluca 2018-11-09 00:31:52,714+01 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [] VM '21c5fe9f-cd46-49fd-a6f3-009b4d450894' was discovered as 'Up' on VDS '4de40432-c1f7-4f20-b231-347095015fbd'(ovirtdemo01.localdomain.local) 2018-11-09 00:31:52,764+01 INFO [org.ovirt.engine.core.bll.AddUnmanagedVmsCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [7fcce3cb] Running command: AddUnmanagedVmsCommand internal: true. 2018-11-09 00:31:52,766+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DumpXmlsVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [7fcce3cb] START, DumpXmlsVDSCommand(HostName = ovirtdemo01.localdomain.local, Params:{hostId='4de40432-c1f7-4f20-b231-347095015fbd', vmIds='[21c5fe9f-cd46-49fd-a6f3-009b4d450894]'}), log id: 5d5a0a63 2018-11-09 00:31:52,775+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DumpXmlsVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [7fcce3cb] FINISH, DumpXmlsVDSCommand, return: {21c5fe9f-cd46-49fd-a6f3-009b4d450894=<domain type='kvm' id='2'> <name>HostedEngine</name> <uuid>21c5fe9f-cd46-49fd-a6f3-009b4d450894</uuid> <metadata xmlns:ovirt-tune="http://ovirt.org/vm/tune/1.0" xmlns:ovirt-vm=" http://ovirt.org/vm/1.0"> <ovirt-tune:qos/> <ovirt-vm:vm xmlns:ovirt-vm="http://ovirt.org/vm/1.0"> <ovirt-vm:destroy_on_reboot type="bool">False</ovirt-vm:destroy_on_reboot> <ovirt-vm:memGuaranteedSize type="int">0</ovirt-vm:memGuaranteedSize> <ovirt-vm:startTime type="float">1541719799.6</ovirt-vm:startTime> <ovirt-vm:device devtype="console" name="console0"> <ovirt-vm:deviceId>2e8944d3-7ac4-4597-8883-c0b2937fb23b</ovirt-vm:deviceId> <ovirt-vm:specParams/> <ovirt-vm:vm_custom/> </ovirt-vm:device> <ovirt-vm:device mac_address="00:16:3e:35:d9:2c"> <ovirt-vm:deviceId>0f1d0ce3-8843-4418-b882-0d84ca481717</ovirt-vm:deviceId> <ovirt-vm:network>ovirtmgmt</ovirt-vm:network> <ovirt-vm:specParams/> <ovirt-vm:vm_custom/> </ovirt-vm:device> <ovirt-vm:device devtype="disk" name="hdc"> <ovirt-vm:deviceId>6d167005-b547-4190-938f-ce1b82eae7af</ovirt-vm:deviceId> <ovirt-vm:shared>false</ovirt-vm:shared> <ovirt-vm:specParams/> <ovirt-vm:vm_custom/> </ovirt-vm:device> <ovirt-vm:device devtype="disk" name="vda"> <ovirt-vm:deviceId>8eb98007-1d9a-4689-bbab-b3c7060efef8</ovirt-vm:deviceId> <ovirt-vm:domainID>fbcfb922-0103-43fb-a2b6-2bf0c9e356ea</ovirt-vm:domainID> <ovirt-vm:guestName>/dev/vda</ovirt-vm:guestName> <ovirt-vm:imageID>8eb98007-1d9a-4689-bbab-b3c7060efef8</ovirt-vm:imageID> <ovirt-vm:poolID>00000000-0000-0000-0000-000000000000</ovirt-vm:poolID> <ovirt-vm:shared>exclusive</ovirt-vm:shared> <ovirt-vm:volumeID>64bdb7cd-60a1-4420-b3a6-607b20e2cd5a</ovirt-vm:volumeID> <ovirt-vm:specParams/> <ovirt-vm:vm_custom/> <ovirt-vm:volumeChain> <ovirt-vm:volumeChainNode> <ovirt-vm:domainID>fbcfb922-0103-43fb-a2b6-2bf0c9e356ea</ovirt-vm:domainID> <ovirt-vm:imageID>8eb98007-1d9a-4689-bbab-b3c7060efef8</ovirt-vm:imageID> <ovirt-vm:leaseOffset type="int">0</ovirt-vm:leaseOffset> <ovirt-vm:leasePath>/rhev/data-center/mnt/ovirtdemo01.localdomain.local:_SHE__DOMAIN/fbcfb922-0103-43fb-a2b6-2bf0c9e356ea/images/8eb98007-1d9a-4689-bbab-b3c7060efef8/64bdb7cd-60a1-4420-b3a6-607b20e2cd5a.lease</ovirt-vm:leasePath> <ovirt-vm:path>/rhev/data-center/mnt/ovirtdemo01.localdomain.local:_SHE__DOMAIN/fbcfb922-0103-43fb-a2b6-2bf0c9e356ea/images/8eb98007-1d9a-4689-bbab-b3c7060efef8/64bdb7cd-60a1-4420-b3a6-607b20e2cd5a</ovirt-vm:path> <ovirt-vm:volumeID>64bdb7cd-60a1-4420-b3a6-607b20e2cd5a</ovirt-vm:volumeID> </ovirt-vm:volumeChainNode> </ovirt-vm:volumeChain> </ovirt-vm:device> </ovirt-vm:vm> </metadata> <memory unit='KiB'>6270976</memory> <currentMemory unit='KiB'>6270976</currentMemory> <vcpu placement='static' current='1'>2</vcpu> <cputune> <shares>1020</shares> </cputune> <resource> <partition>/machine</partition> </resource> <sysinfo type='smbios'> <system> <entry name='manufacturer'>oVirt</entry> <entry name='product'>oVirt Node</entry> <entry name='version'>7-5.1804.5.el7.centos</entry> <entry name='serial'>2820BD92-2B2B-42C5-912B-76FB65E93FBF</entry> <entry name='uuid'>21c5fe9f-cd46-49fd-a6f3-009b4d450894</entry> </system> </sysinfo> <os> <type arch='x86_64' machine='pc-i440fx-rhel7.5.0'>hvm</type> <smbios mode='sysinfo'/> </os> <features> <acpi/> </features> <cpu mode='custom' match='exact' check='full'> <model fallback='forbid'>Skylake-Client</model> <feature policy='require' name='hypervisor'/> </cpu> <clock offset='variable' adjustment='0' basis='utc'> <timer name='rtc' tickpolicy='catchup'/> <timer name='pit' tickpolicy='delay'/> <timer name='hpet' present='no'/> </clock> <on_poweroff>destroy</on_poweroff> <on_reboot>destroy</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/libexec/qemu-kvm</emulator> <disk type='file' device='cdrom'> <driver error_policy='stop'/> <source startupPolicy='optional'/> <target dev='hdc' bus='ide'/> <readonly/> <alias name='ide0-1-0'/> <address type='drive' controller='0' bus='1' target='0' unit='0'/> </disk> <disk type='file' device='disk' snapshot='no'> <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/> <source file='/var/run/vdsm/storage/fbcfb922-0103-43fb-a2b6-2bf0c9e356ea/8eb98007-1d9a-4689-bbab-b3c7060efef8/64bdb7cd-60a1-4420-b3a6-607b20e2cd5a'/> <backingStore/> <target dev='vda' bus='virtio'/> <serial>8eb98007-1d9a-4689-bbab-b3c7060efef8</serial> <boot order='1'/> <alias name='virtio-disk0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/> </disk> <controller type='scsi' index='0' model='virtio-scsi'> <alias name='scsi0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </controller> <controller type='usb' index='0' model='piix3-uhci'> <alias name='usb'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'> <alias name='pci.0'/> </controller> <controller type='ide' index='0'> <alias name='ide'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <controller type='virtio-serial' index='0'> <alias name='virtio-serial0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/> </controller> <lease> <lockspace>fbcfb922-0103-43fb-a2b6-2bf0c9e356ea</lockspace> <key>64bdb7cd-60a1-4420-b3a6-607b20e2cd5a</key> <target path='/rhev/data-center/mnt/ovirtdemo01.localdomain.local:_SHE__DOMAIN/fbcfb922-0103-43fb-a2b6-2bf0c9e356ea/images/8eb98007-1d9a-4689-bbab-b3c7060efef8/64bdb7cd-60a1-4420-b3a6-607b20e2cd5a.lease'/> </lease> <interface type='bridge'> <mac address='00:16:3e:35:d9:2c'/> <source bridge='ovirtmgmt'/> <target dev='vnet0'/> <model type='virtio'/> <link state='up'/> <alias name='net0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> <console type='pty' tty='/dev/pts/0'> <source path='/dev/pts/0'/> <target type='virtio' port='0'/> <alias name='console0'/> </console> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channels/21c5fe9f-cd46-49fd-a6f3-009b4d450894.com.redhat.rhevm.vdsm'/> <target type='virtio' name='com.redhat.rhevm.vdsm' state='connected'/> <alias name='channel0'/> <address type='virtio-serial' controller='0' bus='0' port='1'/> </channel> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channels/21c5fe9f-cd46-49fd-a6f3-009b4d450894.org.qemu.guest_agent.0'/> <target type='virtio' name='org.qemu.guest_agent.0' state='connected'/> <alias name='channel1'/> <address type='virtio-serial' controller='0' bus='0' port='2'/> </channel> <channel type='unix'> <source mode='bind' path='/var/lib/libvirt/qemu/channels/21c5fe9f-cd46-49fd-a6f3-009b4d450894.org.ovirt.hosted-engine-setup.0'/> <target type='virtio' name='org.ovirt.hosted-engine-setup.0' state='disconnected'/> <alias name='channel2'/> <address type='virtio-serial' controller='0' bus='0' port='3'/> </channel> <input type='mouse' bus='ps2'> <alias name='input0'/> </input> <input type='keyboard' bus='ps2'> <alias name='input1'/> </input> <graphics type='vnc' port='5900' autoport='yes' listen='0' passwdValidTo='1970-01-01T00:00:01'> <listen type='address' address='0'/> </graphics> <video> <model type='vga' vram='32768' heads='1' primary='yes'/> <alias name='video0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </video> <memballoon model='none'> <alias name='balloon0'/> </memballoon> <rng model='virtio'> <backend model='random'>/dev/urandom</backend> <alias name='rng0'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/> </rng> </devices> <seclabel type='dynamic' model='selinux' relabel='yes'> <label>system_u:system_r:svirt_t:s0:c500,c542</label> <imagelabel>system_u:object_r:svirt_image_t:s0:c500,c542</imagelabel> </seclabel> <seclabel type='dynamic' model='dac' relabel='yes'> <label>+107:+107</label> <imagelabel>+107:+107</imagelabel> </seclabel> </domain> }, log id: 5d5a0a63 2018-11-09 00:31:52,822+01 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerObjectsBuilder] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [7fcce3cb] null architecture type, replacing with x86_64, VM [HostedEngine]

3 4

Storage domain mount error: Lustre file system (Posix compliant FS)
by okok102928＠fusiondata.co.kr 09 Nov '18

09 Nov '18

Hi. I am an ovirt user in Korea. I am working on VDI. It's a pleasure to meet you, the ovirt specialists. (I do not speak English well... Thank you for your understanding!) I am testing Lustre File System in Ovirt or RH(E)V environment. (The reason is simple: glusterfs and nfs have limit of performance, SAN Storage and excellent Software Defined Storage are quite expensive.) Testing for file system performance was successful. As expected, luster showed amazing performance. However, there was an error adding luster storage to the storage domain as Posix compliant FS. Domain Function : Data Storage Type : POSIX compliant FS Host to Use : [SPM_HOSTNAME] Name : [STORAGE_DOMAIN_NAME] Path : 10.10.10.15@tcp:/lustre/vmstore VFS Type : lustre Mount Options : The vdsm debug logs are shown below. 2018-10-25 12:46:58,963+0900 INFO (jsonrpc/2) [storage.xlease] Formatting index for lockspace u'c0ef7ee6-1da9-4eef-9e03-387cd3a24445' (version=1) (xlease:653) 2018-10-25 12:46:58,971+0900 DEBUG (jsonrpc/2) [root] /usr/bin/dd iflag=fullblock of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases oflag=direct,seek_bytes seek=1048576 bs=256512 count=1 conv=notrunc,nocreat,fsync (cwd None) (commands:65) 2018-10-25 12:46:58,985+0900 DEBUG (jsonrpc/2) [root] FAILED: <err> = "/usr/bin/dd: error writing '/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\n"; <rc> = 1 (commands:86) 2018-10-25 12:46:58,985+0900 INFO (jsonrpc/2) [vdsm.api] FINISH createStorageDomain error=Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\n" from=::ffff:192.168.161.104,52188, flow_id=794bd395, task_id=c9847bf3-2267-483b-9099-f05a46981f7f (api:50) 2018-10-25 12:46:58,985+0900 ERROR (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in createStorageDomain File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2591, in createStorageDomain storageType, domVersion) File "/usr/lib/python2.7/site-packages/vdsm/storage/nfsSD.py", line 87, in create remotePath, storageType, version) File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 465, in _prepareMetadata cls.format_external_leases(sdUUID, xleases_path) File "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 1200, in format_external_leases xlease.format_index(lockspace, backend) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 661, in format_index index.dump(file) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 761, in dump file.pwrite(INDEX_BASE, self._buf) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 994, in pwrite self._run(args, data=buf[:]) File "/usr/lib/python2.7/site-packages/vdsm/storage/xlease.py", line 1011, in _run raise cmdutils.Error(args, rc, "[suppressed]", err) Error: Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\n" 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') Task._run: c9847bf3-2267-483b-9099-f05a46981f7f (6, u'c0ef7ee6-1da9-4eef-9e03-387cd3a24445', u'vmstore', u'10.10.10.15@tcp:/lustre/vmstore', 1, u'4') {} failed - stopping task (task:894) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') stopping in state failed (force False) (task:1256) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') ref 1 aborting True (task:1002) 2018-10-25 12:46:58,986+0900 INFO (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') aborting: Task is aborted: u'Command [\'/usr/bin/dd\', \'iflag=fullblock\', u\'of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases\', \'oflag=direct,seek_bytes\', \'seek=1048576\', \'bs=256512\', \'count=1\', \'conv=notrunc,nocreat,fsync\'] failed with rc=1 out=\'[suppressed]\' err="/usr/bin/dd: error writing \'/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases\': Invalid argument\\n1+0 records in\\n0+0 records out\\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\\n"' - code 100 (task:1181) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') Prepare: aborted: Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\n" (task:1186) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') ref 0 aborting True (task:1002) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') Task._doAbort: force False (task:937) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.ResourceManager.Owner] Owner.cancelAll requests {} (resourceManager:947) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') moving from state failed -> state aborting (task:602) 2018-10-25 12:46:58,986+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') _aborting: recover policy none (task:557) 2018-10-25 12:46:58,987+0900 DEBUG (jsonrpc/2) [storage.TaskManager.Task] (Task='c9847bf3-2267-483b-9099-f05a46981f7f') moving from state failed -> state failed (task:602) 2018-10-25 12:46:58,987+0900 DEBUG (jsonrpc/2) [storage.ResourceManager.Owner] Owner.releaseAll requests {} resources {} (resourceManager:910) 2018-10-25 12:46:58,987+0900 DEBUG (jsonrpc/2) [storage.ResourceManager.Owner] Owner.cancelAll requests {} (resourceManager:947) 2018-10-25 12:46:58,987+0900 ERROR (jsonrpc/2) [storage.Dispatcher] FINISH createStorageDomain error=Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\n" (dispatcher:86) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/dispatcher.py", line 73, in wrapper result = ctask.prepare(func, *args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 108, in wrapper return m(self, *a, **kw) File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 1189, in prepare raise self.error Error: Command ['/usr/bin/dd', 'iflag=fullblock', u'of=/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases', 'oflag=direct,seek_bytes', 'seek=1048576', 'bs=256512', 'count=1', 'conv=notrunc,nocreat,fsync'] failed with rc=1 out='[suppressed]' err="/usr/bin/dd: error writing '/rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore/c0ef7ee6-1da9-4eef-9e03-387cd3a24445/dom_md/xleases': Invalid argument\n1+0 records in\n0+0 records out\n0 bytes (0 B) copied, 0.000943896 s, 0.0 kB/s\n" 2018-10-25 12:46:58,987+0900 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StorageDomain.create failed (error 351) in 0.41 seconds (__init__:573) 2018-10-25 12:46:59,058+0900 DEBUG (jsonrpc/3) [jsonrpc.JsonRpcServer] Calling 'StoragePool.disconnectStorageServer' in bridge with {u'connectionParams': [{u'id': u'316c5f1f-753e-42a1-8e30-4ee6f976906a', u'connection': u'10.10.10.15@tcp:/lustre/vmstore', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'lustre', u'password': '********', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 6} (__init__:590) 2018-10-25 12:46:59,058+0900 WARN (jsonrpc/3) [devel] Provided value "6" not defined in StorageDomainType enum for StoragePool.disconnectStorageServer (vdsmapi:275) 2018-10-25 12:46:59,058+0900 WARN (jsonrpc/3) [devel] Provided parameters {u'id': u'316c5f1f-753e-42a1-8e30-4ee6f976906a', u'connection': u'10.10.10.15@tcp:/lustre/vmstore', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'lustre', u'password': '********', u'port': u''} do not match any of union ConnectionRefParameters values (vdsmapi:275) 2018-10-25 12:46:59,059+0900 DEBUG (jsonrpc/3) [storage.TaskManager.Task] (Task='3c6b249f-a47f-47f1-a647-5893b6f60b7c') moving from state preparing -> state preparing (task:602) 2018-10-25 12:46:59,059+0900 INFO (jsonrpc/3) [vdsm.api] START disconnectStorageServer(domType=6, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'id': u'316c5f1f-753e-42a1-8e30-4ee6f976906a', u'connection': u'10.10.10.15@tcp:/lustre/vmstore', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'vfs_type': u'lustre', u'password': '********', u'port': u''}], options=None) from=::ffff:192.168.161.104,52188, flow_id=f1bf4bf8-9033-42af-9329-69960638ba0e, task_id=3c6b249f-a47f-47f1-a647-5893b6f60b7c (api:46) 2018-10-25 12:46:59,059+0900 INFO (jsonrpc/3) [storage.Mount] unmounting /rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore (mount:212) 2018-10-25 12:46:59,094+0900 DEBUG (jsonrpc/3) [storage.Mount] /rhev/data-center/mnt/10.10.10.15@tcp:_lustre_vmstore unmounted: 0.03 seconds (utils:452) 1. If you use the direct flag when using the dd command, luster only works in multiples of 4k (4096). Therefore, bs = 256512, which is not a multiple of 4096, causes an error. 2. Ovirt / RH(E)V An error occurs regardless of version. I have tested both in 3.6, 4.1, and 4.2 environments. I searched hard, but I did not have a similar case. I want to ask three questions. 1. Is there a way to fix the problem in Ovirt? (Secure bypass or some configurations) 2. (Extension of Question # 1) Where does block size 256512 come from? Why is it 256512? 3. Is this a problem you need to solve in the Lustre file system? (For example, a setting capable of direct IO in units of 512 bytes) I need help. Thank you for your reply.

3 2

Changing the system resources of the pool VM
by Hyung-Keun Kim 09 Nov '18

09 Nov '18

Hi. What I want to ask is simple. System resource changes in the Pool VM do not seem to be supported by ovirt. So let me ask you two questions. 1. Can you tell what the reason is? Are you related to the ovf file? 2. Is there any other way to use sub-templates? (Manual work is also fine) Is it possible to modify DB value only? If not, what else should I touch? Waiting for experts to answer. Thank you.

1 0

GlusterFS distributed replicated with arbiter on 4 nodes - settings
by Jarosław Prokopowski 08 Nov '18

08 Nov '18

Hi Guys, I would like to use GlusterFS distributed-replicated with arbiter volume on 4 nodes for oVirt. Can you tell me what tuning parameters should I set for such volume for best VM performance? Does it make any sense to upgrade from Glusterfs 3.12 to 4.1 or even 5.0? Thanks! Jarek

3 2

non-ovirt node as gluster node
by Tony Brian Albers 08 Nov '18

08 Nov '18

Hi guys, I have 3 machines that I'd like to test oVirt/gluster on. The idea is that I want two of them to be oVirt nodes and the third to run the oVirt engine. They all have 8 hdd's, and I'd like to use these in gluster for storing the vm images. (on all 3 machines) So, machine1 is a gluster server with oVirt engine installed machine2 is a gluster server and oVirt node machine3 is a gluster server and oVirt node Is this doable? TIA, /tony -- Tony Albers Systems Architect Systems Director, National Cultural Heritage Cluster Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark. Tel: +45 2566 2383 / +45 8946 2316

6 7

Q: Guest shutdown from UPS power off signal with "virsh"
by Andrei Verovski 08 Nov '18

08 Nov '18

Hi ! I have a shell script running on all servers which intercepts power off signal (in case of power failure). Is it safe to use direct KVM “virsh” commands to force guest shutdown on oVirt nodes, bypassing oVirt engine ? “shutdown now” directly on oVirt nodes v4.2.6 takes an enormous amount of time because for whatever reason guests can’t be suspended. My nodes installed on CentOS 7.5, I’m not using pre-packaged version because each consecutive upgrade simply wipes out all my mods. Thanks in advance. Andrei PS. I found this script to shutdown KVM guests: *************************************** #!/bin/bash # https://ask.fedoraproject.org/en/question/8796/make-libvirt-to-shutdown-my-… LIST_VM=`virsh list | grep running | awk '{print $2}'` TIMEOUT=90 DATE=`date -R` LOGFILE="/var/log/shutdownkvm.log" if [ "x$activevm" = "x" ] then exit 0 fi for activevm in $LIST_VM do PIDNO=`ps ax | grep $activevm | grep kvm | cut -c 1-6 | head -n1` echo "$DATE : Shutdown : $activevm : $PIDNO" >> $LOGFILE virsh shutdown $activevm > /dev/null COUNT=0 while [ "$COUNT" -lt "$TIMEOUT" ] do ps --pid $PIDNO > /dev/null if [ "$?" -eq "1" ] then COUNT=110 else sleep 5 COUNT=$(($COUNT+5)) fi done if [ $COUNT -lt 110 ] then echo "$DATE : $activevm not successful force shutdown" >> $LOGFILE virsh destroy $activevm > /dev/null fi done

2 1

wrong vm disk size after uploading and attaching to VM
by Jarosław Prokopowski 08 Nov '18

08 Nov '18

Hi, After uploading virutal machine disk to storage domain and attaching it to virtual machine the disk size is shown in properties as 0 and the VM boots to dracut complaining about the disk size. The disk is "thin provision" Device /dev/sda2 has size of 22528 sectors which is smaller than corresponding PV size of 166746122 <16%20674%2061%2022> Is there a way to fix that? Thanks Jarek

1 0

set up ovirt 4.2 hyperconverged with glusterfs "storage network" over infiniband
by Mike Lykov 08 Nov '18

08 Nov '18

Hi All! I'm try to set up last ovirt version : ovirt-release42-pre.rpm repository (because bug https://bugzilla.redhat.com/show_bug.cgi?id=1637468 , for example - it's not fixed in release42 stable) Then, I install these (and many deps) rpms: ovirt-hosted-engine-setup-2.2.30-1.el7.noarch ovirt-engine-appliance-4.2-20181026.1.el7.noarch vdsm-4.20.43-1.el7.x86_64 vdsm-gluster-4.20.43-1.el7.x86_64 vdsm-network-4.20.43-1.el7.x86_64 All from that repository, and use webui installer for create glusterfs volumes (default suggested engine, data, vmstore) and then install hosted engine on that "engine" volume. But in my case i try to setup additional "storage network" (for example, as described there: https://ovirt.org/develop/release-management/features/gluster/select-networ… ) These screenshots are too old, and in 4.2 UI changed as I see, but idea are same. I have two interface on each host: one ethernet (enp59s0f0 with address from 172.16.10.0/24 with default gateway) and one "Infiniband" (no default gateway, only between cluster nodes, no routing, no external access). Really it is Intel Omni-path fabric : ----------- [root@ovirtnode1 log]# hfi1_control -i Driver Version: 10.8-0 Opa Version: 10.8.0.0.204 0: BoardId: Intel Corporation Omni-Path HFI Silicon 100 Series [integrated] 0,1: Status: 5: LinkUp 4: ACTIVE ------------- It looks like IP-over-IB interface: 6: ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65520 qdisc pfifo_fast state UP group default qlen 256 link/infiniband 80:00:00:02:fe:80:00:00:00:00:00:00:00:11:75:09:01:1a:ee:ea brd 00:ff:ff:ff:ff:12:40:1b:80:01:00:00:00:00:00:00:ff:ff:ff:ff inet 172.16.100.1/24 brd 172.16.100.255 scope global noprefixroute ib0 valid_lft forever preferred_lft forever It has this properties in ifcfg-ib0 file: CONNECTED_MODE=yes MTU=65520 All IP-s on that interfaces pair have DNS records on external DNS: ethernet (management network) has ovirtnode{N} names and infiniband (storage network) has an ovirtstor{N} names. During webui glusterfs setup I used ovirtstor host names, trusted pool created: 5a9a0a5f-12f4-48b1-bfbe-24c172adc65c ovirtstor5.miac Connected 41350da9-c944-41c5-afdc-46ff51ab93f6 ovirtstor6.miac Connected 0f50175e-7e47-4839-99c7-c7ced21f090c localhost Connected Then I log in to web administration console and add two other hosts by their names Name Hostname/IP Cluster Data Center Status SPM ovirtnode1 ovirtnode1 Default Default Up SPM ovirtnode5 ovirtnode5 Default Default Up Normal For this setup I have some questions: 1. Where is a webui place when I can configure that i want to use "storage network" ? I try to create second network (network->networks->new), but vdsm overwrite the ifcfg-ib0 file without that properties, as it is "like ethernet" interface: Generated by VDSM version 4.20.43-1.el7 DEVICE=ib0 ONBOOT=yes IPADDR=172.16.100.5 NETMASK=255.255.255.0 BOOTPROTO=none MTU=65520 DEFROUTE=no NM_CONTROLLED=no IPV6INIT=no MTU i entered by hand in General->MTU-Custom field, but: It cannot be set without "CONNECTED_MODE=yes" property, and now in networks->"storage"->hosts it always show as "out-of-sync". "Custom properties" are greyed and not available. 2. If I use checkbox "VM network" when create network and then "setup host networks" with this network for ib0 interface - all engine hangs. I think it's because it try to bridge infiniband interface with other, and that cannot done (i see only "1 task running" that never ends and no other interface can show any details) 3. Also ovirt try to start send LLDP TLVs on interface ib0, but it cannot be done: Nov 6 17:30:01 ovirtnode5 systemd: Starting Link Layer Discovery Protocol Agent Daemon.... Nov 6 17:30:01 ovirtnode5 kernel: bnx2x: [bnx2x_dcbnl_set_dcbx:2383(enp59s0f0)]Requested DCBX mode 5 is beyond advertised capabilities Nov 6 17:30:02 ovirtnode5 systemd: Started /sbin/ifup ib0. Nov 6 17:30:02 ovirtnode5 systemd: Starting /sbin/ifup ib0. Nov 6 17:30:02 ovirtnode5 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Nov 6 17:30:02 ovirtnode5 NetworkManager[1650]: <info> [1541511002.9642] device (ib0): carrier: link connected Nov 6 17:30:02 ovirtnode5 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Nov 6 17:30:02 ovirtnode5 lldpad: setsockopt nearest_bridge: Invalid argument Nov 6 17:30:41 ovirtnode5 vdsm[127585]: ERROR Internal server error#012Traceback (most recent call last):#012 File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", lin e 606, in _handle_request#012 res = method(**params)#012 File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 193, in _dynamicMethod#012 result = fn(*methodArg s)#012 File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1561, in getLldp#012 info=supervdsm.getProxy().get_lldp_info(filter))#012 File "/usr/lib/python2.7/site-pack ages/vdsm/common/supervdsm.py", line 55, in __call__#012 return callMethod()#012 File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 53, in <lambda>#012 **kwargs)#012 File "<string>", line 2, in get_lldp_info#012 File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in _callmethod#012 raise convert_to_error(kin d, result)#012TlvReportLldpError: (1, 'Agent instance for device not found \n', '', 'ib0') 4. Gluster volumes are in strange state: I "import domain" (storage->domains) that webui installer created on first step, but in "host to use" there is a drop-down list contains only host names as it added to cluster, i.e. ovirtnode1, ovirtnode{N}. And there is a red message "For data integrity make sure that the server is configured with Quorum (both client and server Quorum)" (it configured by cockpit webui installer, as i see). But imported volumes shown as "1 Up 2 Down" bricks, and on host only "localhost" bricks showed as "Online", in logs there is a message Nov 6 10:24:24 ovirtnode5 systemd: Started GlusterFS, a clustered file-system server. Nov 6 10:24:24 ovirtnode5 glusterd[229325]: [2018-11-06 06:24:24.404149] C [MSGID: 106003] [glusterd-server-quorum.c:354:glusterd_do_volume_quorum_action] 0-management: Server q uorum regained for volume data. Starting local bricks. Nov 6 10:24:24 ovirtnode5 glusterd[229325]: [2018-11-06 06:24:24.450356] C [MSGID: 106003] [glusterd-server-quorum.c:354:glusterd_do_volume_quorum_action] 0-management: Server q uorum regained for volume engine. Starting local bricks. Nov 6 10:24:24 ovirtnode5 glusterd[229325]: [2018-11-06 06:24:24.503677] C [MSGID: 106003] [glusterd-server-quorum.c:354:glusterd_do_volume_quorum_action] 0-management: Server q uorum regained for volume vmstore. Starting local bricks. What does it mean? If "quorum REGAINED" that all bricks must be started, isn't it? When i try to create volume (storage->volumes->new), press "add bricks" - there is a similar drop-down box "Bricks Host" contains only "ovirtnode" names, not "ovirtstor" ib interfaces.. If I try to use it - It cannot finished with error like "This host not in trusted pool", its true - in trusted tool there is other interface. What the right way to configure this? Are there a "some start guide" for this case with config-steps? I found https://www.ovirt.org/documentation/quickstart/quickstart-guide/ but it also out-of-date, for example it not describe GlusterFS for storage domains, has old screenshots (previous interface version), etc... I cannot find any documentation in https://www.ovirt.org/documentation/admin-guide/ For example, https://www.ovirt.org/documentation/admin-guide/chap-Logical_Networks/ Explanation of Settings in the Manage Networks Window does not contain role "Gluster network" at all... Many links point to not-existent pages, for example "For more information on these parameters, see Explanation of bridge opts Parameters." link to https://www.ovirt.org/documentation/admin-guide/chap-Logical_Networks/Expla… that "404 Not found :( Sorry, but the page you were trying to view does not exist." (it is for example, there are MANY 404 links/pages). -- Mike

1 1