January 2014 - Users - oVirt List Archives

[Users] oVirt 3.4 test day summary
by Doron Fediuck 28 Jan '14

28 Jan '14

Hi all, thanks for joining us to the first 3.4 test day. We all struggled with network bandwidth, and hopefully next testday will be better, so join us again for the next oVirt test day. Here are some statistics: Total of bugs opened: 108 Broken into areas: Unnamed 16 gluster 1 infra 21 integration 8 network 10 node 2 sla 3 storage 24 ux 1 virt 22 Top 3 reporters: amureini(a)redhat.com 20 emesika(a)redhat.com 7 oourfali(a)redhat.com 7 IRC participants, top 3: 115 sbonazzo 100 didi 81 OaaSvc Special contributors: Andrew Lau (andrew(a)andrewklau.com) for his work and reports on hosted engine. For their special contribution, Andrew Lau and OaaSvc will get special T-shirts of the oVirt community (please contact me offline). Thanks again and see you soon in the 2nd test day! Doron

2 2

[Users] Setup Networks: Unexpected exception
by Frank Wall 28 Jan '14

28 Jan '14

Hi, still testing 3.4 and I'm unable to save a node's network configuration in webadmin: Error while executing action Setup Networks: Unexpected exception My configuration on the ovirt node: - manually added net2 bridge, attached to eth1 My configuration in ovirt-engine webadmin: - added new network net2 - noticed that ovirt failed to find this network on node - tried to add net2 to node with "Setup Host Networks" Error in engine.log [1]. Error in vdsm.log [2]. I think it could be related to BZ 1054195: https://bugzilla.redhat.com/show_bug.cgi?id=1054195 ([NetworkLabels] Attaching two labeled networks to a cluster result in failure of the latter) I'm not sure, because I only wanted to add *one* new network. Please note that this is a self-hosted engine setup. Just in case this makes a difference... ovirt-engine: ovirt-engine-3.4.0-0.5.beta1.el6.noarch ovirt node: vdsm-4.14.1-17.gitcf59a55.el6.x86_64 ovirt-hosted-engine-setup-1.2.0-0.0.master.20140117.gitfaf77a5.el6.noarch Thanks - Frank [1] 2014-01-27 23:41:08,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-10) [1 783e132] START, SetupNetworksVDSCommand(HostName = mgt03rn.example.com, HostId = a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, for ce=false, checkConnectivity=true, conectivityTimeout=120, networks=[net2 {id=db98fa95-e922-4060-8d39-f9ac0cb2f16f, description=Jumphost Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-000000000002, mtu=0, vmNetwork=true, cl uster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false} , providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[bond001 {id=c5b50ccf-5b74-4737-b7cd-980c9c8acf51, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=bond001, macAddress=2c:44:fd:82:f5:5f, networkName=null, bondOptions=mode=802.3ad, bootProtocol=STATIC_IP, address=10.0.0.103, subnet=255.255.255.0, gateway=null, mtu=1500, bridged=false, type=0, networkImplementationDetails=null}, eth3 {id=7aaf1ac1-944a-4fe6-9d22-7dc41c6e275c, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth3, macAddress=2C:44:FD:82:F5:5F, networkName=null, bondName=bond001, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, eth4 {id=0c23834d-97ae-462a-9701-e89b3dc6a83a, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth4, macAddress=D8:9D:67:22:B6:4C, networkName=null, bondName=bond001, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, eth1 {id=54cb3cf6-c4bd-4907-bf28-9020022965d5, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth1, macAddress=2c:44:fd:82:f5:5d, networkName=net2, bondName=null, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=0, bridged=true, speed=1000, type=0, networkImplementationDetails=null}, eth2 {id=a53c448f-8061-460f-9c24-3081a2376de7, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth2, macAddress=2c:44:fd:82:f5:5e, networkName=null, bondName=null, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, eth5 {id=e9f15827-bb15-41d9-8ccc-49d812cde8a6, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth5, macAddress=d8:9d:67:22:b6:4d, networkName=null, bondName=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}, eth0 {id=b4aea8bc-bdde-4e1e-a206-46ee853220c0, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth0, macAddress=2c:44:fd:82:f5:5c, networkName=ovirtmgmt, bondName=null, bootProtocol=STATIC_IP, address=10.0.0.103, subnet=255.255.0.0, gateway=10.0.0.1, mtu=1500, bridged=true, speed=1000, type=2, networkImplementationDetails={inSync=true, managed=true}}], removedNetworks=[], removedBonds=[]), log id: 78e823a3 2014-01-27 23:41:08,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-10) [1783e132] FINISH, SetupNetworksVDSCommand, log id: 78e823a3 2014-01-27 23:41:09,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-10) [1783e132] Failed in SetupNetworksVDS method 2014-01-27 23:41:09,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-10) [1783e132] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception, code = 16 2014-01-27 23:41:09,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-10) [1783e132] Command SetupNetworksVDSCommand(HostName = mgt03rn.example.com, HostId = a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, force=false, checkConnectivity=true, conectivityTimeout=120, networks=[net2 {id=db98fa95-e922-4060-8d39-f9ac0cb2f16f, description=Jumphost Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-000000000002, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[bond001 {id=c5b50ccf-5b74-4737-b7cd-980c9c8acf51, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=bond001, macAddress=2c:44:fd:82:f5:5f, networkName=null, bondOptions=mode=802.3ad, bootProtocol=STATIC_IP, address=10.0.0.103, subnet=255.255.255.0, gateway=null, mtu=1500, bridged=false, type=0, networkImplementationDetails=null}, eth3 {id=7aaf1ac1-944a-4fe6-9d22-7dc41c6e275c, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth3, macAddress=2C:44:FD:82:F5:5F, networkName=null, bondName=bond001, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, eth4 {id=0c23834d-97ae-462a-9701-e89b3dc6a83a, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth4, macAddress=D8:9D:67:22:B6:4C, networkName=null, bondName=bond001, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, eth1 {id=54cb3cf6-c4bd-4907-bf28-9020022965d5, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth1, macAddress=2c:44:fd:82:f5:5d, networkName=net2, bondName=null, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=0, bridged=true, speed=1000, type=0, networkImplementationDetails=null}, eth2 {id=a53c448f-8061-460f-9c24-3081a2376de7, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth2, macAddress=2c:44:fd:82:f5:5e, networkName=null, bondName=null, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, eth5 {id=e9f15827-bb15-41d9-8ccc-49d812cde8a6, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth5, macAddress=d8:9d:67:22:b6:4d, networkName=null, bondName=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}, eth0 {id=b4aea8bc-bdde-4e1e-a206-46ee853220c0, vdsId=a11f5383-b8f7-4bed-b1f3-3c7c46ecbe7a, name=eth0, macAddress=2c:44:fd:82:f5:5c, networkName=ovirtmgmt, bondName=null, bootProtocol=STATIC_IP, address=10.0.0.103, subnet=255.255.0.0, gateway=10.0.0.1, mtu=1500, bridged=true, speed=1000, type=2, networkImplementationDetails={inSync=true, managed=true}}], removedNetworks=[], removedBonds=[]) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception, code = 16 2014-01-27 23:41:09,328 ERROR [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp--127.0.0.1-8702-10) [1783e132] Command org.ovirt.engine.core.bll.network.host.SetupNetworksCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to SetupNetworksVDS, error = Unexpected exception, code = 16 (Failed with error unexpected and code 16) [2] Thread-119::DEBUG::2014-01-27 23:41:09,769::BindingXMLRPC::970::vds::(wrapper) client [10.0.0.12]::call setupNetworks with ({'net2': {'nic': 'eth1', 'STP': 'no', 'bridged': 'true'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [1783e132] Thread-120::DEBUG::2014-01-27 23:41:09,770::BindingXMLRPC::970::vds::(wrapper) client [10.0.0.12]::call ping with () {} flowID [1783e132] Thread-120::DEBUG::2014-01-27 23:41:09,770::BindingXMLRPC::977::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} Thread-95::DEBUG::2014-01-27 23:41:09,867::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.0.0.10:_vol__svm0__data__nfs__orgmgt/7ea2a278-7659-41d7-92c4-5d0f41a75bf8/dom_md/metadata bs=4096 count=1' (cwd None) Thread-95::DEBUG::2014-01-27 23:41:09,871::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n512 bytes (512 B) copied, 0.000273105 s, 1.9 MB/s\n'; <rc> = 0 Thread-119::ERROR::2014-01-27 23:41:10,119::BindingXMLRPC::989::vds::(wrapper) unexpected error Traceback (most recent call last): File "/usr/share/vdsm/BindingXMLRPC.py", line 973, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/BindingXMLRPC.py", line 402, in setupNetworks return api.setupNetworks(networks, bondings, options) File "/usr/share/vdsm/API.py", line 1294, in setupNetworks supervdsm.getProxy().setupNetworks(networks, bondings, options) File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ return callMethod() File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> **kwargs) File "<string>", line 2, in setupNetworks File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod raise convert_to_error(kind, result) AttributeError: 'ConfigWriter' object has no attribute 'getEthtoolOpts'

5 7

[Users] oVirt 3.4 - testing days report [read only disks]
by Martin Perina 28 Jan '14

28 Jan '14

Hi, I tested read only disks feature [1] and it worked fine. I used this configuration: 1) RHEL 6 VM rhel1 with shared disk mounted as RW, 2) RHEL 6 VM rhel2 with shared disk mounted as RO 3) Windows 7 VM win71 with shared disk mounted as RO rhel2 and win71 VMs sees all files on shared disk, but the disk was read only for them. Martin [1] http://www.ovirt.org/Features/Read_Only_Disk

1 0

[Users] Strange UI bug: tab "VM" unusable / oVirt 3.3.1+
by Frank Wall 28 Jan '14

28 Jan '14

Hi, I'm experiencing a strange UI bug in the Amdin Portal. The "Virtual Machines" tab is unusable in serval ways: - when selecting a VM, all buttons are greyed-out, except "New VM" - you cannot power on, power off, open console or edit a VM - when selecting a VM, the VM-specific tabs do not appear on the bottom All other tabs, especially the "Hosts" tab are working as expected. Initially I suspected an incompatible browser on my side, so I tried with Firefox 25, Chrome and IE 11. No success. This UI bug hit me after upgrading from oVirt 3.3.0 to 3.3.1. And it is still reproducable in oVirt 3.3.2 BETA1. Any hint on this? Or any advice how to provide some useful debug output? I have to mention that I am able to workaround this bug: - select a VM - right click, choose "New VM", click "Cancel" - now most VM actions are no longer greyed-out - power on the VM - still the "console" button remains greyed-out Thanks - Frank

5 19

[Users] OVirt 3.3.2 Snapshot Pane empty in Firefox
by Markus Stockhausen 28 Jan '14

28 Jan '14

------=_NextPartTM-000-7b46d2aa-6d60-401b-93f2-4073fbfdcf92 Content-Type: multipart/alternative; boundary="_000_12EF8D94C6F8734FB2FF37B9FBEDD173585DB468EXCHANGEcollogi_" --_000_12EF8D94C6F8734FB2FF37B9FBEDD173585DB468EXCHANGEcollogi_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hello, I had a mysterios behaviour in the webinterface twice this week. The Snapshot list of a VM remained empty in Firefox although I know that snapshots exist. The "Create Snapshot" button was still working and issued the right commands. Nevertheless the list remained empty. Opening an IE session prooved that everything was ok. The pane was populated with the list of snapshots. After restarting Firefox everything was fine again. Has anybody experienced simialr issues and if yes is there already an opn BZ for that? Markus --_000_12EF8D94C6F8734FB2FF37B9FBEDD173585DB468EXCHANGEcollogi_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html dir=3D"ltr"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-= 1"> <style id=3D"owaParaStyle" type=3D"text/css">P {margin-top:0;margin-bottom:= 0;}</style> </head> <body ocsi=3D"0" fpstyle=3D"1"> <div style=3D"direction: ltr;font-family: Tahoma;color: #000000;font-size: = 10pt;">Hello, I had a mysterios behaviour in the webinterface twice this week. The Snapshot list of a VM remained empty in Firefox although I know that snapshots exist. The "Create Snapshot" button was still working and issued the right commands. Nevertheless the list remained empty. Opening an IE session prooved that everything was ok. The pane was populated with the list of snapshots. After restarting Firefox everything was fine again. Has anybody experienced simialr issues and if yes is there already an opn BZ for that? Markus </div> </body> </html> --_000_12EF8D94C6F8734FB2FF37B9FBEDD173585DB468EXCHANGEcollogi_-- ------=_NextPartTM-000-7b46d2aa-6d60-401b-93f2-4073fbfdcf92 Content-Type: text/plain; name="InterScan_Disclaimer.txt" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="InterScan_Disclaimer.txt" **************************************************************************** Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Über das Internet versandte E-Mails können unter fremden Namen erstellt oder manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine rechtsverbindliche Willenserklärung. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln Vorstand: Kadir Akin Dr. Michael Höhnerbach Vorsitzender des Aufsichtsrates: Hans Kristian Langva Registergericht: Amtsgericht Köln Registernummer: HRB 52 497 This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. e-mails sent over the internet may have been written under a wrong name or been manipulated. That is why this message sent as an e-mail is not a legally binding declaration of intention. Collogia Unternehmensberatung AG Ubierring 11 D-50678 Köln executive board: Kadir Akin Dr. Michael Höhnerbach President of the supervisory board: Hans Kristian Langva Registry office: district court Cologne Register number: HRB 52 497 **************************************************************************** ------=_NextPartTM-000-7b46d2aa-6d60-401b-93f2-4073fbfdcf92--

3 4

Re: [Users] Data Center stuck between "Non Responsive" and "Contending"
by Ted Miller 28 Jan '14

28 Jan '14

On 1/26/2014 4:00 PM, Itamar Heim wrote: > On 01/26/2014 10:51 PM, Ted Miller wrote: >> >> On 1/26/2014 3:10 PM, Itamar Heim wrote: >>> On 01/26/2014 10:08 PM, Ted Miller wrote: >>>> My Data Center is down, and won't come back up. >>>> >>>> Data Center Status on the GUI flips between "Non Responsive" and >>>> "Contending" >>>> >>>> Also noted: >>>> Host sometimes seen flipping between "Low" and "Contending" in SPM >>>> column. >>>> Storage VM2 "Data (Master)" is in "Cross Data-Center Status" = Unknown >>>> VM2 is "up" under "Volumes" tab >>>> >>>> Created another volume for VM storage. It shows up in "volumes" tab, >>>> but when I try to add "New Domain" in storage tab, says that "There are >>>> No Data Centers to which the Storage Domain can be attached" >>>> >>>> Setup: >>>> 2 hosts w/ glusterfs storage >>>> 1 engine >>>> all 3 computers Centos 6.5, just updated >>>> ovirt-engine 3.3.0.1-1.el6 >>>> ovirt-engine-lib 3.3.2-1.el6 >>>> ovirt-host-deploy.noarch 1.1.3-1.el6 >>>> glusterfs.x86_64 3.4.2-1.el6 >>>> >>>> This loop seems to repeat in the ovirt-engine log (grep of log showing >>>> only DefaultQuartzScheduler_Worker-79 thread: >>>> >>>> 2014-01-26 14:44:58,416 INFO >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] >>>> (DefaultQuartzScheduler_Worker-79) Irs placed on server >>>> 9a591103-83be-4ca9-b207-06929223b541 failed. Proceed Failover >>>> 2014-01-26 14:44:58,511 INFO >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] >>>> (DefaultQuartzScheduler_Worker-79) hostFromVds::selectedVds - office4a, >>>> spmStatus Free, storage pool mill >>>> 2014-01-26 14:44:58,550 INFO >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] >>>> (DefaultQuartzScheduler_Worker-79) SpmStatus on vds >>>> 127ed939-34af-41a8-87a0-e2f6174b1877: Free >>>> 2014-01-26 14:44:58,571 INFO >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] >>>> (DefaultQuartzScheduler_Worker-79) starting spm on vds office4a, storage >>>> pool mill, prevId 2, LVER 15 >>>> 2014-01-26 14:44:58,579 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) START, SpmStartVDSCommand(HostName = >>>> office4a, HostId = 127ed939-34af-41a8-87a0-e2f6174b1877, storagePoolId = >>>> 536a864d-83aa-473a-a675-e38aafdd9071, prevId=2, prevLVER=15, >>>> storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log >>>> id: 74c38eb7 >>>> 2014-01-26 14:44:58,617 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) spmStart polling started: taskId = >>>> e8986753-fc80-4b11-a11d-6d3470b1728c >>>> 2014-01-26 14:45:00,662 ERROR >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetTaskStatusVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) Failed in HSMGetTaskStatusVDS method >>>> 2014-01-26 14:45:00,664 ERROR >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetTaskStatusVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) Error code AcquireHostIdFailure and >>>> error message VDSGenericException: VDSErrorException: Failed to >>>> HSMGetTaskStatusVDS, error = Cannot acquire host id >>>> 2014-01-26 14:45:00,665 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) spmStart polling ended: taskId = >>>> e8986753-fc80-4b11-a11d-6d3470b1728c task status = finished >>>> 2014-01-26 14:45:00,666 ERROR >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) Start SPM Task failed - result: >>>> cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to >>>> HSMGetTaskStatusVDS, error = Cannot acquire host id >>>> 2014-01-26 14:45:00,695 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) spmStart polling ended, spm >>>> status: Free >>>> 2014-01-26 14:45:00,702 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) START, >>>> HSMClearTaskVDSCommand(HostName = office4a, HostId = >>>> 127ed939-34af-41a8-87a0-e2f6174b1877, >>>> taskId=e8986753-fc80-4b11-a11d-6d3470b1728c), log id: 336ec5a6 >>>> 2014-01-26 14:45:00,722 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) FINISH, HSMClearTaskVDSCommand, log >>>> id: 336ec5a6 >>>> 2014-01-26 14:45:00,724 INFO >>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] >>>> (DefaultQuartzScheduler_Worker-79) FINISH, SpmStartVDSCommand, return: >>>> org.ovirt.engine.core.common.businessentities.SpmStatusResult@13652652, >>>> log id: 74c38eb7 >>>> 2014-01-26 14:45:00,733 INFO >>>> [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] >>>> (DefaultQuartzScheduler_Worker-79) Running command: >>>> SetStoragePoolStatusCommand internal: true. Entities affected : ID: >>>> 536a864d-83aa-473a-a675-e38aafdd9071 Type: StoragePool >>>> 2014-01-26 14:45:00,778 ERROR >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] >>>> (DefaultQuartzScheduler_Worker-79) >>>> IrsBroker::Failed::GetStoragePoolInfoVDS due to: >>>> IrsSpmStartFailedException: IRSGenericException: IRSErrorException: >>>> SpmStart failed >>>> >>>> Ted Miller >>>> Elkhart, IN, USA >>>> >>>> >>>> >>>> _______________________________________________ >>>> Users mailing list >>>> Users(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/users >>>> >>> >>> is this gluster storage (guessing sunce you mentioned a 'volume') >> yes (mentioned under "setup" above) >>> does it have a quorum? >> Volume Name: VM2 >> Type: Replicate >> Volume ID: 7bea8d3b-ec2a-4939-8da8-a82e6bda841e >> Status: Started >> Number of Bricks: 1 x 3 = 3 >> Transport-type: tcp >> Bricks: >> Brick1: 10.41.65.2:/bricks/01/VM2 >> Brick2: 10.41.65.4:/bricks/01/VM2 >> Brick3: 10.41.65.4:/bricks/101/VM2 >> Options Reconfigured: >> cluster.server-quorum-type: server >> storage.owner-gid: 36 >> storage.owner-uid: 36 >> auth.allow: * >> user.cifs: off >> nfs.disa >>> (there were reports of split brain on the domain metadata before when >>> no quorum exist for gluster) >> after full heal: >> >> [root@office4a ~]$ gluster volume heal VM2 info >> Gathering Heal info on volume VM2 has been successful >> >> Brick 10.41.65.2:/bricks/01/VM2 >> Number of entries: 0 >> >> Brick 10.41.65.4:/bricks/01/VM2 >> Number of entries: 0 >> >> Brick 10.41.65.4:/bricks/101/VM2 >> Number of entries: 0 >> [root@office4a ~]$ gluster volume heal VM2 info split-brain >> Gathering Heal info on volume VM2 has been successful >> >> Brick 10.41.65.2:/bricks/01/VM2 >> Number of entries: 0 >> >> Brick 10.41.65.4:/bricks/01/VM2 >> Number of entries: 0 >> >> Brick 10.41.65.4:/bricks/101/VM2 >> Number of entries: 0 >> >> noticed this in host /var/log/messages (while looking for something >> else). Loop seems to repeat over and over. >> >> Jan 26 15:35:52 office4a sanlock[3763]: 2014-01-26 15:35:52-0500 14678 >> [30419]: read_sectors delta_leader offset 512 rv -90 >> /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids >> >> Jan 26 15:35:53 office4a sanlock[3763]: 2014-01-26 15:35:53-0500 14679 >> [3771]: s1997 add_lockspace fail result -90 >> Jan 26 15:35:58 office4a vdsm TaskManager.Task ERROR >> Task=`89885661-88eb-4ea3-8793-00438735e4ab`::Unexpected error#012Traceback >> (most recent call last):#012 File "/usr/share/vdsm/storage/task.py", line >> 857, in _run#012 return fn(*args, **kargs)#012 File >> "/usr/share/vdsm/logUtils.py", line 45, in wrapper#012 res = f(*args, >> **kwargs)#012 File "/usr/share/vdsm/storage/hsm.py", line 2111, in >> getAllTasksStatuses#012 allTasksStatus = sp.getAllTasksStatuses()#012 >> File "/usr/share/vdsm/storage/securable.py", line 66, in wrapper#012 raise >> SecureError()#012SecureError >> Jan 26 15:35:59 office4a sanlock[3763]: 2014-01-26 15:35:59-0500 14686 >> [30495]: read_sectors delta_leader offset 512 rv -90 >> /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids >> >> Jan 26 15:36:00 office4a sanlock[3763]: 2014-01-26 15:36:00-0500 14687 >> [3772]: s1998 add_lockspace fail result -90 >> Jan 26 15:36:00 office4a vdsm TaskManager.Task ERROR >> Task=`8db9ff1a-2894-407a-915a-279f6a7eb205`::Unexpected error#012Traceback >> (most recent call last):#012 File "/usr/share/vdsm/storage/task.py", line >> 857, in _run#012 return fn(*args, **kargs)#012 File >> "/usr/share/vdsm/storage/task.py", line 318, in run#012 return >> self.cmd(*self.argslist, **self.argsdict)#012 File >> "/usr/share/vdsm/storage/sp.py", line 273, in startSpm#012 >> self.masterDomain.acquireHostId(self.id)#012 File >> "/usr/share/vdsm/storage/sd.py", line 458, in acquireHostId#012 >> self._clusterLock.acquireHostId(hostId, async)#012 File >> "/usr/share/vdsm/storage/clusterlock.py", line 189, in >> acquireHostId#012 raise se.AcquireHostIdFailure(self._sdUUID, >> e)#012AcquireHostIdFailure: Cannot acquire host id: >> ('0322a407-2b16-40dc-ac67-13d387c6eb4c', SanlockException(90, 'Sanlock >> lockspace add failure', 'Message too long')) >> >> Ted Miller >> Elkhart, IN, USA >> > > this is the new storage domain? what about the previous volume for the > first SD? The default/default data center/cluster had to be abandoned because of a split-brain that could not be healed. Can't remove old storage from database, can't get data center up due to corrupt storage, ends up a circular argument. I started over with same hosts, totally new storage in new data center. This mill/one data center/cluster was working fine with VM2 storage, then died. Ted Miller

4 8

[Users] Subject: Outage :: Mailman, downloads :: 2014-01-27 23:00 UTC
by Karsten Wade 28 Jan '14

28 Jan '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 There us an outage of Mailman (lists.oviry.org) and downloads (resources.ovirt.org) for about 15 minutes. The outage will occur in one about one hour from now at 2014-01-27 23:00 UTC. To view in your local time: date -d '2014-01-27 23:00 UTC' == Details == We have a no-cost upgrade for RAM and disk space available. Since this host has run out of disk space a few times recently, which has affected Mailman services, it seems like a good idea to grab the extra space immediately. == Affected services == * Mailman (lists.ovirt.org) * Downloads (resources.ovirt.org) + yum repos * Some redirects. === Not-affected services == * www.ovirt.org * jenkins.ovirt.org * gerrit.ovirt.org * etc. == Future plans == This host is due to be de-provisioned, when possible. - -- Karsten 'quaid' Wade .^\ CentOS Engineering Manager http://TheOpenSourceWay.org \ http://community.redhat.com @quaid (identi.ca/twitter/IRC) \v' gpg: AD0E0C41 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlLm2UAACgkQ2ZIOBq0ODEHoxQCcD7hA9E+dEGtoyB38Gh0ZmncS BNIAnipN9fwZmDxxPPYn8DDJjSfqzWFJ =W6Ga -----END PGP SIGNATURE-----

1 2

[Users] oVirt 3.4 - testing days report [iproute2 configurator]
by Douglas Schilling Landgraf 28 Jan '14

28 Jan '14

Hi, During the tests I have faced the below bug: vdsm-4.14.1-2 unable to restart on reboot after a network is defined on ovirt-node https://bugzilla.redhat.com/show_bug.cgi?id=1057657 Additionally (not related to iproute2 tests), I have faced: [RFE] report BOOTPROTO and BONDING_OPTS independent of netdevice.cfg https://bugzilla.redhat.com/show_bug.cgi?id=987813 (I have workaround creating manually ifcfg-em1 and ifcfg-ovirtmgmt) firefox seg faults when using the Admin Portal on RHEL 6.5 https://bugzilla.redhat.com/show_bug.cgi?id=1044010 (Updated to firefox-24.2.0-6.el6_5.x86_64 resolved the problem.) Test data for iproute2: ======================== - Setup Node -> put it in maintenance - Changed the vdsm.conf on node to: [vars] ssl = true net_configurator = iproute2 net_persistence = unified [addresses] management_port = 54321 - Restart vdsm/supervdsm - Host is UP again, no problems - DataCenter -> Logical Network -> New - Name: net25 -> [x] Enable Vlan tagging [ ] VM Network - Since I have just one nic at host I have added dummy interface. #ip link add name dummy_interface type dummy - Put the host in maintenance and put again UP to recognize the new interface - Host -> Network -> Setup Host Networks -> drag/drop net25 to dummy_interace -> [x] save network interface On host vdsClient -s 0 getVdsCaps appears [net25] * Rebooted to check if the new net25 will be persistent. -- Cheers Douglas

1 0

[Users] oVirt 3.4 test day - Template Versions
by Federico Simoncelli 27 Jan '14

27 Jan '14

Feature tested: http://www.ovirt.org/Features/Template_Versions - create a new vm vm1 and make a template template1 from it - create a new vm vm2 based on template1 and make some changes - upgrade to 3.4 - create a new template template1.1 from vm2 - create a new vm vm3 from template1 (clone) - content ok - create a new vm vm4 from template1.1 (thin) - content ok - create a new vm vm5 from template1 last (thin) - content ok (same as 1.1) - try to remove template1 (failed as template1.1 is still present) - try to remove template1.1 (failed as vm5 is still present) - create a new vm vm6 and make a template blank1.1 as new version of the blank template (succeeded) - create a vm pool vmpool1 with the "latest" template from template1 - create a vm pool vmpool2 with the "template1.1" (last) template from template1 - start vmpool1 and vmpool2 and verify that the content is the same - create a new template template1.2 - start vmpool1 and verify that the content is the same as latest (template1.2) - start vmpool2 and verify that the content is the same as template1.1 Suggestions: - the template blank is special, I am not sure if allowing versioning may be confusing (for example is not even editable) - as far as I can see the "Sub Version Name" is not editable anymore (after picking it) -- Federico

2 2

[Users] Hosted-engine runtime issues (3.4 BETA)
by Frank Wall 27 Jan '14

27 Jan '14

Hi, finally I've got the new hosted-engine feature running on RHEL6 using oVirt 3.4 BETA/nightly. I've come across a few issues and wanted to clarify if this is the desired behaviour: 1.) hosted-engine storage domain not visible in GUI The NFS-Storage I've used to install the hosted-engine is not visible in oVirt's Admin Portal. Though it is mounted on my oVirt Node below /rhev/data-center/mnt/. I tried to import this storage domain, but apparently this fails because it's already mounted. Is there any way to make this storage domain visible? 2.) hosted-engine VM device are not visible in GUI The disk and network devices are not visible in the admin portal. Thus I'm unable to change anything. Is this intended? If so, how am I supposed to make changes? 3.) move hosted-engine VM to a different storage Because of all of the above I seem to be unable to move my hosted-engine VM to a different NFS-Storage. How can this be done? Thanks - Frank

3 13

[Users] Cluster compatibility
by Piotr Kliczewski 27 Jan '14

27 Jan '14

I wanted to install two hosts one on f19 and the second on el6. I created additional cluster for el6. Host installation for el6 worked well and it joined the cluster without any issues. Whereas host in f19 was successfully deployed but it failed to join the cluster due to: Host fedora is compatible with versions (3.0,3.1,3.2,3.3) and cannot join Cluster Default which is set to version 3.4. Here are the versions that I use: engine: Name : ovirt-engine Arch : noarch Version : 3.4.0 Release : 0.5.beta1.fc19 Size : 1.5 M Repo : installed >From repo : ovirt-3.4.0-prerelease fedora host: Name : vdsm Arch : x86_64 Version : 4.14.1 Release : 2.fc19 Size : 2.9 M Repo : installed >From repo : ovirt-3.4.0-prerelease el6 host: Name : vdsm Arch : x86_64 Version : 4.14.1 Release : 2.el6 Size : 2.9 M Repo : installed >From repo : ovirt-3.4.0-prerelease Both clusters are set to be compatible with 3.4. Is there anything that I am missing? Piotr

4 3

[Users] Centos 6.5 and bonding: "A slave interface is not properly configured"
by Federico Sayd 27 Jan '14

27 Jan '14

11 26

Re: [Users] networking: basic vlan help
by Juan Pablo Lorier 27 Jan '14

27 Jan '14

This is a multi-part message in MIME format. --------------010004070404070407050707 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Hi Itamar, I don't know if I get your post right, but to me, it seems that if so many users hit the same rock, it should mean that this should be documented somewhere visible and in my opinion, push on getting bug 1049476 <https://bugzilla.redhat.com/show_bug.cgi?id=1049476> solved asap. Regards, --------------010004070404070407050707 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> </head> <body text="#000000" bgcolor="#FFFFFF"> Hi Itamar, I don't know if I get your post right, but to me, it seems that if so many users hit the same rock, it should mean that this should be documented somewhere visible and in my opinion, push on getting bug <a name="b1049476" href="https://bugzilla.redhat.com/show_bug.cgi?id=1049476">1049476</a> solved asap. Regards, </body> </html> --------------010004070404070407050707--

4 4

[Users] Reboot causes poweroff of VM 3.4 Beta
by Jon Archer 27 Jan '14

27 Jan '14

Hi, Seem to be suffering an issue in 3.4 where if a vm is rebooted it actually shuts down, this occurs for all guests regardless of OS installed within. Anyone seen this? Jon

4 10

[Users] Issues starting hosted engine VM
by Andrew Lau 27 Jan '14

27 Jan '14

Hi, With the great help from sbonazzo, I managed to step past the initial bug with the hosted-engine-setup but appear to have run into another show stopper. I ran through the install process successfully up to the stage where it completed and the engine VM was to be shutdown. (The engine has already been installed on the VM and the host has been connected to the engine). The issue starts here that the host finds itself not able to start the VM up again. VDSM Logs: http://www.fpaste.org/69592/00427141/ ovirt-hosted-engine-ha agent.log http://www.fpaste.org/69595/43609139/ It seems to keep failing to start the VM.. when I restart the agent I can see the score drop to 0 after 3 boot attempts. The interesting thing seems to be in the VDSM Logs "'Virtual machine does not exist', 'code': 1}}" I'm not sure where else to look. Suggestions? Cheers, Andrew

6 25

[Users] Power saving cluster policy (3.4 test day)
by Lior Vernia 27 Jan '14

27 Jan '14

Hello, Just wanted to drop a line here about this feature I tested last week, which I thought was cool. I only tested it with two hosts and a single VM, using one of the hosts as a reserve, but it was quite satisfying to see the hosts being powered off and on as the VM was being run and stopped. This could be interesting to look at for those of you running a moderately-sized deployment, if often the load on your hosts is low. Yours, Lior.

3 2

[Users] sanlock leases on VM disks
by José Luis Sanz Boixader 27 Jan '14

27 Jan '14

I have an oVirt testing setup with 3 hosts running for a few weeks: CentOS 6.4, oVirt 3.3.1, VDSM 4.13.0, iSCSI based storage domain. I have just realized that sanlock has no leases on VM disks, so nothing prevents vdsm/libvirt from starting a VM on two different hosts, corrupting disk data. I know that something has to go wrong on oVirt engine to do it, but I've manually forced some errors ("Setting Host state to Non-Operational", "VM xxxx is not responding") for a "Highly available" VM and oVirt engine started that VM on another host. oVirt engine was not aware, but the VM was running on two hosts. I think this is a job for libvirt/sanlock/wdmd, but libvirt is not receiving "lease" tags for disks when creating domains. I think it should. What's left in my config? What am I doing wrong? Thanks

2 3

[Users] oVirt 3.4 test day: iscsi multipath
by Francesco Romani 27 Jan '14

27 Jan '14

Hi everyone, During the last oVirt 3.4 test day I played a bit with ISCSI multipath: http://www.ovirt.org/Feature/iSCSI-Multipath#Configure_iSCSI_Multipathing It took me longer than expected to properly set up things but, once done, everything looked fine at the config level (both seen from engine and the actual OS configuration) and worked well on my tests, including physical disconnections mid-I/O. Well done! :) -- Francesco Romani RedHat Engineering Virtualization R & D IRC: fromani

1 0

[Users] multiple storage domains
by Michal Skrivanek 27 Jan '14

27 Jan '14

Hey, I was trying to play with multiple storage domain during the 3.4 test day and even though it took me ages to set storage up correctly, the feature itself seems to be working just fine. Much easier to select what kind of storage I want to use…just Shared vs Local storage pool. VM could use volumes from different domains and I didn't have to worry about the right type (other than local vs shared, obviously:) Thanks, michal

1 0

[Users] CANCELED: Feature Review: Gluster Volume Snapshots
by Blue Jeans Network 27 Jan '14

27 Jan '14

------=_Part_794_1616979341.1390801575818 Content-Type: multipart/related; boundary="----=_Part_795_166231402.1390801575818" ------=_Part_795_166231402.1390801575818 Content-Type: multipart/alternative; boundary="----=_Part_796_2122432314.1390801575818" ------=_Part_796_2122432314.1390801575818 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Shubhendu Ram Tripathi (shtripat(a)redhat.com) has cancelled the following meeting: Meeting Title: Feature Review: Gluster Volume Snapshots Meeting Time: Monday January 27, 2014 6:30 p.m. IST / 1 hr ************************************************ Message/Description: Cancelled ************************************************ Blue Jeans Network 2012 ------=_Part_796_2122432314.1390801575818 Content-Type: text/html;charset="utf-8" Content-Transfer-Encoding: 7bit <table width="100%"> <tr bgcolor="#d8d8d8"> <td align="center"> <table width="600px" bgcolor="#FFFFFF" style="margin-top:20px;padding:0px 50px 10px 50px;margin-bottom:20px;text-align:left;"> <tr> <td style="padding-right:10px;padding-bottom:20px;"> <a href="http://bluejeans.com"> <img src="https://static.bluejeans.com/z1/static/images/bjn/BlueJeans_Logo.png" alt="Blue Jeans" style="border:none;"> </a> </td> </tr> <tr> <td style="font-size: 20px;color: #333333; padding-bottom:30px;"> <a href="mailto:shtripat@redhat.com">Shubhendu Ram Tripathi</a> has cancelled the following meeting: </td> </tr> <tr> <td style="padding-top:10px; font-size: 16px;"> Meeting Title: Feature Review: Gluster Volume Snapshots </td> </tr> <tr> <td style="padding-top:10px; padding-bottom: 10px; font-size: 16px;"> Meeting Time: Monday January 27, 2014 • 6:30 p.m. IST / 1 hr </td> </tr> <tr> <td> <hr size="1" noshade="noshade" style="line-height:1px;color:#CCCCCC;"> </td> </tr> <tr> <td style="style="padding-top:10px;""> Message/Description: Cancelled </td> </tr> <tr> <td style="line-height:1px;color:#CCCCCC;"> <hr size="1" noshade="noshade" style="line-height:1px;color:#CCCCCC;border-color:#CCCCCC;"> </td> </tr> <tr> <td style="font-size:11px;text-align:left"> ©Blue Jeans Network 2013 </td> </tr> </table> </td> </tr> </table> ------=_Part_796_2122432314.1390801575818 Content-Type: text/calendar; method=REQUEST; charset="utf-8" Content-Transfer-Encoding: 7bit BEGIN:VCALENDAR VERSION:2.0 METHOD:CANCEL PRODID:-//PYVOBJECT//NONSGML Version 1//EN BEGIN:VTIMEZONE TZID:Asia/Kolkata TZURL:http://tzurl.org/zoneinfo-outlook/Asia/Kolkata X-LIC-LOCATION:Asia/Kolkata BEGIN:STANDARD TZOFFSETFROM:+0530 TZOFFSETTO:+0530 TZNAME:IST DTSTART:19700101T000000 END:STANDARD END:VTIMEZONE BEGIN:VEVENT UID:0H44B_sN0PzTAnM2@H6D3JmW4G7v71tX DTSTART;TZID=Asia/Kolkata:20140127T183000 DTEND;TZID=Asia/Kolkata:20140127T193000 ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED:mailto:u sers(a)ovirt.org CREATED:20140121T113648Z DESCRIPTION:\nShubhendu Ram Tripathi (shtripat(a)redhat.com) has cancelled t his meeting.\n\n************************************************\n\nMessag e/Description: Cancelled\n\n\n******************************************** ****\n\nBlue Jeans Network 2012\n DTSTAMP:20140127T054615Z LAST-MODIFIED:20140127T054615Z LOCATION: ORGANIZER:mailto:shtripat@redhat.com SEQUENCE:1 STATUS:CANCELLED SUMMARY:Feature Review: Gluster Volume Snapshots TRANSP:OPAQUE END:VEVENT END:VCALENDAR ------=_Part_796_2122432314.1390801575818-- ------=_Part_795_166231402.1390801575818-- ------=_Part_794_1616979341.1390801575818 Content-Type: application/ics; name=invite.ics Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=invite.ics BEGIN:VCALENDAR VERSION:2.0 METHOD:CANCEL PRODID:-//PYVOBJECT//NONSGML Version 1//EN BEGIN:VTIMEZONE TZID:Asia/Kolkata TZURL:http://tzurl.org/zoneinfo-outlook/Asia/Kolkata X-LIC-LOCATION:Asia/Kolkata BEGIN:STANDARD TZOFFSETFROM:+0530 TZOFFSETTO:+0530 TZNAME:IST DTSTART:19700101T000000 END:STANDARD END:VTIMEZONE BEGIN:VEVENT UID:0H44B_sN0PzTAnM2@H6D3JmW4G7v71tX DTSTART;TZID=Asia/Kolkata:20140127T183000 DTEND;TZID=Asia/Kolkata:20140127T193000 ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED:mailto:u sers(a)ovirt.org CREATED:20140121T113648Z DESCRIPTION:\nShubhendu Ram Tripathi (shtripat(a)redhat.com) has cancelled t his meeting.\n\n************************************************\n\nMessag e/Description: Cancelled\n\n\n******************************************** ****\n\nBlue Jeans Network 2012\n DTSTAMP:20140127T054615Z LAST-MODIFIED:20140127T054615Z LOCATION: ORGANIZER:mailto:shtripat@redhat.com SEQUENCE:1 STATUS:CANCELLED SUMMARY:Feature Review: Gluster Volume Snapshots TRANSP:OPAQUE END:VEVENT END:VCALENDAR ------=_Part_794_1616979341.1390801575818--

1 0

[Users] Cancelled: Feature Review: Gluster Volume Snapshot
by Shubhendu Tripathi 27 Jan '14

27 Jan '14

------=_Part_8859059_641577150.1390801417195 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit The following meeting has been cancelled: Subject: Feature Review: Gluster Volume Snapshot Organizer: "Shubhendu Tripathi" <shtripat(a)redhat.com> Location: "Vijayanagara - BLR" <vijayanagara-blr(a)redhat.com> Resources: "Vijayanagara - BLR" <vijayanagara-blr(a)redhat.com> (Vijayanagara - BLR) Time: Monday, January 27, 2014, 6:30:00 PM - 7:30:00 PM GMT +05:30 Chennai, Kolkata, Mumbai, New Delhi Invitees: arch(a)ovirt.org; users(a)ovirt.org; rnachimu(a)redhat.com; don(a)techcetera.com; otavio.ferranti(a)eldorado.org.br; lucas.lima(a)suinfra.ufrgs.br; pagupta(a)redhat.com; ehildesh(a)redhat.com; srevivo(a)redhat.com; Karli.Sjoberg(a)slu.se; pportant(a)redhat.com ... *~*~*~*~*~*~*~*~*~* Hi, The meeting is cancelled as the feature is being dropped from the current release because of other high priority features being taken up. Extremely sorry for the last moment cancellation. Will schedule the feature review later once we take up this feature. Thanks and Regards, Shubhendu Tripathi ------=_Part_8859059_641577150.1390801417195 Content-Type: text/calendar; charset=utf-8; method=CANCEL; name=meeting.ics Content-Transfer-Encoding: quoted-printable BEGIN:VCALENDAR PRODID:Zimbra-Calendar-Provider VERSION:2.0 METHOD:CANCEL BEGIN:VTIMEZONE TZID:Asia/Kolkata BEGIN:STANDARD DTSTART:16010101T000000 TZOFFSETTO:+0530 TZOFFSETFROM:+0530 TZNAME:IST END:STANDARD END:VTIMEZONE BEGIN:VEVENT UID:3440764a-ef38-4491-a023-f369dcfe9a18 SUMMARY:Cancelled: Feature Review: Gluster Volume Snapshot COMMENT:The following meeting has been cancelled: LOCATION:"Vijayanagara - BLR" <vijayanagara-blr(a)redhat.com> ATTENDEE;ROLE=3DREQ-PARTICIPANT;PARTSTAT=3DNEEDS-ACTION;RSVP=3DTRUE:mailto:= arch@ov irt.org ATTENDEE;ROLE=3DREQ-PARTICIPANT;PARTSTAT=3DNEEDS-ACTION;RSVP=3DTRUE:mailto:= users@o virt.org ATTENDEE;CN=3DVijayanagara - BLR;CUTYPE=3DRESOURCE;ROLE=3DNON-PARTICIPANT;P= ARTSTAT =3DACCEPTED;RSVP=3DTRUE:mailto:vijayanagara-blr@redhat.com ATTENDEE;CN=3DRamesh Nachimuthu;PARTSTAT=3DACCEPTED:mailto:rnachimu@redhat.= com ATTENDEE;CN=3DDon Harris;PARTSTAT=3DTENTATIVE:mailto:don@techcetera.com ATTENDEE;CN=3DOtavio Luiz Ferranti;PARTSTAT=3DDECLINED:mailto:otavio.ferran= ti@el dorado.org.br ATTENDEE;CN=3DLucas Lima;PARTSTAT=3DACCEPTED:mailto:lucas.lima@suinfra.ufrg= s.br ATTENDEE;CN=3DPankaj Gupta;PARTSTAT=3DACCEPTED:mailto:pagupta@redhat.com ATTENDEE;CN=3DEldan Hildesheim;PARTSTAT=3DTENTATIVE:mailto:ehildesh@redhat.= com ATTENDEE;CN=3DShai Revivo;PARTSTAT=3DTENTATIVE:mailto:srevivo@redhat.com ATTENDEE;CN=3D"Karli Sj=C3=B6berg";PARTSTAT=3DDECLINED:mailto:Karli.Sjoberg= @slu.se ATTENDEE;CN=3DPeter Portante;PARTSTAT=3DDECLINED:mailto:pportant@redhat.com ATTENDEE;CUTYPE=3DINDIVIDUAL;PARTSTAT=3DDECLINED:mailto:dbishop@controlscan= .com ATTENDEE;CN=3DRic Wheeler;PARTSTAT=3DTENTATIVE:mailto:rwheeler@redhat.com ATTENDEE;CN=3DPavithra;PARTSTAT=3DACCEPTED:mailto:psriniva@redhat.com ATTENDEE;CN=3DSatya Vempati;PARTSTAT=3DACCEPTED:mailto:svempati@tintri.com ATTENDEE;CN=3DEldad Marciano;PARTSTAT=3DACCEPTED:mailto:emarcian@redhat.com ORGANIZER;CN=3DShubhendu Tripathi:mailto:shtripat@redhat.com DTSTART;TZID=3D"Asia/Kolkata":20140127T183000 DTEND;TZID=3D"Asia/Kolkata":20140127T193000 STATUS:CANCELLED CLASS:PUBLIC X-MICROSOFT-CDO-INTENDEDSTATUS:BUSY TRANSP:OPAQUE LAST-MODIFIED:20140127T054337Z DTSTAMP:20140127T054337Z SEQUENCE:1 DESCRIPTION:The following meeting has been cancelled:\n\nSubject: Feature R= e view: Gluster Volume Snapshot \nOrganizer: "Shubhendu Tripathi" <shtripat@= re dhat.com> \n\nLocation: "Vijayanagara - BLR" <vijayanagara-blr(a)redhat.com>= \ nResources: "Vijayanagara - BLR" <vijayanagara-blr(a)redhat.com> (Vijayanaga= ra - BLR) \nTime: Monday\, January 27\, 2014\, 6:30:00 PM - 7:30:00 PM GMT += 05 :30 Chennai\, Kolkata\, Mumbai\, New Delhi\n \nInvitees: arch(a)ovirt.org\; = us ers(a)ovirt.org\; rnachimu(a)redhat.com\; don(a)techcetera.com\; otavio.ferranti= @e ldorado.org.br\; lucas.lima(a)suinfra.ufrgs.br\; pagupta(a)redhat.com\; ehilde= sh @redhat.com\; srevivo(a)redhat.com\; Karli.Sjoberg(a)slu.se\; pportant(a)redhat.= co m ... \n\n\n*~*~*~*~*~*~*~*~*~*\n\nHi\,\n\nThe meeting is cancelled as the= f eature is being dropped from the current release because of other high pri= or ity features being taken up.\nExtremely sorry for the last moment cancella= ti on.\n\nWill schedule the feature review later once we take up this feature= .\ n\nThanks and Regards\,\nShubhendu Tripathi END:VEVENT END:VCALENDAR ------=_Part_8859059_641577150.1390801417195--

1 0

[Users] sanlock can't read empty 'ids' file
by Ted Miller 27 Jan '14

27 Jan '14

--------------000306010201050105090700 Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit After some indirect path to getting here, I believe that the cause of my problem is with sanlock. (See thread on 'Data Center Status on the GUI flips between "Non Responsive" and "Contending" ' for how I got here). My sanlock.log file is full of: 2014-01-26 21:36:19-0500 36474 [2905]: s4576 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 2014-01-26 21:36:19-0500 36474 [26767]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512 2014-01-26 21:36:19-0500 36474 [26767]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-26 21:36:20-0500 36475 [2905]: s4576 add_lockspace fail result -90 2014-01-26 21:36:26-0500 36481 [2906]: s4577 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 2014-01-26 21:36:26-0500 36481 [26809]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512 2014-01-26 21:36:26-0500 36481 [26809]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-26 21:36:27-0500 36482 [2906]: s4577 add_lockspace fail result -90 The only other thing is after rebooting, when it says: 2014-01-26 11:28:53-0500 29 [2897]: sanlock daemon started 2.8 host 09423427-2f70-4f68-9696-e41a93937ef0.office2a.l 2014-01-26 11:29:22-0500 57 [2905]: s1 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 2014-01-26 11:29:22-0500 57 [3569]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c001000 result 0:0 match len 512 2014-01-26 11:29:22-0500 57 [3569]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-26 11:29:23-0500 58 [2905]: s1 add_lockspace fail result -90 2014-01-26 11:29:32-0500 67 [2905]: s2 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 2014-01-26 11:29:32-0500 67 [3731]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512 2014-01-26 11:29:32-0500 67 [3731]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-26 11:29:33-0500 68 [2905]: s2 add_lockspace fail result -90 2014-01-26 11:29:42-0500 77 [2905]: s3 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 2014-01-26 11:29:42-0500 77 [3806]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512 2014-01-26 11:29:42-0500 77 [3806]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-26 11:29:43-0500 78 [2905]: s3 add_lockspace fail result -90 Background: Setup is 2 hosts on Centos 6.5 with gluster storage, engine on separate Centos 6.5, all up to date. Originally set up running: Data Center: default Cluster: default Master storage domain: VM log had entries like: 2013-12-18 23:20:39-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -103:0 match res 2013-12-18 23:20:39-0500 4510 [3318]: s1 delta_renew read rv -103 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:39-0500 4510 [3318]: s1 renewal error -103 delta_length 9 last_success 4481 2013-12-18 23:20:40-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res 2013-12-18 23:20:40-0500 4510 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:40-0500 4510 [3318]: s1 renewal error -107 delta_length 0 last_success 4481 2013-12-18 23:20:40-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res 2013-12-18 23:20:40-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:40-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481 2013-12-18 23:20:41-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res 2013-12-18 23:20:41-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:41-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481 storage 'VM' had a Split-Brain. In trying to fix split-brain, file dom_md/ids was erased. I never revived the Data Center 'default' after that. log is full of: 2014-01-16 17:23:21-0500 62902 [29262]: open error -13 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2014-01-16 17:23:21-0500 62902 [29262]: s3 open_disk /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids error -13 2014-01-16 17:23:22-0500 62903 [3368]: s3 add_lockspace fail result -19 2014-01-16 17:23:31-0500 62912 [3368]: s4 lockspace 9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88:1:/rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids:0 Jan. 16: Created new: Data Center: mill; Cluster: one; Master storage domain: 'VM2' All was working. Logs looked like this: 2013-12-18 23:20:39-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -103:0 match res 2013-12-18 23:20:39-0500 4510 [3318]: s1 delta_renew read rv -103 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:39-0500 4510 [3318]: s1 renewal error -103 delta_length 9 last_success 4481 2013-12-18 23:20:40-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res 2013-12-18 23:20:40-0500 4510 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:40-0500 4510 [3318]: s1 renewal error -107 delta_length 0 last_success 4481 2013-12-18 23:20:40-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res 2013-12-18 23:20:40-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:40-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481 2013-12-18 23:20:41-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res 2013-12-18 23:20:41-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids 2013-12-18 23:20:41-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481 For a while, very little was logged at all, and this were working fine. Then, Jan 22 logs went from: 2014-01-22 00:44:56-0500 521397 [30933]: leader3 m 0 v 0 ss 0 nh 0 mh 0 oi 0 og 0 lv 0 2014-01-22 00:44:56-0500 521397 [30933]: leader4 sn rn ts 0 cs 0 2014-01-22 00:44:56-0500 521397 [30933]: s123 delta_renew verify_leader error -223 2014-01-22 00:44:56-0500 521397 [30933]: s123 renewal error -223 delta_length 0 last_success 521369 2014-01-22 00:44:57-0500 521398 [3362]: s123 kill 32599 sig 15 count 9 2014-01-22 00:44:57-0500 521398 [30933]: verify_leader 2 wrong magic 0 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-22 00:44:57-0500 521398 [30933]: leader1 delta_renew error -223 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c host_id 2 2014-01-22 00:44:57-0500 521398 [30933]: leader2 path /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids offset 0 2014-01-22 00:44:57-0500 521398 [30933]: leader3 m 0 v 0 ss 0 nh 0 mh 0 oi 0 og 0 lv 0 to: 2014-01-22 00:45:21-0500 521422 [17199]: 0322a407 aio collect 0 0x7f87ac0008c0:0x7f87ac0008d0:0x7f87ac101000 result 0:0 match len 512 2014-01-22 00:45:21-0500 521422 [17199]: read_sectors delta_leader offset 512 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-22 00:45:22-0500 521423 [3368]: s125 add_lockspace fail result -90 2014-01-22 00:45:25-0500 521426 [3368]: s126 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:2:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 2014-01-22 00:45:25-0500 521426 [17243]: 0322a407 aio collect 0 0x7f87ac0008c0:0x7f87ac0008d0:0x7f87ac101000 result 0:0 match len 512 2014-01-22 00:45:25-0500 521426 [17243]: read_sectors delta_leader offset 512 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids 2014-01-22 00:45:26-0500 521427 [3368]: s126 add_lockspace fail result -90 2014-01-22 00:45:36-0500 521437 [3368]: s127 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:2:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0 and the Data Center has been down ever since. Best I can figure is that something is supposed to be in dom_md/ids, but that file is empty: ls /rhev/data-center/mnt/glusterSD/10.41.65.2\:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ -l total 1029 -rw-rw---- 1 vdsm kvm 0 Jan 22 00:44 ids -rw-rw---- 1 vdsm kvm 0 Jan 16 18:50 inbox -rw-rw---- 1 vdsm kvm 2097152 Jan 21 18:20 leases -rw-r--r-- 1 vdsm kvm 491 Jan 21 18:20 metadata -rw-rw---- 1 vdsm kvm 0 Jan 16 18:50 outbox Any hints as to how to put whatever is needed into 'ids', or reinitialize the sanlock system--or a better diagnosis and solution--gladly accepted. Ted Miller Elkhart, IN, USA --------------000306010201050105090700 Content-Type: text/html; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"> </head> <body text="#000000" bgcolor="#FFFFFF"> After some indirect path to getting here, I believe that the cause of my problem is with sanlock.  (See thread on 'Data Center Status on the GUI flips between "Non Responsive" and "Contending" '  for how I got here). My sanlock.log file is full of: <pre>2014-01-26 21:36:19-0500 36474 [2905]: s4576 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> <pre>2014-01-26 21:36:19-0500 36474 [26767]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512</pre> <pre>2014-01-26 21:36:19-0500 36474 [26767]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-26 21:36:20-0500 36475 [2905]: s4576 add_lockspace fail result -90</pre> <pre>2014-01-26 21:36:26-0500 36481 [2906]: s4577 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> <pre>2014-01-26 21:36:26-0500 36481 [26809]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512</pre> <pre>2014-01-26 21:36:26-0500 36481 [26809]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-26 21:36:27-0500 36482 [2906]: s4577 add_lockspace fail result -90</pre> The only other thing is after rebooting, when it says: <pre>2014-01-26 11:28:53-0500 29 [2897]: sanlock daemon started 2.8 host 09423427-2f70-4f68-9696-e41a93937ef0.office2a.l</pre> <pre>2014-01-26 11:29:22-0500 57 [2905]: s1 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> <pre>2014-01-26 11:29:22-0500 57 [3569]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c001000 result 0:0 match len 512</pre> <pre>2014-01-26 11:29:22-0500 57 [3569]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-26 11:29:23-0500 58 [2905]: s1 add_lockspace fail result -90</pre> <pre>2014-01-26 11:29:32-0500 67 [2905]: s2 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> <pre>2014-01-26 11:29:32-0500 67 [3731]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512</pre> <pre>2014-01-26 11:29:32-0500 67 [3731]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-26 11:29:33-0500 68 [2905]: s2 add_lockspace fail result -90</pre> <pre>2014-01-26 11:29:42-0500 77 [2905]: s3 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:1:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> <pre>2014-01-26 11:29:42-0500 77 [3806]: 0322a407 aio collect 0 0x7f196c0008c0:0x7f196c0008d0:0x7f196c101000 result 0:0 match len 512</pre> <pre>2014-01-26 11:29:42-0500 77 [3806]: read_sectors delta_leader offset 0 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-26 11:29:43-0500 78 [2905]: s3 add_lockspace fail result -90</pre> Background: Setup is 2 hosts on Centos 6.5 with gluster storage, engine on separate Centos 6.5, all up to date. Originally set up running: <blockquote>Data Center: default Cluster: default Master storage domain: VM </blockquote> log had entries like: <blockquote> <pre>2013-12-18 23:20:39-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -103:0 match res</pre> <pre>2013-12-18 23:20:39-0500 4510 [3318]: s1 delta_renew read rv -103 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:39-0500 4510 [3318]: s1 renewal error -103 delta_length 9 last_success 4481</pre> <pre>2013-12-18 23:20:40-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res</pre> <pre>2013-12-18 23:20:40-0500 4510 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:40-0500 4510 [3318]: s1 renewal error -107 delta_length 0 last_success 4481</pre> <pre>2013-12-18 23:20:40-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res</pre> <pre>2013-12-18 23:20:40-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:40-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481</pre> <pre>2013-12-18 23:20:41-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res</pre> <pre>2013-12-18 23:20:41-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:41-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481</pre> </blockquote> storage 'VM' had a Split-Brain.  In trying to fix split-brain, file dom_md/ids was erased.  I never revived the Data Center 'default' after that. <blockquote>log is full of: <pre>2014-01-16 17:23:21-0500 62902 [29262]: open error -13 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2014-01-16 17:23:21-0500 62902 [29262]: s3 open_disk /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids error -13</pre> <pre>2014-01-16 17:23:22-0500 62903 [3368]: s3 add_lockspace fail result -19</pre> <pre>2014-01-16 17:23:31-0500 62912 [3368]: s4 lockspace 9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88:1:/rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids:0</pre> </blockquote> Jan. 16: Created new:  Data Center: mill; Cluster: one;  Master storage domain: 'VM2'  All was working. <blockquote>Logs looked like this: <pre>2013-12-18 23:20:39-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -103:0 match res</pre> <pre>2013-12-18 23:20:39-0500 4510 [3318]: s1 delta_renew read rv -103 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:39-0500 4510 [3318]: s1 renewal error -103 delta_length 9 last_success 4481</pre> <pre>2013-12-18 23:20:40-0500 4510 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res</pre> <pre>2013-12-18 23:20:40-0500 4510 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:40-0500 4510 [3318]: s1 renewal error -107 delta_length 0 last_success 4481</pre> <pre>2013-12-18 23:20:40-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res</pre> <pre>2013-12-18 23:20:40-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:40-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481</pre> <pre>2013-12-18 23:20:41-0500 4511 [3318]: 9b6e6bf1 aio collect 0 0x7fd3b40008c0:0x7fd3b40008d0:0x7fd3c59ae000 result -107:0 match res</pre> <pre>2013-12-18 23:20:41-0500 4511 [3318]: s1 delta_renew read rv -107 offset 0 /rhev/data-center/mnt/10.41.65.4:_VM/9b6e6bf1-29a1-4abf-8e85-bf9c4a329c88/dom_md/ids</pre> <pre>2013-12-18 23:20:41-0500 4511 [3318]: s1 renewal error -107 delta_length 0 last_success 4481</pre> </blockquote> For a while, very little was logged at all, and this were working fine.  Then, Jan 22 logs went from: <blockquote> <pre>2014-01-22 00:44:56-0500 521397 [30933]: leader3 m 0 v 0 ss 0 nh 0 mh 0 oi 0 og 0 lv 0</pre> <pre>2014-01-22 00:44:56-0500 521397 [30933]: leader4 sn  rn  ts 0 cs 0</pre> <pre>2014-01-22 00:44:56-0500 521397 [30933]: s123 delta_renew verify_leader error -223</pre> <pre>2014-01-22 00:44:56-0500 521397 [30933]: s123 renewal error -223 delta_length 0 last_success 521369</pre> <pre>2014-01-22 00:44:57-0500 521398 [3362]: s123 kill 32599 sig 15 count 9</pre> <pre>2014-01-22 00:44:57-0500 521398 [30933]: verify_leader 2 wrong magic 0 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-22 00:44:57-0500 521398 [30933]: leader1 delta_renew error -223 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c host_id 2</pre> <pre>2014-01-22 00:44:57-0500 521398 [30933]: leader2 path /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids offset 0</pre> <pre>2014-01-22 00:44:57-0500 521398 [30933]: leader3 m 0 v 0 ss 0 nh 0 mh 0 oi 0 og 0 lv 0</pre> </blockquote> to: <blockquote> <pre>2014-01-22 00:45:21-0500 521422 [17199]: 0322a407 aio collect 0 0x7f87ac0008c0:0x7f87ac0008d0:0x7f87ac101000 result 0:0 match len 512</pre> <pre>2014-01-22 00:45:21-0500 521422 [17199]: read_sectors delta_leader offset 512 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-22 00:45:22-0500 521423 [3368]: s125 add_lockspace fail result -90</pre> <pre>2014-01-22 00:45:25-0500 521426 [3368]: s126 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:2:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> <pre>2014-01-22 00:45:25-0500 521426 [17243]: 0322a407 aio collect 0 0x7f87ac0008c0:0x7f87ac0008d0:0x7f87ac101000 result 0:0 match len 512</pre> <pre>2014-01-22 00:45:25-0500 521426 [17243]: read_sectors delta_leader offset 512 rv -90 /rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids</pre> <pre>2014-01-22 00:45:26-0500 521427 [3368]: s126 add_lockspace fail result -90</pre> <pre>2014-01-22 00:45:36-0500 521437 [3368]: s127 lockspace 0322a407-2b16-40dc-ac67-13d387c6eb4c:2:/rhev/data-center/mnt/glusterSD/10.41.65.2:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ids:0</pre> </blockquote> and the Data Center has been down ever since. Best I can figure is that something is supposed to be in dom_md/ids, but that file is empty: <pre>ls /rhev/data-center/mnt/glusterSD/10.41.65.2\:VM2/0322a407-2b16-40dc-ac67-13d387c6eb4c/dom_md/ -l</pre> <pre>total 1029</pre> <pre>-rw-rw---- 1 vdsm kvm       0 Jan 22 00:44 ids</pre> <pre>-rw-rw---- 1 vdsm kvm       0 Jan 16 18:50 inbox</pre> <pre>-rw-rw---- 1 vdsm kvm 2097152 Jan 21 18:20 leases</pre> <pre>-rw-r--r-- 1 vdsm kvm     491 Jan 21 18:20 metadata</pre> <pre>-rw-rw---- 1 vdsm kvm       0 Jan 16 18:50 outbox </pre> Any hints as to how to put whatever is needed into 'ids', or reinitialize the sanlock system--or a better diagnosis and solution--gladly accepted. Ted Miller Elkhart, IN, USA </body> </html> --------------000306010201050105090700--

1 0

[Users] oVirt 3.4.0 issues with storage
by Jon Archer 26 Jan '14

26 Jan '14

Hi all, I upgraded to 3.4 beta this evening and seem to have developed a problem with the storage domains. I seem unable to bring them online getting the error in the console "Failed to activate Storage Domain". Also alongside this error is a warning, "Invalid status on Data Center local_datacenter. Setting status to Non Responsive" Anyone seen this? Or any ideas? Thanks Jon

4 11

[Users] mavericks as a guest vm?
by Mark 26 Jan '14

26 Jan '14

I have older Xserve hardware that is 64 bit but the bios is 32 bit. Fusion runs mavericks with no problem. The vm runs in 64 bit mode. I'd like to run mavericks as vm under ovirt on this hardware. Google searches I've done keep pointing to vmware. Any pointers?

3 2

[Users] Configure VNC-Password timeout
by Sven Kieske 26 Jan '14

26 Jan '14

Hi, the default timeout for the vnc passwords is 2 Minutes. I'd like to reconfigure this. Is there an engine-config value or is this hardcoded? How can this be changed? -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen

4 5