September 2013 - Users - oVirt List Archives

[Users] oVirt Updates - September 16th
by Itamar Heim 17 Sep '13

17 Sep '13

Summer vacations and holidays, but many updates... Conferences/Talks - Greg Padget will cover the new sla mechanism in ovirt at LinuxCon/CloudOpen NA (September 17th, New Orleans) - a lot of sessions around linuxcon europe/kvm forum. also, the annual developer summit. Dave Neary created this helpful page: http://www.ovirt.org/KVM_Forum_2013 3.3 - Release is going out any minute now... looks like an exciting one, packed with features! - deep dives to new 3.3 features if you missed them - deep dives into some of the new features are available at the end of this page: http://www.ovirt.org/OVirt_3.3_release_notes - note on native glusterfs storage domain and .el6 centos/rhel 6.4 don't have qemu/libvirt packages supporting this. these are expected with 6.5. we are trying to find a solution prior to 6.5 to resolve this. - Zhou Zheng Sheng graciously created guest agent packages for ubuntu and debian[1] - heads up that we're planning a bit larger 3.3.1 which will rebase and pass some more testing. then more frequent 3.3.x updates for issues found. - jason brooks blogged on "Testing oVirt 3.3 with Nested KVM" and "Up and Running with oVirt 3.3" http://community.redhat.com/testing-ovirt-3-3-with-nested-kvm http://community.redhat.com/up-and-running-with-ovirt-3-3/ 3.4 - I started a thread for "what do you want next" - will collect and publish separately. feel free to chime in[2] Case Studies - Dave Neary worked with Alter Way to publish one. http://www.ovirt.org/Alter_Way_case_study - We'd love to see more of these - please ping dneary(a)redhat.com Kimchi - Adam Litke followed on the vote to accept Kimchi as in incubated project. Kimchi is a lightweight single machine virt manager. simplified, html 5, etc. - Mike burns updated they are already trying to build a stand alone ovirt-node with it. - Adam will present Kimchi at the KVM Forum (see conferences below)` Other - René Koch asked for early testing on a new version of the Nagios plugin[3] - Karli Sjöberg published screenshots of their "order portal"[4] - (YouTube) how to use a glance image with ovirt by Hervé Leclerc http://www.youtube.com/watch?v=4yeopUKjjnY Thanks, Itamar [1] http://lists.ovirt.org/pipermail/users/2013-September/016308.html [2] http://lists.ovirt.org/pipermail/users/2013-August/015807.html [3] http://lists.ovirt.org/pipermail/users/2013-August/015779.html [4] http://lists.ovirt.org/pipermail/users/2013-August/015619.html

1 0

[Users] Reimport iSCSI Storage Domain?
by Hans-Joachim 17 Sep '13

17 Sep '13

--========GMXBoundary18211377245371312306 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Hello, 'unfortunally' I updated my oVirt to 3.4.0-0.2.master.20130815150659.git764a14c.el6 and i'd like to go back with all 17 VMs to the soon brand new 3.3 version. It looks like, the database schemas are different, 03030760 for my installed version whereas 3.3 rc comes with 03030640. So I'm pretty sure, I will not able to use this db for 3.3 So my question, is there any way to reimport an existing iSCSI domain without passing hours of exporting/importing VMs from one system to the other? Thank you for your help Hans-Joachim --========GMXBoundary18211377245371312306 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hello,<b= r /> 'unfortunally' I updated my oVirt to  3.4.0-0.2.master.20130815150659.git764a14c.el6 and i'd lik= e to go back with all 17 VMs to the soon brand new 3.3 version. It loo= ks like, the database schemas are different, 03030760 for my installed vers= ion whereas 3.3 rc comes with 03030640. So I'm pretty sure, I will not= able to use this db for 3.3 So my question, is there any way to= reimport an existing iSCSI domain without passing hours of exporting/impor= ting VMs from one system to the other? Thank you for your help<b= r /> Hans-Joachim =C2=A0 --========GMXBoundary18211377245371312306--

2 1

[Users] iSCSI VM storage overlap
by Jérémy Clerc 17 Sep '13

17 Sep '13

------=_Part_80562_294231023.1377269830992 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello,=20 We have a 3 node setup with one for ovirt-engine managing the 2 others node= s.=20 OS on all nodes is CentOS release 6.4 (Final)=20 Ovirt version is 3.2.1-1.beta1.el6.noarch=20 It uses an iSCSI IBM Backend.=20 When importing 2 VMs from exports, it happens that after importing VM1, you= import VM2 and it overwrites some parts of VM1's disk, and so you lose pre= tty much all your data.=20 So it is like the SPM does not know where it wrote VM1. I have found any re= levant logs.=20 Has anyone already experienced this ?=20 Thanks,=20 J=C3=A9r=C3=A9my=20 ------=_Part_80562_294231023.1377269830992 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><head><style type=3D'text/css'>p { margin: 0; }</style></head><body><= div style=3D'font-family: Arial; font-size: 12pt; color: #000099'><style>p = { margin: 0; }</style><div style=3D"font-family: Arial; font-size: 12pt; co= lor: #000099">Hello, We have a 3 node setup with one for ovirt-engin= e managing the 2 others nodes. OS on all nodes is CentOS release 6.4= (Final) Ovirt version is 3.2.1-1.beta1.el6.noarch It uses an= iSCSI IBM Backend. When importing 2 VMs from exports, it happen= s that after importing VM1, you import VM2 and it overwrites some parts of = VM1's disk, and so you lose pretty much all your data. So it is like= the SPM does not  know where it wrote VM1. I have found any relevant = logs. Has anyone already experienced this ? Thanks, =20 J=C3=A9r=C3=A9my </div></div></body></html> ------=_Part_80562_294231023.1377269830992--

2 1

[Users] SPICE Console with Portal - Windows clients
by Aaron Bliss 17 Sep '13

17 Sep '13

This is a multi-part message in MIME format. --------------030407080807010807080708 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi all, Running ovirt-engine version 3.2 (from EL 6 repo) and most everything seems to be working great. I would like to setup SPICE based console access from Windows based clientsrunning Internet Explorer (spice console from Linux based machines and FF work great). The process to setup console SPICE console access from Windows based clients is documented here: http://www.ovirt.org/How_to_Connect_to_SPICE_Console_With_Portal However, the link to download spice.cab (http://elmarco.fedorapeople.org/spice.cab) isn't working. Does anyone have a trust worthy source for spice.cab? Please advise and thanks. Aaron --------------030407080807010807080708 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> </head> <body text="#000000" bgcolor="#FFFFFF"> Hi all, Running ovirt-engine version 3.2 (from EL 6 repo) and most everything seems to be working great.  I would like to setup SPICE based console access from Windows based clients running Internet Explorer (spice console from Linux based machines and FF work great).  The process to setup console SPICE console access from Windows based clients is documented here: <a class="moz-txt-link-freetext" href="http://www.ovirt.org/How_to_Connect_to_SPICE_Console_With_Portal">http://www.ovirt.org/How_to_Connect_to_SPICE_Console_With_Portal</a> However, the link to download spice.cab (<a class="moz-txt-link-freetext" href="http://elmarco.fedorapeople.org/spice.cab">http://elmarco.fedorapeople.org/spice.cab</a>) isn't working.  Does anyone have a trust worthy source for spice.cab?  Please advise and thanks. Aaron  </body> </html> --------------030407080807010807080708--

3 2

[Users] Compliance problem with ovirt 3.3 on Fedora 19
by Thomas Suckow 17 Sep '13

17 Sep '13

I attempted to setup and all-in-one solution on Fedora 19. I ran through the install which made a default data center and cluster. I created a host with 127.0.0.1 and then attempted to add the bridge that the test day documentation states does not get handled properly. After many reboots and disabling NetworkManager.service and enabling network.service as well as manually editing the /etc/sysconfig/network-scripts/ifcfg-* files I had a network connection and reduced the "errors" that seem to be keeping my host in the Nonfunctional state to: Host Localhost does not comply with the cluster Default emulated machines. The Hosts emulated machines are <UNKNOWN> and the cluster is [rhel6.4.0, pc-1.0]} Recommendations of something I may be doing wrong? Has running 3.3 on F19 been a bad choice on my part? Bug?

5 12

[Users] oVIRT 3.3 Failed to acces Master Domain
by Hans-Joachim 16 Sep '13

16 Sep '13

--========GMXBoundary239291378911044835950 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Hello, I run in troubles.... For a testing I completly powered off the oVirt Cluster (Engine as well as the the host).. and now my host is unable to fine the Master Domain System: CentOS 6.4, vdsm-4.12.1-1.el6, oVirt Engine Version: 3.3.0-1.el6 Trace vdsm.log Thread-98::DEBUG::2013-09-11 16:35:06,859::BindingXMLRPC::177::vds::(wrapper) client [192.168.1.29] Thread-98::DEBUG::2013-09-11 16:35:06,859::task::579::TaskManager.Task::(_updateState) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::moving from state init -> state preparing Thread-98::INFO::2013-09-11 16:35:06,860::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='5849b030-626e-47cb-ad90-3ce782d831b3', hostID=1, scsiKey='5849b030-626e-47cb-ad90-3ce782d831b3', msdUUID='3401420d-6918-49f9-b9e2-23ba47949f29', masterVersion=1, options=None) Thread-98::DEBUG::2013-09-11 16:35:06,860::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`079c6f43-9453-4598-a9f3-7056ad3a595e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1020' at '_connectStoragePool' Thread-98::DEBUG::2013-09-11 16:35:06,860::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'exclusive' Thread-98::DEBUG::2013-09-11 16:35:06,861::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free. Now locking as 'exclusive' (1 active user) Thread-98::DEBUG::2013-09-11 16:35:06,861::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=`079c6f43-9453-4598-a9f3-7056ad3a595e`::Granted request Thread-98::INFO::2013-09-11 16:35:06,861::sp::680::Storage.StoragePool::(connect) Connect host #1 to the storage pool 5849b030-626e-47cb-ad90-3ce782d831b3 with master domain: 3401420d-6918-49f9-b9e2-23ba47949f29 (ver = 1) Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::483::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::485::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::494::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::496::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,863::lvm::514::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,863::lvm::516::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,863::misc::807::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) Thread-98::DEBUG::2013-09-11 16:35:06,863::misc::809::SamplingMethod::(__call__) Got in to sampling method Thread-98::DEBUG::2013-09-11 16:35:06,863::misc::807::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) Thread-98::DEBUG::2013-09-11 16:35:06,864::misc::809::SamplingMethod::(__call__) Got in to sampling method Thread-98::DEBUG::2013-09-11 16:35:06,864::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) Thread-98::DEBUG::2013-09-11 16:35:06,875::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21 Thread-98::DEBUG::2013-09-11 16:35:06,875::misc::817::SamplingMethod::(__call__) Returning last result Thread-98::DEBUG::2013-09-11 16:35:08,902::multipath::111::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) Thread-98::DEBUG::2013-09-11 16:35:08,916::multipath::111::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 Thread-98::DEBUG::2013-09-11 16:35:08,917::lvm::483::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,917::lvm::485::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm::494::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm::496::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm::514::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm::516::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,919::misc::817::SamplingMethod::(__call__) Returning last result Thread-98::ERROR::2013-09-11 16:35:08,919::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 3401420d-6918-49f9-b9e2-23ba47949f29 Thread-98::ERROR::2013-09-11 16:35:08,919::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 3401420d-6918-49f9-b9e2-23ba47949f29 Thread-98::DEBUG::2013-09-11 16:35:08,919::lvm::374::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,921::lvm::311::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \'a|/dev/mapper/3600508b1001052395359564d53570200|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 3401420d-6918-49f9-b9e2-23ba47949f29' (cwd None) Thread-98::DEBUG::2013-09-11 16:35:09,096::lvm::311::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "3401420d-6918-49f9-b9e2-23ba47949f29" not found\n'; <rc> = 5 Thread-98::WARNING::2013-09-11 16:35:09,097::lvm::379::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "3401420d-6918-49f9-b9e2-23ba47949f29" not found'] Thread-98::DEBUG::2013-09-11 16:35:09,097::lvm::403::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex Thread-98::ERROR::2013-09-11 16:35:09,098::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 3401420d-6918-49f9-b9e2-23ba47949f29 not found Thread-98::DEBUG::2013-09-11 16:35:09,099::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' Thread-98::DEBUG::2013-09-11 16:35:09,099::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' (0 active users) Thread-98::DEBUG::2013-09-11 16:35:09,099::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out if anyone is waiting for it. Thread-98::DEBUG::2013-09-11 16:35:09,099::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing records. Thread-98::ERROR::2013-09-11 16:35:09,100::task::850::TaskManager.Task::(_setError) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Unexpected error Thread-98::DEBUG::2013-09-11 16:35:09,100::task::869::TaskManager.Task::(_run) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Task._run: b2a7a44f-8cb0-453a-bf52-16a200f992f9 ('5849b030-626e-47cb-ad90-3ce782d831b3', 1, '5849b030-626e-47cb-ad90-3ce782d831b3', '3401420d-6918-49f9-b9e2-23ba47949f29', 1) {} failed - stopping task Thread-98::DEBUG::2013-09-11 16:35:09,100::task::1194::TaskManager.Task::(stop) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::stopping in state preparing (force False) Thread-98::DEBUG::2013-09-11 16:35:09,101::task::974::TaskManager.Task::(_decref) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::ref 1 aborting True Thread-98::INFO::2013-09-11 16:35:09,101::task::1151::TaskManager.Task::(prepare) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::aborting: Task is aborted: 'Cannot find master domain' - code 304 Thread-98::DEBUG::2013-09-11 16:35:09,101::task::1156::TaskManager.Task::(prepare) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Prepare: aborted: Cannot find master domain Thread-98::DEBUG::2013-09-11 16:35:09,101::task::974::TaskManager.Task::(_decref) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::ref 0 aborting True Thread-98::DEBUG::2013-09-11 16:35:09,102::task::909::TaskManager.Task::(_doAbort) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Task._doAbort: force False Thread-98::DEBUG::2013-09-11 16:35:09,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-98::DEBUG::2013-09-11 16:35:09,102::task::579::TaskManager.Task::(_updateState) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::moving from state preparing -> state aborting Thread-98::DEBUG::2013-09-11 16:35:09,102::task::534::TaskManager.Task::(__state_aborting) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::_aborting: recover policy none Thread-98::DEBUG::2013-09-11 16:35:09,102::task::579::TaskManager.Task::(_updateState) Task=`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::moving from state aborting -> state failed Thread-98::DEBUG::2013-09-11 16:35:09,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-98::DEBUG::2013-09-11 16:35:09,103::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-98::ERROR::2013-09-11 16:35:09,103::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Cannot find master domain: 'spUUID=5849b030-626e-47cb-ad90-3ce782d831b3, msdUUID=3401420d-6918-49f9-b9e2-23ba47949f29'", 'code': 304}} and engine.log 2013-09-10 16:35:16,652 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) BaseAsyncTask::OnTaskEndSuccess: Task f587a842-272f-4a86-8c15-7451a39a7f42 (Parent Command ImportVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2013-09-10 16:35:16,654 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-68) Task with DB Task ID a0fc43a0-3f25-4c65-a7e8-8f60762c64c8 and VDSM Task ID 1f3a3700-cfca-40dd-95b4-28b141756e8e is in state Polling. End action for command f61efb6b-d3a4-4e04-a79e-3b7c61920ff2 will proceed when all the entitys tasks are completed. 2013-09-10 16:35:36,817 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) SPMAsyncTask::PollTask: Polling task 1f3a3700-cfca-40dd-95b4-28b141756e8e (Parent Command ImportVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. 2013-09-10 16:35:36,893 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) BaseAsyncTask::OnTaskEndSuccess: Task 1f3a3700-cfca-40dd-95b4-28b141756e8e (Parent Command ImportVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2013-09-10 16:35:36,895 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-95) CommandAsyncTask::EndActionIfNecessary: All tasks of command f61efb6b-d3a4-4e04-a79e-3b7c61920ff2 has ended -> executing EndAction 2013-09-10 16:35:36,896 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-95) CommandAsyncTask::EndAction: Ending action for 2 tasks (command ID: f61efb6b-d3a4-4e04-a79e-3b7c61920ff2): calling EndAction . 2013-09-10 16:35:36,899 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-48) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction ImportVm, executionIndex: 0 2013-09-10 16:35:36,919 INFO [org.ovirt.engine.core.bll.ImportVmCommand] (pool-6-thread-48) Ending command successfully: org.ovirt.engine.core.bll.ImportVmCommand 2013-09-10 16:35:36,948 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (pool-6-thread-48) [1c5353e0] Ending command successfully: org.ovirt.engine.core.bll.CopyImageGroupCommand 2013-09-10 16:35:36,971 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [1c5353e0] START, GetImageInfoVDSCommand( storagePoolId = 5849b030-626e-47cb-ad90-3ce782d831b3, ignoreFailoverLimit = false, storageDomainId = 3401420d-6918-49f9-b9e2-23ba47949f29, imageGroupId = 8061a702-792f-4219-8bf0-8f10ba576c01, imageId = 4b2a7aed-bc11-45c8-8bf1-9c195c5a29ab), log id: 51fca824 2013-09-10 16:35:42,430 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [1c5353e0] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@285e00dd, log id: 51fca824 2013-09-10 16:35:42,449 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (pool-6-thread-48) [57faac34] Ending command successfully: org.ovirt.engine.core.bll.CopyImageGroupCommand 2013-09-10 16:35:42,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [57faac34] START, GetImageInfoVDSCommand( storagePoolId = 5849b030-626e-47cb-ad90-3ce782d831b3, ignoreFailoverLimit = false, storageDomainId = 3401420d-6918-49f9-b9e2-23ba47949f29, imageGroupId = 374e7d38-ebfe-4fab-a6ec-727e9ef9733c, imageId = 54e3344d-45f0-4876-b4a9-cdad98fac7a5), log id: 51aaf563 2013-09-10 16:35:56,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [57faac34] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@dd64762e, log id: 51aaf563 2013-09-10 16:35:57,000 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-6-thread-48) START, SetVmStatusVDSCommand( vmId = dc1ac7da-fef2-48e4-ab91-309b3a1fd2c0, status = Down), log id: 45208621 2013-09-10 16:35:57,007 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-6-thread-48) FINISH, SetVmStatusVDSCommand, log id: 45208621 2013-09-10 16:35:57,008 INFO [org.ovirt.engine.core.bll.ImportVmCommand] (pool-6-thread-48) Lock freed to object EngineLock [exclusiveLocks= key: VM1 value: VM_NAME 2013-09-10 16:35:57,051 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-6-thread-48) Correlation ID: 62df3606, Job ID: 7134d7b0-7878-4bb3-970f-4128c1e818e7, Call Stack: null, Custom Event ID: -1, Message: Vm VM1 was imported successfully to Data Center Default, Cluster Default 2013-09-10 16:35:57,053 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type ImportVm completed, handling the result. 2013-09-10 16:35:57,054 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-48) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type ImportVm succeeded, clearing tasks. 2013-09-10 16:35:57,068 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-6-thread-48) SPMAsyncTask::ClearAsyncTask: Attempting to clear task f587a842-272f-4a86-8c15-7451a39a7f42 2013-09-10 16:35:57,070 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-6-thread-48) START, SPMClearTaskVDSCommand( storagePoolId = 5849b030-626e-47cb-ad90-3ce782d831b3, ignoreFailoverLimit = false, taskId = f587a842-272f-4a86-8c15-7451a39a7f42), log id: 57f89137 2013-09-10 16:35:57,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-6-thread-48) START, HSMClearTaskVDSCommand(HostName = HOST1, HostId = 6593afcd-9e7f-4928-a914-5ad1eeaa3999, taskId=f587a842-272f-4a86-8c15-7451a39a7f42), log id: 5df00 2013-09-11 16:35:01,795 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-81) Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool 2013-09-11 16:35:01,799 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-81) Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool 2013-09-11 16:35:01,854 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) START, ConnectStoragePoolVDSCommand(HostName = BBGLU012, HostId = 6593afcd-9e7f-4928-a914-5ad1eeaa3999, storagePoolId = 5849b030-626e-47cb-ad90-3ce782d831b3, vds_spm_id = 1, masterDomainId = 3401420d-6918-49f9-b9e2-23ba47949f29, masterVersion = 1), log id: 14e339aa 2013-09-11 16:35:09,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) Command org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value 2013-09-11 16:35:09,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) HostName = HOST1 2013-09-11 16:35:09,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=5849b030-626e-47cb-ad90-3ce782d831b3, msdUUID=3401420d-6918-49f9-b9e2-23ba47949f29' 2013-09-11 16:35:09,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) FINISH, ConnectStoragePoolVDSCommand, log id: 14e339aa 2013-09-11 16:35:09,116 ERROR [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (pool-6-thread-50) Could not connect host HOST1 to pool Default 2013-09-11 16:35:09,184 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-81) Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 6593afcd-9e7f-4928-a914-5ad1eeaa3999 Type: VDS 2013-09-11 16:35:09,207 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-81) START, SetVdsStatusVDSCommand(HostName = HOST1, HostId = 6593afcd-9e7f-4928-a914-5ad1eeaa3999, status=NonOperational, nonOperationalReason=STORAGE_DOMAIN_UNREACHABLE), log id: 3c9dbd47 2013-09-11 16:35:09,217 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, SetVdsStatusVDSCommand, log id: 3c9dbd47 2013-09-11 16:35:09,225 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: 64e68249, Job ID: 355b71e9-f7b9-4554-800b-7b08a09d9a12, Call Stack: null, Custom Event ID: -1, Message: Host HOST1 cannot access one of the Storage Domains attached to the Data Center Default. Setting Host state to Non-Operational. 2013-09-11 16:35:09,266 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Power Management test failed for Host BBGLU012.There is no other host in the data center that can be used to test the power management settings. 2013-09-11 16:35:09,275 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-81) Correlation ID: 1a32fa26, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host HOST1 to Storage Pool Default 2013-09-11 16:35:09,320 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-81) Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6593afcd-9e7f-4928-a914-5ad1eeaa3999 Type: VDS 2013-09-11 16:35:09,352 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-81) Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 6593afcd-9e7f-4928-a914-5ad1eeaa3999 Type: VDS 2013-09-11 16:35:09,354 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) Host 6593afcd-9e7f-4928-a914-5ad1eeaa3999 : HOST1 is already in NonOperational status. SetNonOperationalVds command is skipped. [root@bbgpas129 ovirt-engine]# 2013-09-11 16:35:09,184 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-81) Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 6593afcd-9e7f-4928-a914-5ad1eeaa3999 Type: VDS --========GMXBoundary239291378911044835950 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hello,<b= r /> I run in troubles.... For a testing I completly powere= d off the oVirt Cluster (Engine as well as the the host).. and now my host<= br />is unable to fine the Master Domain System: CentOS 6.4,&nbs= p; vdsm-4.12.1-1.el6, = oVirt Engine Version: 3.3.0-1.el6 Trace vdsm.log Thread-98::DEBUG::2013-09-11 16:35:06,859::Bind= ingXMLRPC::177::vds::(wrapper) client [192.168.1.29] Thread-98::DEBUG:= :2013-09-11 16:35:06,859::task::579::TaskManager.Task::(_updateState) Task= =3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::moving from state init -> sta= te preparing Thread-98::INFO::2013-09-11 16:35:06,860::logUtils::44::d= ispatcher::(wrapper) Run and protect: connectStoragePool(spUUID=3D'5849b030= -626e-47cb-ad90-3ce782d831b3', hostID=3D1, scsiKey=3D'5849b030-626e-47cb-ad= 90-3ce782d831b3', msdUUID=3D'3401420d-6918-49f9-b9e2-23ba47949f29', masterV= ersion=3D1, options=3DNone) Thread-98::DEBUG::2013-09-11 16:35:06,860:= :resourceManager::197::ResourceManager.Request::(__init__) ResName=3D`Stora= ge.5849b030-626e-47cb-ad90-3ce782d831b3`ReqID=3D`079c6f43-9453-4598-a9f3-70= 56ad3a595e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '102= 0' at '_connectStoragePool' Thread-98::DEBUG::2013-09-11 16:35:06,860:= :resourceManager::541::ResourceManager::(registerResource) Trying to regist= er resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' for lock type 'e= xclusive' Thread-98::DEBUG::2013-09-11 16:35:06,861::resourceManager::= 600::ResourceManager::(registerResource) Resource 'Storage.5849b030-626e-47= cb-ad90-3ce782d831b3' is free. Now locking as 'exclusive' (1 active user)<b= r />Thread-98::DEBUG::2013-09-11 16:35:06,861::resourceManager::237::Resour= ceManager.Request::(grant) ResName=3D`Storage.5849b030-626e-47cb-ad90-3ce78= 2d831b3`ReqID=3D`079c6f43-9453-4598-a9f3-7056ad3a595e`::Granted request Thread-98::INFO::2013-09-11 16:35:06,861::sp::680::Storage.StoragePool::(= connect) Connect host #1 to the storage pool 5849b030-626e-47cb-ad90-3ce782= d831b3 with master domain: 3401420d-6918-49f9-b9e2-23ba47949f29 (ver =3D 1)= Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::483::OperationMutex::= (_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation = mutex Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::485::OperationMu= tex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the = operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::494::O= perationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got= the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,862::lvm::4= 96::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation= ' released the operation mutex Thread-98::DEBUG::2013-09-11 16:35:06,8= 63::lvm::514::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate= operation' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35= :06,863::lvm::516::OperationMutex::(_invalidateAllLvs) Operation 'lvm inval= idate operation' released the operation mutex Thread-98::DEBUG::2013-0= 9-11 16:35:06,863::misc::807::SamplingMethod::(__call__) Trying to enter sa= mpling method (storage.sdc.refreshStorage) Thread-98::DEBUG::2013-09-1= 1 16:35:06,863::misc::809::SamplingMethod::(__call__) Got in to sampling me= thod Thread-98::DEBUG::2013-09-11 16:35:06,863::misc::807::SamplingMet= hod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) Thread-98::DEBUG::2013-09-11 16:35:06,864::misc::809::SamplingMethod::(__c= all__) Got in to sampling method Thread-98::DEBUG::2013-09-11 16:35:06= ,864::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/= iscsiadm -m session -R' (cwd None) Thread-98::DEBUG::2013-09-11 16:35:= 06,875::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = =3D 'iscsiadm: No session found.\n'; <rc> =3D 21 Thread-98::DEBU= G::2013-09-11 16:35:06,875::misc::817::SamplingMethod::(__call__) Returning= last result Thread-98::DEBUG::2013-09-11 16:35:08,902::multipath::111= ::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd Non= e) Thread-98::DEBUG::2013-09-11 16:35:08,916::multipath::111::Storage.= Misc.excCmd::(rescan) SUCCESS: <err> =3D ''; <rc> =3D 0 Th= read-98::DEBUG::2013-09-11 16:35:08,917::lvm::483::OperationMutex::(_invali= dateAllPvs) Operation 'lvm invalidate operation' got the operation mutex<br= />Thread-98::DEBUG::2013-09-11 16:35:08,917::lvm::485::OperationMutex::(_i= nvalidateAllPvs) Operation 'lvm invalidate operation' released the operatio= n mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm::494::Operation= Mutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the ope= ration mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm::496::Oper= ationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' releas= ed the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,918::lvm:= :514::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operati= on' got the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,918:= :lvm::516::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate op= eration' released the operation mutex Thread-98::DEBUG::2013-09-11 16:= 35:08,919::misc::817::SamplingMethod::(__call__) Returning last result Thread-98::ERROR::2013-09-11 16:35:08,919::sdc::137::Storage.StorageDomain= Cache::(_findDomain) looking for unfetched domain 3401420d-6918-49f9-b9e2-2= 3ba47949f29 Thread-98::ERROR::2013-09-11 16:35:08,919::sdc::154::Stora= ge.StorageDomainCache::(_findUnfetchedDomain) looking for domain 3401420d-6= 918-49f9-b9e2-23ba47949f29 Thread-98::DEBUG::2013-09-11 16:35:08,919::= lvm::374::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got= the operation mutex Thread-98::DEBUG::2013-09-11 16:35:08,921::lvm::3= 11::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " d= evices { preferred_names =3D [\\"^/dev/mapper/\\"] ignore_suspended_devices= =3D1 write_cache_state=3D0 disable_after_error_count=3D3 filter =3D [ \'a|/= dev/mapper/3600508b1001052395359564d53570200|\', \'r|.*|\' ] }  global= {  locking_type=3D1  prioritise_write_locks=3D1  wait_for_l= ocks=3D1 }  backup {  retain_min =3D 50  retain_days =3D 0 }= " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,f= ree,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free 340142= 0d-6918-49f9-b9e2-23ba47949f29' (cwd None) Thread-98::DEBUG::2013-09-1= 1 16:35:09,096::lvm::311::Storage.Misc.excCmd::(cmd) FAILED: <err> = =3D '  Volume group "3401420d-6918-49f9-b9e2-23ba47949f29" not found\n= '; <rc> =3D 5 Thread-98::WARNING::2013-09-11 16:35:09,097::lvm::= 379::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "= 3401420d-6918-49f9-b9e2-23ba47949f29" not found'] Thread-98::DEBUG::20= 13-09-11 16:35:09,097::lvm::403::OperationMutex::(_reloadvgs) Operation 'lv= m reload operation' released the operation mutex Thread-98::ERROR::201= 3-09-11 16:35:09,098::sdc::143::Storage.StorageDomainCache::(_findDomain) d= omain 3401420d-6918-49f9-b9e2-23ba47949f29 not found Thread-98::DEBUG:= :2013-09-11 16:35:09,099::resourceManager::615::ResourceManager::(releaseRe= source) Trying to release resource 'Storage.5849b030-626e-47cb-ad90-3ce782d= 831b3' Thread-98::DEBUG::2013-09-11 16:35:09,099::resourceManager::634= ::ResourceManager::(releaseResource) Released resource 'Storage.5849b030-62= 6e-47cb-ad90-3ce782d831b3' (0 active users) Thread-98::DEBUG::2013-09-= 11 16:35:09,099::resourceManager::640::ResourceManager::(releaseResource) R= esource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3' is free, finding out= if anyone is waiting for it. Thread-98::DEBUG::2013-09-11 16:35:09,09= 9::resourceManager::648::ResourceManager::(releaseResource) No one is waiti= ng for resource 'Storage.5849b030-626e-47cb-ad90-3ce782d831b3', Clearing re= cords. Thread-98::ERROR::2013-09-11 16:35:09,100::task::850::TaskManag= er.Task::(_setError) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Unexpec= ted error Thread-98::DEBUG::2013-09-11 16:35:09,100::task::869::TaskMa= nager.Task::(_run) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Task._run= : b2a7a44f-8cb0-453a-bf52-16a200f992f9 ('5849b030-626e-47cb-ad90-3ce782d831= b3', 1, '5849b030-626e-47cb-ad90-3ce782d831b3', '3401420d-6918-49f9-b9e2-23= ba47949f29', 1) {} failed - stopping task Thread-98::DEBUG::2013-09-11= 16:35:09,100::task::1194::TaskManager.Task::(stop) Task=3D`b2a7a44f-8cb0-4= 53a-bf52-16a200f992f9`::stopping in state preparing (force False) Thre= ad-98::DEBUG::2013-09-11 16:35:09,101::task::974::TaskManager.Task::(_decre= f) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::ref 1 aborting True = Thread-98::INFO::2013-09-11 16:35:09,101::task::1151::TaskManager.Task::(pr= epare) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::aborting: Task is abo= rted: 'Cannot find master domain' - code 304 Thread-98::DEBUG::2013-09= -11 16:35:09,101::task::1156::TaskManager.Task::(prepare) Task=3D`b2a7a44f-= 8cb0-453a-bf52-16a200f992f9`::Prepare: aborted: Cannot find master domain<b= r />Thread-98::DEBUG::2013-09-11 16:35:09,101::task::974::TaskManager.Task:= :(_decref) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::ref 0 aborting Tr= ue Thread-98::DEBUG::2013-09-11 16:35:09,102::task::909::TaskManager.T= ask::(_doAbort) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::Task._doAbor= t: force False Thread-98::DEBUG::2013-09-11 16:35:09,102::resourceMana= ger::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}<br= />Thread-98::DEBUG::2013-09-11 16:35:09,102::task::579::TaskManager.Task::= (_updateState) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::moving from s= tate preparing -> state aborting Thread-98::DEBUG::2013-09-11 16:35= :09,102::task::534::TaskManager.Task::(__state_aborting) Task=3D`b2a7a44f-8= cb0-453a-bf52-16a200f992f9`::_aborting: recover policy none Thread-98:= :DEBUG::2013-09-11 16:35:09,102::task::579::TaskManager.Task::(_updateState= ) Task=3D`b2a7a44f-8cb0-453a-bf52-16a200f992f9`::moving from state aborting= -> state failed Thread-98::DEBUG::2013-09-11 16:35:09,103::resourc= eManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll request= s {} resources {} Thread-98::DEBUG::2013-09-11 16:35:09,103::resourceM= anager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}= Thread-98::ERROR::2013-09-11 16:35:09,103::dispatcher::67::Storage.Di= spatcher.Protect::(run) {'status': {'message': "Cannot find master domain: = 'spUUID=3D5849b030-626e-47cb-ad90-3ce782d831b3, msdUUID=3D3401420d-6918-49f= 9-b9e2-23ba47949f29'", 'code': 304}} and engine.log = 2013-09-10 16:35:16,652 INFO  [org.ovirt.engine.core.bll.SPMAsyn= cTask] (DefaultQuartzScheduler_Worker-68) BaseAsyncTask::OnTaskEndSuccess: = Task f587a842-272f-4a86-8c15-7451a39a7f42 (Parent Command ImportVm, Paramet= ers Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended= successfully. 2013-09-10 16:35:16,654 INFO  [org.ovirt.engine.co= re.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-68) Task with= DB Task ID a0fc43a0-3f25-4c65-a7e8-8f60762c64c8 and VDSM Task ID 1f3a3700-= cfca-40dd-95b4-28b141756e8e is in state Polling. End action for command f61= efb6b-d3a4-4e04-a79e-3b7c61920ff2 will proceed when all the entitys tasks a= re completed. 2013-09-10 16:35:36,817 INFO  [org.ovirt.engine.cor= e.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) SPMAsyncTask::PollTa= sk: Polling task 1f3a3700-cfca-40dd-95b4-28b141756e8e (Parent Command Impor= tVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParam= eters) returned status finished, result 'success'. 2013-09-10 16:35:36= ,893 INFO  [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzSche= duler_Worker-95) BaseAsyncTask::OnTaskEndSuccess: Task 1f3a3700-cfca-40dd-9= 5b4-28b141756e8e (Parent Command ImportVm, Parameters Type org.ovirt.engine= .core.common.asynctasks.AsyncTaskParameters) ended successfully. 2013-= 09-10 16:35:36,895 INFO  [org.ovirt.engine.core.bll.CommandAsyncTask] = (DefaultQuartzScheduler_Worker-95) CommandAsyncTask::EndActionIfNecessary: = All tasks of command f61efb6b-d3a4-4e04-a79e-3b7c61920ff2 has ended -> e= xecuting EndAction 2013-09-10 16:35:36,896 INFO  [org.ovirt.engin= e.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-95) CommandAsyn= cTask::EndAction: Ending action for 2 tasks (command ID: f61efb6b-d3a4-4e04= -a79e-3b7c61920ff2): calling EndAction . 2013-09-10 16:35:36,899 INFO&= nbsp; [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-48) Comma= ndAsyncTask::EndCommandAction [within thread] context: Attempting to EndAct= ion ImportVm, executionIndex: 0 2013-09-10 16:35:36,919 INFO  [or= g.ovirt.engine.core.bll.ImportVmCommand] (pool-6-thread-48) Ending command = successfully: org.ovirt.engine.core.bll.ImportVmCommand 2013-09-10 16:= 35:36,948 INFO  [org.ovirt.engine.core.bll.CopyImageGroupCommand] (poo= l-6-thread-48) [1c5353e0] Ending command successfully: org.ovirt.engine.cor= e.bll.CopyImageGroupCommand 2013-09-10 16:35:36,971 INFO  [org.ov= irt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-= 48) [1c5353e0] START, GetImageInfoVDSCommand( storagePoolId =3D 5849b030-62= 6e-47cb-ad90-3ce782d831b3, ignoreFailoverLimit =3D false, storageDomainId = =3D 3401420d-6918-49f9-b9e2-23ba47949f29, imageGroupId =3D 8061a702-792f-42= 19-8bf0-8f10ba576c01, imageId =3D 4b2a7aed-bc11-45c8-8bf1-9c195c5a29ab), lo= g id: 51fca824 2013-09-10 16:35:42,430 INFO  [org.ovirt.engine.co= re.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [1c5353e0= ] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.busi= nessentities.DiskImage@285e00dd, log id: 51fca824 2013-09-10 16:35:42,= 449 INFO  [org.ovirt.engine.core.bll.CopyImageGroupCommand] (pool-6-th= read-48) [57faac34] Ending command successfully: org.ovirt.engine.core.bll.= CopyImageGroupCommand 2013-09-10 16:35:42,453 INFO  [org.ovirt.en= gine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [5= 7faac34] START, GetImageInfoVDSCommand( storagePoolId =3D 5849b030-626e-47c= b-ad90-3ce782d831b3, ignoreFailoverLimit =3D false, storageDomainId =3D 340= 1420d-6918-49f9-b9e2-23ba47949f29, imageGroupId =3D 374e7d38-ebfe-4fab-a6ec= -727e9ef9733c, imageId =3D 54e3344d-45f0-4876-b4a9-cdad98fac7a5), log id: 5= 1aaf563 2013-09-10 16:35:56,954 INFO  [org.ovirt.engine.core.vdsb= roker.irsbroker.GetImageInfoVDSCommand] (pool-6-thread-48) [57faac34] FINIS= H, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessent= ities.DiskImage@dd64762e, log id: 51aaf563 2013-09-10 16:35:57,000 INF= O  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-6-thr= ead-48) START, SetVmStatusVDSCommand( vmId =3D dc1ac7da-fef2-48e4-ab91-309b= 3a1fd2c0, status =3D Down), log id: 45208621 2013-09-10 16:35:57,007 I= NFO  [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-6-t= hread-48) FINISH, SetVmStatusVDSCommand, log id: 45208621 2013-09-10 1= 6:35:57,008 INFO  [org.ovirt.engine.core.bll.ImportVmCommand] (pool-6-= thread-48) Lock freed to object EngineLock [exclusiveLocks=3D key: VM1 valu= e: VM_NAME 2013-09-10 16:35:57,051 INFO  [org.ovirt.engine.core.d= al.dbbroker.auditloghandling.AuditLogDirector] (pool-6-thread-48) Correlati= on ID: 62df3606, Job ID: 7134d7b0-7878-4bb3-970f-4128c1e818e7, Call Stack: = null, Custom Event ID: -1, Message: Vm VM1 was imported successfully to Dat= a Center Default, Cluster Default 2013-09-10 16:35:57,053 INFO  [= org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-48) CommandAsync= Task::HandleEndActionResult [within thread]: EndAction for action type Impo= rtVm completed, handling the result. 2013-09-10 16:35:57,054 INFO&nbsp= ; [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-48) CommandAs= yncTask::HandleEndActionResult [within thread]: EndAction for action type I= mportVm succeeded, clearing tasks. 2013-09-10 16:35:57,068 INFO  = [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-6-thread-48) SPMAsyncTask::C= learAsyncTask: Attempting to clear task f587a842-272f-4a86-8c15-7451a39a7f4= 2 2013-09-10 16:35:57,070 INFO  [org.ovirt.engine.core.vdsbroker.= irsbroker.SPMClearTaskVDSCommand] (pool-6-thread-48) START, SPMClearTaskVDS= Command( storagePoolId =3D 5849b030-626e-47cb-ad90-3ce782d831b3, ignoreFail= overLimit =3D false, taskId =3D f587a842-272f-4a86-8c15-7451a39a7f42), log = id: 57f89137 2013-09-10 16:35:57,102 INFO  [org.ovirt.engine.core= .vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-6-thread-48) START, HSMC= learTaskVDSCommand(HostName =3D HOST1, HostId =3D 6593afcd-9e7f-4928-a914-5= ad1eeaa3999, taskId=3Df587a842-272f-4a86-8c15-7451a39a7f42), log id: 5df00<= br />2013-09-11 16:35:01,795 INFO  [org.ovirt.engine.core.bll.InitVdsO= nUpCommand] (DefaultQuartzScheduler_Worker-81) Running command: InitVdsOnUp= Command internal: true. Entities affected :  ID: 5849b030-626e-47cb-ad= 90-3ce782d831b3 Type: StoragePool 2013-09-11 16:35:01,799 INFO  [= org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (= DefaultQuartzScheduler_Worker-81) Running command: ConnectHostToStoragePool= ServersCommand internal: true. Entities affected :  ID: 5849b030-626e-= 47cb-ad90-3ce782d831b3 Type: StoragePool 2013-09-11 16:35:01,854 INFO&= nbsp; [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSComma= nd] (pool-6-thread-50) START, ConnectStoragePoolVDSCommand(HostName =3D BBG= LU012, HostId =3D 6593afcd-9e7f-4928-a914-5ad1eeaa3999, storagePoolId =3D 5= 849b030-626e-47cb-ad90-3ce782d831b3, vds_spm_id =3D 1, masterDomainId =3D 3= 401420d-6918-49f9-b9e2-23ba47949f29, masterVersion =3D 1), log id: 14e339aa= 2013-09-11 16:35:09,112 INFO  [org.ovirt.engine.core.vdsbroker.v= dsbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) Command org.ovirt= .engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand return value<= br />2013-09-11 16:35:09,114 INFO  [org.ovirt.engine.core.vdsbroker.vd= sbroker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) HostName =3D HOST1= 2013-09-11 16:35:09,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbro= ker.ConnectStoragePoolVDSCommand] (pool-6-thread-50) Command ConnectStorage= PoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGeneric= Exception: IRSErrorException: IRSNoMasterDomainException: Cannot find maste= r domain: 'spUUID=3D5849b030-626e-47cb-ad90-3ce782d831b3, msdUUID=3D3401420= d-6918-49f9-b9e2-23ba47949f29' 2013-09-11 16:35:09,115 INFO  [org= .ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (pool-= 6-thread-50) FINISH, ConnectStoragePoolVDSCommand, log id: 14e339aa 20= 13-09-11 16:35:09,116 ERROR [org.ovirt.engine.core.bll.InitVdsOnUpCommand] = (pool-6-thread-50) Could not connect host HOST1 to pool Default 2013-0= 9-11 16:35:09,184 INFO  [org.ovirt.engine.core.bll.SetNonOperationalVd= sCommand] (DefaultQuartzScheduler_Worker-81) Running command: SetNonOperati= onalVdsCommand internal: true. Entities affected :  ID: 6593afcd-9e7f-= 4928-a914-5ad1eeaa3999 Type: VDS 2013-09-11 16:35:09,207 INFO  [o= rg.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzSchedu= ler_Worker-81) START, SetVdsStatusVDSCommand(HostName =3D HOST1, HostId =3D= 6593afcd-9e7f-4928-a914-5ad1eeaa3999, status=3DNonOperational, nonOperatio= nalReason=3DSTORAGE_DOMAIN_UNREACHABLE), log id: 3c9dbd47 2013-09-11 1= 6:35:09,217 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSComm= and] (DefaultQuartzScheduler_Worker-81) FINISH, SetVdsStatusVDSCommand, log= id: 3c9dbd47 2013-09-11 16:35:09,225 INFO  [org.ovirt.engine.cor= e.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_W= orker-81) Correlation ID: 64e68249, Job ID: 355b71e9-f7b9-4554-800b-7b08a09= d9a12, Call Stack: null, Custom Event ID: -1, Message: Host HOST1 cannot ac= cess one of the Storage Domains attached to the Data Center Default. Settin= g Host state to Non-Operational. 2013-09-11 16:35:09,266 INFO  [o= rg.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (Defau= ltQuartzScheduler_Worker-81) Correlation ID: null, Call Stack: null, Custom= Event ID: -1, Message: Power Management test failed for Host BBGLU012.Ther= e is no other host in the data center that can be used to test the power ma= nagement settings. 2013-09-11 16:35:09,275 INFO  [org.ovirt.engin= e.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzSchedu= ler_Worker-81) Correlation ID: 1a32fa26, Call Stack: null, Custom Event ID:= -1, Message: Failed to connect Host HOST1 to Storage Pool Default 201= 3-09-11 16:35:09,320 INFO  [org.ovirt.engine.core.bll.HandleVdsCpuFlag= sOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-81) Running comman= d: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affect= ed :  ID: 6593afcd-9e7f-4928-a914-5ad1eeaa3999 Type: VDS 2013-09-= 11 16:35:09,352 INFO  [org.ovirt.engine.core.bll.HandleVdsVersionComma= nd] (DefaultQuartzScheduler_Worker-81) Running command: HandleVdsVersionCom= mand internal: true. Entities affected :  ID: 6593afcd-9e7f-4928-a914-= 5ad1eeaa3999 Type: VDS 2013-09-11 16:35:09,354 INFO  [org.ovirt.e= ngine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-8= 1) Host 6593afcd-9e7f-4928-a914-5ad1eeaa3999 : HOST1 is already in NonOpera= tional status. SetNonOperationalVds command is skipped. [root@bbgpas12= 9 ovirt-engine]# 2013-09-11 16:35:09,184 INFO  [org.ovirt.engine.core.= bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-81) Running= command: SetNonOperationalVdsCommand internal: true. Entities affected :&n= bsp; ID: 6593afcd-9e7f-4928-a914-5ad1eeaa3999 Type: VDS =C2=A0</= span> --========GMXBoundary239291378911044835950--

3 2

Re: [Users] single VM disappeared
by Hans-Joachim 16 Sep '13

16 Sep '13

--========GMXBoundary20094137905613272421 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Hi, Yesterday, I opened a ticket too... Sorry https://bugzilla.redhat.com/show_bug.cgi?id=1007427 Hans-Joachim --========GMXBoundary20094137905613272421 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, Yesterday, I opened a ticket too... Sorry <a href=3D"http= s://bugzilla.redhat.com/show_bug.cgi?id=3D1007427" target=3D"_blank">= https://bugzilla.redhat.com/show_bug.cgi?id=3D1007427</a> Hans-Joachim --========GMXBoundary20094137905613272421--

7 8

[Users] Languages in drop down of admin portal 3.3.0
by Gianluca Cecchi 16 Sep '13

16 Sep '13

In notice this from a firefox in CentOS 6.4: https://docs.google.com/file/d/0BwoPbcrMv8mvc084bUUycm45RWc/edit?usp=sharing I'm using f19 for engine enabling beta repo, that today provided ovirt-engine-3.3.0-4.fc19.noarch BTW: nice to see some more languages; how can I help to have Italian put in...? Gianluca

2 3

[Users] page layout scrambled in 3.3?
by Gianluca Cecchi 16 Sep '13

16 Sep '13

Firefox on CentOS 6.4 ( version firefox-17.0.8-1.el6.centos.x86_64) gives these kinds of layout, just after engine-setup phase. This is when selecting "Default" datacenter icon: https://docs.google.com/file/d/0BwoPbcrMv8mvVGhxck9kTGJtLXc/edit?usp=sharing This is when I select the main "System" icon: https://docs.google.com/file/d/0BwoPbcrMv8mvcU11czRsTW1yX1k/edit?usp=sharing the engine is freshly installed fedora 19 where to day I ran update and engine-setup after enabling beta ovirt repo (ovirt-engine-3.3.0-4.fc19.noarch installed) Anyone else? What would be recommended browser for upcoming 3.3 and its version? Thanks, Gianluca

4 5

[Users] Native GlusterFs Storage domain and prereqs
by Sven Knohsalla 16 Sep '13

16 Sep '13

--_000_DC9ABD90CB55EC448B1F682D5731AF7407AC9F2F55IAD2MBX17mex0_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi, I'm very interested in using libgfapi to get rid of the FUSE overhead, as r= ead here: http://www.ovirt.org/Features/GlusterFS_Storage_Domain The pre-reqs for HVs are: - libvirt version 1.0.1 - qemu version 1.3 Currently I just can find these packages for fc19, I'm running FC18 based n= odes with older packages (productive, not testing). So, am I right in this position I need to migrate to fc19 based hosts for t= his functionality? I'm running an oVirt Engine with version 3.2.1-1.fc18, here I don't have th= e option to choose GlusterFS_Domain, just POSIXFS. Which version do I need here ? Thanks in advance! Best, Sven. Sven Knohsalla | System Administration Office +49 631 68036 433 | Fax +49 631 68036 111 |E-Mail s.knohsalla@netbi= scuits.com | Skype: netbiscuits.admin Netbiscuits GmbH | Europaallee 10 | 67657 | GERMANY [https://my.netbiscuits.com/image/image_gallery?uuid=3D3a1a9d19-c305-4032-8= cef-00b03c3d4c79&groupId=3D10211&t=3D1361534926402]<http://www.netbiscuits.= com/> [https://my.netbiscuits.com/image/image_gallery?uuid=3D9e553e7b-3e7d-4784-= b274-15aa1dfb48e2&groupId=3D10211&t=3D1361533377340] <https://www.netbiscui= ts.com/news> [https://my.netbiscuits.com/image/image_gallery?uuid=3D1d1a5e= 29-ceda-4ab1-9353-67a1e838364d&groupId=3D10211&t=3D1347281040591] <https://= twitter.com/netbiscuits> [https://my.netbiscuits.com/image/image_gallery?u= uid=3Dc99bf866-be25-4236-a0ee-dca68ec828a5&groupId=3D10211&t=3D134728098384= 8] <http://www.linkedin.com/company/netbiscuits> [https://my.netbiscuits.c= om/image/image_gallery?uuid=3Dd62ba951-14dc-450d-b5f1-be33884225e3&groupId= =3D10211&t=3D1347280983872] <http://www.xing.com/companies/netbiscuitsgmbh>= [https://my.netbiscuits.com/image/image_gallery?uuid=3D7b28f500-f415-40bb= -851f-0cd55beeaf45&groupId=3D10211&t=3D1347280983791] <https://www.facebook= .com/Netbiscuits> [https://my.netbiscuits.com/image/image_gallery?uuid=3Dc= c8764d0-a5ac-4623-bb63-da3ca7c97f94&groupId=3D10211&t=3D1347280983836] <htt= ps://plus.google.com/u/0/112410769451962733032> [https://my.netbiscuits.co= m/image/image_gallery?uuid=3Da15e871c-a11b-419c-acca-da5a0ebd5856&groupId= =3D10211&t=3D1347281040599] <http://www.youtube.com/user/netbiscuits> Register Court: Local Court Kaiserslautern | Commercial Register ID: HR B 3= 604 Management Board: Guido Moggert, Michael Neidh=F6fer, Christian Reitz, Mart= in S=FC=DF This message and any files transmitted with it are confidential and intende= d solely for the use of the individual or entity to whom they are addressed= . It may also be privileged or otherwise protected by work product immunity= or other legal rules. Please notify the sender immediately by e-mail if yo= u have received this e-mail by mistake and delete this e-mail from your sys= tem. If you are not the intended recipient you are notified that disclosing= , copying, distributing or taking any action in reliance on the contents of= this information is strictly prohibited. Warning: Although Netbiscuits has taken reasonable precautions to ensure no= viruses are present in this email, the company cannot accept responsibilit= y for any loss or damage arising from the use of this email or attachments. [http://www.netbiscuits.com/image/image_gallery?uuid=3D0ba7711a-a277-4ea0-a= cb0-17fe13c3089d&groupId=3D10211&t=3D1348560850164]Please consider the envi= ronment before printing --_000_DC9ABD90CB55EC448B1F682D5731AF7407AC9F2F55IAD2MBX17mex0_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"><head><meta http-equiv=3DContent-Type content= =3D"text/html; charset=3Diso-8859-1"><meta name=3DGenerator content=3D"Micr= osoft Word 15 (filtered medium)"><style></style></head><body lang=3DDE link=3D"#0563C1" v= link=3D"#954F72"><div class=3DWordSection1>Hi,<o:p></o:p><= o:p> </o:p>I’= m very interested in using libgfapi to get rid of the FUSE overhead, as rea= d here: <a href=3D"http://www.ovirt.org/Features/GlusterFS_Storage_Domai= n">http://www.ovirt.org/Features/GlusterFS_Storage_Domain</a><o:p></o:p></s= pan><o:p> </o:p></p= >The pre-reqs for HVs are:<o:p></o:= p><![if !supportLists]>-  =         <![endif]><= span lang=3DEN-US>libvirt version 1.0.1<o:p></o:p><![if != supportLists]>-      &nb= sp;   <![endif]>qemu vers= ion 1.3<o:p></o:p><o:p>&= nbsp;</o:p>Currently I j= ust can find these packages for fc19, I’m running FC18 based nodes wi= th older packages (productive, not testing).<o:p></o:p>So, am I right in this position I need to m= igrate to fc19 based hosts for this functionality?<o:p></o:p><o:p> </o:p>I’m running an oVirt Engine with version = 3.2.1-1.fc18, here I don’t have the opt= ion to choose GlusterFS_Domain, just POSIXFS.<o:p></o:p><= p class=3DMsoNormal>Which = version do I need here ?<o:p></o:p><= span class=3Dgwt-inlinelabel><o:p> </o:p></s= pan>Thanks in advance!<o:p></o:p><spa= n class=3Dgwt-inlinelabel><o:p> </o:p></span= >= Best, Sven.<o:p></o:p> <o:p></o:p>Sven = Knohsalla | System Administration<o:p></o:p><= span lang=3DEN-US style=3D'color:gray;mso-fareast-language:DE'><o:p> <= /o:p>Office +49 631 68036 433 | Fax= +49 631 68036 111=A0 |E-Mail s.knohsalla@net= biscuits.com | Skype: netbiscuits.admin</span= > <o:p></o:p>Netbiscuits GmbH | Europaal= lee 10 | 67657 | GERMANY<o:p></o:p><o:p> </= o:p><a href=3D"http://www.netbiscuits.com/"= ><i= mg border=3D0 width=3D231 height=3D38 id=3D"_x0000_i1033" src=3D"https://my= .netbiscuits.com/image/image_gallery?uuid=3D3a1a9d19-c305-4032-8cef-00b03c3= d4c79&groupId=3D10211&t=3D1361534926402" alt=3D"https://my.netbiscu= its.com/image/image_gallery?uuid=3D3a1a9d19-c305-4032-8cef-00b03c3d4c79&amp= ;groupId=3D10211&t=3D1361534926402"></a><o:p></o:p><sp= an lang=3DEN-US style=3D'mso-fareast-language:DE'><o:p> </o:p><= /p> <a href=3D"https://www.netbiscuits.com/news"><sp= an style=3D'color:windowtext;mso-fareast-language:DE;text-decoration:none'>= <img border=3D0 width=3D24 height=3D24 id=3D"_x0000_i1032" src=3D"https://m= y.netbiscuits.com/image/image_gallery?uuid=3D9e553e7b-3e7d-4784-b274-15aa1d= fb48e2&groupId=3D10211&t=3D1361533377340" alt=3D"https://my.netbisc= uits.com/image/image_gallery?uuid=3D3031deca-7e56-4417-9822-3d6d72f71ef0&am= p;groupId=3D10211&t=3D1347280983812"></a> <a href=3D"https://t= witter.com/netbiscuits"><img border=3D0 width=3D24 height=3D24 id=3D"_x0= 000_i1031" src=3D"https://my.netbiscuits.com/image/image_gallery?uuid=3D1d1= a5e29-ceda-4ab1-9353-67a1e838364d&groupId=3D10211&t=3D1347281040591= " alt=3D"https://my.netbiscuits.com/image/image_gallery?uuid=3D1d1a5e29-ced= a-4ab1-9353-67a1e838364d&groupId=3D10211&t=3D1347281040591">= </a> = <a href=3D"http://www.linkedin.com/company/netbiscuits"><img bor= der=3D0 width=3D24 height=3D24 id=3D"_x0000_i1030" src=3D"https://my.netbis= cuits.com/image/image_gallery?uuid=3Dc99bf866-be25-4236-a0ee-dca68ec828a5&a= mp;groupId=3D10211&t=3D1347280983848" alt=3D"https://my.netbiscuits.com= /image/image_gallery?uuid=3Dc99bf866-be25-4236-a0ee-dca68ec828a5&groupI= d=3D10211&t=3D1347280983848"></a> <a href=3D"http://www.xing.c= om/companies/netbiscuitsgmbh"><img border=3D0 width=3D24 height=3D24 id= =3D"_x0000_i1029" src=3D"https://my.netbiscuits.com/image/image_gallery?uui= d=3Dd62ba951-14dc-450d-b5f1-be33884225e3&groupId=3D10211&t=3D134728= 0983872" alt=3D"https://my.netbiscuits.com/image/image_gallery?uuid=3Dd62ba= 951-14dc-450d-b5f1-be33884225e3&groupId=3D10211&t=3D1347280983872">= </a> <a href=3D"https://www.facebook.com/Netbiscuits"><img bor= der=3D0 width=3D24 height=3D24 id=3D"_x0000_i1028" src=3D"https://my.netbis= cuits.com/image/image_gallery?uuid=3D7b28f500-f415-40bb-851f-0cd55beeaf45&a= mp;groupId=3D10211&t=3D1347280983791" alt=3D"https://my.netbiscuits.com= /image/image_gallery?uuid=3D7b28f500-f415-40bb-851f-0cd55beeaf45&groupI= d=3D10211&t=3D1347280983791"></a> <a href=3D"https://plus.goog= le.com/u/0/112410769451962733032"><img border=3D0 width=3D24 height=3D24= id=3D"_x0000_i1027" src=3D"https://my.netbiscuits.com/image/image_gallery?= uuid=3Dcc8764d0-a5ac-4623-bb63-da3ca7c97f94&groupId=3D10211&t=3D134= 7280983836" alt=3D"https://my.netbiscuits.com/image/image_gallery?uuid=3Dcc= 8764d0-a5ac-4623-bb63-da3ca7c97f94&groupId=3D10211&t=3D134728098383= 6"></a> <a href=3D"http://www.youtube.com/user/netbiscuits"><im= g border=3D0 width=3D24 height=3D24 id=3D"_x0000_i1026" src=3D"https://my.n= etbiscuits.com/image/image_gallery?uuid=3Da15e871c-a11b-419c-acca-da5a0ebd5= 856&groupId=3D10211&t=3D1347281040599" alt=3D"https://my.netbiscuit= s.com/image/image_gallery?uuid=3Da15e871c-a11b-419c-acca-da5a0ebd5856&g= roupId=3D10211&t=3D1347281040599"></a> <o:p></o:p>Register Court: Local Court Kaiserslaute= rn | Commercial Register ID: HR B 3604 Management Board: G= uido Moggert, Michael Neidh=F6fer, Christian Reitz, Martin S=FC=DF<o:p></o:= p><o:p> </o:p>This message and any files transmitted with it are = confidential and intended solely for the use of the individual or entity to= whom they are addressed. It may also be privileged or otherwise protected = by work product immunity or other legal rules. Please notify the sender imm= ediately by e-mail if you have received this e-mail by mistake and delete t= his e-mail from your system. If you are not the intended recipient you are = notified that disclosing, copying, distributing or taking any action in rel= iance on the contents of this information is strictly prohibited.<o:p></o:p= >Warning: Although Netbiscuits has = taken reasonable precautions to ensure no viruses are present in this email= , the company cannot accept responsibility for any loss or damage arising f= rom the use of this email or attachments.<o:p></o:p><o:p> </o:p><img border=3D= 0 width=3D33 height=3D19 id=3D"_x0000_i1025" src=3D"http://www.netbiscuits.= com/image/image_gallery?uuid=3D0ba7711a-a277-4ea0-acb0-17fe13c3089d&gro= upId=3D10211&t=3D1348560850164" alt=3D"Beschreibung: Beschreibung: http= ://www.netbiscuits.com/image/image_gallery?uuid=3D0ba7711a-a277-4ea0-acb0-1= 7fe13c3089d&groupId=3D10211&t=3D1348560850164">Pleas= e consider the environment before printing<o:p></o:p><o:p> </o:p></div></body></htm= l>= --_000_DC9ABD90CB55EC448B1F682D5731AF7407AC9F2F55IAD2MBX17mex0_--

3 2