- Users - oVirt List Archives

self hosted engine add second host - maintenance mode needed?
by Mike 22 Feb '15

22 Feb '15

Hi Got a running self hosted install with VMs running on the host, now adding a second host to get ha for the engine & VMs. Do I need to put the engine into maintenance mode before running hosted-engine --deploy on new host node? Thanks Mike

3 2

Problem with Neutron + Ovirt 3.5.1 [Centos 7]
by Eduardo Terzella 22 Feb '15

22 Feb '15

Good night, I'm trying oVirt 3.5 + neutron appliance in BareMetal servers, but I am facing some problems. structure: 2 servers with: oVirt 3.5.1 hundreds 7 4 network adapter int = 0 + int2 bond0 => public network => ovirtmgmt int = 1 + int3 bond1 => private network => neutron Virtual Appliance Neutron: http://www.ovirt.org/Features/NeutronVirtualAppliance NOTE: All steps were followed, and checked several times. Openvswitch configuration: *[root@ovirt01 network-scripts]# ovs-vsctl show* 62feffa7-3f3a-48f7-9299-0830ebcd8fd8 Bridge br-neutron Port phy-br-neutron Interface phy-br-neutron Port br-neutron Interface br-neutron type: internal Port neutron Interface neutron Bridge br-int fail_mode: secure Port int-br-neutron Interface int-br-neutron Port "qvof206e358-8f" tag: 1 Interface "qvof206e358-8f" Port br-int Interface br-int type: internal ovs_version: "2.1.3" *[root@ovirt02 /]# ovs-vsctl show* 9d40dda2-62ea-4538-9f82-d5babff0837b Bridge br-int fail_mode: secure Port "qvo723ce1c1-56" tag: 1 Interface "qvo723ce1c1-56" Port int-br-neutron Interface int-br-neutron Port br-int Interface br-int type: internal Bridge br-neutron Port br-neutron Interface br-neutron type: internal Port neutron Interface neutron Port phy-br-neutron Interface phy-br-neutron ovs_version: "2.1.3" *[root@ovirt01 /]# ovs-dpctl show* system@ovs-system: lookups: hit:1946392 missed:6566 lost:1 flows: 4 masks: hit:2490944 total:2 hit/pkt:1.28 port 0: ovs-system (internal) port 1: br-neutron (internal) port 2: br-int (internal) port 3: neutron port 4: int-br-neutron port 5: phy-br-neutron port 7: qvof206e358-8f *[root@ovirt02 /]# ovs-dpctl show* system@ovs-system: lookups: hit:2041047 missed:6445 lost:0 flows: 4 masks: hit:2234366 total:2 hit/pkt:1.09 port 0: ovs-system (internal) port 1: br-neutron (internal) port 2: br-int (internal) port 3: int-br-neutron port 4: phy-br-neutron port 5: neutron port 6: qvo723ce1c1-56 *Testing:* Connectivity between my virtual machines only work when both are running on the same node, when virtual machines are running on different hosts can not make a machine ping the other. *Tcpdump:* *[root@ovirt01 network-scripts]# tcpdump -e -i neutron -p -n not port nfs* tcpdump: WARNING: neutron: no IPv4 address assigned tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on neutron, link-type EN10MB (Ethernet), capture size 65535 bytes 16:57:25.469628 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:26.469565 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:28.469910 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:29.469479 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:30.469472 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:32.469715 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:33.469374 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:34.469367 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:36.469617 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:37.469251 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 16:57:38.469258 00:1a:4a:2c:3f:02 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.4 tell 192.168.100.2, length 28 *[root@ovirt02 /]# tcpdump -e -i neutron -p -n not port nfs* tcpdump: WARNING: neutron: no IPv4 address assigned tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on neutron, link-type EN10MB (Ethernet), capture size 65535 bytes 16:57:23.188238 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:24.187726 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:25.187781 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:27.189224 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:28.188720 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:29.188715 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:31.190152 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:32.189646 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:33.189622 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:35.190959 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:36.190585 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:37.190544 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:39.191885 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:40.191492 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28 16:57:41.191511 00:1a:4a:2c:3f:03 > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 1024, p 0, ethertype ARP, Request who-has 192.168.100.2 tell 192.168.100.4, length 28

2 3

Still blocked...
by Pascal Jakobi 21 Feb '15

21 Feb '15

This is a multi-part message in MIME format. --------------070200090500010505040401 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi there Still stuck when creating an NFS storage domain with an AIO installation. Below is the engine trace. Can someone say what means that 351 error ? Many thanks in advance P PS. I could observe that the NFS mount is done. Ovirt fails afterward. 2015-02-19 10:53:23,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] Lock Acquired to object EngineLock [exclusiveLocks= key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION , sharedLocks= ] 2015-02-19 10:53:23,875 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2015-02-19 10:53:23,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] START, ConnectStorageServerVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: spirou.jakobi.fr:/var/lib/nfs/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7e2f307b 2015-02-19 10:53:29,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7e2f307b 2015-02-19 10:53:29,169 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] Lock freed to object EngineLock [exclusiveLocks= key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION , sharedLocks= ] 2015-02-19 10:53:34,250 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2015-02-19 10:53:34,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] START, ConnectStorageServerVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 7bc8d667-ae81-4462-b825-daebfba2b0bd, connection: spirou.jakobi.fr:/var/lib/nfs/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1d8d975 2015-02-19 10:53:34,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] FINISH, ConnectStorageServerVDSCommand, return: {7bc8d667-ae81-4462-b825-daebfba2b0bd=0}, log id: 1d8d975 2015-02-19 10:53:34,274 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] START, CreateStorageDomainVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storageDomain=StorageDomainStatic[Store, 4bb1e26a-a59b-41f2-b0c5-99a0a55837df], args=spirou.jakobi.fr:/var/lib/nfs/data), log id: 254d3442 2015-02-19 10:53:34,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Failed in CreateStorageDomainVDS method 2015-02-19 10:53:34,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=351, mMessage=Error creating a storage domain: (u'storageType=1, sdUUID=4bb1e26a-a59b-41f2-b0c5-99a0a55837df, domainName=Store, domClass=1, typeSpecificArg=spirou.jakobi.fr:/var/lib/nfs/data domVersion=3',)]] 2015-02-19 10:53:34,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] HostName = lab1 2015-02-19 10:53:34,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command CreateStorageDomainVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storageDomain=StorageDomainStatic[Store, 4bb1e26a-a59b-41f2-b0c5-99a0a55837df], args=spirou.jakobi.fr:/var/lib/nfs/data) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Error creating a storage domain: (u'storageType=1, sdUUID=4bb1e26a-a59b-41f2-b0c5-99a0a55837df, domainName=Store, domClass=1, typeSpecificArg=spirou.jakobi.fr:/var/lib/nfs/data domVersion=3',), code = 351 2015-02-19 10:53:34,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] FINISH, CreateStorageDomainVDSCommand, log id: 254d3442 *2015-02-19 10:53:34,448 ERROR [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Error creating a storage domain: (u'storageType=1, sdUUID=4bb1e26a-a59b-41f2-b0c5-99a0a55837df, domainName=Store, domClass=1, typeSpecificArg=spirou.jakobi.fr:/var/lib/nfs/data domVersion=3',), code = 351 (Failed with error StorageDomainCreationError and code 351)* 2015-02-19 10:53:34,449 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command [id=a20bdf09-e2d3-41aa-a0ab-fc2c10bdbed6]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainDynamic; snapshot: 4bb1e26a-a59b-41f2-b0c5-99a0a55837df. 2015-02-19 10:53:34,450 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command [id=a20bdf09-e2d3-41aa-a0ab-fc2c10bdbed6]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: 4bb1e26a-a59b-41f2-b0c5-99a0a55837df. 2015-02-19 10:53:34,469 ERROR [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand. 2015-02-19 10:53:34,482 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [47bf1185] Correlation ID: 47bf1185, Job ID: e5e52e53-8501-4dec-a5b0-20780183d522, Call Stack: null, Custom Event ID: -1, Message: Failed to add Storage Domain Store. (User: admin@internal) 2015-02-19 10:53:49,050 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Lock Acquired to object EngineLock [exclusiveLocks= key: 7bc8d667-ae81-4462-b825-daebfba2b0bd value: STORAGE_CONNECTION key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION , sharedLocks= ] 2015-02-19 10:53:49,088 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2015-02-19 10:53:49,101 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Removing connection 7bc8d667-ae81-4462-b825-daebfba2b0bd from database 2015-02-19 10:53:49,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-8) [7588445e] START, DisconnectStorageServerVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 7bc8d667-ae81-4462-b825-daebfba2b0bd, connection: spirou.jakobi.fr:/var/lib/nfs/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b7d6be4 2015-02-19 10:53:49,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-8) [7588445e] FINISH, DisconnectStorageServerVDSCommand, return: {7bc8d667-ae81-4462-b825-daebfba2b0bd=0}, log id: 5b7d6be4 2015-02-19 10:53:49,248 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Lock freed to object EngineLock [exclusiveLocks= key: 7bc8d667-ae81-4462-b825-daebfba2b0bd value: STORAGE_CONNECTION key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION , sharedLocks= ] --------------070200090500010505040401 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> Hi there<br> <br> Still stuck when creating an NFS storage domain with an AIO installation. Below is the engine trace. Can someone say what means that 351 error ?<br> <br> Many thanks in advance<br> P<br> PS. I could observe that the NFS mount is done. Ovirt fails afterward.<br> <br> 2015-02-19 10:53:23,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] Lock Acquired to object EngineLock [exclusiveLocks= key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION<br> , sharedLocks= ]<br> 2015-02-19 10:53:23,875 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN<br> 2015-02-19 10:53:23,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] START, ConnectStorageServerVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: spirou.jakobi.fr:/var/lib/nfs/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7e2f307b<br> 2015-02-19 10:53:29,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7e2f307b<br> 2015-02-19 10:53:29,169 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-1) [2c3317b1] Lock freed to object EngineLock [exclusiveLocks= key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION<br> , sharedLocks= ]<br> 2015-02-19 10:53:34,250 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN<br> 2015-02-19 10:53:34,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] START, ConnectStorageServerVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 7bc8d667-ae81-4462-b825-daebfba2b0bd, connection: spirou.jakobi.fr:/var/lib/nfs/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1d8d975<br> 2015-02-19 10:53:34,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] FINISH, ConnectStorageServerVDSCommand, return: {7bc8d667-ae81-4462-b825-daebfba2b0bd=0}, log id: 1d8d975<br> 2015-02-19 10:53:34,274 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] START, CreateStorageDomainVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storageDomain=StorageDomainStatic[Store, 4bb1e26a-a59b-41f2-b0c5-99a0a55837df], args=spirou.jakobi.fr:/var/lib/nfs/data), log id: 254d3442<br> 2015-02-19 10:53:34,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Failed in CreateStorageDomainVDS method<br> 2015-02-19 10:53:34,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value<br> StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=351, mMessage=Error creating a storage domain: (u'storageType=1, sdUUID=4bb1e26a-a59b-41f2-b0c5-99a0a55837df, domainName=Store, domClass=1, typeSpecificArg=spirou.jakobi.fr:/var/lib/nfs/data domVersion=3',)]]<br> 2015-02-19 10:53:34,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] HostName = lab1<br> 2015-02-19 10:53:34,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command CreateStorageDomainVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storageDomain=StorageDomainStatic[Store, 4bb1e26a-a59b-41f2-b0c5-99a0a55837df], args=spirou.jakobi.fr:/var/lib/nfs/data) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Error creating a storage domain: (u'storageType=1, sdUUID=4bb1e26a-a59b-41f2-b0c5-99a0a55837df, domainName=Store, domClass=1, typeSpecificArg=spirou.jakobi.fr:/var/lib/nfs/data domVersion=3',), code = 351<br> 2015-02-19 10:53:34,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-7) [47bf1185] FINISH, CreateStorageDomainVDSCommand, log id: 254d3442<br> <b>2015-02-19 10:53:34,448 ERROR [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Error creating a storage domain: (u'storageType=1, sdUUID=4bb1e26a-a59b-41f2-b0c5-99a0a55837df, domainName=Store, domClass=1, typeSpecificArg=spirou.jakobi.fr:/var/lib/nfs/data domVersion=3',), code = 351 (Failed with error StorageDomainCreationError and code 351)</b><br> 2015-02-19 10:53:34,449 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command [id=a20bdf09-e2d3-41aa-a0ab-fc2c10bdbed6]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainDynamic; snapshot: 4bb1e26a-a59b-41f2-b0c5-99a0a55837df.<br> 2015-02-19 10:53:34,450 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Command [id=a20bdf09-e2d3-41aa-a0ab-fc2c10bdbed6]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: 4bb1e26a-a59b-41f2-b0c5-99a0a55837df.<br> 2015-02-19 10:53:34,469 ERROR [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-7) [47bf1185] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand.<br> 2015-02-19 10:53:34,482 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [47bf1185] Correlation ID: 47bf1185, Job ID: e5e52e53-8501-4dec-a5b0-20780183d522, Call Stack: null, Custom Event ID: -1, Message: Failed to add Storage Domain Store. (User: admin@internal)<br> 2015-02-19 10:53:49,050 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Lock Acquired to object EngineLock [exclusiveLocks= key: 7bc8d667-ae81-4462-b825-daebfba2b0bd value: STORAGE_CONNECTION<br> key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION<br> , sharedLocks= ]<br> 2015-02-19 10:53:49,088 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN<br> 2015-02-19 10:53:49,101 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Removing connection 7bc8d667-ae81-4462-b825-daebfba2b0bd from database<br> 2015-02-19 10:53:49,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-8) [7588445e] START, DisconnectStorageServerVDSCommand(HostName = lab1, HostId = c291c28b-3c3e-49f1-94c5-be0078e7b014, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 7bc8d667-ae81-4462-b825-daebfba2b0bd, connection: spirou.jakobi.fr:/var/lib/nfs/data, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b7d6be4<br> 2015-02-19 10:53:49,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-8) [7588445e] FINISH, DisconnectStorageServerVDSCommand, return: {7bc8d667-ae81-4462-b825-daebfba2b0bd=0}, log id: 5b7d6be4<br> 2015-02-19 10:53:49,248 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [7588445e] Lock freed to object EngineLock [exclusiveLocks= key: 7bc8d667-ae81-4462-b825-daebfba2b0bd value: STORAGE_CONNECTION<br> key: spirou.jakobi.fr:/var/lib/nfs/data value: STORAGE_CONNECTION<br> , sharedLocks= ]<br> <br> </body> </html> --------------070200090500010505040401--

2 1

Slow storage migration towards nfs
by Tobias Fiebig 21 Feb '15

21 Feb '15

Heho, I currently move some vms from fcal-store to nfs, so i can restructure the fcal storage. However, i noticed, that dd is running with oflag=direct. I/o is currently very slow (~160mbit) on the nfs-servers network. Starting dd without oflag=direct leads to link-speed transmission (~1gbit/s). So... is this intended beheaviour? With best Regards, Tobias

1 1

Re: [ovirt-users] Unable to run noVNC console un recent browsers
by Donny Davis 20 Feb '15

20 Feb '15

No, I made my life easy and used nginx to proxy for the websocket. I was then able to use my commercial ssl cert to avoid all of these issues. Using a proxy for a proxy has been working out quite well for cloudspin, because I don't have to mess with anything internal to the engine and noVNC works without issue. DonnyD -----Original Message----- From: Simone Tiraboschi [mailto:stirabos@redhat.com] Sent: Friday, February 20, 2015 7:03 AM To: Donny Davis Subject: Re: [ovirt-users] Unable to run noVNC console un recent browsers ----- Original Message ----- > From: "Donny Davis" <donny(a)cloudspin.me> > To: "Simone Tiraboschi" <stirabos(a)redhat.com> > Sent: Friday, February 20, 2015 2:23:56 PM > Subject: RE: [ovirt-users] Unable to run noVNC console un recent > browsers > > Is your websocket proxy on the same machine as your engine. I also get > the CA error when the time it off. The proxy throws the error to > /var/log/messages Hi Donny, I'm using the proxy on the same machine where the engine runs. No error till now no my side. I also trusted oVirt internal CA to sign other certs in my browser. Did you? You can find it at https://{engine}/ca.crt You should download it and add to the list of trusted certification authorities in your browser. > -----Original Message----- > From: users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] On > Behalf Of Simone Tiraboschi > Sent: Friday, February 20, 2015 5:57 AM > To: Stefano Danzi > Cc: users(a)ovirt.org > Subject: Re: [ovirt-users] Unable to run noVNC console un recent > browsers > > > > ----- Original Message ----- > > From: "Stefano Danzi" <s.danzi(a)hawai.it> > > To: "Darrell Budic" <budic(a)onholyground.com> > > Cc: users(a)ovirt.org > > Sent: Friday, February 20, 2015 9:07:51 AM > > Subject: Re: [ovirt-users] Unable to run noVNC console un recent > > browsers > > > > Hello! > > Already done but this didn't help. > > > > I downloaded a portable version of Firefox 17 and noVNC work as expected. > > > > Il 20/02/2015 5.18, Darrell Budic ha scritto: > > > > > > > > Try reimporting the ca.cert for noVNC by connecting directly to the > > webproxy address at port 6100. Do this by trying to connect to a > > console and then, once the 1006 error shows up, just strip off > > everything after :6100/ . I've found that somewhere in or after 3.5, > > restarting the webproxy causes it to generate its own new ca.cert > > even > through it shouldn't. > > > > -Darrell > > > > > > > > On Feb 19, 2015, at 4:09 PM, Stefano Danzi <s.danzi(a)hawai.it> wrote: > > > > Hello, > > > > I can't make work noVNC console on recent browsers (Chrome 40, > > Firefox > > 35 and IE 11). > > > > The error that I have is already explained here: > > https://forge.univention.org/bugzilla/show_bug.cgi?id=33587 I tried > > to change websocket like suggested ( > > http://errata.univention.de/ucs/3.2/31.html ) but this not helped. > > noVNC 0.5.1 should be soon released in EPEL6/EPEL7 as for [1]. > noVNC 0.5.1 should also improve compatibility with recent browsers. > > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1193454#c3 > > > > Someone know a workaround? > > _______________________________________________ > > Users mailing list Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > > > > > _______________________________________________ > > Users mailing list > > Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > >

4 6

Problem: My VM's keep logging off
by Pedro ML Sousa 20 Feb '15

20 Feb '15

This is a multi-part message in MIME format. --------------050100040509080004020406 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit My VM's keep logging off I have a HP server with 64GB of ram and 2 TB of disk space, the cpu is a Intel E5-2420v2 and 13 thin clients from igel (https://www.igel.com/products/thin-client-zero-client-hardware/iz2ud2-serie…) i've purchase the clients and a service from a company, they installed the thins clients and the system but they are not finding a solution to my problem. The company installed centos 6.6 (final) (kernel linux 23.32-504.3.3.el6.x86_64) and ovirt 3.5.1 for virtualization (o.o.master.20141206225404) I have 12 VM's with centos (when i edit then is shows red hat enterprise linux 6.x x64) and gnome desktop 2.28.2 and 1 VM with windows xp prof. The problem only occurs on the VM's with linux. On linux display type is: Spice I use virtual machine viewer 1.0256 *Problem: when working the vm seems to log off and i have to put the username and password again, all the work that was open is losed.* 1 VM seems to log off more or less at the same hour each day 1h40 pm and 6h15 pm. This VM now as a newer thin client version UD3 instead of UD2 (https://www.igel.com/products/thin-client-zero-client-hardware/iz3ud3-serie…) and now the problem only occur 1 time each day (at 12h30/12h45pm). All of the VM's including the one with XP Pro suffers from slowness, and on libreoffice the mouse scrooll seems nuts scrolling up and down by itself, now the exception is the VM with the new thin client. On the same network switch i have VM's that logs off and others that remain on. So the problem doesn't seem to be with the network. The different VM's logs off from 1 to 7 times a day. Mostly 4 to 5 times a day. When the VM logs off the caps lock become to work on the opposite condition off with caps light on and on with the caps light off. Beside this i have problems with the canon's printes i have, they stop printing quite often. I have access to the logs if anyone can help me i can upload the logs you like. Hope anyone can help me, i'm glad to provide more information if you need. Thanks in advance. PS pedromls(a)pmls.pt --------------050100040509080004020406 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> My VM's keep logging off<br> <div class="linestyle2 colourline"><span><br> I have a HP server with 64GB of ram and 2 TB of disk space, the cpu is a Intel E5-2420v2 and 13 thin clients from igel (<a class="moz-txt-link-freetext" href="https://www.igel.com/products/thin-client-zero-client-hardware/iz2ud2-serie…">https://www.igel.com/products/thin-client-zero-client-hardware/iz2ud2-serie…</a>)<br> </span><span>i've purchase the clients and a service from a company, they installed the thins clients and the system but they are not finding a solution to my problem.<br> </span></div> <div class="linestyle1 colourline"><span>The company installed centos 6.6 (final) (kernel linux 23.32-504.3.3.el6.x86_64) and ovirt 3.5.1 for virtualization (o.o.master.20141206225404)<br> </span></div> <div class="linestyle1 colourline"><span>I have 12 VM's with centos (when i edit then is shows red hat enterprise linux 6.x x64) and gnome desktop 2.28.2 and 1 VM with windows xp prof.<br> <br> The problem only occurs on the VM's with linux.<br> <br> On linux display type is: Spice I use virtual machine viewer 1.0256<br> </span></div> <br> <b>Problem: when working the vm seems to log off and i have to put the username and password again, all the work that was open is losed.</b><br> <br> 1 VM seems to log off more or less at the same hour each day 1h40 pm and 6h15 pm. This VM now as a newer thin client version UD3 instead of UD2 (<a class="moz-txt-link-freetext" href="https://www.igel.com/products/thin-client-zero-client-hardware/iz3ud3-serie…">https://www.igel.com/products/thin-client-zero-client-hardware/iz3ud3-serie…</a>) and now the problem only occur 1 time each day (at 12h30/12h45pm).<br> <br> All of the VM's including the one with XP Pro suffers from <span class="" id="ouHighlight__0_7TO0_7" paragraphname="paragraph0" dstinfo="0:7" srcinfo="0:7">slowness, and on libreoffice the mouse scrooll seems nuts scrolling up and down by itself, now the exception is the VM with the new thin client.<br> <br> On the same network switch i have VM's that logs off and others that remain on. So the problem doesn't seem to be with the network. The different VM's logs off from 1 to 7 times a day. Mostly 4 to 5 times a day.<br> <br> When the VM logs off the caps lock become to work on the opposite condition off with caps light on and on with the caps light off.<br> </span><br> Beside this i have problems with the canon's printes i have, they stop printing quite often.<br> <br> I have access to the logs if anyone can help me i can upload the logs you like.<br> <br> Hope anyone can help me, i'm glad to provide more information if you need.<br> <br> Thanks in advance.<br> <br> PS<br> <a class="moz-txt-link-abbreviated" href="mailto:pedromls@pmls.pt">pedromls(a)pmls.pt</a> </body> </html> --------------050100040509080004020406--

2 2

Unable to run noVNC console un recent browsers
by Stefano Danzi 20 Feb '15

20 Feb '15

Hello, I can't make work noVNC console on recent browsers (Chrome 40, Firefox 35 and IE 11). The error that I have is already explained here: https://forge.univention.org/bugzilla/show_bug.cgi?id=33587 I tried to change websocket like suggested (http://errata.univention.de/ucs/3.2/31.html) but this not helped. Someone know a workaround?

5 6

Ovirt spice cannot log
by tharaka 20 Feb '15

20 Feb '15

This is a multi-part message in MIME format. --------------080200000709010709000606 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi, My ovirt version *oVirt Engine Version: 3.5.0.1-1.el6 , *i cannot connect to ovirt graphical server via spice , i have already installed firebox plug-in, but i'm using *Version 3.1.0-3.26ovirt *server without any spice issue, Please guide me to resolve this problem. Thank You, Malinda Tharaka. --------------080200000709010709000606 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-1"> </head> <body text="#000000" bgcolor="#FFFFFF"> Hi,<br> <br> My ovirt version <b><span class="gwt-InlineLabel">oVirt Engine Version: 3.5.0.1-1.el6 , </span></b><span class="gwt-InlineLabel">i cannot connect to ovirt graphical server via spice , i have already installed firebox plug-in, <br> but i'm using </span><span class="gwt-InlineLabel"><b>Version 3.1.0-3.26ovirt </b>server without any spice issue, Please guide me to resolve this problem.<br> <br> Thank You,<br> Malinda Tharaka.<br> </span> </body> </html> --------------080200000709010709000606--

1 0

Re: [ovirt-users] Announcing the moVirt Incubator Project!
by Donny D 19 Feb '15

19 Feb '15

----_com.android.email_2495776108079720 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 CiAgICAKVGhhdCBpcyBncmVhdCBwcm9qZWN0LiBUaGlzIG1ha2VzIG1lIHZlcnkgaGFwcHkuwqAK CgpIYXBweSBDb25uZWN0aW5nLiBTZW50IGZyb20gbXkgU3ByaW50IFNhbXN1bmcgR2FsYXh5IFPC riA1CgotLS0tLS0tLSBPcmlnaW5hbCBtZXNzYWdlIC0tLS0tLS0tCkZyb206IEJyaWFuIFByb2Zm aXR0IDxicHJvZmZpdEByZWRoYXQuY29tPiAKRGF0ZTogMDIvMTcvMjAxNSAgOToxNyBBTSAgKEdN VC0wNzowMCkgClRvOiBib2FyZCA8Ym9hcmRAb3ZpcnQub3JnPiAKQ2M6IGFubm91bmNlQG92aXJ0 Lm9yZywgdXNlcnMgPHVzZXJzQG92aXJ0Lm9yZz4sIGRldmVsQG92aXJ0Lm9yZyAKU3ViamVjdDog W292aXJ0LXVzZXJzXSBBbm5vdW5jaW5nIHRoZSBtb1ZpcnQgSW5jdWJhdG9yIFByb2plY3QhIAoK VGhpcyBtZXNzYWdlIGlzIHRvIGFubm91bmNlIG1vVmlydCBhcyBhIG5ldyBvVmlydCBpbmN1YmF0 b3IgcHJvamVjdCwgYXBwcm92ZWQgYnkgdW5hbmltb3VzIHZvdGUgb2YgdGhlIEJvYXJkIG1haWxp bmcgbGlzdCEKCkRldGFpbHMgYWJvdXQgdGhlIHByb2plY3QgY2FuIGJlIGZvdW5kIGF0CgpodHRw Oi8vd3d3Lm92aXJ0Lm9yZy9Qcm9qZWN0X21vVmlydAoKTW9yZSBpbmZvcm1hdGlvbiBhYm91dCB0 aGUgaW5jdWJhdG9yIGF0IG9WaXJ0IGNhbiBiZSBmb3VuZCBhdAoKaHR0cDovL3d3dy5vdmlydC5v cmcvSW5jdWJhdGluZ19hbl9vVmlydF9TdWJwcm9qZWN0CgpQbGVhc2UgY2hlY2sgb3V0IHRoaXMg cHJvamVjdCBhbmQgc2VlIHdoYXQgeW91IGNhbiBkbyB0byBoZWxwIQoKLS0gCkJyaWFuIFByb2Zm aXR0CgpDb21tdW5pdHkgTGlhaXNvbgpvVmlydApPcGVuIFNvdXJjZSBhbmQgU3RhbmRhcmRzLCBS ZWQgSGF0IC0gaHR0cDovL2NvbW11bml0eS5yZWRoYXQuY29tClBob25lOiArMSA1NzQgMzgzIDlC S1AKSVJDOiBia3AgQCBPRlRDCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fClVzZXJzIG1haWxpbmcgbGlzdApVc2Vyc0BvdmlydC5vcmcKaHR0cDovL2xpc3Rz Lm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCg== ----_com.android.email_2495776108079720 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0 L2h0bWw7IGNoYXJzZXQ9VVRGLTgiPjwvaGVhZD48Ym9keT4KICAgIAo8ZGl2PlRoYXQgaXMgZ3Jl YXQgcHJvamVjdC4gVGhpcyBtYWtlcyBtZSB2ZXJ5IGhhcHB5LiZuYnNwOzwvZGl2PjxkaXY+PGJy PjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXYgaWQ9ImNvbXBvc2VyX3Np Z25hdHVyZSI+PGRpdiBzdHlsZT0iZm9udC1zaXplOjg1JTtjb2xvcjojNTc1NzU3Ij5IYXBweSBD b25uZWN0aW5nLiBTZW50IGZyb20gbXkgU3ByaW50IFNhbXN1bmcgR2FsYXh5IFPCriA1PC9kaXY+ PC9kaXY+PGJyPjxicj4tLS0tLS0tLSBPcmlnaW5hbCBtZXNzYWdlIC0tLS0tLS0tPGJyPkZyb206 IEJyaWFuIFByb2ZmaXR0ICZsdDticHJvZmZpdEByZWRoYXQuY29tJmd0OyA8YnI+RGF0ZTogMDIv MTcvMjAxNSAgOToxNyBBTSAgKEdNVC0wNzowMCkgPGJyPlRvOiBib2FyZCAmbHQ7Ym9hcmRAb3Zp cnQub3JnJmd0OyA8YnI+Q2M6IGFubm91bmNlQG92aXJ0Lm9yZywgdXNlcnMgJmx0O3VzZXJzQG92 aXJ0Lm9yZyZndDssIGRldmVsQG92aXJ0Lm9yZyA8YnI+U3ViamVjdDogW292aXJ0LXVzZXJzXSBB bm5vdW5jaW5nIHRoZSBtb1ZpcnQgSW5jdWJhdG9yIFByb2plY3QhIDxicj48YnI+VGhpcyBtZXNz YWdlIGlzIHRvIGFubm91bmNlIG1vVmlydCBhcyBhIG5ldyBvVmlydCBpbmN1YmF0b3IgcHJvamVj dCwgYXBwcm92ZWQgYnkgdW5hbmltb3VzIHZvdGUgb2YgdGhlIEJvYXJkIG1haWxpbmcgbGlzdCE8 YnI+PGJyPkRldGFpbHMgYWJvdXQgdGhlIHByb2plY3QgY2FuIGJlIGZvdW5kIGF0PGJyPjxicj5o dHRwOi8vd3d3Lm92aXJ0Lm9yZy9Qcm9qZWN0X21vVmlydDxicj48YnI+TW9yZSBpbmZvcm1hdGlv biBhYm91dCB0aGUgaW5jdWJhdG9yIGF0IG9WaXJ0IGNhbiBiZSBmb3VuZCBhdDxicj48YnI+aHR0 cDovL3d3dy5vdmlydC5vcmcvSW5jdWJhdGluZ19hbl9vVmlydF9TdWJwcm9qZWN0PGJyPjxicj5Q bGVhc2UgY2hlY2sgb3V0IHRoaXMgcHJvamVjdCBhbmQgc2VlIHdoYXQgeW91IGNhbiBkbyB0byBo ZWxwITxicj48YnI+LS0gPGJyPkJyaWFuIFByb2ZmaXR0PGJyPjxicj5Db21tdW5pdHkgTGlhaXNv bjxicj5vVmlydDxicj5PcGVuIFNvdXJjZSBhbmQgU3RhbmRhcmRzLCBSZWQgSGF0IC0gaHR0cDov L2NvbW11bml0eS5yZWRoYXQuY29tPGJyPlBob25lOiArMSA1NzQgMzgzIDlCS1A8YnI+SVJDOiBi a3AgQCBPRlRDPGJyPl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fPGJyPlVzZXJzIG1haWxpbmcgbGlzdDxicj5Vc2Vyc0BvdmlydC5vcmc8YnI+aHR0cDovL2xp c3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPGJyPjwvYm9keT48L2h0bWw+ ----_com.android.email_2495776108079720--

6 6

Re: [ovirt-users] importing iscsi storage domain
by Elad Ben Aharon 19 Feb '15

19 Feb '15

------=_Part_9372914_326988970.1423648670110 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Steven - can you please attach engine.log also? (/var/log/ovirt-engine/engi= ne.log)=20 Adding Maor and Liron from DEV.=20 Maor, Liron, can you take a look?=20 In vdsm.log I see the following:=20 Thread-77065::WARNING::2015-02-10 09:43:49,917::resourceManager::591::Stora= ge.ResourceManager::(registerResource) Resource factory failed to create re= source '2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43a4-92a= 9-bfe913ec8b69'. Canceling request.=20 Traceback (most recent call last):=20 File "/usr/share/vdsm/storage/resourceManager.py", line 587, in registerRes= ource=20 obj =3D namespaceObj.factory.createResource(name, lockType)=20 File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in createRes= ource=20 lockType)=20 File "/usr/share/vdsm/storage/resourceFactories.py", line 119, in __getReso= urceCandidatesList=20 repoPath =3D os.path.join(self.storage_repository, dom.getPools()[0])=20 IndexError: list index out of range=20 Thread-77065::DEBUG::2015-02-10 09:43:49,918::resourceManager::210::Storage= .ResourceManager.Request::(cancel) ResName=3D`2e94bbac-1648-49db-8605-ce574= d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69`ReqID=3D`10e68fbb-ac50= -461f-92ac-d8c43060ed43`::Canceled request=20 Thread-77065::WARNING::2015-02-10 09:43:49,918::resourceManager::203::Stora= ge.ResourceManager.Request::(cancel) ResName=3D`2e94bbac-1648-49db-8605-ce5= 74d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69`ReqID=3D`10e68fbb-ac= 50-461f-92ac-d8c43060ed43`::Tried to cancel a processed request=20 Thread-77065::ERROR::2015-02-10 09:43:49,918::task::866::Storage.TaskManage= r.Task::(_setError) Task=3D`6e023655-23ad-42cd-9b7e-6c5e5e3b08b9`::Unexpect= ed error=20 Traceback (most recent call last):=20 File "/usr/share/vdsm/storage/task.py", line 873, in _run=20 return fn(*args, **kargs)=20 File "/usr/share/vdsm/logUtils.py", line 45, in wrapper=20 res =3D f(*args, **kwargs)=20 File "/usr/share/vdsm/storage/hsm.py", line 1285, in setVolumeDescription= =20 pool.setVolumeDescription(sdUUID, imgUUID, volUUID, description)=20 File "/usr/share/vdsm/storage/securable.py", line 77, in wrapper=20 return method(self, *args, **kwargs)=20 File "/usr/share/vdsm/storage/sp.py", line 1884, in setVolumeDescription=20 rm.LockType.exclusive):=20 File "/usr/share/vdsm/storage/resourceManager.py", line 523, in acquireReso= urce=20 raise se.ResourceAcqusitionFailed()=20 ResourceAcqusitionFailed: Could not acquire resource. Probably resource fac= tory threw an exception.: ()=20 ----- Original Message ----- From: "Steven M. Bellistri" <SBellistri(a)ldirx.com>=20 To: "Elad Ben Aharon" <ebenahar(a)redhat.com>=20 Sent: Tuesday, 10 February, 2015 6:35:32 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 Another issue, when I failback the 2 storage domains, the 2 nd SD is not wo= rking. The vm that has the DB drives will not boot after I failover (I chec= ked the virtio-scsi setting and it was checked), but I was getting an error= in the manager saying that: Failed to update OVF disks 952af113-8219-43a4-= 92a9-bfe913ec8b69, OVF data isn't updated on those OVF stores (Data Center = Default, Storage Domain iSCSI_2). So then I tried putting the SD2 into main= tenance mode and then reactivating it, but it would not active or would it = detach. I had to destroy the SD. The weird thing is that I had no problems = with the 1 st SD. I am sending the vdsm.log file from the host in the PR si= te.=20 From: Elad Ben Aharon [mailto:ebenahar@redhat.com]=20 Sent: Monday, February 9, 2015 1:26 AM=20 To: Steven M. Bellistri=20 Cc: Aharon Canan; users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 The import domain operation consists of several stages which their executio= n time can vary.=20 It would be almost impossible to estimate how long it will take. But, since= the whole import operation, along with the VMs registration in the new env= ironment, doesn't involve any long time operations, like disks creation, it= shouldn't take more than a few minutes.=20 ----- Original Message ----- From: "Steven M. Bellistri" <SBellistri(a)ldirx.com>=20 To: "Elad Ben Aharon" <ebenahar(a)redhat.com>=20 Cc: "Aharon Canan" <acanan(a)redhat.com>, users(a)ovirt.org=20 Sent: Thursday, 5 February, 2015 5:41:11 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 I put the storage domain in maintenance mode, then changed the time from 60= minutes to 5min, then after I failed the storage over I was able to import = the domain. Thanks so much for the help. I just have one more question, is = there anyway to calculate how long it will take to import a domain, because= our production environment is about 5.5TB with about 40vm=E2=80=99s?=20 thanks=20 From: Elad Ben Aharon [mailto:ebenahar@redhat.com]=20 Sent: Thursday, February 5, 2015 1:49 AM=20 To: Steven M. Bellistri=20 Cc: Aharon Canan; users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 If you can't see the VMs under 'VM Import' subtab under the imported storag= e domain, it means that you won't be able to recover those VMs (because the= ir configuration files weren't uploaded to the domain).=20 For the next time, you can decrease the time interval of the OVFs upload as= explained below in the thread.=20 Regarding the upgrade, it is possible to upgrade from 3.4 to 3.5 and once y= ou'll upgrade the setup and the DC compatibility version to 3.5, the OVFs o= f the VMs will be uploaded to the storage domains where the VMs's disks are= located on. (again, every 60 minutes by default).=20 Elad Ben Aharon=20 RHEV-QE storage=20 From: "Steven M. Bellistri" < SBellistri(a)ldirx.com >=20 To: "Elad Ben Aharon" < ebenahar(a)redhat.com >=20 Cc: "Aharon Canan" < acanan(a)redhat.com >, users(a)ovirt.org=20 Sent: Wednesday, 4 February, 2015 5:44:37 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 No, I did not wait 60 minutes before I tried to failover. Do, I need to sta= rt over, or can I just failback and wait the hour for the ovfs to upload? I= do have a question, is this feature possible for an environment that was u= pgraded from 3.4 to 3.5? My production environment is 3.4, the 3.5 environm= ent is a clean test environment, but if I cant upgrade to 3.5 from 3.4 then= this will not be a good DR option for me.=20 thanks=20 From: Elad Ben Aharon [ mailto:ebenahar@redhat.com ]=20 Sent: Wednesday, February 4, 2015 8:56 AM=20 To: Steven M. Bellistri=20 Cc: Aharon Canan; users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 Hi Steven,=20 In order to import the VMs from the imported storage domain, the VMs config= uration files (which are called OVFs) have to be uploaded first before the = domain is detached from the setup. This is being done by engine in a time i= nterval of 60 minutes (it's configurable using rhevm-config --set OvfUpdate= InMinutes=3D<value> and restart ovirt-engine service). From 3.5.1, the OVFs= are uploaded once you move the storage domain to maintenance. did you do s= o in the original RHEV environment? What was the version of this environmen= t?=20 If you didn't deactivate the domain in the first environment and then tried= to attach it to the DR environment, the existence of the VMs in the domain= depends on the OVFs upload that was supposed to be done by the first engin= e, which is being done every 60 minutes as explained, so if you've created = those VMs and immediately destroyed the setup, those VMs probably won't be = available for you in the DR environment.=20 Elad Ben Aharon=20 RHEV-QE storage=20 From: "Steven M. Bellistri" < SBellistri(a)LDIRx.com >=20 To: "Aharon Canan" < acanan(a)redhat.com >=20 Cc: users(a)ovirt.org=20 Sent: Tuesday, 3 February, 2015 6:16:01 PM=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 version 3.5.1=20 From: Aharon Canan [ mailto:acanan@redhat.com ]=20 Sent: Tuesday, February 3, 2015 6:22 AM=20 To: Steven M. Bellistri=20 Cc: users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 What version are you using?=20 Regards,=20 __________________________________________________=20 Aharon Canan=20 int phone - 8272036=20 ext phone - +97297692036=20 email - acanan(a)redhat.com=20 From: "Steven M. Bellistri" < SBellistri(a)ldirx.com >=20 To: "Aharon Canan" < acanan(a)redhat.com >=20 Cc: users(a)ovirt.org=20 Sent: Monday, February 2, 2015 8:12:00 PM=20 Subject: RE: [ovirt-users] importing iscsi storage domain=20 Thank you for the response.=20 I went thru the steps 1-9, and when I get to step 10 there is no import vms= or import templates sub-tabs. I am including the vdsm.log from the host. A= lso, when I do a lvs on the host, I can see the disks that reside in the im= ported SD, one is 30gb and the other is 40gb. The storage domain I am impor= ting is called iSCSI.=20 From: Aharon Canan [ mailto:acanan@redhat.com ]=20 Sent: Sunday, February 1, 2015 9:55 AM=20 To: Steven M. Bellistri=20 Cc: users(a)ovirt.org=20 Subject: Re: [ovirt-users] importing iscsi storage domain=20 Hi=20 Please check below link for info, ovirt version should be 3.5=20 http://www.ovirt.org/Features/ImportStorageDomain=20 please be aware to step 10 under " Work flow for Import block Storage Domai= n - UI flow "=20 In case it is not working, please add exact steps and engine/vdsm logs so w= e will be able to check=20 Regards,=20 __________________________________________________=20 Aharon Canan=20 int phone - 8272036=20 ext phone - +97297692036=20 email - acanan(a)redhat.com=20 <blockquote> From: "Steven M. Bellistri" < SBellistri(a)LDIRx.com >=20 To: " users(a)ovirt.org " < users(a)ovirt.org >=20 Sent: Friday, January 30, 2015 12:18:54 AM=20 Subject: [ovirt-users] importing iscsi storage domain=20 I am trying to test failing over to a DR site using the storage domain impo= rt. The DR site shows that it imported the iscsi storage domain, and activa= tes it in the datacenter, but none of the vm=E2=80=99s or anything shows up= . What am I missing.=20 thanks=20 Steven Bellistri=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 _______________________________________________=20 Users mailing list=20 Users(a)ovirt.org=20 http://lists.ovirt.org/mailman/listinfo/users=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 </blockquote> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 _______________________________________________=20 Users mailing list=20 Users(a)ovirt.org=20 http://lists.ovirt.org/mailman/listinfo/users=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments.=20 ------=_Part_9372914_326988970.1423648670110 Content-Type: multipart/related; boundary="----=_Part_9372915_292966117.1423648670110" ------=_Part_9372915_292966117.1423648670110 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: times new roman, new york, times, se= rif; font-size: 12pt; color: #000000"><div><div>Steven - can you please att= ach engine.log also? (/var/log/ovirt-engine/engine.log)<br></div></div><div= ><br></div><div>Adding Maor and Liron from DEV. </div><div><br>Maor, L= iron, can you take a look? <br></div><div><br></div><div>In vdsm.log I see = the following:<br></div><div><br></div><div>Thread-77065::WARNING::2015-02-= 10 09:43:49,917::resourceManager::591::Storage.ResourceManager::(registerRe= source) Resource factory failed to create resource '2e94bbac-1648-49db-8605= -ce574d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b69'. Canceling requ= est.<br>Traceback (most recent call last):<br>  File "/usr/share/vdsm/= storage/resourceManager.py", line 587, in registerResource<br>  &= nbsp; obj =3D namespaceObj.factory.createResource(name, lockType)<br> = File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in createRe= source<br>    lockType)<br>  File "/usr/share/vdsm/stor= age/resourceFactories.py", line 119, in __getResourceCandidatesList<br>&nbs= p;   repoPath =3D os.path.join(self.storage_repository, dom.getPo= ols()[0])<br>IndexError: list index out of range<br>Thread-77065::DEBUG::20= 15-02-10 09:43:49,918::resourceManager::210::Storage.ResourceManager.Reques= t::(cancel) ResName=3D`2e94bbac-1648-49db-8605-ce574d2bc240_imageNS.952af11= 3-8219-43a4-92a9-bfe913ec8b69`ReqID=3D`10e68fbb-ac50-461f-92ac-d8c43060ed43= `::Canceled request<br>Thread-77065::WARNING::2015-02-10 09:43:49,918::reso= urceManager::203::Storage.ResourceManager.Request::(cancel) ResName=3D`2e94= bbac-1648-49db-8605-ce574d2bc240_imageNS.952af113-8219-43a4-92a9-bfe913ec8b= 69`ReqID=3D`10e68fbb-ac50-461f-92ac-d8c43060ed43`::Tried to cancel a proces= sed request<br>Thread-77065::ERROR::2015-02-10 09:43:49,918::task::866::Sto= rage.TaskManager.Task::(_setError) Task=3D`6e023655-23ad-42cd-9b7e-6c5e5e3b= 08b9`::Unexpected error<br>Traceback (most recent call last):<br>  Fil= e "/usr/share/vdsm/storage/task.py", line 873, in _run<br>  &nbsp= ; return fn(*args, **kargs)<br>  File "/usr/share/vdsm/logUtils.py", l= ine 45, in wrapper<br>    res =3D f(*args, **kwargs)<br>&nbs= p; File "/usr/share/vdsm/storage/hsm.py", line 1285, in setVolumeDescriptio= n<br>    pool.setVolumeDescription(sdUUID, imgUUID, volUUID,= description)<br>  File "/usr/share/vdsm/storage/securable.py", line 7= 7, in wrapper<br>    return method(self, *args, **kwargs)<br= >  File "/usr/share/vdsm/storage/sp.py", line 1884, in setVolumeDescri= ption<br>    rm.LockType.exclusive):<br>  File "/usr/sh= are/vdsm/storage/resourceManager.py", line 523, in acquireResource<br>&nbsp= ;   raise se.ResourceAcqusitionFailed()<br>ResourceAcqusitionFail= ed: Could not acquire resource. Probably resource factory threw an exceptio= n.: ()</div><div><br></div><div><br></div><hr id=3D"zwchr"><div style=3D"co= lor:#000;font-weight:normal;font-style:normal;text-decoration:none;font-fam= ily:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Steven M. Bel= listri" <SBellistri(a)ldirx.com><br><b>To: </b>"Elad Ben Aharon" <eb= enahar(a)redhat.com><br><b>Sent: </b>Tuesday, 10 February, 2015 6:35:32 PM= <br><b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain<br><di= v><br></div> <style></style> <div class=3D"WordSection1"> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">Another issue, when I = failback the 2 storage domains, the 2<sup>nd</sup> SD is not working. = The vm that has the DB drives will not boot after I failover (I checked th= e virtio-scsi setting and it was checked), but I was getting an error in the manager saying that: Failed to update OV= F disks 952af113-8219-43a4-92a9-bfe913ec8b69, OVF data isn't updated on tho= se OVF stores (Data Center Default, Storage Domain iSCSI_2).   So= then I tried putting the SD2 into maintenance mode and then reactivating it, but it would not active or would it detach.=   I had to destroy the SD.  The weird thing is that I had no prob= lems with the 1<sup>st</sup> SD.  I am sending the vdsm.log file from = the host in the PR site.</span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b>From:</b> Elad Ben Aharon [mailto:ebenahar@redhat= .com] <br> <b>Sent:</b> Monday, February 9, 2015 1:26 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> Aharon Canan; users(a)ovirt.org<br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</p> </div> </div> <p class=3D"MsoNormal"> </p> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">The import domain operat= ion consists of several stages which their execution time can vary.</span><= span style=3D"font-size:12.0pt;color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">It would be almost impos= sible to estimate how long it will take. But, since the whole import operat= ion, along with the VMs registration in the new environment, doesn't involv= e any long time operations, like disks creation, it shouldn't take more than a few minutes.</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr id=3D"zwchr" size=3D"2" width=3D"100%" align=3D"center"> </span></div> <div> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <SBellistri(a)ldirx.com><br> <b>To: </b>"Elad Ben Aharon" <ebenahar(a)redhat.com><br> <b>Cc: </b>"Aharon Canan" <acanan(a)redhat.com>, users(a)ovirt.org<br> <b>Sent: </b>Thursday, 5 February, 2015 5:41:11 PM<br> <b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain</span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">I put the storage doma= in in maintenance mode, then changed the time from 60minutes to 5min, then = after I failed the storage over I was able to import the domain.  Than= ks so much for the help.  I just have one more question, is there anyway to calculate how long it will take to impor= t a domain, because our production environment is about 5.5TB with about 40= vm=E2=80=99s?</span><span style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">thanks</span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Elad Ben Aharon [mailto:ebenahar@redhat.com] <br> <b>Sent:</b> Thursday, February 5, 2015 1:49 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> Aharon Canan; users(a)ovirt.org<br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">If you can't see the VMs= under 'VM Import' subtab under the imported storage domain, it means that = you won't be able to recover those VMs (because their configuration files w= eren't uploaded to the domain). </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">For the next time, you c= an decrease the time interval of the OVFs upload as explained below in the = thread. <br> <br> <br> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">Regarding the upgrade, i= t is possible to upgrade from 3.4 to 3.5 and once you'll upgrade the setup = and the DC compatibility version to 3.5, the OVFs of the VMs will be upload= ed to the storage domains where the VMs's disks are located on. (again, every 60 minutes by default).<br> <br> <br> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"><br> <br> <br> </span></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"><br>   <br> Elad Ben Aharon<br> RHEV-QE storage</span></p> <div> <p class=3D"MsoNormal"><span style=3D"color:black"><img id=3D"_x0000_i1025"= src=3D"cid:image001.jpg@01D0451B.AEA225C0" height=3D"68" width=3D"150"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">    </spa= n></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <div> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@ldirx.com" = target=3D"_blank">SBellistri(a)ldirx.com</a>><br> <b>To: </b>"Elad Ben Aharon" <<a href=3D"mailto:ebenahar@redhat.com" tar= get=3D"_blank">ebenahar(a)redhat.com</a>><br> <b>Cc: </b>"Aharon Canan" <<a href=3D"mailto:acanan@redhat.com" target= =3D"_blank">acanan(a)redhat.com</a>>, <a href=3D"mailto:users@ovirt.org" target=3D"_blank">users(a)ovirt.org</a><br= > <b>Sent: </b>Wednesday, 4 February, 2015 5:44:37 PM<br> <b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain</span><spa= n style=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">No, I did not wait 60 = minutes before I tried to failover.  Do, I need to start over, or can = I just failback and wait the hour for the ovfs to upload?  I do have a= question, is this feature possible for an environment that was upgraded from 3.4 to 3.5?  My production environment is 3.4,= the 3.5 environment is a clean test environment, but if I cant upgrade to = 3.5 from 3.4 then this will not be a good DR option for me.  </span><span style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">thanks</span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Elad Ben Aharon [<a href=3D"mailto:ebenahar@redhat.= com" target=3D"_blank">mailto:ebenahar@redhat.com</a>] <br> <b>Sent:</b> Wednesday, February 4, 2015 8:56 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> Aharon Canan; <a href=3D"mailto:users@ovirt.org" target=3D"_blan= k">users(a)ovirt.org</a><br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">Hi Steven,</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">In order to import the V= Ms from the imported storage domain, the VMs configuration files (which are= called OVFs) have to be uploaded first before the domain is detached from = the setup. This is being done by engine in a time interval of 60 minutes (it's configurable using rhevm-config --s= et OvfUpdateInMinutes=3D<value> and restart ovirt-engine service). Fr= om 3.5.1, the OVFs are uploaded once you move the storage domain to mainten= ance.  did you do so in the original RHEV environment? What was the version of this environment?</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">If you didn't deactivate= the domain in the first environment and then tried to attach it to the DR = environment, the existence of the VMs in the domain depends on the OVFs upl= oad that was supposed to be done by the first engine, which is being done every 60 minutes as explained, so if= you've created those VMs and immediately destroyed the setup, those VMs pr= obably won't be available for you in the DR environment.</span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"><br>   <br> Elad Ben Aharon<br> RHEV-QE storage</span></p> <div> <p class=3D"MsoNormal"><span style=3D"color:black"><img id=3D"_x0000_i1027"= src=3D"cid:image001.jpg@01D0451B.AEA225C0" height=3D"68" width=3D"150" bor= der=3D"0"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black">    </spa= n></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <div> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@LDIRx.com" = target=3D"_blank">SBellistri(a)LDIRx.com</a>><br> <b>To: </b>"Aharon Canan" <<a href=3D"mailto:acanan@redhat.com" target= =3D"_blank">acanan(a)redhat.com</a>><br> <b>Cc: </b><a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Sent: </b>Tuesday, 3 February, 2015 6:16:01 PM<br> <b>Subject: </b>Re: [ovirt-users] importing iscsi storage domain</span><spa= n style=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">version 3.5.1</span><s= pan style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Aharon Canan [<a href=3D"mailto:acanan@redhat.com" = target=3D"_blank">mailto:acanan@redhat.com</a>] <br> <b>Sent:</b> Tuesday, February 3, 2015 6:22 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> <a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">What version are you using?</span><span styl= e=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Regards, <br> __________________________________________________<br> </span><strong><span style=3D"font-size:10.0pt;font-family:"Comic Sans= MS";color:#3366FF">Aharon Canan</span></strong><span style=3D"font-si= ze:10.0pt;font-family:"Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= int phone - 8272036</span><span style=3D"font-size:10.0pt;font-family:&quot= ;Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= ext phone - +97297692036</span><span style=3D"font-size:10.0pt;font-family:= "Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= email - <a href=3D"mailto:acanan@redhat.com" target=3D"_blank"> acanan(a)redhat.com</a></span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <blockquote style=3D"border:none;border-left:solid #1010FF 1.5pt;padding:0i= n 0in 0in 4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-bottom:5.0pt"> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@ldirx.com" = target=3D"_blank">SBellistri(a)ldirx.com</a>><br> <b>To: </b>"Aharon Canan" <<a href=3D"mailto:acanan@redhat.com" target= =3D"_blank">acanan(a)redhat.com</a>><br> <b>Cc: </b><a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Sent: </b>Monday, February 2, 2015 8:12:00 PM<br> <b>Subject: </b>RE: [ovirt-users] importing iscsi storage domain</span><spa= n style=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">Thank you for the resp= onse.</span><span style=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D">I went thru the steps = 1-9, and when I get to step 10 there is no import vms or import templates s= ub-tabs.  I am including the vdsm.log from the host.  Also, when = I do a lvs on the host, I can see the disks that reside in the imported SD, one is 30gb and the other is 40gb.  The st= orage domain I am importing is called iSCSI.</span><span style=3D"color:bla= ck"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <p class=3D"MsoNormal"><span style=3D"color:#1F497D"> </span><span sty= le=3D"color:black"></span></p> <div> <div style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in = 0in 0in"> <p class=3D"MsoNormal"><b><span style=3D"color:black">From:</span></b><span= style=3D"color:black"> Aharon Canan [<a href=3D"mailto:acanan@redhat.com" = target=3D"_blank">mailto:acanan@redhat.com</a>] <br> <b>Sent:</b> Sunday, February 1, 2015 9:55 AM<br> <b>To:</b> Steven M. Bellistri<br> <b>Cc:</b> <a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovirt= .org</a><br> <b>Subject:</b> Re: [ovirt-users] importing iscsi storage domain</span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Hi</span><span style=3D"color:black"></span>= </p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Please check below link for info, ovirt vers= ion should be 3.5</span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"><a href=3D"http://www.ovirt.org/Features/Imp= ortStorageDomain" target=3D"_blank">http://www.ovirt.org/Features/ImportSto= rageDomain</a></span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">please be aware to step 10 under "<span clas= s=3D"mw-headline">Work flow for Import block Storage Domain - UI flow</span= >"</span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">In case it is not working, please add exact = steps and engine/vdsm logs so we will be able to check </span><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black">Regards, <br> __________________________________________________<br> </span><strong><span style=3D"font-size:10.0pt;font-family:"Comic Sans= MS";color:#3366FF">Aharon Canan</span></strong><span style=3D"font-si= ze:10.0pt;font-family:"Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= int phone - 8272036</span><span style=3D"font-size:10.0pt;font-family:&quot= ;Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= ext phone - +97297692036</span><span style=3D"font-size:10.0pt;font-family:= "Comic Sans MS";color:black"><br> </span><span style=3D"font-family:"Comic Sans MS";color:#3366FF">= email - <a href=3D"mailto:acanan@redhat.com" target=3D"_blank"> acanan(a)redhat.com</a></span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> <div class=3D"MsoNormal" style=3D"text-align:center" align=3D"center"><span= style=3D"color:black"> <hr size=3D"2" width=3D"100%" align=3D"center"> </span></div> <blockquote style=3D"border:none;border-left:solid #1010FF 1.5pt;padding:0i= n 0in 0in 4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-bottom:5.0pt"> <p class=3D"MsoNormal"><b><span style=3D"font-family:"Helvetica",= sans-serif;color:black">From: </span></b><span style=3D"font-family:"Helvetica",sans-serif;colo= r:black">"Steven M. Bellistri" <<a href=3D"mailto:SBellistri@LDIRx.com" = target=3D"_blank">SBellistri(a)LDIRx.com</a>><br> <b>To: </b>"<a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@ovir= t.org</a>" <<a href=3D"mailto:users@ovirt.org" target=3D"_blank">users@o= virt.org</a>><br> <b>Sent: </b>Friday, January 30, 2015 12:18:54 AM<br> <b>Subject: </b>[ovirt-users] importing iscsi storage domain</span><span st= yle=3D"color:black"></span></p> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Helvetica",san= s-serif;color:black"> </span><span style=3D"color:black"></span></p> </div> <p class=3D"MsoNormal"><span style=3D"color:black">I am trying to test fail= ing over to a DR site using the storage domain import.  The DR site sh= ows that it imported the iscsi storage domain, and activates it in the data= center, but none of the vm=E2=80=99s or anything shows up.  What am I missing.</span></p> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <p class=3D"MsoNormal"><span style=3D"color:black">thanks</span></p> <p class=3D"MsoNormal"><span style=3D"color:black"> </span></p> <p class=3D"MsoNormal"><span style=3D"color:black">Steven Bellistri</span><= /p> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments. <br> _______________________________________________<br> Users mailing list<br> <a href=3D"mailto:Users@ovirt.org" target=3D"_blank">Users(a)ovirt.org</a><br= > <a href=3D"http://lists.ovirt.org/mailman/listinfo/users" target=3D"_blank"= >http://lists.ovirt.org/mailman/listinfo/users</a></span><span style=3D"col= or:black"></span></p> </blockquote> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments. </span><span style=3D"color:black"></span></p> </blockquote> <div> <p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co= mic Sans MS";color:black"> </span><span style=3D"color:black"></s= pan></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments. <br> _______________________________________________<br> Users mailing list<br> <a href=3D"mailto:Users@ovirt.org" target=3D"_blank">Users(a)ovirt.org</a><br= > <a href=3D"http://lists.ovirt.org/mailman/listinfo/users" target=3D"_blank"= >http://lists.ovirt.org/mailman/listinfo/users</a></span><span style=3D"col= or:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"Ti= mes New Roman",serif;color:black"> </span><span style=3D"color:bl= ack"></span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments.</s= pan><span style=3D"color:black"></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"Ti= mes New Roman",serif;color:black"> </span><span style=3D"color:bl= ack"></span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"He= lvetica",sans-serif;color:black"><br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delivering this message to the intended = recipient, you are hereby notified that any review, dissemination, distribu= tion, printing or copying of this email message and/or any attachments is s= trictly prohibited. If you have received this transmission in error, please notify the sender immediately = at 1-866-516-3121 and permanently delete this email and any attachments.</s= pan></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-size:12.0pt;font-family:"Ti= mes New Roman",serif;color:black"> </span></p> </div> </div> </div> <br> This email and its attachments may contain privileged and confidential info= rmation and/or protected health information (PHI) intended solely for the u= se of LDI Integrated Pharmacy Services and the recipient(s) named above. If= you are not the recipient, or the employee or agent responsible for delive= ring this message to the intended recipient, you are hereby notified that a= ny review, dissemination, distribution, printing or copying of this email m= essage and/or any attachments is strictly prohibited. If you have received = this transmission in error, please notify the sender immediately at 1-866-5= 16-3121 and permanently delete this email and any attachments. </div><div><br></div></div></body></html> ------=_Part_9372915_292966117.1423648670110 Content-Type: image/jpeg; name=image001.jpg Content-Disposition: attachment; filename=image001.jpg Content-Transfer-Encoding: base64 Content-Description: image001.jpg Content-ID: <image001.jpg(a)01D0451B.AEA225C0> /9j/4AAQSkZJRgABAQEASABIAAD/4gxYSUNDX1BST0ZJTEUAAQEAAAxITGlubwIQAABtbnRyUkdC IFhZWiAHzgACAAkABgAxAABhY3NwTVNGVAAAAABJRUMgc1JHQgAAAAAAAAAAAAAAAAAA9tYAAQAA AADTLUhQICAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABFj cHJ0AAABUAAAADNkZXNjAAABhAAAAGx3dHB0AAAB8AAAABRia3B0AAACBAAAABRyWFlaAAACGAAA ABRnWFlaAAACLAAAABRiWFlaAAACQAAAABRkbW5kAAACVAAAAHBkbWRkAAACxAAAAIh2dWVkAAAD TAAAAIZ2aWV3AAAD1AAAACRsdW1pAAAD+AAAABRtZWFzAAAEDAAAACR0ZWNoAAAEMAAAAAxyVFJD AAAEPAAACAxnVFJDAAAEPAAACAxiVFJDAAAEPAAACAx0ZXh0AAAAAENvcHlyaWdodCAoYykgMTk5 OCBIZXdsZXR0LVBhY2thcmQgQ29tcGFueQAAZGVzYwAAAAAAAAASc1JHQiBJRUM2MTk2Ni0yLjEA AAAAAAAAAAAAABJzUkdCIElFQzYxOTY2LTIuMQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAWFlaIAAAAAAAAPNRAAEAAAABFsxYWVogAAAAAAAAAAAAAAAA AAAAAFhZWiAAAAAAAABvogAAOPUAAAOQWFlaIAAAAAAAAGKZAAC3hQAAGNpYWVogAAAAAAAAJKAA AA+EAAC2z2Rlc2MAAAAAAAAAFklFQyBodHRwOi8vd3d3LmllYy5jaAAAAAAAAAAAAAAAFklFQyBo dHRwOi8vd3d3LmllYy5jaAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAABkZXNjAAAAAAAAAC5JRUMgNjE5NjYtMi4xIERlZmF1bHQgUkdCIGNvbG91ciBzcGFjZSAt IHNSR0IAAAAAAAAAAAAAAC5JRUMgNjE5NjYtMi4xIERlZmF1bHQgUkdCIGNvbG91ciBzcGFjZSAt IHNSR0IAAAAAAAAAAAAAAAAAAAAAAAAAAAAAZGVzYwAAAAAAAAAsUmVmZXJlbmNlIFZpZXdpbmcg Q29uZGl0aW9uIGluIElFQzYxOTY2LTIuMQAAAAAAAAAAAAAALFJlZmVyZW5jZSBWaWV3aW5nIENv bmRpdGlvbiBpbiBJRUM2MTk2Ni0yLjEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHZpZXcAAAAA ABOk/gAUXy4AEM8UAAPtzAAEEwsAA1yeAAAAAVhZWiAAAAAAAEwJVgBQAAAAVx/nbWVhcwAAAAAA AAABAAAAAAAAAAAAAAAAAAAAAAAAAo8AAAACc2lnIAAAAABDUlQgY3VydgAAAAAAAAQAAAAABQAK AA8AFAAZAB4AIwAoAC0AMgA3ADsAQABFAEoATwBUAFkAXgBjAGgAbQByAHcAfACBAIYAiwCQAJUA mgCfAKQAqQCuALIAtwC8AMEAxgDLANAA1QDbAOAA5QDrAPAA9gD7AQEBBwENARMBGQEfASUBKwEy ATgBPgFFAUwBUgFZAWABZwFuAXUBfAGDAYsBkgGaAaEBqQGxAbkBwQHJAdEB2QHhAekB8gH6AgMC DAIUAh0CJgIvAjgCQQJLAlQCXQJnAnECegKEAo4CmAKiAqwCtgLBAssC1QLgAusC9QMAAwsDFgMh Ay0DOANDA08DWgNmA3IDfgOKA5YDogOuA7oDxwPTA+AD7AP5BAYEEwQgBC0EOwRIBFUEYwRxBH4E jASaBKgEtgTEBNME4QTwBP4FDQUcBSsFOgVJBVgFZwV3BYYFlgWmBbUFxQXVBeUF9gYGBhYGJwY3 BkgGWQZqBnsGjAadBq8GwAbRBuMG9QcHBxkHKwc9B08HYQd0B4YHmQesB78H0gflB/gICwgfCDII RghaCG4IggiWCKoIvgjSCOcI+wkQCSUJOglPCWQJeQmPCaQJugnPCeUJ+woRCicKPQpUCmoKgQqY Cq4KxQrcCvMLCwsiCzkLUQtpC4ALmAuwC8gL4Qv5DBIMKgxDDFwMdQyODKcMwAzZDPMNDQ0mDUAN Wg10DY4NqQ3DDd4N+A4TDi4OSQ5kDn8Omw62DtIO7g8JDyUPQQ9eD3oPlg+zD88P7BAJECYQQxBh EH4QmxC5ENcQ9RETETERTxFtEYwRqhHJEegSBxImEkUSZBKEEqMSwxLjEwMTIxNDE2MTgxOkE8UT 5RQGFCcUSRRqFIsUrRTOFPAVEhU0FVYVeBWbFb0V4BYDFiYWSRZsFo8WshbWFvoXHRdBF2UXiReu F9IX9xgbGEAYZRiKGK8Y1Rj6GSAZRRlrGZEZtxndGgQaKhpRGncanhrFGuwbFBs7G2MbihuyG9oc AhwqHFIcexyjHMwc9R0eHUcdcB2ZHcMd7B4WHkAeah6UHr4e6R8THz4faR+UH78f6iAVIEEgbCCY IMQg8CEcIUghdSGhIc4h+yInIlUigiKvIt0jCiM4I2YjlCPCI/AkHyRNJHwkqyTaJQklOCVoJZcl xyX3JicmVyaHJrcm6CcYJ0kneierJ9woDSg/KHEooijUKQYpOClrKZ0p0CoCKjUqaCqbKs8rAis2 K2krnSvRLAUsOSxuLKIs1y0MLUEtdi2rLeEuFi5MLoIuty7uLyQvWi+RL8cv/jA1MGwwpDDbMRIx SjGCMbox8jIqMmMymzLUMw0zRjN/M7gz8TQrNGU0njTYNRM1TTWHNcI1/TY3NnI2rjbpNyQ3YDec N9c4FDhQOIw4yDkFOUI5fzm8Ofk6Njp0OrI67zstO2s7qjvoPCc8ZTykPOM9Ij1hPaE94D4gPmA+ oD7gPyE/YT+iP+JAI0BkQKZA50EpQWpBrEHuQjBCckK1QvdDOkN9Q8BEA0RHRIpEzkUSRVVFmkXe RiJGZ0arRvBHNUd7R8BIBUhLSJFI10kdSWNJqUnwSjdKfUrESwxLU0uaS+JMKkxyTLpNAk1KTZNN 3E4lTm5Ot08AT0lPk0/dUCdQcVC7UQZRUFGbUeZSMVJ8UsdTE1NfU6pT9lRCVI9U21UoVXVVwlYP VlxWqVb3V0RXklfgWC9YfVjLWRpZaVm4WgdaVlqmWvVbRVuVW+VcNVyGXNZdJ114XcleGl5sXr1f D19hX7NgBWBXYKpg/GFPYaJh9WJJYpxi8GNDY5dj62RAZJRk6WU9ZZJl52Y9ZpJm6Gc9Z5Nn6Wg/ aJZo7GlDaZpp8WpIap9q92tPa6dr/2xXbK9tCG1gbbluEm5rbsRvHm94b9FwK3CGcOBxOnGVcfBy S3KmcwFzXXO4dBR0cHTMdSh1hXXhdj52m3b4d1Z3s3gReG54zHkqeYl553pGeqV7BHtje8J8IXyB fOF9QX2hfgF+Yn7CfyN/hH/lgEeAqIEKgWuBzYIwgpKC9INXg7qEHYSAhOOFR4Wrhg6GcobXhzuH n4gEiGmIzokziZmJ/opkisqLMIuWi/yMY4zKjTGNmI3/jmaOzo82j56QBpBukNaRP5GokhGSepLj k02TtpQglIqU9JVflcmWNJaflwqXdZfgmEyYuJkkmZCZ/JpomtWbQpuvnByciZz3nWSd0p5Anq6f HZ+Ln/qgaaDYoUehtqImopajBqN2o+akVqTHpTilqaYapoum/adup+CoUqjEqTepqaocqo+rAqt1 q+msXKzQrUStuK4trqGvFq+LsACwdbDqsWCx1rJLssKzOLOutCW0nLUTtYq2AbZ5tvC3aLfguFm4 0blKucK6O7q1uy67p7whvJu9Fb2Pvgq+hL7/v3q/9cBwwOzBZ8Hjwl/C28NYw9TEUcTOxUvFyMZG xsPHQce/yD3IvMk6ybnKOMq3yzbLtsw1zLXNNc21zjbOts83z7jQOdC60TzRvtI/0sHTRNPG1EnU y9VO1dHWVdbY11zX4Nhk2OjZbNnx2nba+9uA3AXcit0Q3ZbeHN6i3ynfr+A24L3hROHM4lPi2+Nj 4+vkc+T85YTmDeaW5x/nqegy6LzpRunQ6lvq5etw6/vshu0R7ZzuKO6070DvzPBY8OXxcvH/8ozz GfOn9DT0wvVQ9d72bfb794r4Gfio+Tj5x/pX+uf7d/wH/Jj9Kf26/kv+3P9t////4QCMRXhpZgAA TU0AKgAAAAgABQESAAMAAAABAAEAAAEaAAUAAAABAAAASgEbAAUAAAABAAAAUgEoAAMAAAABAAIA AIdpAAQAAAABAAAAWgAAAAAAAABIAAAAAQAAAEgAAAABAAOgAQADAAAAAQABAACgAgAEAAAAAQAA AJagAwAEAAAAAQAAAEQAAAAA/9sAQwABAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB AQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB/9sAQwEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB AQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB/8AAEQgARACWAwEiAAIR AQMRAf/EAB8AAAEFAQEBAQEBAAAAAAAAAAABAgMEBQYHCAkKC//EALUQAAIBAwMCBAMFBQQEAAAB fQECAwAEEQUSITFBBhNRYQcicRQygZGhCCNCscEVUtHwJDNicoIJChYXGBkaJSYnKCkqNDU2Nzg5 OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6g4SFhoeIiYqSk5SVlpeYmZqio6Slpqeo qaqys7S1tre4ubrCw8TFxsfIycrS09TV1tfY2drh4uPk5ebn6Onq8fLz9PX29/j5+v/EAB8BAAMB AQEBAQEBAQEAAAAAAAABAgMEBQYHCAkKC//EALURAAIBAgQEAwQHBQQEAAECdwABAgMRBAUhMQYS QVEHYXETIjKBCBRCkaGxwQkjM1LwFWJy0QoWJDThJfEXGBkaJicoKSo1Njc4OTpDREVGR0hJSlNU VVZXWFlaY2RlZmdoaWpzdHV2d3h5eoKDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5 usLDxMXGx8jJytLT1NXW19jZ2uLj5OXm5+jp6vLz9PX29/j5+v/aAAwDAQACEQMRAD8A/v4ooooA KK+T/wBrX9ub9kr9hbwH/wALH/aw+PHgD4LeGp47s6OninVTJ4k8VXNlaz3k+neC/BmlxX/i7xnq ogtpWXTfDWi6ndtj/Viv58Pil/weC/8ABNXwNry6R4O+FH7YPxZsMTlvEvh/4WeEvBejsIfJ2tb2 /wAVviD4H12bzzK/lI2kxSgQsZY4y0e8bS3f3jSlLZN+ib3P6v6K/nn/AGYP+Dn3/gkv+0hd6Lo2 t/GDxV+zN4h1uEPBZ/tQeDZ/hr4chuhFFJLYXfxPtL3xB8KrK6iMpQLfeM7VLjypZbZ5oUMlf0Fa bqenazp9lq2kX9lqul6lawX2nalp11BfWF/ZXUazW15ZXtrJLbXdrcROksFxbyyQyxsro7KQaHdb 7+ZKaklKLUk1dNO6a7prRrzL1FFFAwooooAKKKKACiiigAooooAKKKKACiiigAr8jf8Agsv/AMFT vA//AASr/ZTvvinc2+leJvjb8Q7zUPBH7Pnw71SS6Fj4h8axaTc6rqXifxOLANfwfD/4e6RBJ4i8 XT2my71HZpvhXSpRrviPSkk/XEnAJ9AT+XNf5fH/AAc2/tPab8ev+CxOr/Bfx9d6ovwh/Zj8H+CP gtomnXd1BD4bm8X+JvDejfGPx7rDi2m+0pb6nrPiz4a6DrVxcG2ZpPCGn2xjFgtxNc8uOxSwOCxe NlSrV44TDV8S6OHh7TEVlQpyqOlQp3j7StU5eWnDmjzTaV1e57vC+RVOKeJeH+GqOPy3KqvEGd5X ktPM85xTwWUZdPNMbQwSx+aYxU6zwuX4R1vrGNxCpVXRw9OpUVObjyv8KfG37Q/xx/b2/am1z4z/ ALRnjbxZ8VfGviK01bVfEmqaxdta6pqPh/Q47m503wXoljBcx6V4L8GrqOrx2mleBPDLad4Y060f 7PeDWdTkvdf1D0rwv4P+C3jc2c1r8Gb3R2aFmkl1jwRd6LZWt1GiGezuZZylpeTwSs0AdFurSSaO RElfaRWt4x+FNzo9vpPiH4I6d4W8JeLdEnnkaOPTba0s/Euk3dv5dzo+o3MSHzoXZYbqATl45JYk 2z20nlXUXEaV+0L420LW9L0H4sfDa58MpeXtpptx4itpLqLTbee8mit4r2T7RHc6Z/Z4lk3XDW+v TyW6HISYKSf50z3Psz43jPM+Gq1eM6GD9lHK6OfvLM0wVSlUxTxGInlcakaWZU8VSnhnSqYerOov ZvDyUpWhH/Zjwp8J+BfouVcPwP434DKa2HzbiKnmVXj3MfCKlxzwHxRhcwwmQUsnyrC8d18FXx/B OKyPHYfO6eYYTOMDh8HUjjY5thqlGipYirb8ffAEXnh/xne6K+iWmrxWq3XhGDRNBh0e5SztInfU /Duv3dpcQW/iKw1uANbx293YRwWcjKzLeISlfq3/AMEB/wDgvn8S/wDgn78UfC/7P/x68Sa/44/Y r8e+ItM0vXNE1XUvt7fs8Pq7Q2h+K/w1Go3QfQfBGgyeVqHxV+F+kSHw6fDr6v448GaPousaDrOm eJ/k4EHByGXrkchl65GPvAjkY4bt1r84fiN+zr4r8Ox6x8R9KGn6lZW+qax4hvfCnlNFqGn6FNql 3eGxkcSTWWrQjTJXi1S1iWB1tpbi3iF6keybv8K/EDmljMr4jzOlB1sRgo5VPEONK9arTlQqYaPJ BQhGX1ejUc6jhB4irVnUnKviff8Ak/p7/REVGjw3x34L8D4/Ewy/KOJ6/H2GyhV8c6eX4DG4fNMJ nVV4jE1MRiK1P+18xwiw2FWIrwyjAYKhhMNRyrJZLDf7idhf2Wq2Nnqem3dtf6fqFrb31hfWc0dz Z3tldwpcWt3aXELPFcW1zBJHPBNE7RyxSI6MVYGrdfgl/wAG1P7SfiD9pD/gkp8A28Ya/H4m8XfA vVvHX7OGra2DdGfUdJ+E/iG4034f3N613eX88l83w0u/CEd5O91J9quInuQsayrGv7AftCftH/A7 9lH4Xa18a/2i/iV4d+Enwq8O3mi6frnjnxXLdQaHpd54i1W20TRILua0truWNtS1a8tdPtiYSjXN xFGzKXFf0Mf47b6nttFfHPhr/goH+xr40/aE8K/sqeD/ANoHwH4p/aD8ZeAF+KOj/C7w/dX2r+I4 PAsvh3TvFtprviBbKyls/Cn9oeG9W07WtN03xPdaVq9/p17b3VrYSRyqT4b+0B/wWX/4Jgfsu/FK 7+C3xy/bQ+DPgr4oaTqMGleJPB/9tXfiHU/B9/cW0d3HaeMz4ZsdYtvCd2LaaGea016eyureKeCS 4gjSeJnAP04pGYKrMxCqoLMxIAAAySSSAABySTgdSa4TwD8Ufhx8U/h94d+LHw28d+EvHfwy8W6D B4o8M+P/AAn4g0zXfB+u+HbiA3MWtaZ4h0+5n0y607yVd5LqO4McPlyrMY2ikC/mXqX/AAWi/wCC VvxC8T+J/gH4M/bp/Z98Q/E7V9I8R+HtG0iw8ZwvouueIJdK1G1g0TRPGkkMfgvV9Turlfs9lbWG v3DX9y8VrZG4uZoonAP1tWRHVXRlZGVXV1IKsrAFWVgSrKQQQykg560+v4Rf+CEP7Tf7QfgX/g35 /wCClfxg8M/FfxvffFH4B+OvFx+D+ueLNT1n4ny+AL3w3+zZ8A9XstC0LQPGV5rsSaLZ+J9Q1i5k 8E2cdvpX27UNStLKws2udif12eM/+Cg/7G3wz8TXfg34h/tC+A/DOsaLr+keDfFOrahLqv8Awgng 7xtrMmkWuneD/HXxNtdLn+G3gTxZqF9ruj2ln4a8W+K9G1m4u9X0u1isjPf2scoB9nUV5h8V/jV8 J/gZ4M/4WF8XviF4V+HngxtW0Hw/ba/4o1e206z1LxD4q1G30jwv4c0ZWZrjXPEnibVru10zw54f 0iG+1jXdRuYLLSrO7uZo4287+D37X37OPx517xR4T+F/xQ0vW/GngvRLHxP4p8B6xpPibwR8QtE8 LardX9jpfiu88AePNE8NeMR4T1S+0rUrDTfFEWiSaFqF/YXtlaX81zbTRIAfSdFfmR8Mf+Cpv7Nf j/48fHz4SXXxB8FaTovwt1j4P6H4H8SQ3/iS9vPiFffErwmmualv01/DNvDo39i61c2vhy0hS6vT fSrLeTTWyyxwp+m9ABRRRQA1+Vb/AHT/ACNf5IH/AAcV/Bf4laj/AMFs/wBqrwBo3hPXtb8WfEjx /wCC/G3w90HQtC1zxLr/AI40Txv8C/hXBYSeGPDfhjTdc8Q635GpeCfE2kXkdlpU5jutPkWRRBLH K/8Arg1mNo2kNqQ1h9M09tVVFiXUzY2h1BYwGRY1vjCbsIFdlCibaFYgAAnIHW/VO6fW61T9b6n+ bB/wT2/4Ie/Gr9o3/gnd8Q/ip8Kvixf63+2H8KPjN4g8A+IP2KPjH4Yt/hJc+CdD8PanYxWHhLxV 4m8WaVL8Tvhx8RPF/gbULT4q+D5PFmljwTLpWo6J4VuPDmn28154ktvy8+PGlat+zH8avG37O37R miy/Bv4s+AdWuNM13wp48utPtLOaBHzp+v8Ah/xDLJFonijwl4htGi1Twz4o0x1sdZ0yaOQxWOpQ ajpOm/61Ol/Br4U6J8U/FHxv0b4e+EtK+L3jfwvoXgrxl8R9O0SysvGHizwr4Yurq88N6H4l1u3j ju9dsfD9xfXraKmpvcvpa3l1FZPDDcTI+H8UvgF8IfivNa+IfGnwh+D3j7xx4c0++j8D+Ivid8N/ DvjiTw5qEkTyWTQzalaHVodNS/EM97ZaZqVhLcRq6wXFvMyzL+fcQ+GXC3EVWeKq4arl2OnJznjc sqQw86s27uVejOnVw1SUpNynU9jGvOTvKsz+v/B36cPj34OYHDZFgM8wHGXCmFpwoYfhrjnC184w 2Cw0EoxoZZmWHxmAzrBUqdOMKWGwrzGvlmFpQjCjl6Wh/kan4kfDMIX/AOFnfDLYozgfELwaW2hc /LCNa804HARYy5PyqhOBXzx8af2j/CFl4a1vw34K1EeIvEOr2N1pX23T45H0zSReRNbzzG7ePy72 /WKR0trG2E2Lhla7aKNWr/UD/bRvvCX7KH7FPxY8efFb9nb9l7xH+1V49ufEXw+/Zg+Hf7O/wjGp eIvjJ+0b4s8Can4b+Fll4M0zXfCGreLJPHWorY6p4r8Qm103XLb4a/D3RdaudS17xHonhTVPEt7/ ACA/Av8A4M7v26/iP8M/CnxG+Ifxg/Z5+BPjfV/D/h3VdP8Ahr4m0/4j+LPGHhN10TTGtLXxvceH Lmw8IaV4vtLhHn1zQ9Li8YaPYaqJbV9c1+IzXEvz2VeC/DuXY/D42tjsxzBYarCvDDV3h6dGdSnO M6ftvZUVOpBSV5QU4Rnop80HKMv2Ljz9pn4ycY8KZxwxlvC3BfCU87wGJyzFZ3lcc4xmZ4fB42hU w+L/ALO+v5jUwuExNWlUlThiZ4fE1MPGUp4d0sRGliKf9GH/AAaOfD/VPBv/AASkutdvWDad8R/2 pPjz4p8OOs808Uuj6JqWjfDuWeEyfu/KfW/BerIrwErKUaR/3pevbv8Ag6NtoLz/AII1/tAWl1GJ ba6+Jn7LdtcRHBEsE/7SXwzimjIYMpDxsykMGXnkGv0z/Yp+EvhP9j74W/CX9hT4eeEfFH/CCfs7 fBbwf4b0r4k6nDYR2vjLU9PtreLxBrGpx6fZWNtH4g8T61dX/iTULi2iS2vNRvtRWG2thbMi+af8 Fcf2GvGn/BRj9hz4jfsp+APHXhX4ceJ/Gvi34R+JLHxZ4z0zWNZ8PWCfDX4oeFviFc297pugz2uq XP8AaUPh1tOiW2urUpJciRriILur9i/H11fzfU/zeSSSSSSWiSVkl0SS0SXRI/Ej9iP9lP4E/sM/ 8EK7z/gp58L/AIeaX4s/b0vf+Cc/xA/acuv2nPiI194t+Kx8beMfgbfeIbfR7bxNfXMl9p3gnwnp 40rw/pPhzT3trFtI0G0uL0TajJdX8v5T/wDBGbxj+0t4P/4J96hpvgT/AIIPf8PDvDn7SfiX4w3v xp/ap8XfG/4O215+0Tc3njbxX4T1nTte0b4iad4k8U2Nn4bt7S68KX1pf6lG+q67a654smtodY12 /ubj+2/9kL9lCL4DfsG/AP8AYv8Aild+HviVafDL9m3wZ+z748u7Oyu4fDPjjT9C8EQeCvEDxafq GLyLSdfskuAbW6PnpBcmN2LLuP4UfCP/AIItf8FRP+Ce/iTxx4L/AOCXX/BSj4d+BP2TPFfiO98R eGvgB+0n8F5fiGPhteaqbE3c2j67bTaiuo38cVktlPqek2/g+LxFAF1bxZo2veNrjVvGGqAH4g69 4I/4KDf8E6/+Den/AIKP/CD41/CD4p/ADwz8RP2tvh1ofwe8A+MvFug+LtW074C/tAa5oMHxb+G2 j694d8S+LpBouttpmoeEdc1H7Ta6tr1z4y13X/sVjq+vXjxf0TfsVf8ABJD/AIJ2eIv+CM/wt8B+ JvgP8GviZD8cv2TPDPxP+I3xjk8LaPJ428VeO/G/wyt/Fk3j7w548CyeIvCyeHdRntv+FdWfh/V7 LTPA2h6NoujaDBa6dp0UI+3IP+CfHxd/aS/4J7/Ff9jP/gpj+0Np37S3jn4wal4pv9T+Mfwz+Huk /CmfwEbnXLLxT8Mpfh/opXUrCHV/g34k0+w1Hwjrl/Y+ZfjTbFdds7+Y39xf/kr+zj/wRK/4K3/C j4Yf8MQeL/8AgrLoif8ABPtlfw/qWifDD4STaB8e5/hjqB1AeJvhp4C8XeIZ9bu/hFofi5L65iuo tK8XeI7LwdZ38uk+BLTSNEtbPS4gD8mf+CMouZ/+DaT/AILJG3uLjTL+/wDEfxKlTULYul3aahqf 7JH7O0zatatG9u0Vyt3ctqNqYZIBDMYzBJEqIy/3o6R8EfhTbfBRPgIPAnhuf4QXvgW68A6n4Bvd LtL/AMOax4U1vSJtN13S9b029int9aTX4L29fXptUS7uNaur69vNUlurm7uJZPwN/Yy/4Ia/FP8A ZQ/4Jp/8FBv2B4/jN8M9avP2tfGvjzXvhd4qg0bxnNofw88P+Jvh14F+HWg6L4wt7y6g1rX5tB03 wPZS3NxpV1ZtqBlkSOWzLK0X9JdtE0MEMTEFo4ooyRnBKRqhIzzglSRnnHWgD8df2Sv2jdC/Z2/4 J3fsD+F/Fdj8TP2gPi54w8Oaf8CPgR4F0S20rxL8XPjB4q+Fnh/xqlvdXmu+I9Q8PeEPDv8AYfw1 +Hep+IvHfxL8c+IvCvhPRra0nN7rA1bWdG0nVPO/j94z/afl/wCCgf8AwSY8Y/Eb4CfB/wCDWkeI v2gP2hvg9L4r8NfHO9+KPxZ1Pwd4t/Y3+O/xG1T4XeItFHwS8JeHtN8Fa74n+EXgfx5rM+i/ErXR b+L/AIc+DYY9L1CEnV7T2u3/AGEPjp4A+Gf7EGs/Cf4kfDWP9oL9i3WfiiRY+LtL8RSfB74yeAPj JY+IdJ8ffDrWb+xhuPGHgK7uEuvCPiXwz8QdG0rX7/w74l8IRWl94c8R+GNa1rSb3e8WfsoftXfH j9pD9jP9pL4zfEn4VeCNO/ZR+MPjjx5afs8/DNPE3ivwdq+mePPgL8U/hDqPibWPih4l0Lwx4m8U fE7SLnx1p8fhSO38KeDvAmgeErrx7p+qaR4t8Sa54a8S+EgDuv2Zif8Ahu//AIKYZJP/ABP/ANkb v0z+z3aZ+me/+TX6JV+fmqfA/wDaa+Gv7W/xK+OnwJvfgl4t+Gv7RWg/A7R/i34H+KeqeM/BXijw H4m+EQ8U+H9Q+I/gHxF4R8LeNLTxz/wlvw+1vQNCl8BeJLLwhBpOteCtN1W18Xva6/qtpZ/V3hb/ AIW5/wALF8fHxafDH/CtnXTB8Po9LhkXXImjjC6idWuHupTcm4ctJKJLWzW1lWOGzN1C7ygA9Voo ooAKKKKACiiigDgtY+F3w+8QePvCHxS1zwlo2sfED4f6X4j0fwN4p1O2+3an4PsfF6WUPin/AIRl rl5INEvPENrp9nYavqenQ2+p3+mQLplxePp5a2bvaKKADHOefzP8ulFFFABRRRQAUUUUAFFFFABR RRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQAUUUUAFFFFABRRRQB/9k= ------=_Part_9372915_292966117.1423648670110-- ------=_Part_9372914_326988970.1423648670110--

4 6