oVirt & gluster - which copy is written to?
by Bill Bill
--_000_SN1PR08MB1389E9AA24246B61EE308341A6730SN1PR08MB1389namp_
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
SGVsbG8sDQoNCkxldOKAmXMgc2F5IEkgaGF2ZSBhIDUgbm9kZSBjb252ZXJnZWQgY2x1c3RlciBv
ZiBvVmlydCAmIGdsdXN0ZXJGUyB3aXRoIGEgcmVwbGljYSBjb3VudCBvZiDigJwz4oCdLg0KDQpI
b3N0MSAtIHJlcGxpY2ENCkhvc3QyIC0gcmVwbGljYQ0KSG9zdDMgLSByZXBsaWNhDQpIb3N0NA0K
SG9zdDUNCg0KSWYgSSBzcGluIGEgVk0gdXAgb24gSG9zdDEg4oCTIGRvZXMgdGhlIGZpcnN0IHJl
cGxpY2EgZ2V0IGNyZWF0ZWQgbG9jYWwgdG8gdGhhdCBzZXJ2ZXI/DQoNCkluIHRoZSBldmVudCBJ
IG1vdmUgdGhlIFZNIHRvIGFub3RoZXIgaG9zdCwgZG9lcyB0aGUgcmVwbGljYSBvZiB0aGUgZGlz
ayBmb2xsb3cgdGhlIFZNIHNvIGVzc2VudGlhbGx5IGl04oCZcyB3cml0aW5nIHRvIGEgbG9jYWwg
Y29weSBmaXJzdCBvciBkb2VzIGl0IOKAnGFsd2F5c+KAnSB3cml0ZSBhY3Jvc3MgdGhlIG5ldHdv
cmsuDQoNCkZvciBleGFtcGxlLCB3aXRoIFZNd2FyZSwgdGhlIGRpc2sgd2lsbCBmb2xsb3cgdGhl
IFZNIHRvIHRoZSBoeXBlcnZpc29yIHlvdSBtb3ZlIGl0IHRvIHNvIHRoYXQgdGhlIHdyaXRlcyBh
cmUgZXNzZW50aWFsbHkg4oCcbG9jYWzigJ0uDQoNCkkgaGF2ZSBub3QgYmVlbiBhYmxlIHRvIGZp
bmQgYW55dGhpbmcgb24gdGhlIGludGVybmV0IG9yIGluIHRoZSBkb2N1bWVudGF0aW9uIHRoYXQg
c3BlY2lmaWVzIGhvdyB0aGlzIHByb2Nlc3Mgd29ya3MuIElkZWFsbHksIHlvdSB3b3VsZG7igJl0
IHdhbnQgYSBWTSByZXNpZGluZyBvbiBIb3N0MSB0aGF0IGFjY2Vzc2VzIGl0cyBkaXNrIG9uIEhv
c3QzLiBNdWx0aXBsZSB0aGF0IGJ5IGh1bmRyZWRzIG9mIFZN4oCZcyBhbmQgaXQgd291bGQgY3Jl
YXRlIGEgdG9uIG9mIHVubmVjZXNzYXJ5IG5ldHdvcmsgY29uZ2VzdGlvbi4NCg0K
--_000_SN1PR08MB1389E9AA24246B61EE308341A6730SN1PR08MB1389namp_
Content-Type: text/html; charset="utf-8"
Content-ID: <7766EE5FA0193D41AFCE783FA42221BE(a)sct-15-1-485-2-msonline-outlook-1173a.templateTenant>
Content-Transfer-Encoding: base64
PGh0bWwgeG1sbnM6bz0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6b2ZmaWNlIiB4
bWxuczp3PSJ1cm46c2NoZW1hcy1taWNyb3NvZnQtY29tOm9mZmljZTp3b3JkIiB4bWxuczptPSJo
dHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL29mZmljZS8yMDA0LzEyL29tbWwiIHhtbG5zPSJo
dHRwOi8vd3d3LnczLm9yZy9UUi9SRUMtaHRtbDQwIj4NCjxoZWFkPg0KPG1ldGEgaHR0cC1lcXVp
dj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPg0KPG1l
dGEgbmFtZT0iR2VuZXJhdG9yIiBjb250ZW50PSJNaWNyb3NvZnQgV29yZCAxNSAoZmlsdGVyZWQg
bWVkaXVtKSI+DQo8c3R5bGU+PCEtLQ0KLyogRm9udCBEZWZpbml0aW9ucyAqLw0KQGZvbnQtZmFj
ZQ0KCXtmb250LWZhbWlseToiQ2FtYnJpYSBNYXRoIjsNCglwYW5vc2UtMToyIDQgNSAzIDUgNCA2
IDMgMiA0O30NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6Q2FsaWJyaTsNCglwYW5vc2UtMToy
IDE1IDUgMiAyIDIgNCAzIDIgNDt9DQovKiBTdHlsZSBEZWZpbml0aW9ucyAqLw0KcC5Nc29Ob3Jt
YWwsIGxpLk1zb05vcm1hbCwgZGl2Lk1zb05vcm1hbA0KCXttYXJnaW46MGluOw0KCW1hcmdpbi1i
b3R0b206LjAwMDFwdDsNCglmb250LXNpemU6MTEuMHB0Ow0KCWZvbnQtZmFtaWx5OiJDYWxpYnJp
IixzYW5zLXNlcmlmO30NCmE6bGluaywgc3Bhbi5Nc29IeXBlcmxpbmsNCgl7bXNvLXN0eWxlLXBy
aW9yaXR5Ojk5Ow0KCWNvbG9yOmJsdWU7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQph
OnZpc2l0ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQNCgl7bXNvLXN0eWxlLXByaW9yaXR5
Ojk5Ow0KCWNvbG9yOiM5NTRGNzI7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQouTXNv
Q2hwRGVmYXVsdA0KCXttc28tc3R5bGUtdHlwZTpleHBvcnQtb25seTt9DQpAcGFnZSBXb3JkU2Vj
dGlvbjENCgl7c2l6ZTo4LjVpbiAxMS4waW47DQoJbWFyZ2luOjEuMGluIDEuMGluIDEuMGluIDEu
MGluO30NCmRpdi5Xb3JkU2VjdGlvbjENCgl7cGFnZTpXb3JkU2VjdGlvbjE7fQ0KLS0+PC9zdHls
ZT4NCjwvaGVhZD4NCjxib2R5IGxhbmc9IkVOLVVTIiBsaW5rPSJibHVlIiB2bGluaz0iIzk1NEY3
MiI+DQo8ZGl2IGNsYXNzPSJXb3JkU2VjdGlvbjEiPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+SGVs
bG8sPC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+Jm5ic3A7PC9wPg0KPHAgY2xhc3M9Ik1zb05v
cm1hbCI+TGV04oCZcyBzYXkgSSBoYXZlIGEgNSBub2RlIGNvbnZlcmdlZCBjbHVzdGVyIG9mIG9W
aXJ0ICZhbXA7IGdsdXN0ZXJGUyB3aXRoIGEgcmVwbGljYSBjb3VudCBvZiDigJwz4oCdLjwvcD4N
CjxwIGNsYXNzPSJNc29Ob3JtYWwiPiZuYnNwOzwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPkhv
c3QxIC0gcmVwbGljYTwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPkhvc3QyIC0gcmVwbGljYTwv
cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPkhvc3QzIC0gcmVwbGljYTwvcD4NCjxwIGNsYXNzPSJN
c29Ob3JtYWwiPkhvc3Q0PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+SG9zdDU8L3A+DQo8cCBj
bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWls
eTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPiZuYnNwOzwvc3Bhbj48L3A+DQo8
cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZh
bWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPklmIEkgc3BpbiBhIFZNIHVw
IG9uIEhvc3QxIOKAkyBkb2VzIHRoZSBmaXJzdCByZXBsaWNhIGdldCBjcmVhdGVkIGxvY2FsIHRv
IHRoYXQgc2VydmVyPzwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls
ZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVv
dDssc2VyaWYiPiZuYnNwOzwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBz
dHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4m
cXVvdDssc2VyaWYiPkluIHRoZSBldmVudCBJIG1vdmUgdGhlIFZNIHRvIGFub3RoZXIgaG9zdCwg
ZG9lcyB0aGUgcmVwbGljYSBvZiB0aGUgZGlzayBmb2xsb3cgdGhlIFZNIHNvIGVzc2VudGlhbGx5
IGl04oCZcyB3cml0aW5nIHRvIGEgbG9jYWwgY29weSBmaXJzdCBvciBkb2VzIGl0IOKAnGFsd2F5
c+KAnSB3cml0ZSBhY3Jvc3MNCiB0aGUgbmV0d29yay48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1z
b05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7
VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj4mbmJzcDs8L3NwYW4+PC9wPg0KPHAgY2xhc3M9
Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1
b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj5Gb3IgZXhhbXBsZSwgd2l0aCBWTXdhcmUs
IHRoZSBkaXNrIHdpbGwgZm9sbG93IHRoZSBWTSB0byB0aGUgaHlwZXJ2aXNvciB5b3UgbW92ZSBp
dCB0byBzbyB0aGF0IHRoZSB3cml0ZXMgYXJlIGVzc2VudGlhbGx5IOKAnGxvY2Fs4oCdLg0KPC9z
cGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIu
MHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+Jm5ic3A7
PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6
MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+SSBo
YXZlIG5vdCBiZWVuIGFibGUgdG8gZmluZCBhbnl0aGluZyBvbiB0aGUgaW50ZXJuZXQgb3IgaW4g
dGhlIGRvY3VtZW50YXRpb24gdGhhdCBzcGVjaWZpZXMgaG93IHRoaXMgcHJvY2VzcyB3b3Jrcy4g
SWRlYWxseSwgeW91IHdvdWxkbuKAmXQgd2FudCBhIFZNIHJlc2lkaW5nIG9uIEhvc3QxIHRoYXQN
CiBhY2Nlc3NlcyBpdHMgZGlzayBvbiBIb3N0My4gTXVsdGlwbGUgdGhhdCBieSBodW5kcmVkcyBv
ZiBWTeKAmXMgYW5kIGl0IHdvdWxkIGNyZWF0ZSBhIHRvbiBvZiB1bm5lY2Vzc2FyeSBuZXR3b3Jr
IGNvbmdlc3Rpb24uPC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxvOnA+Jm5ic3A7
PC9vOnA+PC9wPg0KPC9kaXY+DQo8L2JvZHk+DQo8L2h0bWw+DQo=
--_000_SN1PR08MB1389E9AA24246B61EE308341A6730SN1PR08MB1389namp_--
7 years, 11 months
IsolatedNetworks
by Winfried de Heiden
Hi All,
As described on http://old.ovirt.org/Features/IsolatedNetworks,
Isolated networks in one of proposed features of oVirt 4.0:
"The current host networking api (up to ovirt-engine-3.6) requires a
network to be configured on top of a network interface.
In order to configure a local network on the host the user had to
create a dummy interface to which the network was attached.
The Isolated Networks feature aimed to configure a local host on the
network which isn't connected to any network interface and allows vms
which are connected to it to communicate with each other.
Isolated Networks will be limited to VM networks only and only MTU
should be relevant in that network definition for the created isolated
network."
Hence, I should be able to create a host-only network with an
underlaying NIC; sounds nice for my @home Cloud...
However, runing oVirt 4.0 it is still complaining a NIC is misssing. I
might have configured something wrong. How to set create an isolated
network? Is there already any documentation?
Kind regards,
Winny
7 years, 11 months
VMs seems to be slow, while snapshot delete is happening
by SATHEESARAN
Hi All,
I have created a VM with 60GB of disk space.
I have started I/O inside the VM, after sometime when the disk was 4GB full,
I took a snapshot of the disk from UI.
I/O kept continuing and the new image file ( overlay file ) was 15GB in
size.
Now I deleted the snapshot.
I think this would initiate block-merges.
During this time, my I/O was were slower, till the snapshot delete is
completed.
Its not very slow, but slow.
Is this a known behavior ?
Advance thanks,
Satheesaran S
7 years, 11 months
Re: [ovirt-users] Adding another host to my cluster
by Charles Tassell
Hey Gervais,
Try enabling NetworkManager and firewalld before doing the
hosted-engine --deploy. I have run into problems with oVirt trying to
perform tasks on hosts where firewalld is disabled, so maybe you are
running into a similar problem. Also, I think the setup script will
disable NetworkManager if it needs to. I know I didn't manually disable
it on any of the boxes I installed on.
On 16-05-12 04:49 PM, users-request(a)ovirt.org wrote:
> Message: 1
> Date: Thu, 12 May 2016 14:22:12 -0300
> From: Gervais de Montbrun <gervais(a)demontbrun.com>
> To: Wee Sritippho <wee.s(a)forest.go.th>
> Cc: users <users(a)ovirt.org>
> Subject: Re: [ovirt-users] Adding another host to my cluster
> Message-ID: <28B7FC74-5C52-4F60-B9F3-39A36621A7CA(a)demontbrun.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hi Wee
> (and others)
>
> Thanks for the reply. I tried what you suggested, but I am in the exact same state. :-(
>
> I don't want to completely remove my hosted engine setup as it is working on the two other hosts in my cluster. I did not run the rm -rf stes listed here (https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-f... <https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-f...>) that would wipe my hosted_engine nfs mount. If you know that this is 100% necessary, please let me know.
>
> I did:
> hosted-engine --clean-metadata --force-cleanup --host-id=3
> run the bash script to remove all of the ovirt packages and config files
> reinstalled ovirt-hosted-engine-setup
> ran "hosted-engine --deploy"
>
> I'm back exactly where I started. Is there a way to run just the network configuration part of the deploy?
>
> Since the last attempt, I did upgrade my hosted engine and my cluster is now running oVirt 3.6.5.
>
> Cheers,
> Gervais
>
>
>
>> On May 12, 2016, at 11:50 AM, Wee Sritippho <wee.s(a)forest.go.th> wrote:
>>
>> Hi,
>>
>> I used to have a similar problem where one of my host can't be deployed due to the absence of ovirtmgmt bridge. Simone said it's a bug ( https://bugzilla.redhat.com/1323465 <https://bugzilla.redhat.com/1323465> ) which would be fixed in 3.6.6.
>>
>> This is what I've done to solve it:
>>
>> 1. In the web UI, set the failed host to maintenance.
>> 2. Remove it.
>> 3. In that host, run a script from https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-f... <https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-f...>
>> 4. Install ovirt-hosted-engine-setup again.
>> 5. Redeploy again.
>>
>> Hope that helps
>>
>> On 11 ??????? 2016 22 ?????? 48 ???? 58 ?????? GMT+07:00, Gervais de Montbrun <gervais(a)demontbrun.com> wrote:
>> Hi Folks,
>>
>> I hate to reply to my own message, but I'm really hoping someone can help me with my issue
>> http://lists.ovirt.org/pipermail/users/2016-May/039690.html <http://lists.ovirt.org/pipermail/users/2016-May/039690.html>
>>
>> Does anyone have a suggestion for me? If there is any more information that I can provide that would help you to help me, please advise.
>>
>> Cheers,
>> Gervais
>>
>>
>>
>>> On May 9, 2016, at 1:42 PM, Gervais de Montbrun <gervais(a)demontbrun.com <mailto:gervais@demontbrun.com>> wrote:
>>>
>>> Hi All,
>>>
>>> I'm trying to add a third host into my oVirt cluster. I have hosted engine setup on the first two. It's failing to finish the hosted-engine --deploy on this third host. I wiped the server and did a CentOS 7 minimum install and ran it again to have a clean machine.
>>>
>>> My setup:
>>> CentOS 7 clean install
>>> yum install -y http://resources.ovirt.org/pub/yum-repo/ovirt-release36.rpm <http://resources.ovirt.org/pub/yum-repo/ovirt-release36.rpm>
>>> yum install -y ovirt-hosted-engine-setup
>>> yum upgrade -y && reboot
>>> systemctl disable NetworkManager ; systemctl stop NetworkManager ; systemctl disable firewalld ; systemctl stop firewalld
>>> hosted-engine --deploy
>>>
>>> hosted-engine --deploy always throws an error:
>>> [ ERROR ] The VDSM host was found in a failed state. Please check engine and bootstrap installation logs.
>>> [ ERROR ] Unable to add Cultivar2 to the manager
>>> and then echo's
>>> [ INFO ] Waiting for VDSM hardware info
>>> ...
>>> [ ERROR ] Failed to execute stage 'Closing up': VDSM did not start within 120 seconds
>>> [ INFO ] Stage: Clean up
>>> [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20160509131103.conf'
>>> [ INFO ] Stage: Pre-termination
>>> [ INFO ] Stage: Termination
>>> [ ERROR ] Hosted Engine deployment failed: this system is not reliable, please check the issue, fix and redeploy
>>> Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20160509130658-qb8ev0.log
>>>
>>> Full output of hosted-engine --deploy included in the attached zip file.
>>> I've also included vdsm.log (There is more than one tries worth of tries in there).
>>> You'll also find the ovirt-hosted-engine-setup-20160509130658-qb8ev0.log listed above.
>>>
>>> This is my "test" setup. Cultivar0 is my first host and my nfs server for storage. I have two hosts in the setup already and everything is working fine. The host does show up in the oVirt admin, but shows "Installed Failed"
>>> <PastedGraphic-1.png>
>>>
>>> Trying to reinstall from within the interface just fails again.
>>>
>>> The ovirt bridge interface is not configured and there are no config files in /etc/sysconfi/network-scripts related to ovirt.
>>>
>>> OS:
>>> [root@cultivar2 ovirt-hosted-engine-setup]# cat /etc/redhat-release
>>> CentOS Linux release 7.2.1511 (Core)
>>>
>>> [root@cultivar2 ovirt-hosted-engine-setup]# uname -a
>>> Linux cultivar2.grove.silverorange.com <http://cultivar2.grove.silverorange.com/> 3.10.0-327.13.1.el7.x86_64 #1 SMP Thu Mar 31 16:04:38 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
>>>
>>> Versions:
>>> [root@cultivar2 ovirt-hosted-engine-setup]# rpm -qa | grep -i ovirt
>>> libgovirt-0.3.3-1.el7_2.1.x86_64
>>> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch
>>> ovirt-host-deploy-1.4.1-1.el7.centos.noarch
>>> ovirt-vmconsole-1.0.0-1.el7.centos.noarch
>>> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch
>>> ovirt-release36-007-1.noarch
>>> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
>>> ovirt-setup-lib-1.0.1-1.el7.centos.noarch
>>> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch
>>> [root@cultivar2 ovirt-hosted-engine-setup]#
>>> [root@cultivar2 ovirt-hosted-engine-setup]#
>>> [root@cultivar2 ovirt-hosted-engine-setup]#
>>> [root@cultivar2 ovirt-hosted-engine-setup]# rpm -qa | grep -i virt
>>> libvirt-daemon-driver-secret-1.2.17-13.el7_2.4.x86_64
>>> virt-viewer-2.0-6.el7.x86_64
>>> libgovirt-0.3.3-1.el7_2.1.x86_64
>>> libvirt-daemon-kvm-1.2.17-13.el7_2.4.x86_64
>>> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch
>>> fence-virt-0.3.2-2.el7.x86_64
>>> virt-what-1.13-6.el7.x86_64
>>> libvirt-python-1.2.17-2.el7.x86_64
>>> libvirt-daemon-1.2.17-13.el7_2.4.x86_64
>>> libvirt-daemon-config-nwfilter-1.2.17-13.el7_2.4.x86_64
>>> libvirt-lock-sanlock-1.2.17-13.el7_2.4.x86_64
>>> libvirt-daemon-driver-nodedev-1.2.17-13.el7_2.4.x86_64
>>> libvirt-daemon-driver-network-1.2.17-13.el7_2.4.x86_64
>>> libvirt-daemon-driver-storage-1.2.17-13.el7_2.4.x86_64
>>> ovirt-host-deploy-1.4.1-1.el7.centos.noarch
>>> virt-v2v-1.28.1-1.55.el7.centos.2.x86_64
>>> ovirt-vmconsole-1.0.0-1.el7.centos.noarch
>>> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch
>>> libvirt-client-1.2.17-13.el7_2.4.x86_64
>>> libvirt-daemon-driver-nwfilter-1.2.17-13.el7_2.4.x86_64
>>> ovirt-release36-007-1.noarch
>>> libvirt-daemon-driver-interface-1.2.17-13.el7_2.4.x86_64
>>> libvirt-daemon-driver-qemu-1.2.17-13.el7_2.4.x86_64
>>> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
>>> ovirt-setup-lib-1.0.1-1.el7.centos.noarch
>>> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch
>>>
>>> I also have a series of stuck tasks that I can't clear related to the host that can't be added... This is a secondary issue and I don't want to get off track, but they look like this:
>>> <PastedGraphic-2.png>
>>>
>>> I'd appreciate any help that can be offered.
>>>
>>> Cheers,
>>> Gervais
>>>
>>>
>>> Gervais de Montbrun
>>> Systems Administrator / silverorange Inc.
>>>
>>> Phone +1 902 367 4532 ext. 104 <tel:+1 902 367 4532 ext. 104>
>>> Mobile +1 902 978 0009 <tel:+1 902 978 0009>
>>>
>>> <hosted-engine--deploy-logs.zip>
>>
>>
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users <http://lists.ovirt.org/mailman/listinfo/users>
>>
>> --
>> Wee
>
7 years, 11 months
USB
by Brett I. Holcomb
How do I get a VM to see USB devices? If I understand it correctly I
have to go to Edit VM -> Console and enable USB native. I have the
console options set to use usb. However, I'm finding conflicting
information. Supposedly libvirt will allow sharing of a USB device
over a network but to start with I'd be happy just being able to
connect a usb device to the host and having it detected. I have some
programmable devices I'd like to program in Linux using my VM.
Has anyone uses usbip and if so how well does it work?
7 years, 11 months
Unable to install 3.6.5 under CentOS 6.7
by Tom Lambdin
--Apple-Mail=_08403896-EA5E-474D-91FC-4F685EBD9816
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
Hi,
Although the release note indicates that 3.6.5 is supported under =
CentOS/RHEL 6.7, when we attempt to update to the the latest version =
under CentOS 6.7, the highest version we can get from the repo is 3.6.3.
If we spin up a brand new machine running CentOS 7.2, we do however =
successfully get 3.6.5. Ideally we=E2=80=99d like to avoid having to =
migrate our management host to CentOS 7 at this time.
Is there something we=E2=80=99re missing here or is there a problem with =
the repo configuration?
Regards,
-Tom Lambdin
--Apple-Mail=_08403896-EA5E-474D-91FC-4F685EBD9816
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
filename=signature.asc
Content-Type: application/pgp-signature;
name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iQEcBAEBCgAGBQJXOZngAAoJEHN9aBbFQxh53lQH/24JE/jH6N3NTanyJVAH49ul
7TUUZCySt1EMW4Gvqypld2IWsUKbh/JnORlqXU4jWmvBrjRcVWEj+mWLRPmFp0/o
WbRCGK4OJvgDgYTxssmjWPe2wxWdEw0XCJsT1pmWyYSLjO4M0ZKWfXxKG9sFOihe
8KgNLYSLIHSbBCqrckb1S9GwjHpemxYGtupDJOhMpo10vXwFkmED6+maUGsYhK3W
7xcIIciKRZjVn52BRyQ+wE/9AYoaDpn37NSJG74JAx8abkC2zsSoPQf+W5raEPWe
RA/zGCUUYEadQPjMoQkrgQenAMYzDeHs+6CB0qRzrGEVwMg2M+fgIx2PiFWriWE=
=blJi
-----END PGP SIGNATURE-----
--Apple-Mail=_08403896-EA5E-474D-91FC-4F685EBD9816--
7 years, 11 months
disk order in vm and disk order in export
by Fabrice Bacchella
--Apple-Mail=_0FD01BB4-6FFE-420A-805E-4CF6B336A6A8
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
I have a VM with the following disks (in the ordrer return by a get =
query):
=20
<Disk =
href=3D"/api/vms/2ddfb8c3-d258-4d3e-9f65-fc247d0a03f6/disks/1180405d-699e-=
4594-bf73-8b1b170f38a9" id=3D"1180405d-699e-4594-bf73-8b1b170f38a9">
...
<name>vm_sys</name>
<actual_size>17179869184</actual_size> <- 16GiB
<interface>virtio_scsi</interface>
<bootable>true</bootable>
<storage_type>image</storage_type>
</Disk>
<Disk =
href=3D"/api/vms/2ddfb8c3-d258-4d3e-9f65-fc247d0a03f6/disks/1fe74758-c521-=
40ed-b8e5-d02d80188088" id=3D"1fe74758-c521-40ed-b8e5-d02d80188088">
<name>vm_data</name>
<interface>virtio_scsi</interface>
<bootable>false</bootable>
<lun_storage id=3D"3600c0ff00026285a2091355701000000">
<logical_unit id=3D"3600c0ff00026285a2091355701000000">
<size>1099511627776</size> <- 1 TiB.
<paths>0</paths>
</logical_unit>
</lun_storage>
<storage_type>lun</storage_type>
</Disk>
So the first one is a 16 GiB virtual disk, the second one a 1 iTB direct =
access LUN that will contains data.
But once booterd, I see:
lsblk =20
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1T 0 disk=20
...
sdb 8:16 0 16G 0 disk=20
...
and :
ls -l /dev/disk/by-*/*
...
lrwxrwxrwx. 1 root root 9 May 16 09:03 =
/dev/disk/by-path/pci-0000:00:04.0-scsi-0:0:0:0 -> ../../sda
lrwxrwxrwx. 1 root root 9 May 16 09:03 =
/dev/disk/by-path/pci-0000:00:04.0-scsi-0:0:0:1 -> ../../sdb
So the first disk sda is the second non bootable disk.
What set the disk order associated to a VM ? Is there a way to enforce =
that the first disk is really the first disk ?=
--Apple-Mail=_0FD01BB4-6FFE-420A-805E-4CF6B336A6A8
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=us-ascii
<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html =
charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D""><div style=3D"margin: 0px 0px 0px 6px; font-family: =
'Helvetica Neue';" class=3D""><span style=3D"font-family: Helvetica;" =
class=3D"">I have a VM with the following disks (in the ordrer return by =
a get query):</span><div class=3D"" style=3D"font-family: =
Helvetica;"> <div class=3D""><div class=3D"" style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"><Disk =
href=3D"/api/vms/2ddfb8c3-d258-4d3e-9f65-fc247d0a03f6/disks/1180405d-699e-=
4594-bf73-8b1b170f38a9" =
id=3D"1180405d-699e-4594-bf73-8b1b170f38a9"></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
...</div><div class=3D"" style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"> =
<name>vm_sys</name></div><div class=3D"" style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;"> =
<actual_size>17179869184</actual_size> <- 16GiB</div><div =
class=3D"" style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;"> =
<interface>virtio_scsi</interface></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<bootable>true</bootable></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<storage_type>image</storage_type></div><div class=3D""=
style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;"></Disk></div><div class=3D"" style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo; min-height: 13px;"><br =
class=3D""></div><div class=3D"" style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"><Disk =
href=3D"/api/vms/2ddfb8c3-d258-4d3e-9f65-fc247d0a03f6/disks/1fe74758-c521-=
40ed-b8e5-d02d80188088" =
id=3D"1fe74758-c521-40ed-b8e5-d02d80188088"></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<name>vm_data</name></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<interface>virtio_scsi</interface></div><div class=3D""=
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<bootable>false</bootable></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<lun_storage =
id=3D"3600c0ff00026285a2091355701000000"></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
<logical_unit =
id=3D"3600c0ff00026285a2091355701000000"></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
=
<size>1099511627776</size> <- 1 TiB.</div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
=
<paths>0</paths></div><div class=3D"" style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> =
</logical_unit></div><div class=3D"" style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> =
</lun_storage></div><div class=3D"" style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> =
<storage_type>lun</storage_type></div><div class=3D"" =
style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;"></Disk></div></div><div class=3D""><br class=3D""></div><div=
class=3D"">So the first one is a 16 GiB virtual disk, the second one a =
1 iTB direct access LUN that will contains data.</div></div><div =
class=3D"" style=3D"font-family: Helvetica;"><br class=3D""></div><div =
class=3D"" style=3D"font-family: Helvetica;">But once booterd, I =
see:</div><div class=3D"" style=3D"font-family: Helvetica;"><div =
class=3D"">lsblk </div><div class=3D"">NAME =
MAJ:MIN RM SIZE RO TYPE MOUNTPOINT</div><div =
class=3D"">sda 8:0 0 =
1T 0 disk </div></div><div class=3D"" =
style=3D"font-family: Helvetica;">...</div><div class=3D"" =
style=3D"font-family: Helvetica;"><div class=3D"">sdb =
8:16 0 16G 0 =
disk </div></div><div class=3D"" style=3D"font-family: =
Helvetica;">...</div><div class=3D"" style=3D"font-family: =
Helvetica;"><br class=3D""></div><div class=3D"" style=3D"font-family: =
Helvetica;">and :</div><div class=3D"" style=3D"font-family: =
Helvetica;"><div class=3D"">ls -l /dev/disk/by-*/*</div></div><div =
class=3D"" style=3D"font-family: Helvetica;">...</div><div class=3D"" =
style=3D"font-family: Helvetica;"><div class=3D"">lrwxrwxrwx. 1 root =
root 9 May 16 09:03 =
/dev/disk/by-path/pci-0000:00:04.0-scsi-0:0:0:0 -> =
../../sda</div></div><div class=3D"" style=3D"font-family: =
Helvetica;"><div class=3D"">lrwxrwxrwx. 1 root root 9 May 16 09:03 =
/dev/disk/by-path/pci-0000:00:04.0-scsi-0:0:0:1 -> =
../../sdb</div></div><div class=3D"" style=3D"font-family: =
Helvetica;"><br class=3D""></div><div class=3D"" style=3D"font-family: =
Helvetica;">So the first disk sda is the second non bootable =
disk.</div><div class=3D"" style=3D"font-family: Helvetica;">What set =
the disk order associated to a VM ? Is there a way to enforce that the =
first disk is really the first disk ?</div></div></body></html>=
--Apple-Mail=_0FD01BB4-6FFE-420A-805E-4CF6B336A6A8--
7 years, 11 months
USB
by Brett I. Holcomb
How do I get a VM to see USB devices? If I understand it correctly I
have to go to Edit VM -> Console and enable USB native. I have the
console options set to use usb. However, I'm finding conflicting
information. Supposedly libvirt will allow sharing of a USB device
over a network but to start with I'd be happy just being able to
connect a usb device to the host and having it detected. I have some
programmable devices I'd like to program in Linux using my VM.
Has anyone uses usbip and if so how well does it work?
7 years, 11 months
Failed to activate Storage Domain infer (Data Center Default) by admin
by William Kwan
------=_Part_1857742_1292403466.1463201198840
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
hi all,
I still have the lock error which I need some help to resolve. I found some=
posts used sanlock command. But I'm not sure if it fit in my case.=C2=A0Th=
anks in advance.=C2=A0libvirtError: Failed to acquire lock: No space left o=
n deviceThread-49::DEBUG::2016-05-13 22:02:49,693::vm::2779::vm.Vm::(setDow=
nStatus) vmId=3D`bd48bba5-4109-4a58-ac89-832add1f4de4`::Changed state to Do=
wn: Failed to acquire lock: No space left on device=C2=A0
I wasn't able to bring up the hosted-engine on Node1 and I got the above er=
ror. =C2=A0I was able to run `hosted-engine --start-pool` on Node2, but not=
Node1.
#hosted-engine --start-poolConnecting Storage Pool
Starting SPMf5f78fb8-42e3-46e5-93c2-6c3b00914048Activating Storage DomainRe=
source timeout: ()
With the "Storage pool" up on Node2, I was able to start the hosted-engine.=
=C2=A0But when I try to active the Master storage domain called 'infra'
"Host cannot access the Storage Domain(s) <UNKNOWN> attached to the Data Ce=
nter Default. Setting Host state to Non-Operational""Failed to connect Host=
to Storage Pool Default"
Tried again and I would get=C2=A0"Failed to activate Storage Domain infra (=
Data Center Default)"
ThanksW
------=_Part_1857742_1292403466.1463201198840
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><head></head><body><div style=3D"color:#000; background-color:#fff; f=
ont-family:Courier New, courier, monaco, monospace, sans-serif;font-size:13=
px"><div id=3D"yui_3_16_0_ym19_1_1463183424286_23613"><font size=3D"2" id=
=3D"yui_3_16_0_ym19_1_1463183424286_27097">hi all,</font></div><div id=3D"y=
ui_3_16_0_ym19_1_1463183424286_23613"><font size=3D"2"><br></font></div><di=
v id=3D"yui_3_16_0_ym19_1_1463183424286_23613" dir=3D"ltr"><font size=3D"2"=
id=3D"yui_3_16_0_ym19_1_1463183424286_27250">I still have the lock error w=
hich I need some help to resolve. I found some posts used sanlock command. =
But I'm not sure if it fit in my case. </font><span style=3D"font-size=
: small;">Thanks in advance.</span></div><div id=3D"yui_3_16_0_ym19_1_14631=
83424286_23613" dir=3D"ltr"><font size=3D"2" id=3D"yui_3_16_0_ym19_1_146318=
3424286_27109"> </font></div><div style=3D"margin-top: 0px; margin-bot=
tom: 0px; line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_26357=
"><span id=3D"yui_3_16_0_ym19_1_1463183424286_26358"><font size=3D"2" id=3D=
"yui_3_16_0_ym19_1_1463183424286_27151">libvirtError: Failed to acquire loc=
k: No space left on device</font></span></div><div id=3D"yui_3_16_0_ym19_1_=
1463183424286_26359"></div><div style=3D"margin-top: 0px; margin-bottom: 0p=
x; line-height: normal;" dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1463183424286_=
26360"><span id=3D"yui_3_16_0_ym19_1_1463183424286_26361"><font size=3D"2" =
id=3D"yui_3_16_0_ym19_1_1463183424286_27149">Thread-49::DEBUG::2016-05-13 2=
2:02:49,693::vm::2779::vm.Vm::(setDownStatus) vmId=3D`bd48bba5-4109-4a58-ac=
89-832add1f4de4`::Changed state to Down: Failed to acquire lock: No space l=
eft on device </font></span></div><div style=3D"margin-top: 0px; margi=
n-bottom: 0px; line-height: normal;" dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_14=
63183424286_26360"><span><font size=3D"2"><br></font></span></div><div styl=
e=3D"margin-top: 0px; margin-bottom: 0px; line-height: normal;" dir=3D"ltr"=
id=3D"yui_3_16_0_ym19_1_1463183424286_26360"><span><font size=3D"2"><br></=
font></span></div><div style=3D"margin-top: 0px; margin-bottom: 0px; line-h=
eight: normal;" dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1463183424286_26360"><s=
pan id=3D"yui_3_16_0_ym19_1_1463183424286_26372"><font size=3D"2" id=3D"yui=
_3_16_0_ym19_1_1463183424286_27110">I wasn't able to bring up the hosted-en=
gine on Node1 and I got the above error. I was able to run `hosted-en=
gine --start-pool` on Node2, but not Node1.</font></span></div><div style=
=3D"margin-top: 0px; margin-bottom: 0px; line-height: normal;" dir=3D"ltr" =
id=3D"yui_3_16_0_ym19_1_1463183424286_26360"><div style=3D"margin-top: 0px;=
margin-bottom: 0px; line-height: normal;" id=3D"yui_3_16_0_ym19_1_14631834=
24286_26491"><div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_14=
63183424286_26541"><span style=3D"font-variant-ligatures: no-common-ligatur=
es"><font size=3D"2"><br></font></span></div><div style=3D"line-height: nor=
mal;" id=3D"yui_3_16_0_ym19_1_1463183424286_26541"><span style=3D"font-vari=
ant-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_2=
6542"><font size=3D"2" id=3D"yui_3_16_0_ym19_1_1463183424286_27154">#hosted=
-engine --start-pool</font></span></div>
<div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_2=
6543"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui=
_3_16_0_ym19_1_1463183424286_26544"><font size=3D"2" id=3D"yui_3_16_0_ym19_=
1_1463183424286_27120">Connecting Storage Pool</font></span></div>
<div style=3D"line-height: normal; min-height: 14px;" id=3D"yui_3_16_0_ym19=
_1_1463183424286_26545"><font size=3D"2"><span style=3D"font-variant-ligatu=
res: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_26546"></sp=
an><br id=3D"yui_3_16_0_ym19_1_1463183424286_26547"></font></div>
<div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_2=
6548"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui=
_3_16_0_ym19_1_1463183424286_26549"><font size=3D"2" id=3D"yui_3_16_0_ym19_=
1_1463183424286_27112">Starting SPM</font></span></div>
<div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_2=
6550"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui=
_3_16_0_ym19_1_1463183424286_26551"><font size=3D"2">f5f78fb8-42e3-46e5-93c=
2-6c3b00914048</font></span></div>
<div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_2=
6552"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui=
_3_16_0_ym19_1_1463183424286_26553"><font size=3D"2">Activating Storage Dom=
ain</font></span></div>
<div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_2=
6554"><span style=3D"font-variant-ligatures: no-common-ligatures" id=3D"yui=
_3_16_0_ym19_1_1463183424286_26555"><font size=3D"2" id=3D"yui_3_16_0_ym19_=
1_1463183424286_27114">Resource timeout: ()</font></span></div><div dir=3D"=
ltr" id=3D"yui_3_16_0_ym19_1_1463183424286_26556"><span style=3D"font-varia=
nt-ligatures: no-common-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_26=
557"><font size=3D"2"><br id=3D"yui_3_16_0_ym19_1_1463183424286_26558"></fo=
nt></span></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1463183424286_2655=
6"><span style=3D"font-variant-ligatures: no-common-ligatures"><font size=
=3D"2"><br></font></span></div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_146=
3183424286_26556"><span style=3D"font-variant-ligatures: no-common-ligature=
s"><font size=3D"2"><br></font></span></div><div dir=3D"ltr" id=3D"yui_3_16=
_0_ym19_1_1463183424286_26556"><span style=3D"font-variant-ligatures: no-co=
mmon-ligatures" id=3D"yui_3_16_0_ym19_1_1463183424286_26626"><font size=3D"=
2" id=3D"yui_3_16_0_ym19_1_1463183424286_27106">With the "Storage pool" up =
on Node2, I was able to start the hosted-engine. But when I try to ac=
tive the Master storage domain called 'infra'</font></span></div><div dir=
=3D"ltr" id=3D"yui_3_16_0_ym19_1_1463183424286_26556"><span style=3D"font-v=
ariant-ligatures: no-common-ligatures"><font size=3D"2"><br></font></span><=
/div><div dir=3D"ltr" id=3D"yui_3_16_0_ym19_1_1463183424286_26556"><div sty=
le=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_26737" di=
r=3D"ltr"><font size=3D"2" id=3D"yui_3_16_0_ym19_1_1463183424286_27104">"Ho=
st cannot access the Storage Domain(s) <UNKNOWN> attached to the Data=
Center Default. Setting Host state to Non-Operational"</font></div><div st=
yle=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_26737" d=
ir=3D"ltr"><font size=3D"2" id=3D"yui_3_16_0_ym19_1_1463183424286_27116">"F=
ailed to connect Host to Storage Pool Default"</font></div><div style=3D"li=
ne-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_26737" dir=3D"ltr=
"><font size=3D"2"><br></font></div><div style=3D"line-height: normal;" id=
=3D"yui_3_16_0_ym19_1_1463183424286_26737" dir=3D"ltr"><font size=3D"2" id=
=3D"yui_3_16_0_ym19_1_1463183424286_27102">Tried again and I would get =
;</font></div><div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1=
463183424286_26737" dir=3D"ltr"><font size=3D"2" id=3D"yui_3_16_0_ym19_1_14=
63183424286_27100">"Failed to activate Storage Domain infra (Data Center De=
fault)"</font></div><div style=3D"line-height: normal;" id=3D"yui_3_16_0_ym=
19_1_1463183424286_26737" dir=3D"ltr"><font size=3D"2"><br></font></div><di=
v style=3D"line-height: normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_2673=
7" dir=3D"ltr"><font size=3D"2"><br></font></div><div style=3D"line-height:=
normal;" id=3D"yui_3_16_0_ym19_1_1463183424286_26737" dir=3D"ltr"><font si=
ze=3D"2">Thanks</font></div><div style=3D"line-height: normal;" id=3D"yui_3=
_16_0_ym19_1_1463183424286_26737" dir=3D"ltr"><font size=3D"2" id=3D"yui_3_=
16_0_ym19_1_1463183424286_27099">W</font></div></div></div></div></div></bo=
dy></html>
------=_Part_1857742_1292403466.1463201198840--
7 years, 11 months
