<div dir="ltr">When I trigger the live snapshot while pinging the guest I get the following high latency but no packet loss:<div><br></div><div>...</div><div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=32 ttl=63 time=0.267 ms</div>
<div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=33 ttl=63 time=0.319 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=34 ttl=63 time=0.231 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=35 ttl=63 time=0.294 ms</div>
<div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=36 ttl=63 time=0.357 ms</div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=37 ttl=63 time=10375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=38 ttl=63 time=9375 ms</b></div>
<div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=39 ttl=63 time=8375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=40 ttl=63 time=7375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=41 ttl=63 time=6375 ms</b></div>
<div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=42 ttl=63 time=5375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=43 ttl=63 time=4375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=44 ttl=63 time=3375 ms</b></div>
<div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=45 ttl=63 time=2375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=46 ttl=63 time=1375 ms</b></div><div><b>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=47 ttl=63 time=375 ms</b></div>
<div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=48 ttl=63 time=0.324 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=49 ttl=63 time=0.232 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=50 ttl=63 time=0.318 ms</div>
<div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=51 ttl=63 time=0.297 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=52 ttl=63 time=0.343 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=53 ttl=63 time=0.293 ms</div>
<div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=54 ttl=63 time=0.286 ms</div></div><div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=55 ttl=63 time=0.302 ms</div><div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=56 ttl=63 time=0.304 ms</div>
<div>64 bytes from <a href="http://10.0.6.228">10.0.6.228</a>: icmp_seq=57 ttl=63 time=0.305 ms</div><div>^C</div><div>--- 10.0.6.228 ping statistics ---</div><div>57 packets transmitted, 57 received, 0% packet loss, time 56000ms</div>
<div>rtt min/avg/max/mdev = 0.228/1037.547/10375.035/2535.522 ms, pipe 11</div></div><div><br></div><div>So the guest is in some sort of paused mode, but its interesting that the pings seems to be queued rather than dropped.</div>
</div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><span style="font-family:arial,sans-serif;font-size:16px"><strong>Steve Dainard </strong></span><span style="font-size:12px"></span><br>
<span style="font-family:arial,sans-serif;font-size:12px">IT Infrastructure Manager<br>
<a href="http://miovision.com/" target="_blank">Miovision</a> | <em>Rethink Traffic</em><br>
519-513-2407 ex.250<br>
877-646-8476 (toll-free)<br>
<br>
<strong style="font-family:arial,sans-serif;font-size:13px;color:#999999"><a href="http://miovision.com/blog" target="_blank">Blog</a> | </strong><font color="#999999" style="font-family:arial,sans-serif;font-size:13px"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">LinkedIn</a> | <a href="https://twitter.com/miovision" target="_blank">Twitter</a> | <a href="https://www.facebook.com/miovision" target="_blank">Facebook</a></strong></font> </span>
<hr style="font-family:arial,sans-serif;font-size:13px;color:#333333;clear:both">
<div style="color:#999999;font-family:arial,sans-serif;font-size:13px;padding-top:5px">
        <span style="font-family:arial,sans-serif;font-size:12px">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br>
        <span style="font-family:arial,sans-serif;font-size:12px">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div>
</div></div>
<br><br><div class="gmail_quote">On Mon, Feb 3, 2014 at 12:08 PM, Maor Lipchuk <span dir="ltr"><<a href="mailto:mlipchuk@redhat.com" target="_blank">mlipchuk@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
>From the engine logs it seems that indeed live snapshot is called (The<br>
command is snapshotVDSCommand see [1]).<br>
This is done right after the snapshot has been created in the VM and it<br>
signals the qemu process to start using the new volume created.<br>
<br>
When live snapshot does not succeed we should see in the log something<br>
like "Wasn't able to live snapshot due to error:...", but it does not<br>
appear so it seems that this worked out fine.<br>
<br>
At some point I can see in the logs that VDSM reports to the engine that<br>
the VM is paused.<br>
<br>
<br>
[1]<br>
2014-02-02 09:41:20,564 INFO<br>
[org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand]<br>
(pool-6-thread-49) START, SnapshotVDSCommand(HostName = ovirt002, HostId<br>
= 3080fb61-2d03-4008-b47f-9b66276a4257,<br>
vmId=e261e707-a21f-4ae8-9cff-f535f4430446), log id: 7e0d7872<br>
2014-02-02 09:41:21,119 INFO<br>
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]<br>
(DefaultQuartzScheduler_Worker-93) VM snapshot-test<br>
e261e707-a21f-4ae8-9cff-f535f4430446 moved from Up --> Paused<br>
2014-02-02 09:41:30,234 INFO<br>
[org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand]<br>
(pool-6-thread-49) FINISH, SnapshotVDSCommand, log id: 7e0d7872<br>
2014-02-02 09:41:30,238 INFO<br>
[org.ovirt.engine.core.bll.CreateSnapshotCommand] (pool-6-thread-49)<br>
[67ea047a] Ending command successfully:<br>
org.ovirt.engine.core.bll.CreateSnapshotCommand<br>
...<br>
<br>
Regards,<br>
Maor<br>
<div class="HOEnZb"><div class="h5"><br>
On 02/03/2014 06:24 PM, Dafna Ron wrote:<br>
> Thanks Steve.<br>
><br>
> from the logs I can see that the create snapshot succeeds and that the<br>
> vm is resumed.<br>
> the vm moves to pause as part of libvirt flows:<br>
><br>
> 2014-02-02 14:41:20.872+0000: 5843: debug : qemuProcessHandleStop:728 :<br>
> Transitioned guest snapshot-test to paused state<br>
> 2014-02-02 14:41:30.031+0000: 5843: debug : qemuProcessHandleResume:776<br>
> : Transitioned guest snapshot-test out of paused into resumed state<br>
><br>
> There are bugs here but I am not sure yet if this is libvirt regression<br>
> or engine.<br>
><br>
> I'm adding Elad and Maor since in engine logs I can't see anything<br>
> calling for live snapshot (only for snapshot) - Maor, shouldn't live<br>
> snapshot command be logged somewhere in the logs?<br>
> Is it possible that engine is calling to create snapshot and not create<br>
> live snapshot which is why the vm pauses?<br>
><br>
> Elad, if engine is not logging live snapshot anywhere I would open a bug<br>
> for engine (to print that in the logs).<br>
> Also, there is a bug in vdsm log for sdc where the below is logged as<br>
> ERROR and not INFO:<br>
><br>
> Thread-23::ERROR::2014-02-02<br>
> 09:51:19,497::sdc::137::Storage.StorageDomainCache::(_findDomain)<br>
> looking for unfetched domain a52938f7-2cf4-4771-acb2-0c78d14999e5<br>
> Thread-23::ERROR::2014-02-02<br>
> 09:51:19,497::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain)<br>
> looking for domain a52938f7-2cf4-4771-acb2-0c78d14999e5<br>
><br>
> If the engine was sending live snapshot or if there is no difference in<br>
> the two commands in engine side than I would open a bug for libvirt for<br>
> pausing the vm during live snapshot.<br>
><br>
> Dafna<br>
><br>
> On 02/03/2014 02:41 PM, Steve Dainard wrote:<br>
>> [root@ovirt002 ~]# vdsClient -s 0 getStorageDomainInfo<br>
>> a52938f7-2cf4-4771-acb2-0c78d14999e5<br>
>> uuid = a52938f7-2cf4-4771-acb2-0c78d14999e5<br>
>> pool = ['fcb89071-6cdb-4972-94d1-c9324cebf814']<br>
>> lver = 5<br>
>> version = 3<br>
>> role = Master<br>
>> remotePath = gluster-store-vip:/rep1<br>
>> spm_id = 2<br>
>> type = NFS<br>
>> class = Data<br>
>> master_ver = 1<br>
>> name = gluster-store-rep1<br>
>><br>
>><br>
>> *Steve Dainard *<br>
>> IT Infrastructure Manager<br>
>> Miovision <<a href="http://miovision.com/" target="_blank">http://miovision.com/</a>> | /Rethink Traffic/<br>
>> <a href="tel:519-513-2407" value="+15195132407">519-513-2407</a> ex.250<br>
>> <a href="tel:877-646-8476" value="+18776468476">877-646-8476</a> (toll-free)<br>
>><br>
>> *Blog <<a href="http://miovision.com/blog" target="_blank">http://miovision.com/blog</a>> | **LinkedIn<br>
>> <<a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">https://www.linkedin.com/company/miovision-technologies</a>> | Twitter<br>
>> <<a href="https://twitter.com/miovision" target="_blank">https://twitter.com/miovision</a>> | Facebook<br>
>> <<a href="https://www.facebook.com/miovision" target="_blank">https://www.facebook.com/miovision</a>>*<br>
>> ------------------------------------------------------------------------<br>
>> Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener,<br>
>> ON, Canada | N2C 1L3<br>
>> This e-mail may contain information that is privileged or<br>
>> confidential. If you are not the intended recipient, please delete the<br>
>> e-mail and any attachments and notify us immediately.<br>
>><br>
>><br>
>> On Sun, Feb 2, 2014 at 2:55 PM, Dafna Ron <<a href="mailto:dron@redhat.com">dron@redhat.com</a><br>
>> <mailto:<a href="mailto:dron@redhat.com">dron@redhat.com</a>>> wrote:<br>
>><br>
>> please run vdsClient -s 0 getStorageDomainInfo<br>
>> a52938f7-2cf4-4771-acb2-0c78d14999e5<br>
>><br>
>> Thanks,<br>
>><br>
>> Dafna<br>
>><br>
>><br>
>><br>
>> On 02/02/2014 03:02 PM, Steve Dainard wrote:<br>
>><br>
>> Logs attached with VM running on qemu-kvm-rhev packages<br>
>> installed.<br>
>><br>
>> *Steve Dainard *<br>
>> IT Infrastructure Manager<br>
>> Miovision <<a href="http://miovision.com/" target="_blank">http://miovision.com/</a>> | /Rethink Traffic/<br>
>> <a href="tel:519-513-2407" value="+15195132407">519-513-2407</a> <tel:<a href="tel:519-513-2407" value="+15195132407">519-513-2407</a>> ex.250<br>
>><br>
>> <a href="tel:877-646-8476" value="+18776468476">877-646-8476</a> <tel:<a href="tel:877-646-8476" value="+18776468476">877-646-8476</a>> (toll-free)<br>
>><br>
>> *Blog <<a href="http://miovision.com/blog" target="_blank">http://miovision.com/blog</a>> | **LinkedIn<br>
>> <<a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">https://www.linkedin.com/company/miovision-technologies</a>> |<br>
>> Twitter <<a href="https://twitter.com/miovision" target="_blank">https://twitter.com/miovision</a>> | Facebook<br>
>> <<a href="https://www.facebook.com/miovision" target="_blank">https://www.facebook.com/miovision</a>>*<br>
>><br>
>> ------------------------------------------------------------------------<br>
>> Miovision Technologies Inc. | 148 Manitou Drive, Suite 101,<br>
>> Kitchener, ON, Canada | N2C 1L3<br>
>> This e-mail may contain information that is privileged or<br>
>> confidential. If you are not the intended recipient, please<br>
>> delete the e-mail and any attachments and notify us immediately.<br>
>><br>
>><br>
>> On Sun, Feb 2, 2014 at 5:05 AM, Dafna Ron <<a href="mailto:dron@redhat.com">dron@redhat.com</a><br>
>> <mailto:<a href="mailto:dron@redhat.com">dron@redhat.com</a>> <mailto:<a href="mailto:dron@redhat.com">dron@redhat.com</a><br>
>> <mailto:<a href="mailto:dron@redhat.com">dron@redhat.com</a>>>> wrote:<br>
>><br>
>> can you please upload full engine, vdsm, libvirt and vm's<br>
>> qemu logs?<br>
>><br>
>><br>
>> On 02/02/2014 02:08 AM, Steve Dainard wrote:<br>
>><br>
>> I have two CentOS 6.5 Ovirt hosts (ovirt001, ovirt002)<br>
>><br>
>> I've installed the applicable qemu-kvm-rhev packages<br>
>> from this<br>
>> site: <a href="http://www.dreyou.org/ovirt/vdsm32/Packages/" target="_blank">http://www.dreyou.org/ovirt/vdsm32/Packages/</a> on<br>
>> ovirt002.<br>
>><br>
>> On ovirt001 if I take a live snapshot:<br>
>><br>
>> Snapshot 'test qemu-kvm' creation for VM<br>
>> 'snapshot-test' was<br>
>> initiated by admin@internal.<br>
>> The VM is paused<br>
>> Failed to create live snapshot 'test qemu-kvm' for VM<br>
>> 'snapshot-test'. VM restart is recommended.<br>
>> Failed to complete snapshot 'test qemu-kvm' creation<br>
>> for VM<br>
>> 'snapshot-test'.<br>
>> The VM is then started, and the status for the snapshot<br>
>> changes to OK.<br>
>><br>
>> On ovirt002 (with the packages from dreyou) I don't<br>
>> get any<br>
>> messages about a snapshot failing, but my VM is still<br>
>> paused<br>
>> to complete the snapshot. Is there something else<br>
>> other than<br>
>> the qemu-kvm-rhev packages that would enable this<br>
>> functionality?<br>
>><br>
>> I've looked for some information on when the packages<br>
>> would be<br>
>> built as required in the CentOS repos, but I don't see<br>
>> anything definitive.<br>
>><br>
>> <a href="http://lists.ovirt.org/pipermail/users/2013-December/019126.html" target="_blank">http://lists.ovirt.org/pipermail/users/2013-December/019126.html</a><br>
>> Looks like one of the maintainers is waiting for<br>
>> someone to<br>
>> tell him what flags need to be set.<br>
>><br>
>> Also, another thread here:<br>
>> <a href="http://comments.gmane.org/gmane.comp.emulators.ovirt.arch/1618" target="_blank">http://comments.gmane.org/gmane.comp.emulators.ovirt.arch/1618</a><br>
>> same maintainer, mentioning that he hasn't seen<br>
>> anything in<br>
>> the bug tracker.<br>
>><br>
>> There is a bug here:<br>
>> <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1009100" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1009100</a> that seems<br>
>> to have ended in finding a way for qemu to expose<br>
>> whether it<br>
>> supports live snapshots, rather than figuring out how<br>
>> to get<br>
>> the CentOS team the info they need to build the<br>
>> packages with<br>
>> the proper flags set.<br>
>><br>
>> I have bcc'd both dreyou (packaged the qemu-kvm-rhev<br>
>> packages<br>
>> listed above) and Russ (CentOS maintainer mentioned in<br>
>> the<br>
>> other threads) if they wish to chime in and perhaps<br>
>> collaborate on which flags, if any, should be set for the<br>
>> qemu-kvm builds so we can get a CentOS bug report<br>
>> going and<br>
>> hammer this out.<br>
>><br>
>> Thanks everyone.<br>
>><br>
>> **crosses fingers and hopes for live snapshots soon**<br>
>><br>
>><br>
>><br>
>> *Steve Dainard *<br>
>> IT Infrastructure Manager<br>
>> Miovision <<a href="http://miovision.com/" target="_blank">http://miovision.com/</a>> | /Rethink Traffic/<br>
>> <a href="tel:519-513-2407" value="+15195132407">519-513-2407</a> <tel:<a href="tel:519-513-2407" value="+15195132407">519-513-2407</a>> <tel:<a href="tel:519-513-2407" value="+15195132407">519-513-2407</a><br>
>> <tel:<a href="tel:519-513-2407" value="+15195132407">519-513-2407</a>>> <tel:<a href="tel:519-513-2407" value="+15195132407">519-513-2407</a> <tel:<a href="tel:519-513-2407" value="+15195132407">519-513-2407</a>><br>
>> <tel:519-513-2407 <tel:519-513-2407>>> ex.250<br>
>> 877-646-8476 <tel:877-646-8476> <tel:877-646-8476<br>
>> <tel:877-646-8476>> <tel:877-646-8476 <tel:877-646-8476><br>
>><br>
>> <tel:877-646-8476 <tel:877-646-8476>>> (toll-free)<br>
>><br>
>> *Blog <<a href="http://miovision.com/blog" target="_blank">http://miovision.com/blog</a>> | **LinkedIn<br>
>><br>
>> <<a href="https://www.linkedin.com/company/miovision-technologies" target="_blank">https://www.linkedin.com/company/miovision-technologies</a>> |<br>
>> Twitter <<a href="https://twitter.com/miovision" target="_blank">https://twitter.com/miovision</a>> | Facebook<br>
>> <<a href="https://www.facebook.com/miovision" target="_blank">https://www.facebook.com/miovision</a>>*<br>
>><br>
>> ------------------------------------------------------------------------<br>
>><br>
>><br>
>> Miovision Technologies Inc. | 148 Manitou Drive, Suite<br>
>> 101,<br>
>> Kitchener, ON, Canada | N2C 1L3<br>
>> This e-mail may contain information that is privileged or<br>
>> confidential. If you are not the intended recipient,<br>
>> please<br>
>> delete the e-mail and any attachments and notify us<br>
>> immediately.<br>
>><br>
>><br>
>> On Fri, Jan 31, 2014 at 1:26 PM, Steve Dainard<br>
>> <<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a><br>
>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a><br>
>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a>>><br>
>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a><br>
>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a>><br>
>><br>
>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a><br>
>> <mailto:<a href="mailto:sdainard@miovision.com">sdainard@miovision.com</a>>>>> wrote:<br>
>><br>
>><br>
>> How would you developers, speaking for the<br>
>> oVirt-community,<br>
>> propose to<br>
>> solve this for CentOS _now_ ?<br>
>><br>
>> I would imagine that the easiest way is that<br>
>> you build and<br>
>> host this one<br>
>> package(qemu-kvm-rhev), since you´ve basically<br>
>> already<br>
>> have<br>
>> the source<br>
>> and recipe (since you´re already providing it<br>
>> for RHEV<br>
>> anyway). Then,<br>
>> once that´s in place, it´s more a question of<br>
>> where to<br>
>> host the<br>
>> packages, in what repository. Be it your own,<br>
>> or some<br>
>> other<br>
>> repo set up<br>
>> for the SIG.<br>
>><br>
>> This is my view, how I as a user view this issue.<br>
>><br>
>><br>
>><br>
>> I think this is a pretty valid view.<br>
>><br>
>> What would it take to get the correct qemu package<br>
>> hosted<br>
>> in the<br>
>> ovirt repo?<br>
>><br>
>> --<br>
>><br>
>> Med Vänliga Hälsningar<br>
>><br>
>><br>
>> -------------------------------------------------------------------------------<br>
>><br>
>> Karli Sjöberg<br>
>> Swedish University of Agricultural Sciences<br>
>> Box 7079<br>
>> (Visiting<br>
>> Address<br>
>> Kronåsvägen 8)<br>
>> S-750 07 Uppsala, Sweden<br>
>> Phone: +46-(0)18-67 15 66<br>
>> <tel:%2B46-%280%2918-67%2015%2066><br>
>> <tel:%2B46-%280%2918-67%2015%2066><br>
>> <tel:%2B46-%280%2918-67%2015%2066><br>
>> <a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a>><br>
>> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a>>><br>
>> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a><br>
>> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a>> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a><br>
>> <mailto:<a href="mailto:karli.sjoberg@slu.se">karli.sjoberg@slu.se</a>>>><br>
>><br>
>> _______________________________________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>><br>
>> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>>><br>
>> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>><br>
>> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>>>><br>
>><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
>><br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> _______________________________________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>><br>
>> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a> <mailto:<a href="mailto:Users@ovirt.org">Users@ovirt.org</a>>><br>
>><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
>><br>
>><br>
>><br>
>> -- Dafna Ron<br>
>><br>
>><br>
>><br>
>><br>
>> -- Dafna Ron<br>
>><br>
>><br>
><br>
><br>
<br>
</div></div></blockquote></div><br></div>