<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-AU;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-AU" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoPlainText">Hi Michael,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Thanks for this information - it's great, the guide should be updated on the ovirt webpage to reflect the information you've provided below.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Just to hopefully help someone else out in the future - we had only 1 vNIC defined in the UCS Service Profile, this caused problems when we enabled dynamic vnic's on that host.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">The resolution was leave the initial interface as it is.. and as a management interface and setup another interface for the dynamic vnics. Ensure that your "vNIC/vHBA Placement" doesn't change either!<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><img width="658" height="112" id="Picture_x0020_1" src="cid:image001.png@01D16A5D.E23F0A20"><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">So in this case eth0 = ovirtmgmt bridge, and ovirt device is the vNICs.<o:p></o:p></p>
<p class="MsoPlainText"><br>
When the system reboots after this change I’ve lost my bridge and vdsmd failed to start.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I manually setup the first interface again so I can talk to it again and I’ve even setup the bridge.... but I can’t get it working again? Below is what I see in the logs. I’ve even tried a re-installation(ovirt maint/reinstall) but no
joy..<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I’ve managed to get this working on 1 host.. but no idea what I did that was different!?.. If I remove the vNIC ovirt it starts working as expected - where can I find out some more information on what vdsm is doing?<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">systemd: Started Auxiliary vdsm service for running helper functions as root.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Starting Auxiliary vdsm service for running helper functions as root...<o:p></o:p></p>
<p class="MsoPlainText">systemd: Starting Virtualization daemon...<o:p></o:p></p>
<p class="MsoPlainText">journal: libvirt version: 1.2.17, package: 13.el7_2.2 (CentOS BuildSystem <http://bugs.centos.org>, 2015-12-09-13:08:22, worker1.bsys.centos.org)<o:p></o:p></p>
<p class="MsoPlainText">journal: Module /usr/lib64/libvirt/connection-driver/libvirt_driver_lxc.so not accessible<o:p></o:p></p>
<p class="MsoPlainText">systemd: Started Virtualization daemon.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Starting Virtual Desktop Server Manager network restoration...<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/share/vdsm/vdsm-restore-net-config", line 425, in <module><o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: restore(args)<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/share/vdsm/vdsm-restore-net-config", line 388, in restore<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: unified_restoration()<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/share/vdsm/vdsm-restore-net-config", line 110, in unified_restoration<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: _remove_networks_in_running_config()<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/share/vdsm/vdsm-restore-net-config", line 195, in _remove_networks_in_running_config<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: _inRollback=True)<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/share/vdsm/network/api.py", line 932, in setupNetworks<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: "system" % network)<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: network.errors.ConfigNetworkError: (27, "Cannot delete network 'ovirtmgmt': It doesn't exist in the system")<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: Traceback (most recent call last):<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/bin/vdsm-tool", line 219, in main<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: return tool_command[cmd]["command"](*args)<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/tool/restore_nets.py", line 41, in restore_command<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: exec_restore(cmd)<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/tool/restore_nets.py", line 54, in exec_restore<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: raise EnvironmentError('Failed to restore the persisted networks')<o:p></o:p></p>
<p class="MsoPlainText">vdsm-tool: EnvironmentError: Failed to restore the persisted networks<o:p></o:p></p>
<p class="MsoPlainText">systemd: vdsm-network.service: main process exited, code=exited, status=1/FAILURE<o:p></o:p></p>
<p class="MsoPlainText">systemd: Failed to start Virtual Desktop Server Manager network restoration.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Dependency failed for Virtual Desktop Server Manager.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Dependency failed for MOM instance configured for VDSM purposes.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Job mom-vdsm.service/start failed with result 'dependency'.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Job vdsmd.service/start failed with result 'dependency'.<o:p></o:p></p>
<p class="MsoPlainText">systemd: Unit vdsm-network.service entered failed state.<o:p></o:p></p>
<p class="MsoPlainText">systemd: vdsm-network.service failed.<o:p></o:p></p>
<p class="MsoPlainText">systemd-logind: Removed session 5.<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Cheers<o:p></o:p></p>
<p class="MsoPlainText">David<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">-----Original Message-----<o:p></o:p></p>
<p class="MsoPlainText">From: Michael Burman [<a href="mailto:mburman@redhat.com">mailto:mburman@redhat.com</a>]
<o:p></o:p></p>
<p class="MsoPlainText">Sent: Wednesday, February 17, 2016 16:56<o:p></o:p></p>
<p class="MsoPlainText">To: David LeVene <<a href="mailto:David.LeVene@blackboard.com">David.LeVene@blackboard.com</a>><o:p></o:p></p>
<p class="MsoPlainText">Cc: <a href="mailto:users@ovirt.org">users@ovirt.org</a><o:p></o:p></p>
<p class="MsoPlainText">Subject: Re: [ovirt-users] UCS Integration (vmfex/SRIOV)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">HI David)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">If everything configured properly on your UCS side and you have a working Port Profile id/name your next steps should be:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">1) Run for example:<o:p></o:p></p>
<p class="MsoPlainText">engine-config -s CustomDeviceProperties="{type=interface;prop={ifacemacspoof=^(true|false)$;queues=[1-9][0-9]*;vmfex=^[a-zA-Z0-9_.-]{2,32}$;SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}}"
--cver=3.5<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">- Restart your ovirt-engine service<o:p></o:p></p>
<p class="MsoPlainText">- with --cver=3.5 you can specify your cluster version level. ^^<o:p></o:p></p>
<p class="MsoPlainText">- If you don't want that it will overwrite your current attributes, you have to send them all as well(like on my example above). ^^<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">2) Install vdsm-hook-vmfex-dev on your nodes <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">3) In ovirt engine you can verify that host have the hooks installed under 'Hosts' main tab - > 'Host Hooks' sub tab You should see there: a) before_device_migrate_destination b) before_device_create c) before_nic_hotplug<o:p></o:p></p>
<p class="MsoPlainText"><o:p></o:p></p>
<p class="MsoPlainText">4) Create new network and edit the vNIC profile. Choose from the CustomDeviceProperties the 'vmfex' key(like in your example) and in the right field enter your Port Profile id/name(the one that is configured on your UCS side)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">5) Go to 'Setup Networks' sub tab under 'Hosts' -> attach the network with the vmfex profile to NIC on host(drag it)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">6) Create VM or use exist one, create/add new vNIC to the VM with the vmfex profile<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">7) Run VM <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Good luck)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">----- Original Message -----<o:p></o:p></p>
<p class="MsoPlainText">From: "David LeVene" <<a href="mailto:David.LeVene@blackboard.com">David.LeVene@blackboard.com</a>><o:p></o:p></p>
<p class="MsoPlainText">To: <a href="mailto:users@ovirt.org">users@ovirt.org</a><o:p></o:p></p>
<p class="MsoPlainText">Sent: Wednesday, February 17, 2016 5:41:21 AM<o:p></o:p></p>
<p class="MsoPlainText">Subject: [ovirt-users] UCS Integration (vmfex/SRIOV)<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Hey All, <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I’ve got a test instance and would like to get vmfex working. I’m very new to ovirt, so some of the basics are still new to me.
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I currently have a 3 node setup which are all configured without vmfex, what I’d like to do is convert the hosts one by one to use vmfex.
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">From the UCS side of things it works and I’m presented with the SRIOV devices in the host.. but I can’t get the network config in the ovirt admin setup..
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I’m following this guide, but not getting very far… <a href="http://www.ovirt.org/Features/UCS_Integration">
http://www.ovirt.org/Features/UCS_Integration</a> <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">This step says to do this, which is fine.. but when I do this I overwrite the current attribute in there.
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">engine-config -s CustomDeviceProperties='{type=interface;prop={vmfex=^[a-zA-Z0-9_.-]{2,32}$}}'
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">which is… <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"># engine-config -g CustomDeviceProperties <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.0 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.1 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.2 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.3 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: {type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}} version: 3.4
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: {type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}} version: 3.5
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: {type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}} version: 3.6
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">When I update it using the command above, it replaces it…
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">When I append the 2 together, I get see vmfex & prop in the ovirt-engine (screen shot) side of things.. so can someone please check my command to ensure I’m not missing something!
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">engine-config -s CustomDeviceProperties='{type=interface;prop={vmfex=^[a-zA-Z0-9_.-]{2,32}$}}{type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}}’
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"># engine-config -g CustomDeviceProperties <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.0 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.1 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.2 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: version: 3.3 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: {type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}} version: 3.4
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: {type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}} version: 3.5
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">CustomDeviceProperties: {type=interface;prop={vmfex=^[a-zA-Z0-9_.-]{2,32}$}}{type=interface;prop={SecurityGroups=^(?:(?:[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}, *)*[0-9a-fA-F]{8}-(?:[0-9a-fA-F]{4}-){3}[0-9a-fA-F]{12}|)$}}
version: 3.6 <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">As soon as I enable vmfex on a host that was previously working.. it stops working and the network no longer works on the host… (this is not using any of the config above.. just enabled the vmfex in the UCS manager)
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">What is the “correct” way to bring a Host in ovirt using vmfex?
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Regards <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">David <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">This email and any attachments may contain confidential and proprietary information of Blackboard that is for the sole use of the intended recipient. If you are not the intended recipient, disclosure, copying, re-distribution or other
use of any of this information is strictly prohibited. Please immediately notify the sender and delete this transmission if you received this email in error.
<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">_______________________________________________<o:p></o:p></p>
<p class="MsoPlainText">Users mailing list<o:p></o:p></p>
<p class="MsoPlainText"><a href="mailto:Users@ovirt.org">Users@ovirt.org</a><o:p></o:p></p>
<p class="MsoPlainText"><a href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">--<o:p></o:p></p>
<p class="MsoPlainText">Michael Burman<o:p></o:p></p>
<p class="MsoPlainText">RedHat Israel, RHEV-M QE Network Team<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Mobile: 054-5355725<o:p></o:p></p>
<p class="MsoPlainText">IRC: mburman<o:p></o:p></p>
</div>
This email and any attachments may contain confidential and proprietary information of Blackboard that is for the sole use of the intended recipient. If you are not the intended recipient, disclosure, copying, re-distribution or other use of any of this information
is strictly prohibited. Please immediately notify the sender and delete this transmission if you received this email in error.
</body>
</html>