[ovirt-users] Re-add a node
James James
jreg2k at gmail.com
Fri Apr 11 15:32:11 UTC 2014
vdsm is started on node1 now. Now I have this error :
root at node1 ~]# vdsClient -s 0 getConnectedStoragePoolsList
Traceback (most recent call last):
File "/usr/share/vdsm/vdsClient.py", line 2538, in <module>
code, message = commands[command][0](commandArgs)
File "/usr/share/vdsm/vdsClient.py", line 1150, in
getConnectedStoragePoolsList
pools = self.s.getConnectedStoragePoolsList()
File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
return self.__send(self.__name, args)
File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
verbose=self.__verbose
File "/usr/lib64/python2.6/xmlrpclib.py", line 1235, in request
self.send_content(h, request_body)
File "/usr/lib64/python2.6/xmlrpclib.py", line 1349, in send_content
connection.endheaders()
File "/usr/lib64/python2.6/httplib.py", line 908, in endheaders
self._send_output()
File "/usr/lib64/python2.6/httplib.py", line 780, in _send_output
self.send(msg)
File "/usr/lib64/python2.6/httplib.py", line 739, in send
self.connect()
File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py",
line 195, in connect
cert_reqs=self.cert_reqs)
File "/usr/lib64/python2.6/ssl.py", line 342, in wrap_socket
suppress_ragged_eofs=suppress_ragged_eofs)
File "/usr/lib64/python2.6/ssl.py", line 120, in __init__
self.do_handshake()
File "/usr/lib64/python2.6/ssl.py", line 279, in do_handshake
self._sslobj.do_handshake()
SSLError: [Errno 1] _ssl.c:492: error:14090086:SSL
routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed
[root at node1 ~]#
2014-04-11 17:18 GMT+02:00 Dafna Ron <dron at redhat.com>:
> Can you please restart vdsm on the second host and see if it can connect
> to the pool and if the errors are gone once you restart?
>
> Thanks,
>
> Dafna
>
>
>
> On 04/11/2014 04:00 PM, James James wrote:
>
>> I am using a iscsi storage
>>
>> On node2 :
>> [root at node2 ~]# vdsClient -s 0 getConnectedStoragePoolsList
>> 9ca706b7-bc4f-4f88-bd80-a1203e4bd2ce
>>
>> On node1 :
>> [root at node1 ~]# vdsClient -s 0 getConnectedStoragePoolsList
>> Connection to ovirt-node1.example.com:54321 <http://ovirt-node1.example.
>> com:54321> refused
>>
>>
>>
>>
>> 2014-04-11 16:47 GMT+02:00 Dafna Ron <dron at redhat.com <mailto:
>> dron at redhat.com>>:
>>
>> This is the error:
>>
>> Thread-26::ERROR::2014-04-11
>> 15:52:39,788::task::866::TaskManager.Task::(_setError)
>> Task=`e69fe141-ea0c-4ec0-8c7b-a597ce1bc3af`::Unexpected error
>> Traceback (most recent call last):
>> File "/usr/share/vdsm/storage/task.py", line 873, in _run
>> return fn(*args, **kargs)
>> File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>> res = f(*args, **kwargs)
>> File "/usr/share/vdsm/storage/hsm.py", line 3546, in
>> fenceSpmStorage
>> pool.invalidateMetadata()
>> AttributeError: 'StoragePool' object has no attribute
>> 'invalidateMetadata'
>>
>>
>> What storage are you using (iscsi/nfs)
>>
>> can you please run:
>>
>> vdsClient -s 0 getConnectedStoragePoolsList
>>
>>
>>
>>
>> On 04/11/2014 02:56 PM, James James wrote:
>>
>> Here is the second host log ...
>>
>> http://pastebin.com/zJLLaYka
>>
>>
>> 2014-04-11 15:43 GMT+02:00 Dafna Ron <dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>:
>>
>> can you attach the engine log and the vdsm log from the
>> second host?
>>
>> The SPM cannot be released because the master storage
>> domain is
>> not visible from the second host.
>>
>> Dafna
>>
>>
>>
>> On 04/11/2014 02:38 PM, James James wrote:
>>
>> I try to follow the Daria's advices ..
>> I restarted my engine to clear the cache ....
>>
>> but now I am facing a new problem. node1 is the SPM
>> and I have
>> this error message
>> :
>>
>> Manual fence did not revoke the selected SPM (node1)
>> since the
>> master storage domain
>> was not active or could not use another host for the
>> fence
>> operation.
>>
>>
>> ....
>>
>>
>> 2014-04-11 15:16 GMT+02:00 Dafna Ron <dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>:
>>
>> I think there might be a chance it's related to
>> issues we were
>> seeing with engine cache.
>>
>> James, would you mind testing that? restart of
>> ovirt-engine
>> process should clear the cache.
>> once you restart, log in to the webadmin and if
>> the host
>> is still
>> spm and none responsive, can you try confirm host
>> reboot
>> again?
>>
>> If that still fails, can you please attach the
>> engine log?
>>
>> Thanks.
>> Dafna
>>
>>
>>
>>
>>
>>
>> On 04/11/2014 02:13 PM, Itamar Heim wrote:
>>
>> On 04/11/2014 04:10 PM, James James wrote:
>>
>> Nothing new. node1 can't release SPM ... :(
>>
>>
>> allon/federico - thoughts? confirm host
>> shutdown should
>> release SPM for a non-responsive node
>>
>>
>>
>> 2014-04-11 14:49 GMT+02:00 Dafna Ron
>> <dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>>:
>>
>> confirm host has been rebooted should
>> release
>> the SPM :)
>>
>>
>>
>> On 04/11/2014 01:23 PM, James James wrote:
>>
>>
>>
>>
>> 2014-04-11 14:08 GMT+02:00 Dafna Ron
>> <dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>>>:
>>
>>
>> James, Please answer the
>> user's list
>> as well
>> as to me so that
>> other people can participate
>> as well :)
>>
>>
>> Oups ... I will do that ..
>>
>>
>>
>> did you try to press the "confirm
>> host has
>> been rebooted"
>> (right
>> click)
>>
>>
>> Yes but same problem. node1 cannot
>> be in
>> maintenance mode.
>>
>> node1 is SPM . I will make node1
>> release
>> the SPM
>> ressource.
>>
>>
>>
>> On 04/11/2014 12:41 PM, James
>> James
>> wrote:
>>
>>
>>
>>
>> 2014-04-11 13:16
>> GMT+02:00 Dafna Ron
>> <dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>
>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>>>>>:
>>
>>
>> what is the error
>> message you get
>> when you try to
>> put the
>> host in
>> maintenance?
>>
>> I have this message :
>>
>>
>> Error while executing
>> action: Cannot
>> switch Host to
>> Maintenance mode.
>> Host is Storage Pool
>> Manager and
>> is in
>> Non Responsive
>> state.
>> - If power management is
>> configured,
>> engine will try to
>> fence
>> the host automatically.
>> - Otherwise, either bring the
>> node back
>> up, or release
>> the SPM
>> resource.
>> To do so, verify that the
>> node is
>> really
>> down by right
>> clicking on the host and
>> confirm
>> that the
>> node was shutdown
>> manually.
>>
>>
>>
>> are there any running
>> vm's
>> reported?
>>
>>
>> No there is no VM running
>> on this
>> host
>>
>>
>>
>> Try to press the "confirm
>> host has
>> been rebooted"
>> button
>> and than
>> see if you can put
>> the host in
>> maintenance.
>>
>> If that fails, select the
>> host, in
>> the general tab you
>> will get
>> the re-install link.
>>
>>
>>
>> I am running ovirt 3.4.0-1. I
>> down't know
>> where is the
>> re-install link but I
>> can't see it.
>>
>> try to re-install, when
>> install fails
>> the host
>> should change
>> status to failed
>> installation.
>>
>>
>>
>>
>> On 04/11/2014 12:09
>> PM, James
>> James
>> wrote:
>>
>> No, I can't ....
>>
>>
>> 2014-04-11 12:12
>> GMT+02:00 Dafna Ron
>> <dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>>
>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>
>> <mailto:dron at redhat.com
>> <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>
>> <mailto:dron at redhat.com <mailto:dron at redhat.com>>>>>>>>:
>>
>>
>>
>> can you put the host in
>> maintenance?
>>
>>
>>
>>
>> On 04/11/2014 10:43
>> AM, James
>> James wrote:
>>
>> I can't delete
>> the old
>> node because it
>> is in Non
>> Responsive
>> state. The remove
>> button
>> is stil blank .
>>
>> In the engine.log
>> I've
>> got this log :
>> 2014-04-11
>> 11:40:45,911 ERROR
>>
>> [org.ovirt.engine.core.__vdsbroker.vdsbroker.__
>> GetCapabilitiesVDSCommand]
>> (DefaultQuartzScheduler___Worker-88)
>> Command
>> GetCapabilitiesVDSCommand(__HostName =
>> node1,
>> HostId =
>> 36fb6df3-c2c2-4133-86ac-__fe50b99ee2e3,
>> vds=Host[node1])
>> execution failed.
>> Exception:
>> VDSNetworkException:
>>
>> sun.security.provider.__certpath.__SunCertPathBuilderException:
>> unable to find valid
>> certification path to
>> requested
>> target
>> 2014-04-11
>> 11:40:48,943 ERROR
>>
>> [org.ovirt.engine.core.__vdsbroker.vdsbroker.__
>> GetCapabilitiesVDSCommand]
>> (DefaultQuartzScheduler___Worker-12)
>> Command
>> GetCapabilitiesVDSCommand(__HostName =
>> node1,
>> HostId =
>> 36fb6df3-c2c2-4133-86ac-__fe50b99ee2e3,
>> vds=Host[node1])
>> execution failed.
>> Exception:
>> VDSNetworkException:
>>
>> sun.security.provider.__certpath.__SunCertPathBuilderException:
>> unable to find valid
>> certification path to
>> requested
>> target
>>
>>
>>
>>
>>
>> 2014-04-11 11:06
>> GMT+02:00 Alon Bar-Lev
>> <
>> alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>
>> >>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>>
>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com <mailto:alonbl at redhat.com>>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>
>> <mailto:alonbl at redhat.com
>> <mailto:alonbl at redhat.com>>>>>>>>>__:
>>
>>
>>
>>
>>
>> ----- Original
>> Message -----
>> > From:
>> "James James"
>> <jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>>>>>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>
>> <mailto:jreg2k at gmail.com <mailto:jreg2k at gmail.com>>
>> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com> <mailto:jreg2k at gmail.com
>> <mailto:jreg2k at gmail.com>>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140411/3c7a360c/attachment-0001.html>
More information about the Users
mailing list