Re: [ovirt-users] GetGlusterVolumeAdvancedDetailsQuery & GetGlusterVolumeProfileInfoQuery when using seperate storage network
10:52 a.m.
This is a multi-part message in MIME format.
--------------080602020902020502010500
Content-Type: text/plain;
charset="windows-1252"
Content-Transfer-Encoding: quoted-printable
On 05/06/2015 06=3A24 PM=2C knarra wrote=3A
=3E On 05/06/2015 06=3A59 PM=2C Jorick Astrego wrote=3A
=3E=3E
=3E=3E
=3E=3E On 05/06/2015 02=3A49 PM=2C knarra wrote=3A
=3E=3E=3E On 05/06/2015 05=3A33 PM=2C Jorick Astrego wrote=3A
=3E=3E=3E=3E Hi=2C
=3E=3E=3E=3E
=3E=3E=3E=3E Looking forward to bz 1049994 Allow choosing network interf=
ace
=3E=3E=3E=3E for gluster domain traffic=2E
=3E=3E=3E=3E
=3E=3E=3E=3E Currently I have the bricks on a different storage network and=
=3E=3E=3E=3E can=27t get the volume details or profile it=2E
=3E=3E=3E=3E
=3E=3E=3E=3E Will this be handled in 3=2E6 properly=3F I don=27t see any ch=
anges in
=3E=3E=3E=3E gerrit regarding this=2C but I can be ovelooking it=2E
=3E=3E=3E=3E
=3E=3E=3E=3E The errors I get currently=3A
=3E=3E=3E=3E
=3E=3E=3E=3E Could not fetch brick profile stats
=3E=3E=3E=3E
=3E=3E=3E=3E 2015-05-06 10=3A34=3A22=2C430 ERROR
=3E=3E=3E=3E =5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGetGluste=
rVolumeProfileInfoQuery=5D
=3E=3E=3E=3E =28ajp--127=2E0=2E0=2E1-8702-27=29 Query GetGlusterVolumeP=
rofileInfoQuery
=3E=3E=3E=3E failed=2E Exception message is null =3A
=3E=3E=3E=3E java=2Elang=2ENullPointerException=3A java=2Elang=2ENullPo=
interException
=3E=3E=3E=3E
=3E=3E=3E=3E and
=3E=3E=3E=3E
=3E=3E=3E=3E Error in fetching the brick details=2C please try again=2E=
=3E=3E=3E=3E
=3E=3E=3E=3E 2015-05-06 10=3A36=3A14=2C205 ERROR
=3E=3E=3E=3E =5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGetGluste=
rVolumeAdvancedDetailsQuery=5D
=3E=3E=3E=3E =28ajp--127=2E0=2E0=2E1-8702-55=29 Query
=3E=3E=3E=3E GetGlusterVolumeAdvancedDetailsQuery failed=2E Exception m=
essage
=3E=3E=3E=3E is VdcBLLException=3A Volume status failed
=3E=3E=3E=3E error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No br=
ick
=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest/gluster/brick1 in volume da=
ta
=3E=3E=3E=3E Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=20
=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume=
data
=3E=3E=3E=3E return code=3A -1 =28Failed with error GlusterVolumeStatus=
Failed
=3E=3E=3E=3E and code 4157=29 =3A
=3E=3E=3E=3E org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcBLLExce=
ption=3A
=3E=3E=3E=3E VdcBLLException=3A Volume status failed
=3E=3E=3E=3E error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No br=
ick=20
=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume=
data
=3E=3E=3E=3E Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=20
=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume=
data
=3E=3E=3E=3E return code=3A -1 =28Failed with error GlusterVolumeStatus=
Failed
=3E=3E=3E=3E and code 4157=29=3A
=3E=3E=3E=3E org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcBLLExce=
ption=3A
=3E=3E=3E=3E VdcBLLException=3A Volume status failed
=3E=3E=3E=3E error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No br=
ick=20
=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume=
data
=3E=3E=3E=3E Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=20
=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume=
data
=3E=3E=3E=3E return code=3A -1 =28Failed with error GlusterVolumeStatus=
Failed
=3E=3E=3E=3E and code 4157=29
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E Met vriendelijke groet=2C With kind regards=2C
=3E=3E=3E=3E
=3E=3E=3E=3E Jorick Astrego*
=3E=3E=3E=3E
=3E=3E=3E=3E Netbulae Virtualization Experts *
=3E=3E=3E=3E --------------------------------------------------------------=
----------
=3E=3E=3E=3E Tel=3A 053 20 30 270 =09info=40netbulae=2Eeu =09Staalsteden 4-=
3A =09KvK 08198180
=3E=3E=3E=3E Fax=3A 053 20 30 271 =09www=2Enetbulae=2Eeu =097547 TA Ensched=
e =09BTW
=3E=3E=3E=3E NL821234584B01
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E --------------------------------------------------------------=
----------
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F
=3E=3E=3E=3E Users mailing list
=3E=3E=3E=3E Users=40ovirt=2Eorg
=3E=3E=3E=3E http=3A//lists=2Eovirt=2Eorg/mailman/listinfo/users
=3E=3E=3E Hi=2C
=3E=3E=3E
=3E=3E=3E Can you please check what does your gluster peer status on ea=
ch
=3E=3E=3E of your nodes return=3F I guess they are in disconnected state a=
nd
=3E=3E=3E that is the reason you are not able to view these details=2E
=3E=3E=3E
=3E=3E=3E Thanks
=3E=3E=3E kasturi
=3E=3E=3E
=3E=3E On the nodes it gives me the following=3A
=3E=3E
=3E=3E gluster peer status
=3E=3E Connection failed=2E Please check if gluster daemon is operation=
al=2E
=3E=3E
=3E This means that glusterd is not running on this node=2E you could check=
=3E the status of glusterd by running the command =27service glusterd statu=
s=27=2E
=3E
=3E please start glusterd by running the command =27service glusterd start=
=27
=3E on both of your nodes=2E
=3E
=3E Ideally when glusterd goes down node in ovirt should move to
=3E non-operational=2E Because of this BZ 1207150 as of now it is not
=3E changing the state to non operational=2E
There is no glusterd on the compute nodes in our setup=2C we have two
clusters=2E One for virt hosts only and one for GlusterFS only=2E
Like I said=2C everything is Up and running fine=2E It=27s just that I can=
=27t
get the stats because the hostname !=3D GlusterFS NIC ip
=3E=3E
=3E=3E
=3E=3E But everyting is up and ovirt found the manually configured volume=
=3E=3E perfectly=2E But the hostname it lists as glustertest1=2Enetbulae=2E=
test is
=3E=3E not what my volume uses for communication as I created the volume
=3E=3E using the ip=27s of the storage network=2E
=3E=3E
=3E=3E =20
=3E=3E gluster peer status
=3E=3E Number of Peers=3A 2
=3E=3E
=3E=3E Hostname=3A 10=2E1=2E1=2E3
=3E=3E Uuid=3A 1cc0875e-1699-42ae-aed2-9152667ed5af
=3E=3E State=3A Peer in Cluster =28Connected=29
=3E=3E
=3E=3E Hostname=3A 10=2E1=2E1=2E2
=3E=3E Uuid=3A a0b3ac13-7388-441a-a238-1deb023cab6c
=3E=3E State=3A Peer in Cluster =28Connected=29
=3E=3E
=3E Did you import already existing cluster =3F
No=2C I provisioned the nodes=2E Added them to our glusterfs cluster =28wit=
h
virt service disabled=29 and created the volume manually=2E
oVirt auto-discovered the manual created volume after that=2E
Error=3A No brick *glustertest1=2Enetbulae=2Etest*=3A/gluster/brick1 i=
n
volume data=20
Hostname=3A *10=2E1=2E1=2E3*
Things should work better in 3=2E6 =28bz1049994=29=2C but I don=27t see any=
code
changes to =22GetGlusterVolumeProfileInfoQuery=22 linked to this in Bugzill=
a=2E
Met vriendelijke groet=2C With kind regards=2C
Jorick Astrego
Netbulae Virtualization Experts=20
----------------
=09Tel=3A 053 20 30 270 =09info=40netbulae=2Eeu =09Staalsteden 4-3A =09KvK=
08198180
=09Fax=3A 053 20 30 271 =09www=2Enetbulae=2Eeu =097547 TA Enschede =09BTW=
NL821234584B01
----------------
--------------080602020902020502010500
Content-Type: text/html;
charset="windows-1252"
Content-Transfer-Encoding: quoted-printable
=3Chtml=3E
=3Chead=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3C/head=3E
=3Cbody bgcolor=3D=22=23FFFFFF=22 text=3D=22=23000000=22=3E
=3Cbr=3E
=3Cbr=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 06=3A24 PM=2C knar=
ra wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A403A=2E9070308=40redhat=2Ecom=22 type=
=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 06=3A59 PM=2C Jo=
rick
Astrego wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A1721=2E3080605=40netbulae=2Eeu=22 t=
ype=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cbr=3E
=3Cbr=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 02=3A49 PM=2C=
knarra
wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A0DEB=2E2080002=40redhat=2Ecom=22=
type=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 05=3A33 PM=
=2C Jorick
Astrego wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A031A=2E1060200=40netbulae=2Eeu=
=22
type=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
Hi=2C=3Cbr=3E
=3Cbr=3E
Looking forward to
=3Cmeta http-equiv=3D=22content-type=22 content=3D=22text/html=
=3B
charset=3Dwindows-1252=22=3E
=3Cmeta name=3D=22generator=22 content=3D=22Sheets=22=3E
=3Cstyle type=3D=22text/css=22=3E=3C!--td =7Bborder=3A 1px soli=
d =23ccc=3B=7Dbr =7Bmso-data-placement=3Asame-cell=3B=7D--=3E=3C/style=3Ebz=
1049994=A0=A0=A0 Allow choosing network interface for gluster=
domain traffic=2E=3Cbr=3E
=3Cbr=3E
Currently I have the bricks on a different storage network
and can=27t get the volume details or profile it=2E =3Cbr=3E
=3Cbr=3E
Will this be handled in 3=2E6 properly=3F I don=27t see any
changes in gerrit regarding this=2C but I can be ovelooking
it=2E=3Cbr=3E
=3Cbr=3E
The errors I get currently=3A=3Cbr=3E
=3Cbr=3E
=3Cblockquote=3ECould not fetch brick profile stats=3Cbr=3E
=3C/blockquote=3E
=3Cblockquote=3E2015-05-06 10=3A34=3A22=2C430 ERROR
=5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGetGlusterVo=
lumeProfileInfoQuery=5D
=28ajp--127=2E0=2E0=2E1-8702-27=29 Query
GetGlusterVolumeProfileInfoQuery failed=2E Exception message=
is null =3A java=2Elang=2ENullPointerException=3A
java=2Elang=2ENullPointerException=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
and=3Cbr=3E
=3Cblockquote=3EError in fetching the brick details=2C please t=
ry
again=2E=3Cbr=3E
=3Cbr=3E
2015-05-06 10=3A36=3A14=2C205 ERROR
=5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGetGlusterVo=
lumeAdvancedDetailsQuery=5D
=28ajp--127=2E0=2E0=2E1-8702-55=29 Query
GetGlusterVolumeAdvancedDetailsQuery failed=2E Exception
message is VdcBLLException=3A Volume status failed=3Cbr=3E
error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=
glustertest1=2Enetbulae=2Etest/gluster/brick1 in volume data=
=3Cbr=3E
Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume da=
ta=3Cbr=3E
return code=3A -1 =28Failed with error
GlusterVolumeStatusFailed and code 4157=29 =3A
org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcBLLExcepti=
on=3A
VdcBLLException=3A Volume status failed=3Cbr=3E
error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=
=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume da=
ta=3Cbr=3E
Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume da=
ta=3Cbr=3E
return code=3A -1 =28Failed with error
GlusterVolumeStatusFailed and code 4157=29=3A
org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcBLLExcepti=
on=3A
VdcBLLException=3A Volume status failed=3Cbr=3E
error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=
=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume da=
ta=3Cbr=3E
Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volume da=
ta=3Cbr=3E
return code=3A -1 =28Failed with error
GlusterVolumeStatusFailed and code 4157=29=3Cbr=3E
=3C/blockquote=3E
=3Cblockquote=3E=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
=3Cspan style=3D=22color=3A=23604c78=3B=22=3E=3Cfont color=3D=
=22000000=22=3E=3Cspan
style=3D=22mso-fareast-language=3Aen-gb=3B=22 lang=3D=22N=
L=22=3EMet
vriendelijke groet=2C With kind regards=2C=3Cbr=3E
=3Cbr=3E
=3C/span=3EJorick Astrego=3C/font=3E=3C/span=3E=3Cb
style=3D=22color=3A=23604c78=22=3E=3Cbr=3E
=3Cbr=3E
Netbulae Virtualization Experts =3C/b=3E=3Cbr=3E
=3Chr style=3D=22border=3Anone=3Bborder-top=3A1px solid =23ccc=
=3B=22=3E
=3Ctable style=3D=22width=3A 522px=22=3E
=3Ctbody=3E
=3Ctr=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
Tel=3A 053 20
30 270=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
=3Ca
moz-do-not-send=3D=22true=22
class=3D=22moz-txt-link-abbreviated=22
href=3D=22mailto=3Ainfo=40netbulae=2Eeu=22=3Einfo=40n=
etbulae=2Eeu=3C/a=3E=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
Staalsteden
4-3A=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
KvK 08198180=3C/td=3E
=3C/tr=3E
=3Ctr=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
Fax=3A 053 20
30 271=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
=3Ca
moz-do-not-send=3D=22true=22
class=3D=22moz-txt-link-abbreviated=22
href=3D=22http=3A//www=2Enetbulae=2Eeu=22=3Ewww=2Enet=
bulae=2Eeu=3C/a=3E=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
7547 TA
Enschede=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3E=
BTW
NL821234584B01=3C/td=3E
=3C/tr=3E
=3C/tbody=3E
=3C/table=3E
=3Cbr=3E
=3Chr style=3D=22border=3Anone=3Bborder-top=3A1px solid =23ccc=
=3B=22=3E=3Cbr=3E
=3Cbr=3E
=3Cfieldset class=3D=22mimeAttachmentHeader=22=3E=3C/fieldset=
=3E
=3Cbr=3E
=3Cpre wrap=3D=22=22=3E=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F
Users mailing list
=3Ca moz-do-not-send=3D=22true=22 class=3D=22moz-txt-link-abbreviated=22 hr=
ef=3D=22mailto=3AUsers=40ovirt=2Eorg=22=3EUsers=40ovirt=2Eorg=3C/a=3E
=3Ca moz-do-not-send=3D=22true=22 class=3D=22moz-txt-link-freetext=22 href=
=3D=22http=3A//lists=2Eovirt=2Eorg/mailman/listinfo/users=22=3Ehttp=3A//lis=
ts=2Eovirt=2Eorg/mailman/listinfo/users=3C/a=3E=3C/pre=3E
=3C/blockquote=3E
Hi=2C=3Cbr=3E
=3Cbr=3E
=A0=A0=A0 Can you please check what does your gluster peer status=
on
each of your nodes return=3F=A0 I guess they are in disconnected=
state and that is the reason you are not able to view these
details=2E=3Cbr=3E
=3Cbr=3E
Thanks=3Cbr=3E
kasturi=3Cbr=3E
=3Cblockquote cite=3D=22mid=3A554A031A=2E1060200=40netbulae=2Eeu=
=22
type=3D=22cite=22=3E =3C/blockquote=3E
=3Cbr=3E
=3C/blockquote=3E
On the nodes it gives me the following=3A=3Cbr=3E
=3Cbr=3E
=3Cblockquote=3Egluster peer status=3Cbr=3E
Connection failed=2E Please check if gluster daemon is
operational=2E=3Cbr=3E
=3C/blockquote=3E
=3C/blockquote=3E
This means that glusterd is not running on this node=2E you could
check the status of glusterd by running the command =27service
glusterd status=27=2E =3Cbr=3E
=3Cbr=3E
please start glusterd by running the command =27service glusterd
start=27 on both of your nodes=2E=3Cbr=3E
=3Cbr=3E
Ideally when glusterd goes down node in ovirt should move to
non-operational=2E Because of this BZ 1207150 as of now it is not
changing the state to non operational=2E=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
There is no glusterd on the compute nodes in our setup=2C we have two=
clusters=2E One for virt hosts only and one for GlusterFS only=2E=3Cbr=
=3E
=3Cbr=3E
=3Cbr=3E
Like I said=2C everything is Up and running fine=2E It=27s just that I=
can=27t get the stats because the hostname !=3D GlusterFS NIC ip=3Cbr=
=3E
=3Cbr=3E
=3Cbr=3E
=3Cblockquote cite=3D=22mid=3A554A403A=2E9070308=40redhat=2Ecom=22 type=
=3D=22cite=22=3E
=3Cblockquote cite=3D=22mid=3A554A1721=2E3080605=40netbulae=2Eeu=22 t=
ype=3D=22cite=22=3E
=3Cblockquote=3E =3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
But everyting is up and ovirt found the manually configured
volume perfectly=2E But the hostname it lists as
glustertest1=2Enetbulae=2Etest is not what my volume uses for
communication as I created the volume using the ip=27s of the
storage network=2E=3Cbr=3E
=3Cbr=3E
=3Cblockquote=3E=A0=3Cbr=3E
gluster peer status=3Cbr=3E
Number of Peers=3A 2=3Cbr=3E
=3Cbr=3E
Hostname=3A 10=2E1=2E1=2E3=3Cbr=3E
Uuid=3A 1cc0875e-1699-42ae-aed2-9152667ed5af=3Cbr=3E
State=3A Peer in Cluster =28Connected=29=3Cbr=3E
=3Cbr=3E
Hostname=3A 10=2E1=2E1=2E2=3Cbr=3E
Uuid=3A a0b3ac13-7388-441a-a238-1deb023cab6c=3Cbr=3E
State=3A Peer in Cluster =28Connected=29=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
=3C/blockquote=3E
Did you import already existing cluster =3F=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
No=2C I provisioned the nodes=2E Added them to our glusterfs cluster
=28with virt service disabled=29 and created the volume manually=2E=3Cb=
r=3E
=3Cbr=3E
oVirt auto-discovered the manual created volume after that=2E=3Cbr=3E=
=3Cbr=3E
=3Cblockquote=3EError=3A No brick=A0 =3Cb=3Eglustertest1=2Enetbulae=2Et=
est=3C/b=3E=3A/gluster/brick1
in volume data=A0 =3Cbr=3E
=3Cbr=3E
Hostname=3A =3Cb=3E10=2E1=2E1=2E3=3C/b=3E=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
Things should work better in 3=2E6 =28bz1049994=29=2C but I don=27t see=
any
code changes to =22GetGlusterVolumeProfileInfoQuery=22 linked to this i=
n
Bugzilla=2E=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
=20=
=3CBR /=3E
=3CBR /=3E
=3Cb style=3D=22color=3A=23604c78=22=3E=3C/b=3E=3Cbr=3E=3Cspan style=3D=22c=
olor=3A=23604c78=3B=22=3E=3Cfont color=3D=22000000=22=3E=3Cspan style=3D=22=
mso-fareast-language=3Aen-gb=3B=22 lang=3D=22NL=22=3EMet vriendelijke groet=
=2C With kind regards=2C=3Cbr=3E=3Cbr=3E=3C/span=3EJorick Astrego=3C/font=
=3E=3C/span=3E=3Cb style=3D=22color=3A=23604c78=22=3E=3Cbr=3E=3Cbr=3ENetbul=
ae Virtualization Experts =3C/b=3E=3Cbr=3E=3Chr style=3D=22border=3Anone=3B=
border-top=3A1px solid =23ccc=3B=22=3E=3Ctable style=3D=22width=3A 522px=22=
=3E=3Ctbody=3E=3Ctr=3E=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3ETel=3A 053 20 30 270=3C/td=3E =3Ctd style=3D=22width=3A 130px=3Bf=
ont-size=3A 10px=22=3Einfo=40netbulae=2Eeu=3C/td=3E =3Ctd style=3D=22wid=
th=3A 130px=3Bfont-size=3A 10px=22=3EStaalsteden 4-3A=3C/td=3E =3Ctd sty=
le=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3EKvK 08198180=3C/td=3E=3C/tr=
=3E=3Ctr=3E =3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3EFax=
=3A 053 20 30 271=3C/td=3E =3Ctd style=3D=22width=3A 130px=3Bfont-size=
=3A 10px=22=3Ewww=2Enetbulae=2Eeu=3C/td=3E =3Ctd style=3D=22width=3A 130=
px=3Bfont-size=3A 10px=22=3E7547 TA Enschede=3C/td=3E =3Ctd style=3D=22w=
idth=3A 130px=3Bfont-size=3A 10px=22=3EBTW NL821234584B01=3C/td=3E=3C/tr=3E=
=3C/tbody=3E=3C/table=3E=3Cbr=3E=3Chr style=3D=22border=3Anone=3Bborder-top=
=3A1px solid =23ccc=3B=22=3E=3CBR /=3E
=3C/body=3E
=3C/html=3E
--------------080602020902020502010500--
11:15 a.m.
New subject: GetGlusterVolumeAdvancedDetailsQuery & GetGlusterVolumeProfileInfoQuery when using seperate storage network
This is a multi-part message in MIME format.
--------------020405080500070000020703
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
On 05/06/2015 11:22 PM, Jorick Astrego wrote:
On 05/06/2015 06:24 PM, knarra wrote:
> On 05/06/2015 06:59 PM, Jorick Astrego wrote:
>>
>>
>> On 05/06/2015 02:49 PM, knarra wrote:
>>> On 05/06/2015 05:33 PM, Jorick Astrego wrote:
>>>> Hi,
>>>>
>>>> Looking forward to bz 1049994 Allow choosing network interface
>>>> for gluster domain traffic.
>>>>
>>>> Currently I have the bricks on a different storage network and
>>>> can't get the volume details or profile it.
>>>>
>>>> Will this be handled in 3.6 properly? I don't see any changes in
>>>> gerrit regarding this, but I can be ovelooking it.
>>>>
>>>> The errors I get currently:
>>>>
>>>> Could not fetch brick profile stats
>>>>
>>>> 2015-05-06 10:34:22,430 ERROR
>>>> [org.ovirt.engine.core.bll.gluster.GetGlusterVolumeProfileInfoQuery]
>>>> (ajp--127.0.0.1-8702-27) Query
>>>> GetGlusterVolumeProfileInfoQuery failed. Exception message is
>>>> null : java.lang.NullPointerException:
>>>> java.lang.NullPointerException
>>>>
>>>> and
>>>>
>>>> Error in fetching the brick details, please try again.
>>>>
>>>> 2015-05-06 10:36:14,205 ERROR
>>>>
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeAdvancedDetailsQuery]
>>>> (ajp--127.0.0.1-8702-55) Query
>>>> GetGlusterVolumeAdvancedDetailsQuery failed. Exception message
>>>> is VdcBLLException: Volume status failed
>>>> error: Staging failed on *.*.*.*. Error: No brick
>>>> glustertest1.netbulae.test/gluster/brick1 in volume data
>>>> Staging failed on *.*.*.*. Error: No brick
>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>> return code: -1 (Failed with error GlusterVolumeStatusFailed
>>>> and code 4157) :
>>>> org.ovirt.engine.core.common.errors.VdcBLLException:
>>>> VdcBLLException: Volume status failed
>>>> error: Staging failed on *.*.*.*. Error: No brick
>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>> Staging failed on *.*.*.*. Error: No brick
>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>> return code: -1 (Failed with error GlusterVolumeStatusFailed
>>>> and code 4157):
>>>> org.ovirt.engine.core.common.errors.VdcBLLException:
>>>> VdcBLLException: Volume status failed
>>>> error: Staging failed on *.*.*.*. Error: No brick
>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>> Staging failed on *.*.*.*. Error: No brick
>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>> return code: -1 (Failed with error GlusterVolumeStatusFailed
>>>> and code 4157)
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Met vriendelijke groet, With kind regards,
>>>>
>>>> Jorick Astrego*
>>>>
>>>> Netbulae Virtualization Experts *
>>>> ------------------------------------------------------------------------
>>>> Tel: 053 20 30 270 info(a)netbulae.eu Staalsteden 4-3A KvK 08198180
>>>> Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW
>>>> NL821234584B01
>>>>
>>>>
>>>> ------------------------------------------------------------------------
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>> Hi,
>>>
>>> Can you please check what does your gluster peer status on each
>>> of your nodes return? I guess they are in disconnected state and
>>> that is the reason you are not able to view these details.
>>>
>>> Thanks
>>> kasturi
>>>
>> On the nodes it gives me the following:
>>
>> gluster peer status
>> Connection failed. Please check if gluster daemon is operational.
>>
> This means that glusterd is not running on this node. you could check
> the status of glusterd by running the command 'service glusterd status'.
>
> please start glusterd by running the command 'service glusterd start'
> on both of your nodes.
>
> Ideally when glusterd goes down node in ovirt should move to
> non-operational. Because of this BZ 1207150 as of now it is not
> changing the state to non operational.
There is no glusterd on the compute nodes in our setup, we have two
clusters. One for virt hosts only and one for GlusterFS only.
Like I said, everything is Up and running fine. It's just that I can't
get the stats because the hostname != GlusterFS NIC ip
>>
>>
>> But everyting is up and ovirt found the manually configured volume
>> perfectly. But the hostname it lists as glustertest1.netbulae.test
>> is not what my volume uses for communication as I created the volume
>> using the ip's of the storage network.
>>
>>
>> gluster peer status
>> Number of Peers: 2
>>
>> Hostname: 10.1.1.3
>> Uuid: 1cc0875e-1699-42ae-aed2-9152667ed5af
>> State: Peer in Cluster (Connected)
>>
>> Hostname: 10.1.1.2
>> Uuid: a0b3ac13-7388-441a-a238-1deb023cab6c
>> State: Peer in Cluster (Connected)
>>
> Did you import already existing cluster ?
No, I provisioned the nodes. Added them to our glusterfs cluster (with
virt service disabled) and created the volume manually.
oVirt auto-discovered the manual created volume after that.
Error: No brick *glustertest1.netbulae.test*:/gluster/brick1 in
volume data
Hostname: *10.1.1.3*
Things should work better in 3.6 (bz1049994), but I don't see any code
changes to "GetGlusterVolumeProfileInfoQuery" linked to this in Bugzilla.
HI Jorik,
For more information on using separate storage network please refer
to the following feature page.
http://www.ovirt.org/Features/Select_Network_For_Gluster
Thanks
kasturi.
Met vriendelijke groet, With kind regards,
Jorick Astrego*
Netbulae Virtualization Experts *
------------------------------------------------------------------------
Tel: 053 20 30 270 info(a)netbulae.eu Staalsteden 4-3A KvK 08198180
Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01
------------------------------------------------------------------------
--------------020405080500070000020703
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 05/06/2015 11:22 PM, Jorick Astrego
wrote:<br>
</div>
<blockquote cite="mid:554A54C0.8030100@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
<br>
<div class="moz-cite-prefix">On 05/06/2015 06:24 PM, knarra
wrote:<br>
</div>
<blockquote cite="mid:554A403A.9070308@redhat.com"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">On 05/06/2015 06:59 PM, Jorick
Astrego wrote:<br>
</div>
<blockquote cite="mid:554A1721.3080605@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
<br>
<div class="moz-cite-prefix">On 05/06/2015 02:49 PM, knarra
wrote:<br>
</div>
<blockquote cite="mid:554A0DEB.2080002@redhat.com"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">On 05/06/2015 05:33 PM, Jorick
Astrego wrote:<br>
</div>
<blockquote cite="mid:554A031A.1060200@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
Hi,<br>
<br>
Looking forward to
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
<meta name="generator" content="Sheets">
<style type="text/css"><!--td {border: 1px solid #ccc;}br
{mso-data-placement:same-cell;}--></style>bz
1049994 Allow choosing network interface for gluster
domain traffic.<br>
<br>
Currently I have the bricks on a different storage network
and can't get the volume details or profile it. <br>
<br>
Will this be handled in 3.6 properly? I don't see any
changes in gerrit regarding this, but I can be ovelooking
it.<br>
<br>
The errors I get currently:<br>
<br>
<blockquote>Could not fetch brick profile stats<br>
</blockquote>
<blockquote>2015-05-06 10:34:22,430 ERROR
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeProfileInfoQuery]
(ajp--127.0.0.1-8702-27) Query
GetGlusterVolumeProfileInfoQuery failed. Exception
message is null : java.lang.NullPointerException:
java.lang.NullPointerException<br>
<br>
</blockquote>
and<br>
<blockquote>Error in fetching the brick details, please
try again.<br>
<br>
2015-05-06 10:36:14,205 ERROR
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeAdvancedDetailsQuery]
(ajp--127.0.0.1-8702-55) Query
GetGlusterVolumeAdvancedDetailsQuery failed. Exception
message is VdcBLLException: Volume status failed<br>
error: Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test/gluster/brick1 in volume data<br>
Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
return code: -1 (Failed with error
GlusterVolumeStatusFailed and code 4157) :
org.ovirt.engine.core.common.errors.VdcBLLException:
VdcBLLException: Volume status failed<br>
error: Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
return code: -1 (Failed with error
GlusterVolumeStatusFailed and code 4157):
org.ovirt.engine.core.common.errors.VdcBLLException:
VdcBLLException: Volume status failed<br>
error: Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
return code: -1 (Failed with error
GlusterVolumeStatusFailed and code 4157)<br>
</blockquote>
<blockquote><br>
</blockquote>
<br>
<br>
<br>
<span style="color:#604c78;"><font
color="000000"><span
style="mso-fareast-language:en-gb;"
lang="NL">Met
vriendelijke groet, With kind regards,<br>
<br>
</span>Jorick Astrego</font></span><b
style="color:#604c78"><br>
<br>
Netbulae Virtualization Experts </b><br>
<hr style="border:none;border-top:1px solid #ccc;">
<table style="width: 522px">
<tbody>
<tr>
<td style="width: 130px;font-size: 10px">Tel: 053 20
30 270</td>
<td style="width: 130px;font-size: 10px"><a
moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="mailto:info@netbulae.eu">info@netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">Staalsteden
4-3A</td>
<td style="width: 130px;font-size: 10px">KvK
08198180</td>
</tr>
<tr>
<td style="width: 130px;font-size: 10px">Fax: 053 20
30 271</td>
<td style="width: 130px;font-size: 10px"><a
moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="http://www.netbulae.eu">www.netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">7547 TA
Enschede</td>
<td style="width: 130px;font-size: 10px">BTW
NL821234584B01</td>
</tr>
</tbody>
</table>
<br>
<hr style="border:none;border-top:1px solid
#ccc;"><br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre
wrap="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</blockquote>
Hi,<br>
<br>
Can you please check what does your gluster peer status
on each of your nodes return? I guess they are in
disconnected state and that is the reason you are not able
to view these details.<br>
<br>
Thanks<br>
kasturi<br>
<blockquote cite="mid:554A031A.1060200@netbulae.eu"
type="cite"> </blockquote>
<br>
</blockquote>
On the nodes it gives me the following:<br>
<br>
<blockquote>gluster peer status<br>
Connection failed. Please check if gluster daemon is
operational.<br>
</blockquote>
</blockquote>
This means that glusterd is not running on this node. you could
check the status of glusterd by running the command 'service
glusterd status'. <br>
<br>
please start glusterd by running the command 'service glusterd
start' on both of your nodes.<br>
<br>
Ideally when glusterd goes down node in ovirt should move to
non-operational. Because of this BZ 1207150 as of now it is not
changing the state to non operational.<br>
</blockquote>
<br>
There is no glusterd on the compute nodes in our setup, we have
two clusters. One for virt hosts only and one for GlusterFS only.<br>
<br>
<br>
Like I said, everything is Up and running fine. It's just that I
can't get the stats because the hostname != GlusterFS NIC ip<br>
<br>
<br>
<blockquote cite="mid:554A403A.9070308@redhat.com"
type="cite">
<blockquote cite="mid:554A1721.3080605@netbulae.eu"
type="cite">
<blockquote> <br>
<br>
</blockquote>
But everyting is up and ovirt found the manually configured
volume perfectly. But the hostname it lists as
glustertest1.netbulae.test is not what my volume uses for
communication as I created the volume using the ip's of the
storage network.<br>
<br>
<blockquote> <br>
gluster peer status<br>
Number of Peers: 2<br>
<br>
Hostname: 10.1.1.3<br>
Uuid: 1cc0875e-1699-42ae-aed2-9152667ed5af<br>
State: Peer in Cluster (Connected)<br>
<br>
Hostname: 10.1.1.2<br>
Uuid: a0b3ac13-7388-441a-a238-1deb023cab6c<br>
State: Peer in Cluster (Connected)<br>
<br>
</blockquote>
</blockquote>
Did you import already existing cluster ?<br>
</blockquote>
<br>
No, I provisioned the nodes. Added them to our glusterfs cluster
(with virt service disabled) and created the volume manually.<br>
<br>
oVirt auto-discovered the manual created volume after that.<br>
<br>
<blockquote>Error: No brick
<b>glustertest1.netbulae.test</b>:/gluster/brick1
in volume data <br>
<br>
Hostname: <b>10.1.1.3</b><br>
<br>
</blockquote>
Things should work better in 3.6 (bz1049994), but I don't see any
code changes to "GetGlusterVolumeProfileInfoQuery" linked to this
in Bugzilla.<br>
<br>
</blockquote>
<br>
HI Jorik,<br>
<br>
For more information on using separate storage network please
refer to the following feature page.<br>
<br>
<a class="moz-txt-link-freetext"
href="http://www.ovirt.org/Features/Select_Network_For_Gluster"...
<br>
Thanks<br>
kasturi.<br>
<blockquote cite="mid:554A54C0.8030100@netbulae.eu"
type="cite"> <br>
<br>
<br>
<br>
<br>
<br>
<span style="color:#604c78;"><font
color="000000"><span
style="mso-fareast-language:en-gb;" lang="NL">Met
vriendelijke groet, With kind regards,<br>
<br>
</span>Jorick Astrego</font></span><b
style="color:#604c78"><br>
<br>
Netbulae Virtualization Experts </b><br>
<hr style="border:none;border-top:1px solid #ccc;">
<table style="width: 522px">
<tbody>
<tr>
<td style="width: 130px;font-size: 10px">Tel: 053 20 30
270</td>
<td style="width: 130px;font-size: 10px"><a
class="moz-txt-link-abbreviated"
href="mailto:info@netbulae.eu">info@netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">Staalsteden
4-3A</td>
<td style="width: 130px;font-size: 10px">KvK
08198180</td>
</tr>
<tr>
<td style="width: 130px;font-size: 10px">Fax: 053 20 30
271</td>
<td style="width: 130px;font-size: 10px"><a
class="moz-txt-link-abbreviated"
href="http://www.netbulae.eu">www.netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">7547 TA
Enschede</td>
<td style="width: 130px;font-size: 10px">BTW
NL821234584B01</td>
</tr>
</tbody>
</table>
<br>
<hr style="border:none;border-top:1px solid #ccc;"><br>
</blockquote>
<br>
</body>
</html>
--------------020405080500070000020703--
1:04 a.m.
New subject: GetGlusterVolumeAdvancedDetailsQuery & GetGlusterVolumeProfileInfoQuery when using seperate storage network
This is a multi-part message in MIME format.
--------------020905070701030709020902
Content-Type: text/plain;
charset="windows-1252"
Content-Transfer-Encoding: quoted-printable
On 05/06/2015 08=3A15 PM=2C knarra wrote=3A
=3E On 05/06/2015 11=3A22 PM=2C Jorick Astrego wrote=3A
=3E=3E
=3E=3E
=3E=3E On 05/06/2015 06=3A24 PM=2C knarra wrote=3A
=3E=3E=3E On 05/06/2015 06=3A59 PM=2C Jorick Astrego wrote=3A
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E On 05/06/2015 02=3A49 PM=2C knarra wrote=3A
=3E=3E=3E=3E=3E On 05/06/2015 05=3A33 PM=2C Jorick Astrego wrote=3A
=3E=3E=3E=3E=3E=3E Hi=2C
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Looking forward to bz 1049994 Allow choosing network=
interface
=3E=3E=3E=3E=3E=3E for gluster domain traffic=2E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Currently I have the bricks on a different storage netwo=
rk and
=3E=3E=3E=3E=3E=3E can=27t get the volume details or profile it=2E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Will this be handled in 3=2E6 properly=3F I don=27t see=
any changes in
=3E=3E=3E=3E=3E=3E gerrit regarding this=2C but I can be ovelooking it=2E=
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E The errors I get currently=3A
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Could not fetch brick profile stats
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E 2015-05-06 10=3A34=3A22=2C430 ERROR
=3E=3E=3E=3E=3E=3E =5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGet=
GlusterVolumeProfileInfoQuery=5D
=3E=3E=3E=3E=3E=3E =28ajp--127=2E0=2E0=2E1-8702-27=29 Query
=3E=3E=3E=3E=3E=3E GetGlusterVolumeProfileInfoQuery failed=2E Exception=
message is
=3E=3E=3E=3E=3E=3E null =3A java=2Elang=2ENullPointerException=3A
=3E=3E=3E=3E=3E=3E java=2Elang=2ENullPointerException
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E and
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Error in fetching the brick details=2C please try ag=
ain=2E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E 2015-05-06 10=3A36=3A14=2C205 ERROR
=3E=3E=3E=3E=3E=3E =5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGet=
GlusterVolumeAdvancedDetailsQuery=5D
=3E=3E=3E=3E=3E=3E =28ajp--127=2E0=2E0=2E1-8702-55=29 Query
=3E=3E=3E=3E=3E=3E GetGlusterVolumeAdvancedDetailsQuery failed=2E Excep=
tion
=3E=3E=3E=3E=3E=3E message is VdcBLLException=3A Volume status failed=
=3E=3E=3E=3E=3E=3E error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A=
No brick
=3E=3E=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest/gluster/brick1 in vol=
ume data
=3E=3E=3E=3E=3E=3E Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=
=20
=3E=3E=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in=
volume data
=3E=3E=3E=3E=3E=3E return code=3A -1 =28Failed with error GlusterVolume=
StatusFailed
=3E=3E=3E=3E=3E=3E and code 4157=29 =3A
=3E=3E=3E=3E=3E=3E org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcB=
LLException=3A
=3E=3E=3E=3E=3E=3E VdcBLLException=3A Volume status failed
=3E=3E=3E=3E=3E=3E error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A=
No brick=20
=3E=3E=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in=
volume data
=3E=3E=3E=3E=3E=3E Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=
=20
=3E=3E=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in=
volume data
=3E=3E=3E=3E=3E=3E return code=3A -1 =28Failed with error GlusterVolume=
StatusFailed
=3E=3E=3E=3E=3E=3E and code 4157=29=3A
=3E=3E=3E=3E=3E=3E org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcB=
LLException=3A
=3E=3E=3E=3E=3E=3E VdcBLLException=3A Volume status failed
=3E=3E=3E=3E=3E=3E error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A=
No brick=20
=3E=3E=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in=
volume data
=3E=3E=3E=3E=3E=3E Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=
=20
=3E=3E=3E=3E=3E=3E glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in=
volume data
=3E=3E=3E=3E=3E=3E return code=3A -1 =28Failed with error GlusterVolume=
StatusFailed
=3E=3E=3E=3E=3E=3E and code 4157=29
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Met vriendelijke groet=2C With kind regards=2C
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Jorick Astrego*
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E Netbulae Virtualization Experts *
=3E=3E=3E=3E=3E=3E --------------------------------------------------------=
----------------
=3E=3E=3E=3E=3E=3E Tel=3A 053 20 30 270 =09info=40netbulae=2Eeu =09Staalste=
den 4-3A =09KvK 08198180
=3E=3E=3E=3E=3E=3E Fax=3A 053 20 30 271 =09www=2Enetbulae=2Eeu =097547 TA E=
nschede =09BTW
=3E=3E=3E=3E=3E=3E NL821234584B01
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E --------------------------------------------------------=
----------------
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E=3E =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F
=3E=3E=3E=3E=3E=3E Users mailing list
=3E=3E=3E=3E=3E=3E Users=40ovirt=2Eorg
=3E=3E=3E=3E=3E=3E http=3A//lists=2Eovirt=2Eorg/mailman/listinfo/users
=3E=3E=3E=3E=3E Hi=2C
=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E Can you please check what does your gluster peer status=
on
=3E=3E=3E=3E=3E each of your nodes return=3F I guess they are in disconnec=
ted state
=3E=3E=3E=3E=3E and that is the reason you are not able to view these detai=
ls=2E
=3E=3E=3E=3E=3E
=3E=3E=3E=3E=3E Thanks
=3E=3E=3E=3E=3E kasturi
=3E=3E=3E=3E=3E
=3E=3E=3E=3E On the nodes it gives me the following=3A
=3E=3E=3E=3E
=3E=3E=3E=3E gluster peer status
=3E=3E=3E=3E Connection failed=2E Please check if gluster daemon is ope=
rational=2E
=3E=3E=3E=3E
=3E=3E=3E This means that glusterd is not running on this node=2E you could=
=3E=3E=3E check the status of glusterd by running the command =27service
=3E=3E=3E glusterd status=27=2E
=3E=3E=3E
=3E=3E=3E please start glusterd by running the command =27service glusterd=
=3E=3E=3E start=27 on both of your nodes=2E
=3E=3E=3E
=3E=3E=3E Ideally when glusterd goes down node in ovirt should move to
=3E=3E=3E non-operational=2E Because of this BZ 1207150 as of now it is not=
=3E=3E=3E changing the state to non operational=2E
=3E=3E
=3E=3E There is no glusterd on the compute nodes in our setup=2C we have tw=
o
=3E=3E clusters=2E One for virt hosts only and one for GlusterFS only=2E
=3E=3E
=3E=3E
=3E=3E Like I said=2C everything is Up and running fine=2E It=27s just that=
I
=3E=3E can=27t get the stats because the hostname !=3D GlusterFS NIC ip
=3E=3E
=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E
=3E=3E=3E=3E But everyting is up and ovirt found the manually configured vo=
lume
=3E=3E=3E=3E perfectly=2E But the hostname it lists as glustertest1=2Enetbu=
lae=2Etest
=3E=3E=3E=3E is not what my volume uses for communication as I created the=
=3E=3E=3E=3E volume using the ip=27s of the storage network=2E
=3E=3E=3E=3E
=3E=3E=3E=3E =20
=3E=3E=3E=3E gluster peer status
=3E=3E=3E=3E Number of Peers=3A 2
=3E=3E=3E=3E
=3E=3E=3E=3E Hostname=3A 10=2E1=2E1=2E3
=3E=3E=3E=3E Uuid=3A 1cc0875e-1699-42ae-aed2-9152667ed5af
=3E=3E=3E=3E State=3A Peer in Cluster =28Connected=29
=3E=3E=3E=3E
=3E=3E=3E=3E Hostname=3A 10=2E1=2E1=2E2
=3E=3E=3E=3E Uuid=3A a0b3ac13-7388-441a-a238-1deb023cab6c
=3E=3E=3E=3E State=3A Peer in Cluster =28Connected=29
=3E=3E=3E=3E
=3E=3E=3E Did you import already existing cluster =3F
=3E=3E
=3E=3E No=2C I provisioned the nodes=2E Added them to our glusterfs cluster=
=3E=3E =28with virt service disabled=29 and created the volume manually=2E=
=3E=3E
=3E=3E oVirt auto-discovered the manual created volume after that=2E
=3E=3E
=3E=3E Error=3A No brick *glustertest1=2Enetbulae=2Etest*=3A/gluster/b=
rick1 in
=3E=3E volume data=20
=3E=3E
=3E=3E Hostname=3A *10=2E1=2E1=2E3*
=3E=3E
=3E=3E Things should work better in 3=2E6 =28bz1049994=29=2C but I don=27t=
see any
=3E=3E code changes to =22GetGlusterVolumeProfileInfoQuery=22 linked to thi=
s in
=3E=3E Bugzilla=2E
=3E=3E
=3E
=3E HI Jorik=2C
=3E
=3E For more information on using separate storage network please
=3E refer to the following feature page=2E
=3E
=3E http=3A//www=2Eovirt=2Eorg/Features/Select=5FNetwork=5FFor=5FGluste=
r
=3E
=3E Thanks
=3E kasturi=2E
I don=27t think you understand completely=2C the page you refer to is for=
3=2E6=2E I=27m running 3=2E5=2E2 without this feature=2E
The question was=2C will this get fixed along with the changes in 3=2E6 as=
I
don=27t see any code changes refering to the statistics/profiling of the
gluster volume=2E=2E=2E=2E=2E=2E
It will take less time testing 3=2E6 to find out than trying to explain it=
any further =3B-p
Met vriendelijke groet=2C With kind regards=2C
Jorick Astrego
Netbulae Virtualization Experts=20
----------------
=09Tel=3A 053 20 30 270 =09info=40netbulae=2Eeu =09Staalsteden 4-3A =09KvK=
08198180
=09Fax=3A 053 20 30 271 =09www=2Enetbulae=2Eeu =097547 TA Enschede =09BTW=
NL821234584B01
----------------
--------------020905070701030709020902
Content-Type: text/html;
charset="windows-1252"
Content-Transfer-Encoding: quoted-printable
=3Chtml=3E
=3Chead=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3C/head=3E
=3Cbody bgcolor=3D=22=23FFFFFF=22 text=3D=22=23000000=22=3E
=3Cbr=3E
=3Cbr=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 08=3A15 PM=2C knar=
ra wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A5A43=2E1080504=40redhat=2Ecom=22 type=
=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 11=3A22 PM=2C Jo=
rick
Astrego wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A54C0=2E8030100=40netbulae=2Eeu=22 t=
ype=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cbr=3E
=3Cbr=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 06=3A24 PM=2C=
knarra
wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A403A=2E9070308=40redhat=2Ecom=22=
type=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 06=3A59 PM=
=2C Jorick
Astrego wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A1721=2E3080605=40netbulae=2Eeu=
=22
type=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22
http-equiv=3D=22Content-Type=22=3E
=3Cbr=3E
=3Cbr=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 02=3A49 PM=
=2C knarra
wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A0DEB=2E2080002=40redhat=2Ecom=
=22
type=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22=
http-equiv=3D=22Content-Type=22=3E
=3Cdiv class=3D=22moz-cite-prefix=22=3EOn 05/06/2015 05=3A33=
PM=2C
Jorick Astrego wrote=3A=3Cbr=3E
=3C/div=3E
=3Cblockquote cite=3D=22mid=3A554A031A=2E1060200=40netbulae=
=2Eeu=22
type=3D=22cite=22=3E
=3Cmeta content=3D=22text/html=3B charset=3Dwindows-1252=22=
http-equiv=3D=22Content-Type=22=3E
Hi=2C=3Cbr=3E
=3Cbr=3E
Looking forward to
=3Cmeta http-equiv=3D=22content-type=22 content=3D=22text/h=
tml=3B
charset=3Dwindows-1252=22=3E
=3Cmeta name=3D=22generator=22 content=3D=22Sheets=22=3E
=3Cstyle type=3D=22text/css=22=3E=3C!--td =7Bborder=3A 1px=
solid =23ccc=3B=7Dbr =7Bmso-data-placement=3Asame-cell=3B=7D--=3E=3C/style=
=3Ebz
1049994=A0=A0=A0 Allow choosing network interface for glust=
er
domain traffic=2E=3Cbr=3E
=3Cbr=3E
Currently I have the bricks on a different storage
network and can=27t get the volume details or profile it=2E=
=3Cbr=3E
=3Cbr=3E
Will this be handled in 3=2E6 properly=3F I don=27t see any=
changes in gerrit regarding this=2C but I can be
ovelooking it=2E=3Cbr=3E
=3Cbr=3E
The errors I get currently=3A=3Cbr=3E
=3Cbr=3E
=3Cblockquote=3ECould not fetch brick profile stats=3Cbr=3E=
=3C/blockquote=3E
=3Cblockquote=3E2015-05-06 10=3A34=3A22=2C430 ERROR
=5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGetGlust=
erVolumeProfileInfoQuery=5D
=28ajp--127=2E0=2E0=2E1-8702-27=29 Query
GetGlusterVolumeProfileInfoQuery failed=2E Exception
message is null =3A java=2Elang=2ENullPointerException=3A=
java=2Elang=2ENullPointerException=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
and=3Cbr=3E
=3Cblockquote=3EError in fetching the brick details=2C plea=
se
try again=2E=3Cbr=3E
=3Cbr=3E
2015-05-06 10=3A36=3A14=2C205 ERROR
=5Borg=2Eovirt=2Eengine=2Ecore=2Ebll=2Egluster=2EGetGlust=
erVolumeAdvancedDetailsQuery=5D
=28ajp--127=2E0=2E0=2E1-8702-55=29 Query
GetGlusterVolumeAdvancedDetailsQuery failed=2E Exception=
message is VdcBLLException=3A Volume status failed=3Cbr=
=3E
error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No b=
rick
glustertest1=2Enetbulae=2Etest/gluster/brick1 in volume=
data=3Cbr=3E
Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=A0=
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volum=
e
data=3Cbr=3E
return code=3A -1 =28Failed with error
GlusterVolumeStatusFailed and code 4157=29 =3A
org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcBLLExc=
eption=3A
VdcBLLException=3A Volume status failed=3Cbr=3E
error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No b=
rick=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volum=
e
data=3Cbr=3E
Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=A0=
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volum=
e
data=3Cbr=3E
return code=3A -1 =28Failed with error
GlusterVolumeStatusFailed and code 4157=29=3A
org=2Eovirt=2Eengine=2Ecore=2Ecommon=2Eerrors=2EVdcBLLExc=
eption=3A
VdcBLLException=3A Volume status failed=3Cbr=3E
error=3A Staging failed on *=2E*=2E*=2E*=2E Error=3A No b=
rick=A0
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volum=
e
data=3Cbr=3E
Staging failed on *=2E*=2E*=2E*=2E Error=3A No brick=A0=
glustertest1=2Enetbulae=2Etest=3A/gluster/brick1 in volum=
e
data=3Cbr=3E
return code=3A -1 =28Failed with error
GlusterVolumeStatusFailed and code 4157=29=3Cbr=3E
=3C/blockquote=3E
=3Cblockquote=3E=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
=3Cspan style=3D=22color=3A=23604c78=3B=22=3E=3Cfont color=
=3D=22000000=22=3E=3Cspan
style=3D=22mso-fareast-language=3Aen-gb=3B=22 lang=3D=
=22NL=22=3EMet
vriendelijke groet=2C With kind regards=2C=3Cbr=3E
=3Cbr=3E
=3C/span=3EJorick Astrego=3C/font=3E=3C/span=3E=3Cb
style=3D=22color=3A=23604c78=22=3E=3Cbr=3E
=3Cbr=3E
Netbulae Virtualization Experts =3C/b=3E=3Cbr=3E
=3Chr style=3D=22border=3Anone=3Bborder-top=3A1px solid=20=
=23ccc=3B=22=3E
=3Ctable style=3D=22width=3A 522px=22=3E
=3Ctbody=3E
=3Ctr=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3ETel=3A 053
20 30 270=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3E=3Ca
moz-do-not-send=3D=22true=22
class=3D=22moz-txt-link-abbreviated=22
href=3D=22mailto=3Ainfo=40netbulae=2Eeu=22=3Einfo=
=40netbulae=2Eeu=3C/a=3E=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3EStaalsteden
4-3A=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3EKvK
08198180=3C/td=3E
=3C/tr=3E
=3Ctr=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3EFax=3A 053
20 30 271=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3E=3Ca
moz-do-not-send=3D=22true=22
class=3D=22moz-txt-link-abbreviated=22
href=3D=22http=3A//www=2Enetbulae=2Eeu=22=3Ewww=
=2Enetbulae=2Eeu=3C/a=3E=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3E7547 TA
Enschede=3C/td=3E
=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3EBTW
NL821234584B01=3C/td=3E
=3C/tr=3E
=3C/tbody=3E
=3C/table=3E
=3Cbr=3E
=3Chr style=3D=22border=3Anone=3Bborder-top=3A1px solid=20=
=23ccc=3B=22=3E=3Cbr=3E
=3Cbr=3E
=3Cfieldset class=3D=22mimeAttachmentHeader=22=3E=3C/fields=
et=3E
=3Cbr=3E
=3Cpre wrap=3D=22=22=3E=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F
Users mailing list
=3Ca moz-do-not-send=3D=22true=22 class=3D=22moz-txt-link-abbreviated=22 hr=
ef=3D=22mailto=3AUsers=40ovirt=2Eorg=22=3EUsers=40ovirt=2Eorg=3C/a=3E
=3Ca moz-do-not-send=3D=22true=22 class=3D=22moz-txt-link-freetext=22 href=
=3D=22http=3A//lists=2Eovirt=2Eorg/mailman/listinfo/users=22=3Ehttp=3A//lis=
ts=2Eovirt=2Eorg/mailman/listinfo/users=3C/a=3E=3C/pre=3E
=3C/blockquote=3E
Hi=2C=3Cbr=3E
=3Cbr=3E
=A0=A0=A0 Can you please check what does your gluster peer
status on each of your nodes return=3F=A0 I guess they are in=
disconnected state and that is the reason you are not able
to view these details=2E=3Cbr=3E
=3Cbr=3E
Thanks=3Cbr=3E
kasturi=3Cbr=3E
=3Cblockquote cite=3D=22mid=3A554A031A=2E1060200=40netbulae=
=2Eeu=22
type=3D=22cite=22=3E =3C/blockquote=3E
=3Cbr=3E
=3C/blockquote=3E
On the nodes it gives me the following=3A=3Cbr=3E
=3Cbr=3E
=3Cblockquote=3Egluster peer status=3Cbr=3E
Connection failed=2E Please check if gluster daemon is
operational=2E=3Cbr=3E
=3C/blockquote=3E
=3C/blockquote=3E
This means that glusterd is not running on this node=2E you
could check the status of glusterd by running the command
=27service glusterd status=27=2E =3Cbr=3E
=3Cbr=3E
please start glusterd by running the command =27service glusterd=
start=27 on both of your nodes=2E=3Cbr=3E
=3Cbr=3E
Ideally when glusterd goes down node in ovirt should move to
non-operational=2E Because of this BZ 1207150 as of now it is
not changing the state to non operational=2E=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
There is no glusterd on the compute nodes in our setup=2C we have=
two clusters=2E One for virt hosts only and one for GlusterFS
only=2E=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
Like I said=2C everything is Up and running fine=2E It=27s just tha=
t I
can=27t get the stats because the hostname !=3D GlusterFS NIC ip=3C=
br=3E
=3Cbr=3E
=3Cbr=3E
=3Cblockquote cite=3D=22mid=3A554A403A=2E9070308=40redhat=2Ecom=22=
type=3D=22cite=22=3E
=3Cblockquote cite=3D=22mid=3A554A1721=2E3080605=40netbulae=2Eeu=
=22
type=3D=22cite=22=3E
=3Cblockquote=3E =3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
But everyting is up and ovirt found the manually configured
volume perfectly=2E But the hostname it lists as
glustertest1=2Enetbulae=2Etest is not what my volume uses for=
communication as I created the volume using the ip=27s of the=
storage network=2E=3Cbr=3E
=3Cbr=3E
=3Cblockquote=3E=A0=3Cbr=3E
gluster peer status=3Cbr=3E
Number of Peers=3A 2=3Cbr=3E
=3Cbr=3E
Hostname=3A 10=2E1=2E1=2E3=3Cbr=3E
Uuid=3A 1cc0875e-1699-42ae-aed2-9152667ed5af=3Cbr=3E
State=3A Peer in Cluster =28Connected=29=3Cbr=3E
=3Cbr=3E
Hostname=3A 10=2E1=2E1=2E2=3Cbr=3E
Uuid=3A a0b3ac13-7388-441a-a238-1deb023cab6c=3Cbr=3E
State=3A Peer in Cluster =28Connected=29=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
=3C/blockquote=3E
Did you import already existing cluster =3F=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
No=2C I provisioned the nodes=2E Added them to our glusterfs cluste=
r
=28with virt service disabled=29 and created the volume manually=2E=
=3Cbr=3E
=3Cbr=3E
oVirt auto-discovered the manual created volume after that=2E=3Cbr=
=3E
=3Cbr=3E
=3Cblockquote=3EError=3A No brick=A0 =3Cb=3Eglustertest1=2Enetbulae=
=2Etest=3C/b=3E=3A/gluster/brick1
in volume data=A0 =3Cbr=3E
=3Cbr=3E
Hostname=3A =3Cb=3E10=2E1=2E1=2E3=3C/b=3E=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
Things should work better in 3=2E6 =28bz1049994=29=2C but I don=27t=
see
any code changes to =22GetGlusterVolumeProfileInfoQuery=22 linked t=
o
this in Bugzilla=2E=3Cbr=3E
=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
HI Jorik=2C=3Cbr=3E
=3Cbr=3E
=A0=A0=A0 For more information on using separate storage network plea=
se
refer to the following feature page=2E=3Cbr=3E
=3Cbr=3E
=A0=A0=A0 =3Ca moz-do-not-send=3D=22true=22 class=3D=22moz-txt-link-f=
reetext=22
href=3D=22http=3A//www=2Eovirt=2Eorg/Features/Select=5FNetwork=5FFo=
r=5FGluster=22=3Ehttp=3A//www=2Eovirt=2Eorg/Features/Select=5FNetwork=5FFor=
=5FGluster=3C/a=3E=3Cbr=3E
=3Cbr=3E
Thanks=3Cbr=3E
kasturi=2E=3Cbr=3E
=3C/blockquote=3E
=3Cbr=3E
=3Cbr=3E
I don=27t think you understand completely=2C the page you refer to is=
for 3=2E6=2E I=27m running 3=2E5=2E2 without this feature=2E =3Cbr=3E=
=3Cbr=3E
The question was=2C will this get fixed along with the changes in 3=2E6=
as I don=27t see any code changes refering to the statistics/profiling=
of the gluster volume=2E=2E=2E=2E=2E=2E=3Cbr=3E
=3Cbr=3E
It will take less time testing 3=2E6 to find out than trying to
explain it any further =3B-p=3Cbr=3E
=3Cbr=3E
=3Cbr=3E
=20=
=3CBR /=3E
=3CBR /=3E
=3Cb style=3D=22color=3A=23604c78=22=3E=3C/b=3E=3Cbr=3E=3Cspan style=3D=22c=
olor=3A=23604c78=3B=22=3E=3Cfont color=3D=22000000=22=3E=3Cspan style=3D=22=
mso-fareast-language=3Aen-gb=3B=22 lang=3D=22NL=22=3EMet vriendelijke groet=
=2C With kind regards=2C=3Cbr=3E=3Cbr=3E=3C/span=3EJorick Astrego=3C/font=
=3E=3C/span=3E=3Cb style=3D=22color=3A=23604c78=22=3E=3Cbr=3E=3Cbr=3ENetbul=
ae Virtualization Experts =3C/b=3E=3Cbr=3E=3Chr style=3D=22border=3Anone=3B=
border-top=3A1px solid =23ccc=3B=22=3E=3Ctable style=3D=22width=3A 522px=22=
=3E=3Ctbody=3E=3Ctr=3E=3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=
=22=3ETel=3A 053 20 30 270=3C/td=3E =3Ctd style=3D=22width=3A 130px=3Bf=
ont-size=3A 10px=22=3Einfo=40netbulae=2Eeu=3C/td=3E =3Ctd style=3D=22wid=
th=3A 130px=3Bfont-size=3A 10px=22=3EStaalsteden 4-3A=3C/td=3E =3Ctd sty=
le=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3EKvK 08198180=3C/td=3E=3C/tr=
=3E=3Ctr=3E =3Ctd style=3D=22width=3A 130px=3Bfont-size=3A 10px=22=3EFax=
=3A 053 20 30 271=3C/td=3E =3Ctd style=3D=22width=3A 130px=3Bfont-size=
=3A 10px=22=3Ewww=2Enetbulae=2Eeu=3C/td=3E =3Ctd style=3D=22width=3A 130=
px=3Bfont-size=3A 10px=22=3E7547 TA Enschede=3C/td=3E =3Ctd style=3D=22w=
idth=3A 130px=3Bfont-size=3A 10px=22=3EBTW NL821234584B01=3C/td=3E=3C/tr=3E=
=3C/tbody=3E=3C/table=3E=3Cbr=3E=3Chr style=3D=22border=3Anone=3Bborder-top=
=3A1px solid =23ccc=3B=22=3E=3CBR /=3E
=3C/body=3E
=3C/html=3E
--------------020905070701030709020902--
3:07 a.m.
New subject: GetGlusterVolumeAdvancedDetailsQuery & GetGlusterVolumeProfileInfoQuery when using seperate storage network
This is a multi-part message in MIME format.
--------------000704080106010404040203
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
On 05/07/2015 01:34 PM, Jorick Astrego wrote:
On 05/06/2015 08:15 PM, knarra wrote:
> On 05/06/2015 11:22 PM, Jorick Astrego wrote:
>>
>>
>> On 05/06/2015 06:24 PM, knarra wrote:
>>> On 05/06/2015 06:59 PM, Jorick Astrego wrote:
>>>>
>>>>
>>>> On 05/06/2015 02:49 PM, knarra wrote:
>>>>> On 05/06/2015 05:33 PM, Jorick Astrego wrote:
>>>>>> Hi,
>>>>>>
>>>>>> Looking forward to bz 1049994 Allow choosing network
>>>>>> interface for gluster domain traffic.
>>>>>>
>>>>>> Currently I have the bricks on a different storage network and
>>>>>> can't get the volume details or profile it.
>>>>>>
>>>>>> Will this be handled in 3.6 properly? I don't see any changes
in
>>>>>> gerrit regarding this, but I can be ovelooking it.
>>>>>>
>>>>>> The errors I get currently:
>>>>>>
>>>>>> Could not fetch brick profile stats
>>>>>>
>>>>>> 2015-05-06 10:34:22,430 ERROR
>>>>>>
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeProfileInfoQuery]
>>>>>> (ajp--127.0.0.1-8702-27) Query
>>>>>> GetGlusterVolumeProfileInfoQuery failed. Exception message
>>>>>> is null : java.lang.NullPointerException:
>>>>>> java.lang.NullPointerException
>>>>>>
>>>>>> and
>>>>>>
>>>>>> Error in fetching the brick details, please try again.
>>>>>>
>>>>>> 2015-05-06 10:36:14,205 ERROR
>>>>>>
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeAdvancedDetailsQuery]
>>>>>> (ajp--127.0.0.1-8702-55) Query
>>>>>> GetGlusterVolumeAdvancedDetailsQuery failed. Exception
>>>>>> message is VdcBLLException: Volume status failed
>>>>>> error: Staging failed on *.*.*.*. Error: No brick
>>>>>> glustertest1.netbulae.test/gluster/brick1 in volume data
>>>>>> Staging failed on *.*.*.*. Error: No brick
>>>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>>>> return code: -1 (Failed with error GlusterVolumeStatusFailed
>>>>>> and code 4157) :
>>>>>> org.ovirt.engine.core.common.errors.VdcBLLException:
>>>>>> VdcBLLException: Volume status failed
>>>>>> error: Staging failed on *.*.*.*. Error: No brick
>>>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>>>> Staging failed on *.*.*.*. Error: No brick
>>>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>>>> return code: -1 (Failed with error GlusterVolumeStatusFailed
>>>>>> and code 4157):
>>>>>> org.ovirt.engine.core.common.errors.VdcBLLException:
>>>>>> VdcBLLException: Volume status failed
>>>>>> error: Staging failed on *.*.*.*. Error: No brick
>>>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>>>> Staging failed on *.*.*.*. Error: No brick
>>>>>> glustertest1.netbulae.test:/gluster/brick1 in volume data
>>>>>> return code: -1 (Failed with error GlusterVolumeStatusFailed
>>>>>> and code 4157)
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Met vriendelijke groet, With kind regards,
>>>>>>
>>>>>> Jorick Astrego*
>>>>>>
>>>>>> Netbulae Virtualization Experts *
>>>>>>
------------------------------------------------------------------------
>>>>>> Tel: 053 20 30 270 info(a)netbulae.eu Staalsteden 4-3A KvK
>>>>>> 08198180
>>>>>> Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW
>>>>>> NL821234584B01
>>>>>>
>>>>>>
>>>>>>
------------------------------------------------------------------------
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Users mailing list
>>>>>> Users(a)ovirt.org
>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>> Hi,
>>>>>
>>>>> Can you please check what does your gluster peer status on
>>>>> each of your nodes return? I guess they are in disconnected
>>>>> state and that is the reason you are not able to view these details.
>>>>>
>>>>> Thanks
>>>>> kasturi
>>>>>
>>>> On the nodes it gives me the following:
>>>>
>>>> gluster peer status
>>>> Connection failed. Please check if gluster daemon is operational.
>>>>
>>> This means that glusterd is not running on this node. you could
>>> check the status of glusterd by running the command 'service
>>> glusterd status'.
>>>
>>> please start glusterd by running the command 'service glusterd
>>> start' on both of your nodes.
>>>
>>> Ideally when glusterd goes down node in ovirt should move to
>>> non-operational. Because of this BZ 1207150 as of now it is not
>>> changing the state to non operational.
>>
>> There is no glusterd on the compute nodes in our setup, we have two
>> clusters. One for virt hosts only and one for GlusterFS only.
>>
>>
>> Like I said, everything is Up and running fine. It's just that I
>> can't get the stats because the hostname != GlusterFS NIC ip
>>
>>
>>>>
>>>>
>>>> But everyting is up and ovirt found the manually configured volume
>>>> perfectly. But the hostname it lists as glustertest1.netbulae.test
>>>> is not what my volume uses for communication as I created the
>>>> volume using the ip's of the storage network.
>>>>
>>>>
>>>> gluster peer status
>>>> Number of Peers: 2
>>>>
>>>> Hostname: 10.1.1.3
>>>> Uuid: 1cc0875e-1699-42ae-aed2-9152667ed5af
>>>> State: Peer in Cluster (Connected)
>>>>
>>>> Hostname: 10.1.1.2
>>>> Uuid: a0b3ac13-7388-441a-a238-1deb023cab6c
>>>> State: Peer in Cluster (Connected)
>>>>
>>> Did you import already existing cluster ?
>>
>> No, I provisioned the nodes. Added them to our glusterfs cluster
>> (with virt service disabled) and created the volume manually.
>>
>> oVirt auto-discovered the manual created volume after that.
>>
>> Error: No brick *glustertest1.netbulae.test*:/gluster/brick1 in
>> volume data
>>
>> Hostname: *10.1.1.3*
>>
>> Things should work better in 3.6 (bz1049994), but I don't see any
>> code changes to "GetGlusterVolumeProfileInfoQuery" linked to this in
>> Bugzilla.
>>
>
> HI Jorik,
>
> For more information on using separate storage network please
> refer to the following feature page.
>
> http://www.ovirt.org/Features/Select_Network_For_Gluster
>
> Thanks
> kasturi.
I don't think you understand completely, the page you refer to is for
3.6. I'm running 3.5.2 without this feature.
The question was, will this get fixed along with the changes in 3.6 as
I don't see any code changes refering to the statistics/profiling of
the gluster volume......
It will take less time testing 3.6 to find out than trying to explain
it any further ;-p
Yes, it should. As we have changed the way we identify the brick name
based on whether a different network was used to add the brick.
Earlier, the brick name was blindly thought to be <hostname>:<mount path
to directory>. Now the ip address of the interface is used to identify
the brick, if a different interface was used.
We're yet to test out all the flows, but theoretically it should work :)
Met vriendelijke groet, With kind regards,
Jorick Astrego*
Netbulae Virtualization Experts *
------------------------------------------------------------------------
Tel: 053 20 30 270 info(a)netbulae.eu Staalsteden 4-3A KvK 08198180
Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01
------------------------------------------------------------------------
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------000704080106010404040203
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<br>
<div class="moz-cite-prefix">On 05/07/2015 01:34 PM, Jorick Astrego
wrote:<br>
</div>
<blockquote cite="mid:554B1CA1.9050201@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
<br>
<div class="moz-cite-prefix">On 05/06/2015 08:15 PM, knarra
wrote:<br>
</div>
<blockquote cite="mid:554A5A43.1080504@redhat.com"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">On 05/06/2015 11:22 PM, Jorick
Astrego wrote:<br>
</div>
<blockquote cite="mid:554A54C0.8030100@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
<br>
<div class="moz-cite-prefix">On 05/06/2015 06:24 PM, knarra
wrote:<br>
</div>
<blockquote cite="mid:554A403A.9070308@redhat.com"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">On 05/06/2015 06:59 PM, Jorick
Astrego wrote:<br>
</div>
<blockquote cite="mid:554A1721.3080605@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<br>
<br>
<div class="moz-cite-prefix">On 05/06/2015 02:49 PM,
knarra wrote:<br>
</div>
<blockquote cite="mid:554A0DEB.2080002@redhat.com"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">On 05/06/2015 05:33 PM,
Jorick Astrego wrote:<br>
</div>
<blockquote cite="mid:554A031A.1060200@netbulae.eu"
type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
Hi,<br>
<br>
Looking forward to
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
<meta name="generator" content="Sheets">
<style type="text/css"><!--td {border: 1px solid
#ccc;}br {mso-data-placement:same-cell;}--></style>bz
1049994 Allow choosing network interface for
gluster domain traffic.<br>
<br>
Currently I have the bricks on a different storage
network and can't get the volume details or profile
it. <br>
<br>
Will this be handled in 3.6 properly? I don't see any
changes in gerrit regarding this, but I can be
ovelooking it.<br>
<br>
The errors I get currently:<br>
<br>
<blockquote>Could not fetch brick profile stats<br>
</blockquote>
<blockquote>2015-05-06 10:34:22,430 ERROR
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeProfileInfoQuery]
(ajp--127.0.0.1-8702-27) Query
GetGlusterVolumeProfileInfoQuery failed. Exception
message is null : java.lang.NullPointerException:
java.lang.NullPointerException<br>
<br>
</blockquote>
and<br>
<blockquote>Error in fetching the brick details,
please try again.<br>
<br>
2015-05-06 10:36:14,205 ERROR
[org.ovirt.engine.core.bll.gluster.GetGlusterVolumeAdvancedDetailsQuery]
(ajp--127.0.0.1-8702-55) Query
GetGlusterVolumeAdvancedDetailsQuery failed.
Exception message is VdcBLLException: Volume status
failed<br>
error: Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test/gluster/brick1 in volume
data<br>
Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
return code: -1 (Failed with error
GlusterVolumeStatusFailed and code 4157) :
org.ovirt.engine.core.common.errors.VdcBLLException:
VdcBLLException: Volume status failed<br>
error: Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
return code: -1 (Failed with error
GlusterVolumeStatusFailed and code 4157):
org.ovirt.engine.core.common.errors.VdcBLLException:
VdcBLLException: Volume status failed<br>
error: Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
Staging failed on *.*.*.*. Error: No brick
glustertest1.netbulae.test:/gluster/brick1 in volume
data<br>
return code: -1 (Failed with error
GlusterVolumeStatusFailed and code 4157)<br>
</blockquote>
<blockquote><br>
</blockquote>
<br>
<br>
<br>
<span style="color:#604c78;"><font
color="000000"><span
style="mso-fareast-language:en-gb;"
lang="NL">Met
vriendelijke groet, With kind regards,<br>
<br>
</span>Jorick Astrego</font></span><b
style="color:#604c78"><br>
<br>
Netbulae Virtualization Experts </b><br>
<hr style="border:none;border-top:1px solid #ccc;">
<table style="width: 522px">
<tbody>
<tr>
<td style="width: 130px;font-size: 10px">Tel:
053 20 30 270</td>
<td style="width: 130px;font-size: 10px"><a
moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="mailto:info@netbulae.eu">info@netbulae.eu</a></td>
<td style="width: 130px;font-size:
10px">Staalsteden
4-3A</td>
<td style="width: 130px;font-size: 10px">KvK
08198180</td>
</tr>
<tr>
<td style="width: 130px;font-size: 10px">Fax:
053 20 30 271</td>
<td style="width: 130px;font-size: 10px"><a
moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="http://www.netbulae.eu">www.netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">7547 TA
Enschede</td>
<td style="width: 130px;font-size: 10px">BTW
NL821234584B01</td>
</tr>
</tbody>
</table>
<br>
<hr style="border:none;border-top:1px solid
#ccc;"><br>
<br>
<fieldset
class="mimeAttachmentHeader"></fieldset>
<br>
<pre
wrap="">_______________________________________________
Users mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</blockquote>
Hi,<br>
<br>
Can you please check what does your gluster peer
status on each of your nodes return? I guess they are
in disconnected state and that is the reason you are not
able to view these details.<br>
<br>
Thanks<br>
kasturi<br>
<blockquote cite="mid:554A031A.1060200@netbulae.eu"
type="cite"> </blockquote>
<br>
</blockquote>
On the nodes it gives me the following:<br>
<br>
<blockquote>gluster peer status<br>
Connection failed. Please check if gluster daemon is
operational.<br>
</blockquote>
</blockquote>
This means that glusterd is not running on this node. you
could check the status of glusterd by running the command
'service glusterd status'. <br>
<br>
please start glusterd by running the command 'service
glusterd start' on both of your nodes.<br>
<br>
Ideally when glusterd goes down node in ovirt should move to
non-operational. Because of this BZ 1207150 as of now it is
not changing the state to non operational.<br>
</blockquote>
<br>
There is no glusterd on the compute nodes in our setup, we
have two clusters. One for virt hosts only and one for
GlusterFS only.<br>
<br>
<br>
Like I said, everything is Up and running fine. It's just that
I can't get the stats because the hostname != GlusterFS NIC ip<br>
<br>
<br>
<blockquote cite="mid:554A403A.9070308@redhat.com"
type="cite">
<blockquote cite="mid:554A1721.3080605@netbulae.eu"
type="cite">
<blockquote> <br>
<br>
</blockquote>
But everyting is up and ovirt found the manually
configured volume perfectly. But the hostname it lists as
glustertest1.netbulae.test is not what my volume uses for
communication as I created the volume using the ip's of
the storage network.<br>
<br>
<blockquote> <br>
gluster peer status<br>
Number of Peers: 2<br>
<br>
Hostname: 10.1.1.3<br>
Uuid: 1cc0875e-1699-42ae-aed2-9152667ed5af<br>
State: Peer in Cluster (Connected)<br>
<br>
Hostname: 10.1.1.2<br>
Uuid: a0b3ac13-7388-441a-a238-1deb023cab6c<br>
State: Peer in Cluster (Connected)<br>
<br>
</blockquote>
</blockquote>
Did you import already existing cluster ?<br>
</blockquote>
<br>
No, I provisioned the nodes. Added them to our glusterfs
cluster (with virt service disabled) and created the volume
manually.<br>
<br>
oVirt auto-discovered the manual created volume after that.<br>
<br>
<blockquote>Error: No brick
<b>glustertest1.netbulae.test</b>:/gluster/brick1
in volume data <br>
<br>
Hostname: <b>10.1.1.3</b><br>
<br>
</blockquote>
Things should work better in 3.6 (bz1049994), but I don't see
any code changes to "GetGlusterVolumeProfileInfoQuery" linked
to this in Bugzilla.<br>
<br>
</blockquote>
<br>
HI Jorik,<br>
<br>
For more information on using separate storage network
please refer to the following feature page.<br>
<br>
<a moz-do-not-send="true"
class="moz-txt-link-freetext"
href="http://www.ovirt.org/Features/Select_Network_For_Gluster"...
<br>
Thanks<br>
kasturi.<br>
</blockquote>
<br>
<br>
I don't think you understand completely, the page you refer to is
for 3.6. I'm running 3.5.2 without this feature. <br>
<br>
The question was, will this get fixed along with the changes in
3.6 as I don't see any code changes refering to the
statistics/profiling of the gluster volume......<br>
<br>
It will take less time testing 3.6 to find out than trying to
explain it any further ;-p<br>
</blockquote>
<br>
Yes, it should. As we have changed the way we identify the brick
name based on whether a different network was used to add the brick.<br>
Earlier, the brick name was blindly thought to be
<hostname>:<mount path to directory>. Now the ip address
of the interface is used to identify the brick, if a different
interface was used.<br>
<br>
We're yet to test out all the flows, but theoretically it should
work :)<br>
<br>
<br>
<blockquote cite="mid:554B1CA1.9050201@netbulae.eu"
type="cite"> <br>
<br>
<br>
<br>
<br>
<span style="color:#604c78;"><font
color="000000"><span
style="mso-fareast-language:en-gb;" lang="NL">Met
vriendelijke groet, With kind regards,<br>
<br>
</span>Jorick Astrego</font></span><b
style="color:#604c78"><br>
<br>
Netbulae Virtualization Experts </b><br>
<hr style="border:none;border-top:1px solid #ccc;">
<table style="width: 522px">
<tbody>
<tr>
<td style="width: 130px;font-size: 10px">Tel: 053 20 30
270</td>
<td style="width: 130px;font-size: 10px"><a
class="moz-txt-link-abbreviated"
href="mailto:info@netbulae.eu">info@netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">Staalsteden
4-3A</td>
<td style="width: 130px;font-size: 10px">KvK
08198180</td>
</tr>
<tr>
<td style="width: 130px;font-size: 10px">Fax: 053 20 30
271</td>
<td style="width: 130px;font-size: 10px"><a
class="moz-txt-link-abbreviated"
href="http://www.netbulae.eu">www.netbulae.eu</a></td>
<td style="width: 130px;font-size: 10px">7547 TA
Enschede</td>
<td style="width: 130px;font-size: 10px">BTW
NL821234584B01</td>
</tr>
</tbody>
</table>
<br>
<hr style="border:none;border-top:1px solid #ccc;"><br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
</blockquote>
<br>
</body>
</html>
--------------000704080106010404040203--
3682
days inactive
3683
days old
3 comments
3 participants
participants (3)
-
Jorick Astrego -
knarra -
Sahina Bose