--1013620071-1922147181-1386897821=:40672
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
Hi Fabian,=0A=0A=0AI have now a setup like this:=0A=0A=0A=A0 +-----------+ =
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 +----------=
----------+=0A=A0 | =A0ovirt-shell | =A0---- network ---------| =A0 =A0 =A0=
stateless node =A0 |=0A+------------+ =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0+-------------------+=0A=0AA few more questi=
ons:=0A=0A1. Where is the source to build this image?=A0ovirt-node-iso-3.0.=
3-1.1.vdsm.fc19.iso. Is it the same
as=A0http://gerrit.ovirt.org/p/ovirt-no=
de.git?=0A=0A2. I am a little confused by the kernel parameter rhevm_admin_=
password and management_server. Are they used by ovirt-shell to connect to =
the ovirt-node? For example in ovirt-shell, =A0should I use "connect =A0--u=
rl http://<ovirt-node-ip-addr>:8080/api --user "user@domain" --password
"rh=
evm_admin_password"? =A0Also in this command line, what's "user@domain"
and=
where do I specify "user" and
"domain"?=0A=0A=0AThanks.=0A=0A=0A>_________=
_______________________=0A> From: Fabian Deutsch <fabiand(a)redhat.com>=0A>To=
: David Li <david_li(a)sbcglobal.net> =0A>Cc: "users(a)ovirt.org"
<users(a)ovirt.=
org> =0A>Sent: Thursday, December 12, 2013 7:40 AM=0A>Subject: Re: [Users] =
How to pxeboot ovrit node into memory automatically?=0A> =0A>=0A>Am Mittwoc=
h, den 11.12.2013, 17:32 -0800 schrieb David Li:=0A>> Hi Fabian,=0A>>
=0A>>=
I booted the new node stateless. But how can connect to it from ovirt=0A>>=
engine cli? The cli asks for three things: URL, user name and=0A>> passwor=
d. I am not sure how to put them on the kernel boot option=0A>> line.=0A>> =
=0A>> David=0A>> =0A>> =0A>> =0A>=0A>Hey
David,=0A>=0A>please take a look h=
ere to find the correct
cmdline:=0A>https://access.redhat.com/site/document=
ation/en-US/Red_Hat_Enterprise_Virtualization/3.0/html/Hypervisor_Deploymen=
t_Guide/sect-Deployment_Guide-Installing_Red_Hat_Enterprise_Virtualization_=
Hypervisors-RHEV_Hypervisor_Kernel_Parameters_and_Automated_Installation.ht=
ml=0A>=0A>- fabian=0A>=0A>> =0A>>
_________________________________________=
_____________________________=0A>> From: Fabian Deutsch <fabiand(a)redhat.com=
; =0A>> To: David Li <david_li(a)sbcglobal.net>; =0A>>
Cc: users(a)ovirt.org <=
users(a)ovirt.org>; =0A>> Subject: Re: [Users] How
to pxeboot ovrit node into=
memory=0A>> automatically? =0A>> Sent: Wed, Dec 11, 2013 8:00:40 AM
=0A>> =
=0A>> =0A>> Am Dienstag, den 10.12.2013, 16:00 -0800 schrieb David
Li:=0A>>=
Hi Fabian,=0A>> > =0A>> > =0A>> > Does the
stateless ovirt node have the=
VDSM built-in? =0A>> =0A>> Hey
David,=0A>> =0A>> stateless is a feature or=
a special mode of oVirt Node which is also=0A>> available on the "oVirt No=
de for oVirt Engine" image [1].=0A>> But please note that you will have to =
approve the Node in Engine after=0A>> each reboot if you use the stateless =
feature. This bug [2] might also=0A>> tackle the problem of a stateless Nod=
e.=0A>> =0A>> - fabian=0A>> =0A>> --=0A>> [1]=0A>>
http://resources.ovirt.o=
rg/releases/3.3/iso/ovirt-node-iso-3.0.3-1.1.vdsm.fc19.iso=0A>> [2] https:/=
/bugzilla.redhat.com/show_bug.cgi?id=3D875088=0A>> =0A>> > =0A>> >
David=0A=
> > =0A>> >=A0 =A0 =A0 =A0 =0A>> >=0A>>
__________________________________=
____________________________=0A>> >=A0
=A0 =A0 =A0 From: Fabian Deutsch <fa=
biand(a)redhat.com>=0A>> >=A0 =A0 =A0 =A0 To: David Li
<david_li(a)sbcglobal.ne=
t> =0A>> >=A0 =A0 =A0 =A0 Cc: "users(a)ovirt.org"
<users(a)ovirt.org> =0A>> >=
=A0 =A0 =A0 =A0 Sent: Thursday, December 5, 2013 11:47 PM=0A>> >=A0 =A0 =A0=
=A0 Subject: Re: [Users] How to pxeboot ovrit node into memory=0A>> >=A0 =
=A0 =A0 =A0 automatically?=0A>> >=A0 =A0 =A0 =A0 =0A>> >=A0 =A0 =A0 =A0
=0A=
> >=A0 =A0 =A0 =A0 Am Donnerstag, den 05.12.2013, 16:30 -0800
schrieb Davi=
d Li:=0A>> >=A0 =A0 =A0 =A0 > Hi Fabian,=0A>>
>=A0 =A0 =A0 =A0 > =0A>> >=A0=
=A0 =A0 =A0 > I think the bad route is a link local route 169.254.0.0/16.=
=0A>> >=A0 =A0 =A0 =A0 I am not quite sure if it's a real bug but in my cas=
e I have=0A>> >=A0 =A0 =A0 =A0 to remove this route.=0A>> >=A0 =A0 =A0
=A0 =
Also I am using ramdisk based node without a local disk.=0A>>
Can=0A>> >=
=A0 =A0 =A0 =A0 anything be persisted? =0A>> >=A0 =A0
=A0 =A0 =0A>> >=A0 =
=A0 =A0 =A0 Hey David,=0A>> >=A0 =A0 =A0 =A0 =0A>> >=A0 =A0 =A0 =A0 when
yo=
u refer to stateless mode, then no, nothing can be=0A>> >=A0 =A0 =A0 =A0 pe=
rsisted.=0A>> >=A0 =A0 =A0 =A0 Regarding the bug - Please provide the whole=
cmdline you are=0A>> >=A0 =A0 =A0 =A0 using to=0A>> >=A0 =A0 =A0 =A0
boot =
the node, to give me a chance to reproduce it.=0A>> >=A0 =A0 =A0 =A0 =0A>>
=
=A0 =A0 =A0 =A0 - fabian=0A>> >=A0 =A0 =A0 =A0 =0A>>
>=A0 =A0 =A0 =A0 > Da=
vid=0A>> >=A0 =A0 =A0 =A0 > =0A>>
>=A0 =A0 =A0 =A0 > =0A>> >=A0 =A0 =A0 =A0=
=0A>> >=A0 =A0 =A0 =A0 > ----- Original Message
-----=0A>> >=A0 =A0 =A0 =
=A0 > > From: Fabian Deutsch
<fabiand(a)redhat.com>=0A>> >=A0 =A0 =A0 =A0 > >=
To: David Li <david_li(a)sbcglobal.net>=0A>> >=A0 =A0 =A0 =A0 > > Cc:
"users=
@ovirt.org" <users(a)ovirt.org>=0A>> >=A0 =A0 =A0 =A0 > > Sent:
Wednesday, De=
cember 4, 2013 11:17 AM=0A>> >=A0 =A0 =A0 =A0 > > Subject: Re: [Users] How
=
to pxeboot ovrit node into=0A>> memory=0A>> >=A0 =A0 =A0 =A0
automatically?=
=0A>> >=A0 =A0 =A0 =A0 > > =0A>> >=A0 =A0 =A0 =A0 > > Am
Montag, den 02.12.=
2013, 13:53 -0800 schrieb David Li:=0A>> >=A0 =A0 =A0 =A0 > >>=A0 Hi
Fabian=
,=0A>> >=A0 =A0 =A0 =A0 > >> =0A>> >=A0 =A0 =A0 =A0 >
>>=A0 Everytime the o=
virt node boots up, it adds a route=0A>> entry=0A>> >=A0 =A0 =A0 =A0 that
I=
have to =0A>> >=A0 =A0 =A0 =A0 > > manually remove. Otherwise it messed
up=
my routing. =0A>> >=A0 =A0 =A0 =A0 > >>=A0 How do I modify the boot
script=
s to automatically=0A>> remove=0A>> >=A0 =A0 =A0 =A0 it?=0A>> >=A0
=A0 =A0 =
=A0 > > =0A>> >=A0 =A0 =A0 =A0 > > Hey David,=0A>> >=A0 =A0
=A0 =A0 > > =0A=
> >=A0 =A0 =A0 =A0 > > could you file a bug for that route
problem?=0A>> >=
=A0 =A0 =A0 =A0 > > =0A>> >=A0 =A0 =A0 =A0
> > You can try the following wo=
rkaround:=0A>> >=A0 =A0 =A0 =A0 > > =0A>> >=A0 =A0 =A0 =A0 >
> # Create /et=
c/rc.d/rc.local with the commands to run=0A>> >=A0 =A0 =A0 =A0 > > $ vi
/et=
c/rc.d/rc.local=0A>> >=A0 =A0 =A0 =A0 > > $ chmod a+x
/etc/rc.d/rc.local=0A=
> >=A0 =A0 =A0 =A0 > > $ persist
/etc/rc.d/rc.local=0A>> >=A0 =A0 =A0 =A0 =
> =0A>> >=A0 =A0 =A0 =A0 > > /etc/rc.d/rc.local should then be run on
eve=
ry boot.=0A>> >=A0 =A0 =A0 =A0 > > =0A>> >=A0 =A0 =A0
=A0 > > - fabian=0A>>=
=A0 =A0 =A0 =A0 > > =0A>> >=A0 =A0 =A0 =A0 >
>>=A0 ----- Original Message=
-----=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 > From: Fabian Deutsch <fabiand@redhat=
.com>=0A>> >=A0 =A0 =A0 =A0 > >>=A0 > To: David Li
<david_li(a)sbcglobal.net>=
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 > Cc: "users(a)ovirt.org"
<users(a)ovirt.org>=0A=
> >=A0 =A0 =A0 =A0 > >>=A0 > Sent: Monday, October
28, 2013 7:45 AM=0A>> >=
=A0 =A0 =A0 =A0 > >>=A0 > Subject: Re:
[Users] How to pxeboot ovrit node in=
to=0A>> >=A0 =A0 =A0 =A0 memory =0A>> >=A0 =A0 =A0 =A0 > >
automatically?=
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 > =0A>> >=A0 =A0 =A0 =A0 >
>>=A0 > Am Montag=
, den 28.10.2013, 07:42 -0700 schrieb David=0A>> >=A0 =A0 =A0 =A0 Li:=0A>>
=
=A0 =A0 =A0 =A0 > >>=A0 >> =0A>> >=A0 =A0 =A0
=A0 > >>=A0 >>=A0 Hi Fabian,=
=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >> =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 Yes =
rootpwd worked too! Thanks.=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>
=0A>> >=A0 =A0=
=A0 =A0 > >>=A0 >>=A0 Two new problems:=0A>> >=A0 =A0 =A0 =A0
> >>=A0 >> =
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 But I found there is no
networking for=
the=0A>> stateless=0A>> >=A0 =A0 =A0 =A0 node.=0A>> >=A0 =A0 =A0
=A0 > >>=
=A0 >>=A0 What kernel boot options are used to either use=0A>> DHCP=0A>>
>=
=A0 =A0 =A0 =A0 or =0A>> >=A0 =A0 =A0 =A0 > > statically =0A>>
>=A0 =A0 =A0=
=A0 > >>=A0 > configure the IP address for an interface on the=0A>>
node?=
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >> =0A>> >=A0 =A0 =A0 =A0
> >>=A0 >>=A0 I al=
so need to have the sshd enabled. Is there a=0A>> >=A0 =A0 =A0 =A0 kernel o=
ption =0A>> >=A0 =A0 =A0 =A0 > > for that?=0A>> >=A0 =A0 =A0 =A0
> >>=A0 > =
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 > Hey David,=0A>> >=A0 =A0
=A0 =A0 > >>=A0 >=
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 > here you can find all the supported
boot =
params in=0A>> >=A0 =A0 =A0 =A0 ovirt node:=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >=
=0A>> >=A0 =A0 =A0 =A0 > >=0A>> >=0A>>
http://gerrit.ovirt.org/gitweb?p=3D=
ovirt-node.git;a=3Dblob;f=3Dscripts/ovirt-init-functions.sh.in;h=3Dc4280cae=
fb89c77afc1e8bec8c925aa7f3039733;hb=3DHEAD#l214=0A>> >=A0 =A0 =A0 =A0 >
>>=
=A0 > =0A>> >=A0 =A0 =A0 =A0 > >>=A0 > Greetings=0A>>
>=A0 =A0 =A0 =A0 > >>=
=A0 > fabian=0A>> >=A0 =A0 =A0 =A0 > >>=A0 > =0A>> >=A0
=A0 =A0 =A0 > >>=A0=
>=A0 David=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>
=0A>> >=A0 =A0 =A0 =A0 > >>=
=A0 >> =0A>> >=A0 =A0
=A0 =A0 > >>=A0 >> =0A>> >=A0 =A0 =A0 =A0 > >>=A0
>>=
=A0 ----- Original Message -----=0A>> >=A0 =A0 =A0 =A0 > >>=A0
>>=A0 > From=
: Fabian Deutsch <fabiand(a)redhat.com>=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 >=
To: David Li <david_li(a)sbcglobal.net>=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 =
Cc: "users(a)ovirt.org" <users(a)ovirt.org>=0A>>
>=A0 =A0 =A0 =A0 > >>=A0 >>=
=A0 > Sent: Friday, October 25,
2013 9:10 AM=0A>> >=A0 =A0 =A0 =A0 > >>=A0 =
>=A0 > Subject: Re: [Users] How to pxeboot ovrit node=0A>>
>=A0 =A0 =A0 =
=A0 into memory =0A>> >=A0 =A0 =A0 =A0 > >>=A0
> automatically?=0A>> >=A0 =
=A0 =A0 =A0 > >>=A0 >>=A0 > =0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 > Am Freit=
ag, den 25.10.2013, 08:57 -0700 schrieb=0A>> >=A0 =A0 =A0 =A0 David Li:=0A>=
>=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >>=A0 Hi
Fabian,=0A>> >=A0 =A0 =A0 =A0 > >=
=A0 >>=A0 >> =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
>>=A0 That kernel option=
worked for me!=A0 The node is=0A>> >=A0
=A0 =A0 =A0 booted =0A>> >=A0 =A0 =
=A0 =A0 > > up in RAM. =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >
Thanks!=0A>> >=A0 =
=A0 =A0 =A0 > >>=A0 >>=A0 >> =0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 >>=A0 My =
next question is:=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >> How
do I specify t=
he root login and passwd as=0A>> >=A0 =A0 =A0 =A0 boot =0A>> >=A0 =A0
=A0 =
=A0 > > parameters? =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
> =0A>> >=A0 =A0 =
=A0 =A0 > >>=A0 >>=A0 > Hey David.=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 > =
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 > Nice that it worked!
Were you able t=
o register to=0A>> >=A0 =A0 =A0 =A0 the =0A>> >=A0 =A0 =A0 =A0 > >
Engine?=
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 > =0A>> >=A0 =A0
=A0 =A0 > >>=A0 >>=A0=
You can use the adminpw=3D and rootpw=3D kernel=0A>> >=A0
=A0 =A0 =A0 ar=
guments to set =0A>> >=A0 =A0 =A0 =A0 > > =0A>>
>=A0 =A0 =A0 =A0 > >>=A0 > =
passwords.=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 > use=0A>>
>=A0 =A0 =A0 =A0 =
>>=A0 >>=A0 > $ openssl passwd -salt 42=0A>>
>=A0 =A0 =A0 =A0 > >>=A0 >>=
=A0 > to create one or two
passwords=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 > =
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 > Greetings=0A>>
>=A0 =A0 =A0 =A0 > >>=
=A0 >>=A0 > fabian=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
> =0A>> >=A0 =A0 =A0=
=A0 > >>=A0 >>=A0 >>=A0 David=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 >> =0A>>=
=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >> =0A>>
>=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >> =
=0A>> >=A0 =A0
=A0 =A0 > >>=A0 >>=A0 >> =0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=
=A0 >>=A0 ----- Original Message -----=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 =
>=A0 > From: Fabian Deutsch
<fabiand(a)redhat.com>=0A>> >=A0 =A0 =A0 =A0 > >=
=A0 >>=A0 >>=A0 > To: David Li <david_li(a)sbcglobal.net>=0A>>
>=A0 =A0 =A0 =
=A0 > >>=A0 >>=A0 >>=A0 > Cc:
"users(a)ovirt.org" =0A>> >=A0 =A0 =A0 =A0 > > =
<users(a)ovirt.org>=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
>>=A0 > Sent: Thursda=
y, October 24, 2013 11:47 PM=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
>>=A0 > Su=
bject: Re: [Users] How to pxeboot ovrit=0A>> >=A0 =A0 =A0 =A0 node =0A>>
>=
=A0 =A0 =A0 =A0 > > into memory =0A>> >=A0 =A0 =A0 =A0 > >>=A0
>>=A0 > auto=
matically?=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >>=A0 >
=0A>> >=A0 =A0 =A0 =
=A0 > >>=A0 >>=A0 >>=A0 > Am Donnerstag, den 24.10.2013, 16:26
-0700=0A>> >=
=A0 =A0 =A0 =A0 schrieb =0A>> >=A0 =A0 =A0 =A0 > > David Li:=0A>>
>=A0 =A0 =
=A0 =A0 > >>=A0 >>=A0 >>=A0 >>=A0 Hi,=0A>> >=A0 =A0
=A0 =A0 > >>=A0 >>=A0 >=
=A0 >> =0A>> >=A0 =A0 =A0 =A0 > >>=A0
>>=A0 >>=A0 >>=A0 I was following th=
e instructions at
=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >
http://www.ovirt.o=
rg/Node_PXE. My goal =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
>>=A0 > is to use=
pxeboot (iPXE) to boot the node=0A>> >=A0 =A0 =A0 =A0 entirely =0A>>
>=A0 =
=A0 =A0 =A0 > > into RAM =0A>> >=A0 =A0 =A0 =A0 > >>=A0 > with
=0A>> >=A0 =
=A0 =A0 =A0 > >>=A0 >>=A0 > rootfs. What I =0A>> >=A0 =A0 =A0
=A0 > >>=A0 >=
=A0 >>=A0 > got now is an installation screen
which=0A>> >=A0 =A0 =A0 =A0 =
requires a =0A>> >=A0 =A0 =A0 =A0
> > local =0A>> >=A0 =A0 =A0 =A0 > >>=A0 =
storage. My =0A>> >=A0 =A0 =A0 =A0 > >>=A0
>>=A0 > system has =0A>> >=A0 =
=A0 =A0 =A0 > >>=A0
>>=A0 >>=A0 > no disk and this doesn't quite work for m=
e. =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >>=A0 >>
=0A>> >=A0 =A0 =A0 =A0 > >=
=A0 >>=A0 >>=A0 >>=A0 What's are the kernel
parameters I need =0A>> >=A0 =
=A0 =A0 =A0 > > to use to =0A>>
>=A0 =A0 =A0 =A0 > >>=A0 > boot the =0A>> >=
=A0 =A0 =A0 =A0 > >>=A0 >>=A0 > node into =0A>> >=A0 =A0 =A0
=A0 > >>=A0 >>=
=A0 >>=A0 > RAM automatically?=A0 I am OK as the first step=0A>> >=A0
=A0 =
=A0 =A0 with =0A>> >=A0 =A0 =A0 =A0 > > a =0A>> >=A0 =A0 =A0 =A0
> >>=A0 > =
stateless node. =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >>=A0
> =0A>> >=A0 =A0=
=A0 =A0 > >>=A0 >>=A0 >>=A0 > Hey David,=0A>> >=A0 =A0
=A0 =A0 > >>=A0 >>=
=A0 >>=A0 > =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0
>>=A0 > the stateless mode=
is currently not=0A>> >=A0 =A0 =A0 =A0 completely =0A>> >=A0 =A0 =A0
=A0 >=
working with =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >
oVirt=0A>> >=A0 =A0 =A0 =
=A0 > >>=A0 >>=A0 >>=A0 >
Engine. That means a Node needs to be=0A>> >=A0 =
=A0 =A0 =A0 approved =0A>> >=A0 =A0 =A0 =A0 > > each time it =0A>>
>=A0 =A0=
=A0 =A0 > >>=A0 > boots into=0A>> >=A0 =A0 =A0 =A0 > >>=A0
>>=A0 >>=A0 > t=
he stateless mode.=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >>=A0
> The stateles=
s mode can be entered by=0A>> >=A0 =A0 =A0 =A0 appending =0A>> >=A0 =A0
=A0=
=A0 > > stateless to =0A>> >=A0 =A0 =A0 =A0 > >>=A0 > the
=0A>> >=A0 =A0 =
=A0 =A0 > >>=A0 >>=A0 > default=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 >>=A0 >=
kernel arguments.=0A>> >=A0 =A0 =A0 =A0 > >>=A0 >>=A0 >>=A0
> =0A>> >=A0 =
=A0 =A0 =A0 > >>=A0 >>=A0 >>=A0 > Greetings=0A>> >=A0 =A0
=A0 =A0 > >>=A0 >=
=A0 >>=A0 > fabian=0A>> >=A0 =A0 =A0 =A0 >
>>=A0 >>=A0 >>=A0 > =0A>> >=A0 =
=A0 =A0 =A0 >
>>=A0 >>=A0 > =0A>> >=A0 =A0 =A0 =A0 > >>=A0 >
=0A>> >=A0 =A0=
=A0 =A0 > > =0A>> >=A0 =A0 =A0 =A0 =0A>> >=A0 =A0 =A0 =A0
=0A>> >=A0 =A0 =
=A0 =A0 =0A>> >=A0 =A0 =A0 =A0 =0A>> =0A>>
=0A>=0A>=0A>=0A>
--1013620071-1922147181-1386897821=:40672
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"color:#000; background-color:#fff;
font-family:ti=
mes new roman, new york, times, serif;font-size:12pt"><div>Hi
Fabian,</div>=
<div><br></div><div style=3D"color: rgb(0, 0, 0); font-size:
16px; font-fam=
ily: 'times new roman', 'new york', times, serif; background-color:
transpa=
rent; font-style: normal;"><br></div><div style=3D"color:
rgb(0, 0, 0); fon=
t-size: 16px; font-family: 'times new roman', 'new york', times, serif;
bac=
kground-color: transparent; font-style: normal;">I have now a setup like th=
is:</div><div style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family:
'=
times new roman', 'new york', times, serif; background-color: transparent; =
font-style: normal;"><br></div><div style=3D"color: rgb(0, 0,
0); font-size=
: 16px; font-family: 'times new roman', 'new york', times, serif;
backgroun=
d-color: transparent; font-style: normal;"><br></div><div
style=3D"color: r=
gb(0, 0, 0); font-size: 16px; font-family: 'times new roman', 'new york',
t=
imes,
serif; background-color: transparent; font-style: normal;"> +-------=
----+
=
+--------------------+</div><div=
style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: 'times new rom=
an', 'new york', times, serif; background-color: transparent; font-style: n=
ormal;"> | ovirt-shell | ---- network ---------|
&=
nbsp; stateless node |</div><div style=3D"color: rgb(0,
0, 0);=
font-size: 16px; font-family: 'times new roman', 'new york', times,
serif;=
background-color: transparent; font-style: normal;">+------------+ =
 =
;
+-------------------+</div><div style=
=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: 'times new roman',
'=
new york', times, serif; background-color: transparent; font-style:
normal;"><br></div><div style=3D"color: rgb(0, 0, 0);
font-size: 16px; fon=
t-family: 'times new roman', 'new york', times, serif; background-color:
tr=
ansparent; font-style: normal;">A few more questions:</div><div
style=3D"co=
lor: rgb(0, 0, 0); font-size: 16px; font-family: 'times new roman', 'new yo=
rk', times, serif; background-color: transparent; font-style:
normal;"><br>=
</div><div style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family:
'tim=
es new roman', 'new york', times, serif; background-color: transparent; fon=
t-style: normal;">1. Where is the source to build this image? <span
st=
yle=3D"font-size: 12pt;">ovirt-node-iso-3.0.3-1.1.vdsm.fc19.iso. Is it the =
same as </span><span style=3D"background-color: rgb(136, 136, 136);
co=
lor: rgb(238, 238, 238); font-family: Monaco, Menlo, Consolas, 'Courier New=
', monospace; font-size: 13px; line-height: 20px; white-space: pre-wrap;">h=
ttp://gerrit.ovirt.org/p/ovirt-node.git?</span></div><div&...
style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: 'times new rom=
an', 'new york', times, serif; background-color: transparent; font-style: n=
ormal;">2. I am a little confused by the kernel parameter rhevm_admin_passw=
ord and management_server. Are they used by ovirt-shell to connect to the o=
virt-node? For example in ovirt-shell, should I use "connect --=
url http://<ovirt-node-ip-addr>:8080/api --user "user@domain"
--passw=
ord "rhevm_admin_password"? Also in this command line, what's
"user@d=
omain" and where do I specify "user" and
"domain"?</div><div style=3D"color=
: rgb(0, 0, 0); font-size: 16px; font-family: 'times new roman', 'new
york'=
, times, serif; background-color: transparent; font-style:
normal;"><br></d=
iv><div style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: 'times
=
new roman', 'new york', times, serif; background-color: transparent; font-s=
tyle: normal;"><br></div><div style=3D"color: rgb(0, 0, 0);
font-size: 16px=
;
font-family: 'times new roman', 'new york', times, serif;
background-color=
: transparent; font-style: normal;">Thanks.</div><div
style=3D"color: rgb(0=
, 0, 0); font-size: 16px; font-family: 'times new roman', 'new york',
times=
, serif; background-color: transparent; font-style:
normal;"><br></div><div=
style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: 'times new rom=
an', 'new york', times, serif; background-color: transparent; font-style: n=
ormal;"><blockquote style=3D"border-left: 2px solid rgb(16, 16, 255);
margi=
n-left: 5px; margin-top: 5px; padding-left: 5px;"> <div
style=3D"font-fami=
ly: 'times new roman', 'new york', times, serif; font-size:
12pt;"> <div st=
yle=3D"font-family: 'times new roman', 'new york', times, serif;
font-size:=
12pt;"> <div dir=3D"ltr"> <hr size=3D"1">
<font size=3D"2" face=3D"Arial"=
<b><span
style=3D"font-weight:bold;">From:</span></b> Fabian Deutsch
<=
fabiand(a)redhat.com&gt;<br> <b><span
style=3D"font-weight: bold;">To:</span>=
</b> David Li
&lt;david_li(a)sbcglobal.net&gt; <br><b><span
style=3D"font-weight: bold;">C=
c:</span></b> "users(a)ovirt.org" &lt;users(a)ovirt.org&gt;
<br> <b><span style=
=3D"font-weight: bold;">Sent:</span></b> Thursday, December 12,
2013 7:40 A=
M<br> <b><span style=3D"font-weight:
bold;">Subject:</span></b> Re: [Users]=
How to pxeboot ovrit node into memory automatically?<br> </font> </div>
<d=
iv class=3D"y_msg_container"><br>=0AAm Mittwoch, den 11.12.2013, 17:32
-080=
0 schrieb David Li:<br>> Hi Fabian,<br>> <br>> I
booted the new no=
de stateless. But how can connect to it from ovirt<br>> engine cli? The =
cli asks for three things: URL, user name and<br>> password. I am not su=
re how to put them on the kernel boot option<br>> line.<br>>
<br>>=
David<br>> <br>> <br>> <br><br>Hey
David,<br><br>please take a lo=
ok here to find the correct cmdline:<br><a
href=3D"https://access.redhat.co=
m/site/documentation/en-US/Red_Hat_Enterprise_Virtualization/3.0/html/Hyper=
visor_Deployment_Guide/sect-Deployment_Guide-Installing_Red_Hat_Enterprise_=
Virtualization_Hypervisors-RHEV_Hypervisor_Kernel_Parameters_and_Automated_=
Installation.html"
target=3D"_blank">https://access.redhat.com/site/documentati...
at_Enterprise_Virtualization/3.0/html/Hypervisor_Deployment_Guide/sect-Depl=
oyment_Guide-Installing_Red_Hat_Enterprise_Virtualization_Hypervisors-RHEV_=
Hypervisor_Kernel_Parameters_and_Automated_Installation.html</a><br><br>-
f=
abian<br><br>> <br>>
________________________________________________=
______________________<br>> From: Fabian Deutsch <<a
ymailto=3D"mailt=
o:fabiand@redhat.com"
href=3D"mailto:fabiand@redhat.com">fabiand@redhat.com=
</a>>; <br>> To: David Li <<a
ymailto=3D"mailto:david_li@sbcglobal=
.net"
href=3D"mailto:david_li@sbcglobal.net">david_li@sbcglobal.net</a>>=
; <br>> Cc: <a ymailto=3D"mailto:users@ovirt.org"
href=3D"mailto:users@o=
virt.org">users(a)ovirt.org</a> <<a
ymailto=3D"mailto:users@ovirt.org" hre=
f=3D"mailto:users@ovirt.org">users@ovirt.org</a>>;
<br>> Subject: Re:=
[Users] How to pxeboot ovrit node into memory<br>> automatically?
<br>&=
gt; Sent:
Wed, Dec 11, 2013 8:00:40 AM <br>> <br>> <br>> Am
Dienstag, den 1=
0.12.2013, 16:00 -0800 schrieb David Li:<br>> > Hi
Fabian,<br>> &g=
t; <br>> > <br>> > Does the stateless ovirt node
have the VDSM =
built-in? <br>> <br>> Hey David,<br>>
<br>> stateless is a feat=
ure or a special mode of oVirt Node which is also<br>> available on the =
"oVirt Node for oVirt Engine" image [1].<br>> But please note that
you w=
ill have to approve the Node in Engine after<br>> each reboot if you use=
the stateless feature. This bug [2] might also<br>> tackle the problem =
of a stateless Node.<br>> <br>> - fabian<br>>
<br>> --<br>> =
[1]<br>>
http://resources.ovirt.org/releases/3.3/iso/ovirt-node-iso-3.0.=
3-1.1.vdsm.fc19.iso<br>> [2] <a
href=3D"https://bugzilla.redhat.com/show=
_bug.cgi?id=3D875088"
target=3D"_blank">https://bugzilla.redhat.com/show_bu=
g.cgi?id=3D875088</a><br>> <br>> >
<br>> > David<br>> >=
;
<br>> > <br>>
><br>> ___________=
___________________________________________________<br>> >
&nbs=
p; From: Fabian Deutsch <<a
ymailto=3D"mailto:fabiand@redh=
at.com"
href=3D"mailto:fabiand@redhat.com">fabiand@redhat.com</a>><br>&g=
t; > To: David Li <<a
ymailto=3D"mailto:da=
vid_li(a)sbcglobal.net"
href=3D"mailto:david_li@sbcglobal.net">david_li@sbcgl=
obal.net</a>> <br>> >
Cc: "<a ymailto=
=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ovirt.org">users@ovirt.org=
</a>" <<a ymailto=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ovirt.=
org">users(a)ovirt.org</a>&gt; <br>> >
Sent:=
Thursday, December 5, 2013 11:47 PM<br>> >
 =
; Subject: Re: [Users] How to pxeboot ovrit node into memory<br>>
>&n=
bsp; automatically?<br>> >
&=
nbsp;
<br>> > <br>>
> =
Am Donnerstag, den 05.12.2013, 16:30 -0800 schrieb David
Li:<br>>=
; > > Hi
Fabian,<br>> > =
> <br>> >
> I think t=
he bad route is a link local route 169.254.0.0/16.<br>> >
 =
; I am not quite sure if it's a real bug but in my case I hav=
e<br>> > to remove this
route.<br>> >=
; > Also I am using ramdisk based node
withou=
t a local disk.<br>> Can<br>> >
anythin=
g be persisted? <br>> >
<br>> > =
; Hey David,<br>> >
<=
br>> > when you refer to
stateless mode, t=
hen no, nothing can be<br>> >
persisted.<br>> >
Regarding the bug - Ple=
ase provide the whole cmdline you are<br>> >
&nbs=
p; using to<br>> > boot the
node, to give =
me a chance to reproduce it.<br>> >
<br>&g=
t; > - fabian<br>>
>  =
; <br>> >
> David<br>> >&n=
bsp; > <br>> >
>=
; <br>> > >
<br>> > =
> ----- Original Message -----<br>>
> &=
nbsp; > > From: Fabian Deutsch <<a
ymailto=3D"mailto:fabian=
d(a)redhat.com"
href=3D"mailto:fabiand@redhat.com">fabiand@redhat.com</a>>=
<br>> > > >
To: David Li <<a ymai=
lto=3D"mailto:david_li@sbcglobal.net"
href=3D"mailto:david_li@sbcglobal.net">david_li@sbcglobal.net</a>><br>&=
gt; > > > Cc: "<a
ymailto=3D"mailto:use=
rs(a)ovirt.org"
href=3D"mailto:users@ovirt.org">users@ovirt.org</a>" <<a
y=
mailto=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ovirt.org">users@ovi=
rt.org</a>><br>> >
> > Sent: Wedn=
esday, December 4, 2013 11:17 AM<br>> >
&g=
t; > Subject: Re: [Users] How to pxeboot ovrit node into<br>>
memory<=
br>> >
automatically?<br>> > &=
nbsp; > > <br>> >
>=
> Am Montag, den 02.12.2013, 13:53 -0800 schrieb David Li:<br>>
>=
> >> Hi
Fabian,<br>> >&nbs=
p; > >> <br>>
> &nb=
sp; > >> Everytime the ovirt node boots up, it adds a
route<br>> entry<br>> >
that I have to=
<br>> > > >
manually remove. Otherw=
ise it messed up my routing. <br>> >
> =
>> How do I modify the boot scripts to
automatically<br>> re=
move<br>> >
it?<br>> > =
> > <br>> >
> > =
Hey David,<br>> > >
> <br>> >&=
nbsp; > > could you file a bug for that
route pr=
oblem?<br>> > >
> <br>> > =
; > > You can try the following
workaround:<br>&=
gt; > > >
<br>> > &n=
bsp; > > # Create /etc/rc.d/rc.local with the commands to
run<=
br>> > > > $ vi
/etc/rc.d/rc.local<br>> >
> > $ chm=
od a+x /etc/rc.d/rc.local<br>> >
> >=
$ persist /etc/rc.d/rc.local<br>> >
> =
> <br>> > >
> /etc/rc.d/rc.local =
should then be run on every boot.<br>> >
&=
gt; > <br>> >
> > - fabian<br>>=
; > > > <br>>
> &nbs=
p; > >> ----- Original Message
-----<br>> >&nbs=
p; > >> > From:
Fabian Deutsch <<=
a ymailto=3D"mailto:fabiand@redhat.com"
href=3D"mailto:fabiand@redhat.com">=
fabiand(a)redhat.com</a>&gt;<br>&gt; >
> >=
;> > To: David Li <<a
ymailto=3D"mailto:david_li@sbcglobal.n=
et"
href=3D"mailto:david_li@sbcglobal.net">david_li@sbcglobal.net</a>><br>&=
gt; > >
>> > Cc: "<a ymailt=
o=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ovirt.org">users@ovirt.or=
g</a>" <<a ymailto=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ovirt=
.org">users(a)ovirt.org</a>&gt;<br>&gt; >
> =
>> > Sent: Monday, October 28, 2013 7:45
AM<br>> >&nbs=
p; > >> > Subject:
Re: [Users] How t=
o pxeboot ovrit node into<br>> >
memory <b=
r>> > > >
automatically?<br>> >=
; > >> >
<br>> > &=
nbsp; > >> > Am Montag, den
28.10.2013, 07:=
42 -0700 schrieb David<br>> >
Li:<br>> =
> > >>
>> <br>>
> > >>
>> Hi Fabi=
an,<br>> > >
>> >> <b=
r>> > >
>> >> Y=
es rootpwd worked too! Thanks.<br>> >
>=
>> >> <br>> >
> >=
> >> Two new problems:<br>>
>  =
; > >> >> <br>>
> &nb=
sp; > >> >> But I found there is no
networking f=
or the<br>> stateless<br>> >
node.<br>&=
gt; > >
>> >> What=
kernel boot options are used to either use<br>> DHCP<br>>
> =
or <br>> >
> >=
statically <br>> >
>
>> > configure the IP address for an interface on
the<br>&g=
t; node?<br>> > >
>> >&g=
t; <br>> > >
>> >>&nb=
sp; I also need to have the sshd enabled. Is there a<br>> >
&nb=
sp; kernel option <br>> >
&g=
t; > for that?<br>> >
> >>&nbs=
p; > <br>> >
> >> > H=
ey David,<br>> > >
>> > =
<br>> > >
>> > here you =
can find all the supported boot params in<br>> >
=
ovirt node:<br>> >
> >>&nb=
sp; > <br>> >
> ><br>> ><br=
> <a
href=3D"http://gerrit.ovirt.org/gitweb?p=3Dovirt-node.git;a=3Dblob;f...
ipts/ovirt-init-functions.sh.in;h=3Dc4280caefb89c77afc1e8bec8c925aa7f303973=
3;hb=3DHEAD#l214"
target=3D"_blank">http://gerrit.ovirt.org/gitweb?p=3Dovir=
t-node.git;a=3Dblob;f=3Dscripts/ovirt-init-functions.sh.in;h=3Dc4280caefb89=
c77afc1e8bec8c925aa7f3039733;hb=3DHEAD#l214</a><br>> >
&=
nbsp; > >> > <br>>
> &nb=
sp; > >> > Greetings<br>>
> &nb=
sp; > >> > fabian<br>>
> =
> >> > <br>> >
> >=
;> >> David<br>> >
&g=
t; >> >> <br>> >
> &g=
t;> >> <br>> >
> >>=
; >> <br>> >
> >>&nbs=
p; >>
----- Original Message -----<br>> >
> =
>> >> > From: Fabian Deutsch
<<a ymailto=3D"m=
ailto:fabiand@redhat.com"
href=3D"mailto:fabiand@redhat.com">fabiand@redhat=
.com</a>><br>> >
> >> &g=
t;> > To: David Li <<a
ymailto=3D"mailto:david_li@sbcglobal.=
net"
href=3D"mailto:david_li@sbcglobal.net">david_li@sbcglobal.net</a>><=
br>> > >
>> >> =
> Cc: "<a ymailto=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ovirt.=
org">users(a)ovirt.org</a>" <<a
ymailto=3D"mailto:users@ovirt.org" href=3D=
"mailto:users@ovirt.org">users@ovirt.org</a>><br>>
> =
> >> >>
> Sent: Friday, October=
25, 2013 9:10 AM<br>> >
> >>&nbs=
p; >> > Subject: Re: [Users] How to pxeboot ovrit
node<br>&g=
t;
> into memory <br>>
> &nb=
sp; > >> >
automatically?<br>> >  =
; > >> >>
> <br>> > =
> >>
>> > Am Freitag, d=
en 25.10.2013, 08:57 -0700 schrieb<br>> >
=
David Li:<br>> > >
>> >&=
gt; >> Hi Fabian,<br>> >
=
> >> >> >>
<br>> > &nb=
sp; > >> >>
>> That kernel op=
tion worked for me! The node is<br>> >
&nbs=
p; booted <br>> > >
> up in RAM. <br=
> > >
>> > Thanks!<br>&=
gt; >
> >>
>> >> <br>> >
> >=
> >> >> My next question
is:<br>> >&=
nbsp; > >>
>> >> How =
do I specify the root login and passwd as<br>> >
=
boot <br>> >
> > parameters? =
<br>> > >
>> >> =
> <br>> > >
>> >>=
> Hey David.<br>> >
> >>=
; >> > <br>> >
> &=
gt;> >> > Nice that it worked! Were you
able to reg=
ister to<br>> > the
<br>> > &n=
bsp; > > Engine?<br>> >
 =
; > >> >> >
<br>> >
> >> >>
> You can use the admi=
npw=3D and rootpw=3D kernel<br>> >
argumen=
ts to set <br>> > >
> <br>> >&=
nbsp; > >> >
passwords.<br>> >=
> >>
>> > use<br>=
> > >
>> >> >=
; $ openssl passwd -salt 42<br>> >
> &g=
t;> >> > to create one or two
passwords<br>> >=
; > >>
>> > <br>&g=
t; > > >>
>> > =
Greetings<br>> > >
>> >&=
gt; > fabian<br>> >
> >>=
>> > <br>> >
>
>> >> >>
David<br>> > &nbs=
p; > >> >>
>> <br>> >&=
nbsp; > >>
>> >> <br>=
> > >
>> >> >=
;> <br>> > >
>> >>=
>> <br>> >
> >> =
; >> >> ----- Original Message
-----<br>> >&n=
bsp; > >>
>> >> =
> From: Fabian Deutsch <<a
ymailto=3D"mailto:fabiand@redhat.com" hre=
f=3D"mailto:fabiand@redhat.com">fabiand@redhat.com</a>><br>>
>&nbs=
p; > >>
>> >> &=
gt; To: David Li <<a ymailto=3D"mailto:david_li@sbcglobal.net"
href=3D"m=
ailto:david_li@sbcglobal.net">david_li@sbcglobal.net</a>><br>>
> > >>
>> >>=
; > Cc: "<a ymailto=3D"mailto:users@ovirt.org"
href=3D"mailto:user=
s@ovirt.org">users(a)ovirt.org</a>" <br>> >
=
> > <<a ymailto=3D"mailto:users@ovirt.org"
href=3D"mailto:users@ov=
irt.org">users(a)ovirt.org</a>&gt;<br>&gt; >
&g=
t; >> >> >>
> Sent: Thursday, Octobe=
r 24, 2013 11:47 PM<br>> >
> >>&n=
bsp; >> >> > Subject: Re: [Users]
How to pxeboot=
ovrit<br>> > node
<br>> > &nb=
sp; > > into memory <br>>
> &=
nbsp; > >> >> >
automatically?<br>> >&n=
bsp; > >>
>> >> =
> <br>> > >
>>
>> >> > Am Donnerstag, den
24.10.2013, 16:26 -0=
700<br>> > schrieb
<br>> > &nb=
sp; > > David Li:<br>> >
&nbs=
p; > >> >>
>> >> Hi,<br>=
> > >
>> >> >=
;> >> <br>> >
> >>=
>> >>
>> I was following the ins=
tructions at <br>> >
> >> &=
gt;> > <a
href=3D"http://www.ovirt.org/Node_PXE"
target=3D"_bla=
nk">http://www.ovirt.org/Node_PXE</a>. My goal <br>>
> &=
nbsp; > >> >>
>> > is to u=
se pxeboot (iPXE) to boot the node<br>> >
=
entirely <br>> > >
> into RAM
<br>> > >
>> > with <br=
> > >
>> >> &g=
t; rootfs. What I
<br>> > >
>>&nb=
sp; >> >> > got now is an
installation screen wh=
ich<br>> > requires a
<br>> > =
> > local <br>>
> &nbs=
p; > >> > storage. My <br>>
> &=
nbsp; > >> >> > system has
<br>> > =
; > >>
>> >> &g=
t; no disk and this doesn't quite work for me. <br>> >
&=
nbsp; > >> >>
>> >> <br=
> > >
>> >> &g=
t;>
>> What's are the kernel parameters I need
<br>> > > >
to use to <br>> >=
> >> >
boot the <br>> >=
> >>
>> > node in=
to <br>> > >
>> >>&nb=
sp; >> > RAM automatically? I am OK as the first
step<=
br>> > with <br>>
> &nb=
sp; > > a <br>> >
> >&g=
t; > stateless node. <br>> >
>=
>> >> >> >
<br>> > &nbs=
p; > >> >>
>> > Hey=
David,<br>> > >
>> >>=
; >> > <br>> >
> &=
gt;> >> >> > the
stateless mode
is currently not<br>> >
completely <br>&g=
t; > > > working with
<br>> >&nbs=
p; > >> >
oVirt<br>> > &=
nbsp; > >> >>
>> > =
Engine. That means a Node needs to be<br>> >
&nbs=
p; approved <br>> >
> > each time it=
<br>> > >
>> > boots in=
to<br>> > >
>> >>&nbs=
p; >> > the stateless mode.<br>>
> =
> >> >>
>> > The stateles=
s mode can be entered by<br>> >
appending =
<br>> > > >
stateless to <br>> &g=
t; > >> >
the <br>>
> > >>
>> > de=
fault<br>> > >
>> >>&=
nbsp; >> > kernel arguments.<br>>
>  =
; > >> >>
>> > <br>> &g=
t; > >>
>> >>&n=
bsp; > Greetings<br>> >
> >>&n=
bsp; >> >> >
fabian<br>> > &n=
bsp; > >> >>
>> > <br>>=
> > >>
>> > <b=
r>> > >
>> > <br>> &g=
t; > > <br>>
> &=
nbsp; <br>> >
<br>> > &=
nbsp; <br>> >
<br>>
<br>> <br><br><br><br></div> </div>
</div> </blockquote></div> </div>=
</body></html>
--1013620071-1922147181-1386897821=:40672--