live migration between datacenters with shared storage
by Charles Kozler
I couldnt find a definitive on this so I would like to inquire here
I have gluster on my storage backend exporting the volume from a single
node via NFS
I have a DC of 4.0 and I would like to upgrade to 4.1. I would ideally like
to take one node out of the cluster and build a 4.1 datacenter. Then live
migrate VMs from the 4.0 DC over to the 4.1 DC with zero downtime to the VMs
Is this possible? Or would I be safer to export/import VMs?
Thanks!
7 years, 6 months
PXE boot of oVirt Node 4.1
by Latchezar Filtchev
--_000_E1DA3226A946BC428B66CE34DAF3307FB198E62E4Ebl8esrv5aubgi_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hello oVirt-ers,
Did someone was able to install oVirt node 4.1 - ovirt-node-ng-installer-ov=
irt-4.1-2017051704.iso via pxe/tftp boot?
This works http://www.ovirt.org/develop/projects/node/pxe/ for oVirt 3.4
When using the same approach for oVirt 4.0 and oVirt 4.1 the computer hangs=
.
Any help will be appreciated.
Thank you!
Best,
Latcho
--_000_E1DA3226A946BC428B66CE34DAF3307FB198E62E4Ebl8esrv5aubgi_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40"><head><meta http-equiv=3DContent-Type content=
=3D"text/html; charset=3Dus-ascii"><meta name=3DGenerator content=3D"Micros=
oft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1740059739;
mso-list-type:hybrid;
mso-list-template-ids:1560210040 67698703 67698713 67698715 67698703 67698=
713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue vli=
nk=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal>Hello oVirt-ers,=
<o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNorm=
al>Did someone was able to install oVirt node 4.1 - ovirt-node-ng-installer=
-ovirt-4.1-2017051704.iso via pxe/tftp boot?<o:p></o:p></p><p class=3DMsoNo=
rmal><o:p> </o:p></p><p class=3DMsoNormal>This works http://www.ovirt.=
org/develop/projects/node/pxe/ for oVirt 3.4<o:p></o:p></p><p class=3DMsoNo=
rmal>When using the same approach for oVirt 4.0 and oVirt 4.1 the computer =
hangs.<o:p></o:p></p><p class=3DMsoNormal>Any help will be appreciated.<o:p=
></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal><=
o:p> </o:p></p><p class=3DMsoNormal>Thank you!<o:p></o:p></p><p class=
=3DMsoNormal>Best,<o:p></o:p></p><p class=3DMsoNormal>Latcho<o:p></o:p></p>=
<p class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal><o:p> <=
/o:p></p></div></body></html>=
--_000_E1DA3226A946BC428B66CE34DAF3307FB198E62E4Ebl8esrv5aubgi_--
7 years, 6 months
[ANN] oVirt 4.1.3 Second Test Compose is now available
by Sandro Bonazzola
The oVirt Project is pleased to announce the availability of the Second
Test Compose of oVirt 4.1.3 for testing, as of June 1st, 2017
This is pre-release software. Please take a look at our community page[1]
to know how to ask questions and interact with developers and users.
All issues or bugs should be reported via oVirt Bugzilla[2].
This pre-release should not to be used in production.
This update is the second test compose of the third in a series of
stabilization updates to the 4.1 series.
4.1.3 brings more than 25 enhancements and more than 140 bugfixes,
including more than 70 high or urgent
severity fixes, on top of oVirt 4.1 series
This release is available now for:
* Fedora 24 (tech preview)
* Red Hat Enterprise Linux 7.3 or later
* CentOS Linux (or similar) 7.3 or later
This release supports Hypervisor Hosts running:
* Red Hat Enterprise Linux 7.3 or later
* CentOS Linux (or similar) 7.3 or later
* oVirt Node 4.1
* Fedora 24 (tech preview)
See the release notes draft [3] for installation / upgrade instructions and
a list of new features and bugs fixed.
Notes:
- oVirt Appliance has not been composed
- oVirt Live has not been composed
- oVirt Node will be available soon
We are addressing compose issues for above components which are missing
ansible 2.3 and latest fluentd builds from CentOS SIGs.
Additional Resources:
* Read more about the oVirt 4.1.3 release highlights:
http://www.ovirt.org/release/4.1.3/
* Get more oVirt Project updates on Twitter: https://twitter.com/ovirt
* Check out the latest project news on the oVirt blog:
http://www.ovirt.org/blog/
[1] https://www.ovirt.org/community/
[2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt
[3] http://www.ovirt.org/release/4.1.3/
--
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA <https://www.redhat.com/>
<https://red.ht/sig>
TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
7 years, 6 months
Cannot connect to gluster storage after HE installation
by NUNIN Roberto
--_000_8f816fadf2fc4c9983513c35a140da6bDENU01MS0077phoenixloc_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi
Ovirt-node-ng installation using iso image 20170526.
I've made five attempts, each one ended with different fail, still loking a=
t : http://www.ovirt.org/blog/2017/04/up-and-running-with-ovirt-4-1-and-glu=
ster-storage/
The last one was done, successfully (I hope) taking care of :
1) Configure networking before to set date & time, to have chronyd up & =
running
2) Modifying gdeploy generated script, still looking at ntpd instead of =
chronyd
3) Being a gluster based cluster, configured partition on each data disk=
(sdb > sdb1 type 8e + partprobe)
4) Blacklisted all nodes on multipath.conf
5) Double check if refuses from previous attempts was already visible (f=
or example gluster volume group > vgremove -f -y <vg_name>).
After HE installation and restart, no advisory about additional servers to =
add to the cluster, so manually added as new servers. Successfully.
Now I must add storage, but unfortunately, nothing is shown in the Gluster =
drop-down list, even if I change the host.
I've chosen "Use managed gluster".
AT a first look, glusterd is up & running (but disabled at system startup !=
) :
aps-te65-mng.mydomain.it: Loaded: loaded (/usr/lib/systemd/system/gluste=
rd.service; disabled; vendor preset: disabled)
aps-te65-mng.mydomain.it: Active: active (running) since Tue 2017-05-30 =
09:54:23 CEST; 4h 40min ago
aps-te66-mng.mydomain.it: Loaded: loaded (/usr/lib/systemd/system/gluste=
rd.service; disabled; vendor preset: disabled)
aps-te66-mng.mydomain.it: Active: active (running) since Tue 2017-05-30 =
09:54:24 CEST; 4h 40min ago
aps-te67-mng.mydomain.it: Loaded: loaded (/usr/lib/systemd/system/gluste=
rd.service; disabled; vendor preset: disabled)
aps-te67-mng.mydomain.it: Active: active (running) since Tue 2017-05-30 =
09:54:24 CEST; 4h 40min ago
data gluster volume is ok :
[root@aps-te65-mng ~]# gluster volume info data
Volume Name: data
Type: Replicate
Volume ID: ea6a2c9f-b042-42b4-9c0e-1f776e50b828
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x (2 + 1) =3D 3
Transport-type: tcp
Bricks:
Brick1: aps-te65-mng.mydomain.it:/gluster_bricks/data/data
Brick2: aps-te66-mng.mydomain.it:/gluster_bricks/data/data
Brick3: aps-te67-mng.mydomain.it:/gluster_bricks/data/data (arbiter)
Options Reconfigured:
cluster.granular-entry-heal: enable
performance.strict-o-direct: on
network.ping-timeout: 30
storage.owner-gid: 36
storage.owner-uid: 36
user.cifs: off
features.shard: on
cluster.shd-wait-qlength: 10000
cluster.shd-max-threads: 8
cluster.locking-scheme: granular
cluster.data-self-heal-algorithm: full
cluster.server-quorum-type: server
cluster.quorum-type: auto
cluster.eager-lock: enable
network.remote-dio: off
performance.low-prio-threads: 32
performance.stat-prefetch: off
performance.io-cache: off
performance.read-ahead: off
performance.quick-read: off
transport.address-family: inet
performance.readdir-ahead: on
nfs.disable: on
[root@aps-te65-mng ~]#
[root@aps-te65-mng ~]# gluster volume status data
Status of volume: data
Gluster process TCP Port RDMA Port Online Pi=
d
---------------------------------------------------------------------------=
---
Brick aps-te65-mng.mydomain.it:/gluster_bric
ks/data/data 49153 0 Y 52=
710
Brick aps-te66-mng.mydomain.it:/gluster_bric
ks/data/data 49153 0 Y 45=
265
Brick aps-te67-mng.mydomain.it:/gluster_bric
ks/data/data 49153 0 Y 45=
366
Self-heal Daemon on localhost N/A N/A Y 57=
491
Self-heal Daemon on aps-te67-mng.mydomain.it N/A N/A Y 4=
6488
Self-heal Daemon on aps-te66-mng.mydomain.it N/A N/A Y 4=
6384
Task Status of Volume data
---------------------------------------------------------------------------=
---
There are no active volume tasks
[root@aps-te65-mng ~]#
Any hints on this ? May I send logs ?
In hosted-engine log, apart fencing problems with HPE iLO3 agent, I can fin=
d only these errors:
2017-05-30 11:58:56,981+02 ERROR [org.ovirt.engine.core.utils.servlet.Servl=
etUtils] (default task-23) [] Can't read file '/usr/share/ovirt-engine/file=
s/spice/SpiceVersion.txt' for request '/ovirt-engine/services/files/spice/S=
piceVersion.txt', will send a 404 error response.
2017-05-30 13:49:51,033+02 ERROR [org.ovirt.engine.core.utils.servlet.Servl=
etUtils] (default task-64) [] Can't read file '/usr/share/ovirt-engine/file=
s/spice/SpiceVersion.txt' for request '/ovirt-engine/services/files/spice/S=
piceVersion.txt', will send a 404 error response.
2017-05-30 13:58:01,569+02 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker=
.PollVDSCommand] (org.ovirt.thread.pool-6-thread-25) [677ae254] Command 'Po=
llVDSCommand(HostName =3D aps-te66-mng.mydomain.it, VdsIdVDSCommandParamete=
rsBase:{runAsync=3D'true', hostId=3D'3fea5320-33f5-4479-89ce-7d3bc575cd49'}=
)' execution failed: VDSGenericException: VDSNetworkException: Timeout duri=
ng rpc call
2017-05-30 13:58:01,574+02 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker=
.PollVDSCommand] (org.ovirt.thread.pool-6-thread-25) [677ae254] Timeout wai=
ting for VDSM response: Internal timeout occured
2017-05-30 13:58:02,079+02 ERROR [org.ovirt.vdsm.jsonrpc.client.JsonRpcClie=
nt] (ResponseWorker) [] Not able to update response for "2f3f5da7-48ec-43c9=
-a4c7-f935412f70ad"
2017-05-30 13:58:14,371+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditl=
oghandling.AuditLogDirector] (DefaultQuartzScheduler10) [49d9ff38] EVENT_ID=
: VDS_FENCE_STATUS_FAILED(497), Correlation ID: 2f9cdb60, Call Stack: null,=
Custom Event ID: -1, Message: Failed to verify Host aps-te66-mng.mydomain.=
it power management.
2017-05-30 14:02:14,613+02 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker=
.PollVDSCommand] (org.ovirt.thread.pool-6-thread-2) [2334b588] Command 'Pol=
lVDSCommand(HostName =3D aps-te67-mng.mydomain.it, VdsIdVDSCommandParameter=
sBase:{runAsync=3D'true', hostId=3D'd335c802-7e83-492f-855a-bcb31257bad1'})=
' execution failed: VDSGenericException: VDSNetworkException: Timeout durin=
g rpc call
2017-05-30 14:02:19,700+02 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker=
.PollVDSCommand] (org.ovirt.thread.pool-6-thread-2) [2334b588] Timeout wait=
ing for VDSM response: Internal timeout occured
2017-05-30 14:02:19,741+02 ERROR [org.ovirt.vdsm.jsonrpc.client.JsonRpcClie=
nt] (ResponseWorker) [] Not able to update response for "49804adf-283f-4c5c=
-be8c-907100d2ace5"
2017-05-30 15:05:30,066+02 ERROR [org.ovirt.engine.core.utils.servlet.Servl=
etUtils] (default task-61) [] Can't read file '/usr/share/ovirt-engine/file=
s/spice/SpiceVersion_x64.txt' for request '/ovirt-engine/services/files/spi=
ce/SpiceVersion_x64.txt', will send a 404 error response.
Vdsmd service is up & running in all three hosts.
Roberto
________________________________
Questo messaggio e' indirizzato esclusivamente al destinatario indicato e p=
otrebbe contenere informazioni confidenziali, riservate o proprietarie. Qua=
lora la presente venisse ricevuta per errore, si prega di segnalarlo immedi=
atamente al mittente, cancellando l'originale e ogni sua copia e distruggen=
do eventuali copie cartacee. Ogni altro uso e' strettamente proibito e potr=
ebbe essere fonte di violazione di legge.
This message is for the designated recipient only and may contain privilege=
d, proprietary, or otherwise private information. If you have received it i=
n error, please notify the sender immediately, deleting the original and al=
l copies and destroying any hard copies. Any other use is strictly prohibit=
ed and may be unlawful.
--_000_8f816fadf2fc4c9983513c35a140da6bDENU01MS0077phoenixloc_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:x=3D"urn:schemas-microsoft-com:office:excel" xmlns:m=3D"http://schema=
s.microsoft.com/office/2004/12/omml" xmlns=3D"http://www.w3.org/TR/REC-html=
40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
>
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
span.StileMessaggioDiPostaElettronica17
{mso-style-type:personal-compose;
font-family:"Arial",sans-serif;
color:windowtext;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 2.0cm 2.0cm 2.0cm;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:386807542;
mso-list-type:hybrid;
mso-list-template-ids:656424170 68157457 68157465 68157467 68157455 681574=
65 68157467 68157455 68157465 68157467;}
@list l0:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"IT" link=3D"#0563C1" vlink=3D"#954F72">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Ar=
ial",sans-serif">Hi
<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Ar=
ial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">Ovirt-node-ng installation using iso i=
mage 20170526.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">I’ve made five attempts, each on=
e ended with different fail, still loking at : http://www.ovirt.org/blog/20=
17/04/up-and-running-with-ovirt-4-1-and-gluster-storage/<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">The last one was done, successfully (I=
hope) taking care of :<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"text-indent:-18.0pt;mso-list:l0 leve=
l1 lfo1"><![if !supportLists]><span lang=3D"EN-US" style=3D"font-size:10.0p=
t;font-family:"Arial",sans-serif"><span style=3D"mso-list:Ignore"=
>1)<span style=3D"font:7.0pt "Times New Roman"">  =
;
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-size:10.0=
pt;font-family:"Arial",sans-serif">Configure networking before to=
set date & time, to have chronyd up & running<o:p></o:p></span></p=
>
<p class=3D"MsoListParagraph" style=3D"text-indent:-18.0pt;mso-list:l0 leve=
l1 lfo1"><![if !supportLists]><span lang=3D"EN-US" style=3D"font-size:10.0p=
t;font-family:"Arial",sans-serif"><span style=3D"mso-list:Ignore"=
>2)<span style=3D"font:7.0pt "Times New Roman"">  =
;
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-size:10.0=
pt;font-family:"Arial",sans-serif">Modifying gdeploy generated sc=
ript, still looking at ntpd instead of chronyd<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"text-indent:-18.0pt;mso-list:l0 leve=
l1 lfo1"><![if !supportLists]><span lang=3D"EN-US" style=3D"font-size:10.0p=
t;font-family:"Arial",sans-serif"><span style=3D"mso-list:Ignore"=
>3)<span style=3D"font:7.0pt "Times New Roman"">  =
;
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-size:10.0=
pt;font-family:"Arial",sans-serif">Being a gluster based cluster,=
configured partition on each data disk (sdb > sdb1 type 8e + partpr=
obe)<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"text-indent:-18.0pt;mso-list:l0 leve=
l1 lfo1"><![if !supportLists]><span lang=3D"EN-US" style=3D"font-size:10.0p=
t;font-family:"Arial",sans-serif"><span style=3D"mso-list:Ignore"=
>4)<span style=3D"font:7.0pt "Times New Roman"">  =
;
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-size:10.0=
pt;font-family:"Arial",sans-serif">Blacklisted all nodes on multi=
path.conf<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"text-indent:-18.0pt;mso-list:l0 leve=
l1 lfo1"><![if !supportLists]><span lang=3D"EN-US" style=3D"font-size:10.0p=
t;font-family:"Arial",sans-serif"><span style=3D"mso-list:Ignore"=
>5)<span style=3D"font:7.0pt "Times New Roman"">  =
;
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-size:10.0=
pt;font-family:"Arial",sans-serif">Double check if refuses from p=
revious attempts was already visible (for example gluster volume group >=
vgremove –f –y <vg_name>).<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">After HE installation and restart, no =
advisory about additional servers to add to the cluster, so manually added =
as new servers. Successfully.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">Now I must add storage, but unfortunat=
ely, nothing is shown in the Gluster drop-down list, even if I change the h=
ost.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">I’ve chosen “Use managed g=
luster”.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">AT a first look, glusterd is up & =
running (but disabled at system startup !) :<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">aps-te65-mng.mydomain.it: &=
nbsp; Loaded: loaded (/usr/lib/systemd/system/glusterd.service; disabled; v=
endor preset: disabled)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">aps-te65-mng.mydomain.it: &=
nbsp; Active: active (running) since Tue 2017-05-30 09:54:23 CEST; 4h 40min=
ago<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">aps-te66-mng.mydomain.it: &=
nbsp; Loaded: loaded (/usr/lib/systemd/system/glusterd.service; disabled; v=
endor preset: disabled)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">aps-te66-mng.mydomain.it: &=
nbsp; Active: active (running) since Tue 2017-05-30 09:54:24 CEST; 4h 40min=
ago<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">aps-te67-mng.mydomain.it: &=
nbsp; Loaded: loaded (/usr/lib/systemd/system/glusterd.service; disabled; v=
endor preset: disabled)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">aps-te67-mng.mydomain.it: &=
nbsp; Active: active (running) since Tue 2017-05-30 09:54:24 CEST; 4h 40min=
ago<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">data gluster volume is ok :<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co=
urier New"">[root@aps-te65-mng ~]# gluster volume info data<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;font-family:"Co=
urier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Volume Name: data<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Type: Replicate<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Volume ID: ea6a2c9f-b042-42b4-9c0e-1f776e50=
b828<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Status: Started<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Snapshot Count: 0<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Number of Bricks: 1 x (2 + 1) =3D 3<o:p=
></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Transport-type: tcp<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Bricks:<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Brick1: aps-te65-mng.mydomain.it:/gluster_b=
ricks/data/data<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Brick2: aps-te66-mng.mydomain.it:/gluster_b=
ricks/data/data<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Brick3: aps-te67-mng.mydomain.it:/gluster_b=
ricks/data/data (arbiter)<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Options Reconfigured:<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.granular-entry-heal: enable<o:p></o=
:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.strict-o-direct: on<o:p></o:p><=
/span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">network.ping-timeout: 30<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">storage.owner-gid: 36<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">storage.owner-uid: 36<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">user.cifs: off<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">features.shard: on<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.shd-wait-qlength: 10000<o:p></o:p><=
/span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.shd-max-threads: 8<o:p></o:p></span=
></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.locking-scheme: granular<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.data-self-heal-algorithm: full<o:p>=
</o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.server-quorum-type: server<o:p></o:=
p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.quorum-type: auto<o:p></o:p></span>=
</p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">cluster.eager-lock: enable<o:p></o:p></span=
></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">network.remote-dio: off<o:p></o:p></span></=
p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.low-prio-threads: 32<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.stat-prefetch: off<o:p></o:p></=
span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.io-cache: off<o:p></o:p></span>=
</p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.read-ahead: off<o:p></o:p></spa=
n></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.quick-read: off<o:p></o:p></spa=
n></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">transport.address-family: inet<o:p></o:p></=
span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">performance.readdir-ahead: on<o:p></o:p></s=
pan></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">nfs.disable: on<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">[root@aps-te65-mng ~]#<o:p></o:p></span></p=
>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">[root@aps-te65-mng ~]# gluster volume statu=
s data<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Status of volume: data<o:p></o:p></span></p=
>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Gluster process &nbs=
p; &=
nbsp; TCP Port&=
nbsp; RDMA Port Online Pid<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">-------------------------------------------=
-----------------------------------<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Brick aps-te65-mng.mydomain.it:/gluster_bri=
c<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">ks/data/data &=
nbsp; &nbs=
p; &=
nbsp; 49153 0 &n=
bsp; Y 52710<o:p></o:p></sp=
an></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Brick aps-te66-mng.mydomain.it:/gluster_bri=
c<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">ks/data/data &=
nbsp; &nbs=
p; &=
nbsp; 49153 0 &n=
bsp; Y 45265<o:p></o:p></sp=
an></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Brick aps-te67-mng.mydomain.it:/gluster_bri=
c<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">ks/data/data &=
nbsp; &nbs=
p; &=
nbsp; 49153 0 &n=
bsp; Y 45366<o:p></o:p></sp=
an></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Self-heal Daemon on localhost &n=
bsp; N/A&=
nbsp; N/A =
Y 57491<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Self-heal Daemon on aps-te67-mng.mydomain.i=
t N/A N/A =
Y 46488<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Self-heal Daemon on aps-te66-mng.mydomain.i=
t N/A N/A =
Y 46384<o:p></o:p></span><=
/p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">Task Status of Volume data<o:p></o:p></span=
></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">-------------------------------------------=
-----------------------------------<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">There are no active volume tasks<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">[root@aps-te65-mng ~]#<o:p></o:p></span></p=
>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">Any hints on this ? May I send logs ?<=
o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">In hosted-engine log, apart fencing pr=
oblems with HPE iLO3 agent, I can find only these errors:<o:p></o:p></span>=
</p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 11:58:56,981+02 ERROR [org.o=
virt.engine.core.utils.servlet.ServletUtils] (default task-23) [] Can't rea=
d file '/usr/share/ovirt-engine/files/spice/SpiceVersion.txt'
for request '/ovirt-engine/services/files/spice/SpiceVersion.txt', will se=
nd a 404 error response.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 13:49:51,033+02 ERROR [org.o=
virt.engine.core.utils.servlet.ServletUtils] (default task-64) [] Can't rea=
d file '/usr/share/ovirt-engine/files/spice/SpiceVersion.txt'
for request '/ovirt-engine/services/files/spice/SpiceVersion.txt', will se=
nd a 404 error response.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 13:58:01,569+02 ERROR [org.o=
virt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool=
-6-thread-25) [677ae254] Command 'PollVDSCommand(HostName
=3D aps-te66-mng.mydomain.it, VdsIdVDSCommandParametersBase:{runAsync=3D't=
rue', hostId=3D'3fea5320-33f5-4479-89ce-7d3bc575cd49'})' execution failed: =
VDSGenericException: VDSNetworkException: Timeout during rpc call<o:p></o:p=
></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 13:58:01,574+02 ERROR [org.o=
virt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool=
-6-thread-25) [677ae254] Timeout waiting for VDSM response:
Internal timeout occured<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 13:58:02,079+02 ERROR [org.o=
virt.vdsm.jsonrpc.client.JsonRpcClient] (ResponseWorker) [] Not able to upd=
ate response for "2f3f5da7-48ec-43c9-a4c7-f935412f70ad"<o:p></o:p=
></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 13:58:14,371+02 ERROR [org.o=
virt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQu=
artzScheduler10) [49d9ff38] EVENT_ID: VDS_FENCE_STATUS_FAILED(497),
Correlation ID: 2f9cdb60, Call Stack: null, Custom Event ID: -1, Message: =
Failed to verify Host aps-te66-mng.mydomain.it power management.<o:p></o:p>=
</span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 14:02:14,613+02 ERROR [org.o=
virt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool=
-6-thread-2) [2334b588] Command 'PollVDSCommand(HostName
=3D aps-te67-mng.mydomain.it, VdsIdVDSCommandParametersBase:{runAsync=3D't=
rue', hostId=3D'd335c802-7e83-492f-855a-bcb31257bad1'})' execution failed: =
VDSGenericException: VDSNetworkException: Timeout during rpc call<o:p></o:p=
></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 14:02:19,700+02 ERROR [org.o=
virt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool=
-6-thread-2) [2334b588] Timeout waiting for VDSM response:
Internal timeout occured<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 14:02:19,741+02 ERROR [org.o=
virt.vdsm.jsonrpc.client.JsonRpcClient] (ResponseWorker) [] Not able to upd=
ate response for "49804adf-283f-4c5c-be8c-907100d2ace5"<o:p></o:p=
></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New"">2017-05-30 15:05:30,066+02 ERROR [org.o=
virt.engine.core.utils.servlet.ServletUtils] (default task-61) [] Can't rea=
d file '/usr/share/ovirt-engine/files/spice/SpiceVersion_x64.txt'
for request '/ovirt-engine/services/files/spice/SpiceVersion_x64.txt', wil=
l send a 404 error response.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Courier New""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-=
family:"Arial",sans-serif">Vdsmd service is up & running in a=
ll three hosts</span><span lang=3D"EN-US" style=3D"font-size:10.0pt;font-fa=
mily:"Courier New"">.<o:p></o:p></span></p>
<p class=3D"MsoNormal" style=3D"line-height:12.05pt;text-autospace:none"><s=
pan lang=3D"EN-US" style=3D"font-family:"Arial",sans-serif;mso-fa=
reast-language:IT"><o:p> </o:p></span></p>
<p class=3D"MsoNormal" style=3D"line-height:12.05pt;text-autospace:none"><b=
><span style=3D"font-family:"Arial",sans-serif;color:black;mso-fa=
reast-language:IT">Roberto
<br>
<br>
</span></b><span style=3D"font-size:10.0pt;font-family:"Arial",sa=
ns-serif;mso-fareast-language:IT"><o:p></o:p></span></p>
<p class=3D"MsoNormal"><o:p> </o:p></p>
</div>
<br>
<hr>
<font face=3D"Courier New" color=3D"Black" size=3D"2"><br>
Questo messaggio e' indirizzato esclusivamente al destinatario indicato e p=
otrebbe contenere informazioni confidenziali, riservate o proprietarie. Qua=
lora la presente venisse ricevuta per errore, si prega di segnalarlo immedi=
atamente al mittente, cancellando
l'originale e ogni sua copia e distruggendo eventuali copie cartacee. Ogni=
altro uso e' strettamente proibito e potrebbe essere fonte di violazione d=
i legge.<br>
<br>
This message is for the designated recipient only and may contain privilege=
d, proprietary, or otherwise private information. If you have received it i=
n error, please notify the sender immediately, deleting the original and al=
l copies and destroying any hard
copies. Any other use is strictly prohibited and may be unlawful.<br>
</font>
</body>
</html>
--_000_8f816fadf2fc4c9983513c35a140da6bDENU01MS0077phoenixloc_--
7 years, 6 months
Re: [ovirt-users] Engine Down Score is 0
by Sandro Bonazzola
The hosted engine fails to start due to:
Traceback (most recent call last):
File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm
self._run()
File "/usr/share/vdsm/virt/vm.py", line 2026, in _run
self._connection.createXML(domxml, flags),
File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line
123, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 917, in
wrapper
return func(inst, *args, **kwargs)
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3782, in
createXML
if ret is None:raise libvirtError('virDomainCreateXML() failed',
conn=self)
libvirtError: Cannot get interface MTU on 'None': No such device
The Hosted Engine VM has been configured with:
<interface address="None" type="bridge">
<mac address="00:1a:4a:16:01:75"/>
<model type="virtio"/>
<source bridge="storage"/>
<link state="up"/>
</interface>
Not sure how you got there.
Can you share steps you did before having this issue?
On Wed, May 31, 2017 at 4:04 PM, Rizwan Qureshi <rqureshi(a)connexin.co.uk>
wrote:
> Hi Sandro,
>
> PFA the sos report and vdsm logs.
>
>
>
> *From:* Sandro Bonazzola [mailto:sbonazzo@redhat.com]
> *Sent:* Wednesday, May 31, 2017 11:04 AM
> *To:* Rizwan Qureshi <rqureshi(a)connexin.co.uk>; Martin Sivak <
> msivak(a)redhat.com>
> *Cc:* Michal Skrivanek <mskrivan(a)redhat.com>; users(a)ovirt.org
>
> *Subject:* Re: [ovirt-users] Engine Down Score is 0
>
>
>
>
>
>
>
> On Wed, May 31, 2017 at 11:10 AM, Rizwan Qureshi <rqureshi(a)connexin.co.uk>
> wrote:
>
> Hi Sandro,
>
> Thanks for your response.
>
>
>
> We have tried that already but the VM shuts down after the –vm-start
> executes.
>
>
>
> Also, apologies for wrong information bfore. We have 3 dedicated hosts not
> 1.
>
>
>
> Please see below the output of –vm-status command:
>
>
>
>
>
> Can you please share sos report or at least vdsm logs from the hosts?
>
> Need to understand what happened to the vm.
>
>
>
>
>
>
>
> --== Host 1 status ==--
>
>
>
> Status up-to-date : True
>
> Hostname : vmhost1.le1.uk.cxn-network.net
>
> Host ID : 1
>
> Engine status : {"reason": "bad vm status", "health":
> "bad", "vm": "down", "detail": "down"}
>
> Score : 0
>
> stopped : False
>
> Local maintenance : False
>
> crc32 : 37a4ce89
>
> Host timestamp : 76387
>
> Extra metadata (valid at timestamp):
>
> metadata_parse_version=1
>
> metadata_feature_version=1
>
> timestamp=76387 (Wed May 31 10:04:47 2017)
>
> host-id=1
>
> score=0
>
> maintenance=False
>
> state=EngineUnexpectedlyDown
>
> stopped=False
>
> timeout=Thu Jan 1 22:17:00 1970
>
>
>
>
>
> --== Host 2 status ==--
>
>
>
> Status up-to-date : True
>
> Hostname : vmhost2.le1.uk.cxn-network.net
>
> Host ID : 2
>
> Engine status : {"reason": "bad vm status", "health":
> "bad", "vm": "down", "detail": "down"}
>
> Score : 0
>
> stopped : False
>
> Local maintenance : False
>
> crc32 : 937b5542
>
> Host timestamp : 76069
>
> Extra metadata (valid at timestamp):
>
> metadata_parse_version=1
>
> metadata_feature_version=1
>
> timestamp=76069 (Wed May 31 10:04:51 2017)
>
> host-id=2
>
> score=0
>
> maintenance=False
>
> state=EngineUnexpectedlyDown
>
> stopped=False
>
> timeout=Thu Jan 1 22:17:49 1970
>
>
>
>
>
> --== Host 3 status ==--
>
>
>
> Status up-to-date : True
>
> Hostname : vmhost3.le1.uk.cxn-network.net
>
> Host ID : 3
>
> Engine status : {"reason": "bad vm status", "health":
> "bad", "vm": "down", "detail": "down"}
>
> Score : 0
>
> stopped : False
>
> Local maintenance : False
>
> crc32 : 8ffac898
>
> Host timestamp : 76212
>
> Extra metadata (valid at timestamp):
>
> metadata_parse_version=1
>
> metadata_feature_version=1
>
> timestamp=76212 (Wed May 31 10:04:55 2017)
>
> host-id=3
>
> score=0
>
> maintenance=False
>
> state=EngineUnexpectedlyDown
>
> stopped=False
>
> timeout=Thu Jan 1 22:16:58 1970
>
>
>
> *From:* Sandro Bonazzola [mailto:sbonazzo@redhat.com]
> *Sent:* Wednesday, May 31, 2017 7:52 AM
> *To:* Rizwan Qureshi <rqureshi(a)connexin.co.uk>; Michal Skrivanek <
> mskrivan(a)redhat.com>
> *Cc:* users(a)ovirt.org
> *Subject:* Re: [ovirt-users] Engine Down Score is 0
>
>
>
>
>
>
>
> On Tue, May 30, 2017 at 6:32 PM, Rizwan Qureshi <rqureshi(a)connexin.co.uk>
> wrote:
>
> Hello Ovirt Users,
>
> I am new to ovirt.
>
>
>
> Hi, welcome ot oVirt community!
>
>
>
>
>
> Just trying to fix the issue with the engine which seems to be down and
> hence all our VMs which we are very much dependent upon are not working.
>
>
>
> Other VMs shouldn't be affected by an unavailability of the engine, they
> should keep going if already started.
>
>
>
>
>
> Tried googling the log snippet but to no avail. Hoping to get some help
> from you guys.
>
>
>
> I am completely blank and don’t know whats wrong with it.
>
>
>
> We have 3 Dell servers. One for Engine and the other two for nodes. Please
> see the log snippet from the engine server agent.log. Please let me know if
> more information is needed to debug the issue.
>
>
>
> So you have only 1 host dedicated to running hosted engine?
>
>
>
>
>
>
>
> MainThread::INFO::2017-05-30 17:21:51,649::hosted_engine::
> 612::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_vdsm) Initializing VDSM
>
> MainThread::INFO::2017-05-30 17:21:53,820::hosted_engine::
> 639::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_storage_images) Connecting the storage
>
> MainThread::INFO::2017-05-30 17:21:53,821::storage_server::
> 219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
>
> MainThread::INFO::2017-05-30 17:21:58,134::storage_server::
> 226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
>
> MainThread::INFO::2017-05-30 17:21:58,142::storage_server::
> 233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Refreshing the storage domain
>
> MainThread::INFO::2017-05-30 17:21:58,258::hosted_engine::
> 666::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_storage_images) Preparing images
>
> MainThread::INFO::2017-05-30 17:21:58,258::image::126::
> ovirt_hosted_engine_ha.lib.image.Image::(prepare_images) Preparing images
>
> MainThread::INFO::2017-05-30 17:22:00,637::hosted_engine::
> 669::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_storage_images) Reloading vm.conf from the
> shared storage domain
>
> MainThread::INFO::2017-05-30 17:22:00,638::config::206::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
> config::(refresh_local_conf_file) Trying to get a fresher copy of vm
> configuration from the OVF_STORE
>
> MainThread::INFO::2017-05-30 17:22:02,838::ovf_store::103::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
> OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-8e6c-46a49c30967c,
> volUUID:0ae2c43f-5883-4354-a33f-e68e21ae3733
>
> MainThread::INFO::2017-05-30 17:22:02,977::ovf_store::103::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
> OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-b906-5353de1a32cc,
> volUUID:d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
>
> MainThread::INFO::2017-05-30 17:22:03,032::ovf_store::112::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> Extracting Engine VM OVF from the OVF_STORE
>
> MainThread::INFO::2017-05-30 17:22:03,033::ovf_store::119::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:
> _oVirt/4f9e46d7-594e-473c-b0c5-1770c5773a2e/images/4ef3bd37-
> e48d-44a8-b906-5353de1a32cc/d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
>
> MainThread::INFO::2017-05-30 17:22:03,044::config::226::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
> config::(refresh_local_conf_file) Found an OVF for HE VM, trying to
> convert
>
> MainThread::INFO::2017-05-30 17:22:03,046::config::231::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
> config::(refresh_local_conf_file) Got vm.conf from OVF_STORE
>
> MainThread::INFO::2017-05-30 17:22:03,082::states::672::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is
> 0 due to unexpected vm shutdown at Tue May 30 17:18:38 2017
>
> MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::
> 461::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineUnexpectedlyDown (score: 0)
>
> MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::
> 466::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Best remote host vmhost2.le1.uk.cxn-network.net (id: 2, score: 0)
>
> MainThread::INFO::2017-05-30 17:22:13,135::hosted_engine::
> 612::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_vdsm) Initializing VDSM
>
> MainThread::INFO::2017-05-30 17:22:15,305::hosted_engine::
> 639::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_storage_images) Connecting the storage
>
> MainThread::INFO::2017-05-30 17:22:15,306::storage_server::
> 219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
>
> MainThread::INFO::2017-05-30 17:22:19,618::storage_server::
> 226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
>
> MainThread::INFO::2017-05-30 17:22:19,626::storage_server::
> 233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Refreshing the storage domain
>
> MainThread::INFO::2017-05-30 17:22:19,742::hosted_engine::
> 666::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_storage_images) Preparing images
>
> MainThread::INFO::2017-05-30 17:22:19,742::image::126::
> ovirt_hosted_engine_ha.lib.image.Image::(prepare_images) Preparing images
>
> MainThread::INFO::2017-05-30 17:22:22,140::hosted_engine::
> 669::ovirt_hosted_engine_ha.agent.hosted_engine.
> HostedEngine::(_initialize_storage_images) Reloading vm.conf from the
> shared storage domain
>
> MainThread::INFO::2017-05-30 17:22:22,140::config::206::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
> config::(refresh_local_conf_file) Trying to get a fresher copy of vm
> configuration from the OVF_STORE
>
> MainThread::INFO::2017-05-30 17:22:24,333::ovf_store::103::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
> OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-8e6c-46a49c30967c,
> volUUID:0ae2c43f-5883-4354-a33f-e68e21ae3733
>
> MainThread::INFO::2017-05-30 17:22:24,472::ovf_store::103::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan) Found
> OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-b906-5353de1a32cc,
> volUUID:d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
>
> MainThread::INFO::2017-05-30 17:22:24,519::ovf_store::112::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> Extracting Engine VM OVF from the OVF_STORE
>
> MainThread::INFO::2017-05-30 17:22:24,520::ovf_store::119::
> ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1.uk.cxn-network.net:
> _oVirt/4f9e46d7-594e-473c-b0c5-1770c5773a2e/images/4ef3bd37-
> e48d-44a8-b906-5353de1a32cc/d63b9f36-c5f1-4ddc-9d4a-e01f22023e73
>
> MainThread::INFO::2017-05-30 17:22:24,531::config::226::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
> config::(refresh_local_conf_file) Found an OVF for HE VM, trying to
> convert
>
> MainThread::INFO::2017-05-30 17:22:24,533::config::231::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.
> config::(refresh_local_conf_file) Got vm.conf from OVF_STORE
>
> MainThread::INFO::2017-05-30 17:22:24,568::states::672::
> ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is
> 0 due to unexpected vm shutdown at Tue May 30 17:18:39 2017
>
> MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::
> 461::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineUnexpectedlyDown (score: 0)
>
> MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::
> 466::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Best remote host vmhost2.le1.uk.cxn-network.net (id: 2, score: 0)
>
>
>
>
>
> Looks like hosted engine has been turned off at Tue May 30 17:18:38 2017
> without moving to maintenance before doing it.
>
> Above logs are timed 2017-05-30 17:22:24, so 4 minutes after the shutdown.
>
> The agent should have already restarted it in a few minutes after above
> logs.
>
> Next time, if you need to urgently bring it up again you can use:
>
> hosted-engine ---vm-start
>
> as described in http://www.ovirt.org/documentation/self-hosted/
> chap-Troubleshooting/
>
>
>
>
>
> --
>
> Best Regards,
>
> Rizwan Qureshi
>
> VoIP Admin
>
> Ph: 01482xxxxxxx
>
>
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
>
>
> --
>
> *SANDRO BONAZZOLA*
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
>
> Red Hat EMEA <https://www.redhat.com/>
>
> <https://red.ht/sig>
>
> *TRIED. TESTED. TRUSTED.* <https://red.ht/sig>
>
> <https://red.ht/sig>
>
>
>
> <https://red.ht/sig>
>
> <https://red.ht/sig>
>
> -- <https://red.ht/sig>
>
> *SANDRO BONAZZOLA <https://red.ht/sig>*
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
> <https://red.ht/sig>
>
> *Red Hat EMEA* <https://red.ht/sig>
>
> <https://red.ht/sig>
>
> *TRIED. TESTED. TRUSTED.* <https://red.ht/sig>
>
> <https://red.ht/sig>
>
--
SANDRO BONAZZOLA
ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
Red Hat EMEA <https://www.redhat.com/>
<https://red.ht/sig>
TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
7 years, 6 months
Importing VMs from kvm to oVirt. "VM zarafa is down with error. Exit message: Failed to find the libvirt domain."
by Marc Pfaendler
Hello
I'm trying to import an existing kvm VM into oVirt 4.1. It a new server
with a fresh installation of oVirt.
I'm working with the oVirt gui to achieve this.
After moving the VM from the old system into the export folder, the gui
allows me to import it.
The import seems to succeed. But after the VM is imported it fails to start.
Giving this error:
"VM zarafa is down with error. Exit message: Failed to find the
libvirt domain."
Cheers
Marc
7 years, 6 months
Re: [ovirt-users] Ovirt Hosted-Engine VM iptables
by Andrew Dent
I can add a rule into ipdates such as this
iptables -I INPUT -s 192.168.0.10 -p tcp -m tcp --dport 5666 -j ACCEPT
I can see the addition has succeeded with this
iptables-save > /etc/sysconfig/iptables
But a reboot of the Engine VM (not the Host) doesn't keep the new rule,
and I was expecting that during bootup CentOS would read from
/etc/sysconfig/iptables.
Alas it isn't.
Found a solution.
After reading this
https://stackoverflow.com/questions/24756240/how-can-i-use-iptables-on-ce...
I installed iptables-services
But once installed I found that iptables -L showed no rules.
thankfully I still had the default hosted-engine rules in
/etc/sysconfig/iptables
iptables-restore < /etc/sysconfig/iptables
Then.....
service iptables save
restored the default hosted-engine rules including my rule for 5666.
Rebooting the hosted-engine VM and my rule 5666 for NRPE is still there.
Success!!
To answer your other questions
> Did you ask to configure the firewall during engine-setup?
Yes.
Looks like it setup firewalld for me.
> Alternatively, it's recommended to use firewalld.
For the moment I have disabled firewalld and are using iptables....Is
there a reason why firewalld is preferred over iptables?
Kind regards
Andrew
------ Original Message ------
From: "Yedidyah Bar David" <didi(a)redhat.com>
To: "Andrew Dent" <adent(a)ctcroydon.com.au>
Cc: "users" <users(a)ovirt.org>
Sent: 29/05/2017 9:26:23 PM
Subject: Re: [ovirt-users] Ovirt Hosted-Engine VM iptables
>On Mon, May 29, 2017 at 1:14 PM, Andrew Dent <adent(a)ctcroydon.com.au>
>wrote:
>> Hi
>>
>> I would like to add rules into the iptables of the Hosted Engine VM
>>in
>> Ovirt.
>> I am wanting to monitor the Ovirt Engine using Nagios -> NRPE and I
>>would
>> like to open port 5666
>>
>> the version is oVirt Engine Version: 4.1.1.8-1.el7.centos
>> I have tried using the normal process for iptables (iptables-save
>>etc), but
>> it seems that the file
>> /etc/sysconfig/iptables
>> is ignored when the Ovirt Engine VM starts.
>
>What do you mean in "ignored"?
>
>What's the output of 'iptables-save'?
>
>Did you ask to configure the firewall during engine-setup?
>
>>
>> How can I add permanent iptables rules into the Engine VM?
>
>On the engine vm (unlike hosts), the only thing that touches iptables
>is engine-setup. Before doing that it asks you if you want to configure
>the firewall. There aren't currently means to add your custom rules -
>either you manage it all by yourself or you let engine-setup do that.
>
>Alternatively, it's recommended to use firewalld. engine-setup can
>add to firewalld the stuff it wants, and you still can add your own
>stuff.
>
>If I got you wrong and you refer to the hosts (not engine), see also:
>
>https://www.ovirt.org/blog/2016/12/extension-iptables-rules-oVirt-hosts/
>
>Best,
>
>>
>> Kind regards
>>
>>
>> Andrew
>>
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
>
>
>--
>Didi
7 years, 6 months