Network Interface order changed after reboot
by ovirt@timmi.org
Hi List,
I have two nodes (running CentOS 7) and the network interface order
changed for some interfaces after every reboot.
The configurations are done through the oVirt GUI. So the ifcfg-ethX
scripts are configured automatically by VDSM.
Is there any option to get this configured to be stable?
Best regards and thank you
Christoph
8 years, 5 months
InClusterUpgrade Scheduling Policy
by Scott
Hello list,
I'm trying to upgrade a self-hosted engine RHEV environment running 3.5/el6
to 3.6/el7. I'm following the process outlined in these two documents:
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Virtuali...
https://access.redhat.com/solutions/2300331
The problem I'm having is I don't seem to be able to apply the
"InClusterUpgrade" policy (procedure 5.5, step 4). I get the following
error:
Can not start cluster upgrade mode, see below for details:
VM HostedEngine with id 5ca9cb38-82e5-4eea-8ff6-e2bc33598211 is configured
to be not migratable.
But the HostedEngine VM is not one I can edit due to being mid-upgrade.
And even if I could, the setting its complaining about can't be managed by
the engine (I tried in another RHEV instance).
Is this a bug? What am I missing to be able to move on? As it seems now,
the InClusterUpgrade scheduling policy is useless and can't actually be
used.
Thanks for any suggestions/help,
Scott
8 years, 5 months
vm pauses with "vm has paused due to unknown storage error
by Bill Bill
--_000_CO2PR0801MB0743180FC142ED11D7D5D3E0A62E0CO2PR0801MB0743_
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
SGVsbG8sDQoNCkhhdmUgMyBub2RlcyBydW5uaW5nIGJvdGggb1ZpcnQgYW5kIEdsdXN0ZXIgb24g
NCBTU0TigJlzIGVhY2guIEF0IHRoZSBtb21lbnQsIHRoZXJlIGFyZSB0d28gcGh5c2ljYWwgbmlj
cywgb25lIGhhcyBwdWJsaWMgaW50ZXJuZXQgYWNjZXNzIGFuZCB0aGUgb3RoZXIgaXMgYSBub24t
cm91dGFibGUgbmV0d29yayB1c2VkIGZvciBvdmlydG1nbXQgJiBnbHVzdGVyLg0KDQpJbiB0aGUg
bG9naWNhbCBuZXR3b3JrcywgSSBoYXZlIHNlbGVjdGVkIGdsdXN0ZXIgZm9yIHRoZSBub25yb3V0
YWJsZSBuZXR3b3JrIHJ1bm5pbmcgb3ZpcnRtZ210IGFuZCBnbHVzdGVyIGhvd2V2ZXIsIHR3byBW
TeKAmXMgcmFuZG9tbHkgcGF1c2UgZm9yIHdoYXQgc2VlbXMgbGlrZSBubyByZWFzb24uIFRoZXkg
Y2FuIGJvdGggYmUgcmVzdW1lZCB3aXRob3V0IGlzc3VlLg0KDQpPbmUgdGVzdCBWTSBoYXMgNEdC
IG9mIG1lbW9yeSBhbmQgYSBzbWFsbCBkaXNrIOKAkyBubyBwcm9ibGVtcyB3aXRoIHRoaXMgb25l
LiBUd28gb3RoZXJzIGhhdmUgODAwR0IgZGlza3MgYW5kIDMyR0Igb2YgUkFNIOKAkyBib3RoIHZt
4oCZcyBleGhpYml0IHRoZSBzYW1lIGlzc3VlLg0KDQpJIGFsc28gc2VlIHRoZXNlIGluIHRoZSBv
VmlydCBkYXNoYm9hcmQ6DQoNCg0KRmFpbGVkIHRvIHVwZGF0ZSBPVkYgZGlza3MgOWU2MDMyOGQt
MjlhZi00NTMzLTg0ZjktNjMzZDg3ZjU0OGE3LCBPVkYgZGF0YSBpc24ndCB1cGRhdGVkIG9uIHRo
b3NlIE9WRiBzdG9yZXMgKERhdGEgQ2VudGVyIHh4eHh4LCBTdG9yYWdlIERvbWFpbiBzci12b2x1
bWUwMSkuDQoNCkp1biAyMywgMjAxNiA5OjU0OjAzIFBNDQoNClZEU00gY29tbWFuZCBmYWlsZWQ6
IENvdWxkIG5vdCBhY3F1aXJlIHJlc291cmNlLiBQcm9iYWJseSByZXNvdXJjZSBmYWN0b3J5IHRo
cmV3IGFuIGV4Y2VwdGlvbi46ICgpDQoNCi8vLy8vLy8vLy8vLy8vLw0KDQpWTSB4eHh4eCBoYXMg
YmVlbiBwYXVzZWQgZHVlIHRvIHVua25vd24gc3RvcmFnZSBlcnJvci4NCg0KLy8vLy8vLy8vLy8v
Ly8vDQoNCkluIHRoZSBlcnJvciBsb2cgb24gdGhlIGVuZ2luZSwgSSBzZWUgdGhlc2U6DQoNCkVS
Uk9SIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUuZGFsLmRiYnJva2VyLmF1ZGl0bG9naGFuZGxpbmcu
QXVkaXRMb2dEaXJlY3Rvcl0gKEZvcmtKb2luUG9vbC0xLXdvcmtlci03KSBbMTBjYWY5M2VdIENv
cnJlbGF0aW9uIElEOiBudWxsLCBDYWxsIFN0YWNrOiBudWxsLCBDdXN0b20gRXZlbnQgSUQ6IC0x
LCBNZXNzYWdlOiBWTSB4eHh4eHggaGFzIGJlZW4gcGF1c2VkIGR1ZSB0byB1bmtub3duIHN0b3Jh
Z2UgZXJyb3IuDQoNCklORk8gIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUuZGFsLmRiYnJva2VyLmF1
ZGl0bG9naGFuZGxpbmcuQXVkaXRMb2dEaXJlY3Rvcl0gKEZvcmtKb2luUG9vbC0xLXdvcmtlci0x
MSkgWzEwY2FmOTNlXSBDb3JyZWxhdGlvbiBJRDogbnVsbCwgQ2FsbCBTdGFjazogbnVsbCwgQ3Vz
dG9tIEV2ZW50IElEOiAtMSwgTWVzc2FnZTogVk0geHh4eHh4IGhhcyByZWNvdmVyZWQgZnJvbSBw
YXVzZWQgYmFjayB0byB1cC4NCg0KLy8vLy8vLy8vLy8vLy8vDQoNCkhvc3RuYW1lcyBhcmUgYWxs
IGxvY2FsIHRvIC9ldGMvaG9zdHMgb24gYWxsIHNlcnZlcnMg4oCTIHRoZXkgYWxzbyByZXNvbHZl
IHdpdGhvdXQgaXNzdWUgZnJvbSBlYWNoIGhvc3QuDQoNCi8vLy8vLy8vLy8vLy8vDQoNCjIwMTYt
MDYtMjMgMjI6MDg6NTksNjExIFdBUk4gIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2Vy
LmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9yWG1sUnBjXSAoRGVmYXVsdFF1YXJ0
elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBub3QgYXNzb2NpYXRlIGJyaWNr
ICdvdmlydDM0MzU6L21udC9kYXRhL3NyLXZvbHVtZTAxJyBvZiB2b2x1bWUgJzkzZTM2Y2RjLWFi
MWItNDFlYy1hYzdmLTk2NmNmMzg1NmI1OScgd2l0aCBjb3JyZWN0IG5ldHdvcmsgYXMgbm8gZ2x1
c3RlciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5OS05Y2QwLWI2
M2U5MTliOWFjYScNCjIwMTYtMDYtMjMgMjI6MDg6NTksNjE0IFdBUk4gIFtvcmcub3ZpcnQuZW5n
aW5lLmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9yWG1s
UnBjXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBu
b3QgYXNzb2NpYXRlIGJyaWNrICdvdmlydDM2Mzc6L21udC9kYXRhL3NyLXZvbHVtZTAxJyBvZiB2
b2x1bWUgJzkzZTM2Y2RjLWFiMWItNDFlYy1hYzdmLTk2NmNmMzg1NmI1OScgd2l0aCBjb3JyZWN0
IG5ldHdvcmsgYXMgbm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRl
LTA0YjItNGE5OS05Y2QwLWI2M2U5MTliOWFjYScNCjIwMTYtMDYtMjMgMjI6MDg6NTksNjE2IFdB
Uk4gIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVt
ZXNMaXN0UmV0dXJuRm9yWG1sUnBjXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYp
IFsxYzFjZjRmXSBDb3VsZCBub3QgYXNzb2NpYXRlIGJyaWNrICdvdmlydDM4Mzk6L21udC9kYXRh
L3NyLXZvbHVtZTAxJyBvZiB2b2x1bWUgJzkzZTM2Y2RjLWFiMWItNDFlYy1hYzdmLTk2NmNmMzg1
NmI1OScgd2l0aCBjb3JyZWN0IG5ldHdvcmsgYXMgbm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGlu
IGNsdXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5OS05Y2QwLWI2M2U5MTliOWFjYScNCjIwMTYtMDYt
MjMgMjI6MDg6NTksNjE4IFdBUk4gIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2VyLmds
dXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9yWG1sUnBjXSAoRGVmYXVsdFF1YXJ0elNj
aGVkdWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBub3QgYXNzb2NpYXRlIGJyaWNrICdv
dmlydDM0MzU6L21udC9kYXRhL2Rpc3RyaWJ1dGVkJyBvZiB2b2x1bWUgJ2I4ODdiMDVlLTJlYTYt
NDk2ZS05NTUyLTE1NWQ2NThlZWFhNicgd2l0aCBjb3JyZWN0IG5ldHdvcmsgYXMgbm8gZ2x1c3Rl
ciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5OS05Y2QwLWI2M2U5
MTliOWFjYScNCjIwMTYtMDYtMjMgMjI6MDg6NTksNjIwIFdBUk4gIFtvcmcub3ZpcnQuZW5naW5l
LmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9yWG1sUnBj
XSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBub3Qg
YXNzb2NpYXRlIGJyaWNrICdvdmlydDM2Mzc6L21udC9kYXRhL2Rpc3RyaWJ1dGVkJyBvZiB2b2x1
bWUgJ2I4ODdiMDVlLTJlYTYtNDk2ZS05NTUyLTE1NWQ2NThlZWFhNicgd2l0aCBjb3JyZWN0IG5l
dHdvcmsgYXMgbm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRlLTA0
YjItNGE5OS05Y2QwLWI2M2U5MTliOWFjYScNCjIwMTYtMDYtMjMgMjI6MDg6NTksNjIyIFdBUk4g
IFtvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNM
aXN0UmV0dXJuRm9yWG1sUnBjXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsx
YzFjZjRmXSBDb3VsZCBub3QgYXNzb2NpYXRlIGJyaWNrICdvdmlydDM4Mzk6L21udC9kYXRhL2Rp
c3RyaWJ1dGVkJyBvZiB2b2x1bWUgJ2I4ODdiMDVlLTJlYTYtNDk2ZS05NTUyLTE1NWQ2NThlZWFh
Nicgd2l0aCBjb3JyZWN0IG5ldHdvcmsgYXMgbm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGluIGNs
dXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5OS05Y2QwLWI2M2U5MTliOWFjYScNCjIwMTYtMDYtMjMg
MjI6MDg6NTksNjI0IFdBUk4gIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2VyLmdsdXN0
ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9yWG1sUnBjXSAoRGVmYXVsdFF1YXJ0elNjaGVk
dWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBub3QgYXNzb2NpYXRlIGJyaWNrICdvdmly
dDM0MzU6L21udC9kYXRhL2lzbycgb2Ygdm9sdW1lICc4OWYzMjQ1Ny1jOGMzLTQ5MGUtYjQ5MS0x
NmRkMjdkZTAwNzMnIHdpdGggY29ycmVjdCBuZXR3b3JrIGFzIG5vIGdsdXN0ZXIgbmV0d29yayBm
b3VuZCBpbiBjbHVzdGVyICc3NWJkNjRkZS0wNGIyLTRhOTktOWNkMC1iNjNlOTE5YjlhY2EnDQoy
MDE2LTA2LTIzIDIyOjA4OjU5LDYyNiBXQVJOICBbb3JnLm92aXJ0LmVuZ2luZS5jb3JlLnZkc2Jy
b2tlci5nbHVzdGVyLkdsdXN0ZXJWb2x1bWVzTGlzdFJldHVybkZvclhtbFJwY10gKERlZmF1bHRR
dWFydHpTY2hlZHVsZXJfV29ya2VyLTc2KSBbMWMxY2Y0Zl0gQ291bGQgbm90IGFzc29jaWF0ZSBi
cmljayAnb3ZpcnQzNjM3Oi9tbnQvZGF0YS9pc28nIG9mIHZvbHVtZSAnODlmMzI0NTctYzhjMy00
OTBlLWI0OTEtMTZkZDI3ZGUwMDczJyB3aXRoIGNvcnJlY3QgbmV0d29yayBhcyBubyBnbHVzdGVy
IG5ldHdvcmsgZm91bmQgaW4gY2x1c3RlciAnNzViZDY0ZGUtMDRiMi00YTk5LTljZDAtYjYzZTkx
OWI5YWNhJw0KMjAxNi0wNi0yMyAyMjowODo1OSw2MjggV0FSTiAgW29yZy5vdmlydC5lbmdpbmUu
Y29yZS52ZHNicm9rZXIuZ2x1c3Rlci5HbHVzdGVyVm9sdW1lc0xpc3RSZXR1cm5Gb3JYbWxScGNd
IChEZWZhdWx0UXVhcnR6U2NoZWR1bGVyX1dvcmtlci03NikgWzFjMWNmNGZdIENvdWxkIG5vdCBh
c3NvY2lhdGUgYnJpY2sgJ292aXJ0MzgzOTovbW50L2RhdGEvaXNvJyBvZiB2b2x1bWUgJzg5ZjMy
NDU3LWM4YzMtNDkwZS1iNDkxLTE2ZGQyN2RlMDA3Mycgd2l0aCBjb3JyZWN0IG5ldHdvcmsgYXMg
bm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5OS05
Y2QwLWI2M2U5MTliOWFjYScNCjIwMTYtMDYtMjMgMjI6MDg6NTksNjI5IElORk8gIFtvcmcub3Zp
cnQuZW5naW5lLmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0VkRTQ29t
bWFuZF0gKERlZmF1bHRRdWFydHpTY2hlZHVsZXJfV29ya2VyLTc2KSBbMWMxY2Y0Zl0gRklOSVNI
LCBHbHVzdGVyVm9sdW1lc0xpc3RWRFNDb21tYW5kLCByZXR1cm46IHtiODg3YjA1ZS0yZWE2LTQ5
NmUtOTU1Mi0xNTVkNjU4ZWVhYTY9b3JnLm92aXJ0LmVuZ2luZS5jb3JlLmNvbW1vbi5idXNpbmVz
c2VudGl0aWVzLmdsdXN0ZXIuR2x1c3RlclZvbHVtZUVudGl0eUBkOGM5MDM5YiwgOTNlMzZjZGMt
YWIxYi00MWVjLWFjN2YtOTY2Y2YzODU2YjU5PW9yZy5vdmlydC5lbmdpbmUuY29yZS5jb21tb24u
YnVzaW5lc3NlbnRpdGllcy5nbHVzdGVyLkdsdXN0ZXJWb2x1bWVFbnRpdHlAZmU1YWIwMTksIDg5
ZjMyNDU3LWM4YzMtNDkwZS1iNDkxLTE2ZGQyN2RlMDA3Mz1vcmcub3ZpcnQuZW5naW5lLmNvcmUu
Y29tbW9uLmJ1c2luZXNzZW50aXRpZXMuZ2x1c3Rlci5HbHVzdGVyVm9sdW1lRW50aXR5QDlhNTZk
NjMzfSwgbG9nIGlkOiA0ODVhMDYxMQ0KMjAxNi0wNi0yMyAyMjowOTowNCw2NDUgSU5GTyAgW29y
Zy5vdmlydC5lbmdpbmUuY29yZS52ZHNicm9rZXIuZ2x1c3Rlci5HbHVzdGVyVm9sdW1lc0xpc3RW
RFNDb21tYW5kXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItODkpIFtdIFNUQVJULCBH
bHVzdGVyVm9sdW1lc0xpc3RWRFNDb21tYW5kKEhvc3ROYW1lID0gb3ZpcnQzODM5LCBHbHVzdGVy
Vm9sdW1lc0xpc3RWRFNQYXJhbWV0ZXJzOntydW5Bc3luYz0ndHJ1ZScsIGhvc3RJZD0nMzJjNTAw
ZTUtMjY4ZC00MjZhLTlhNGEtMTA4NTM1ZTY3NzIyJ30pLCBsb2cgaWQ6IDQxYjY0NzlkDQo=
--_000_CO2PR0801MB0743180FC142ED11D7D5D3E0A62E0CO2PR0801MB0743_
Content-Type: text/html; charset="utf-8"
Content-ID: <D0C4FA3A5B1EE240A396E58D5F57A2E7(a)sct-15-1-485-2-msonline-outlook-1173a.templateTenant>
Content-Transfer-Encoding: base64
PGh0bWwgeG1sbnM6bz0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6b2ZmaWNlIiB4
bWxuczp3PSJ1cm46c2NoZW1hcy1taWNyb3NvZnQtY29tOm9mZmljZTp3b3JkIiB4bWxuczptPSJo
dHRwOi8vc2NoZW1hcy5taWNyb3NvZnQuY29tL29mZmljZS8yMDA0LzEyL29tbWwiIHhtbG5zPSJo
dHRwOi8vd3d3LnczLm9yZy9UUi9SRUMtaHRtbDQwIj4NCjxoZWFkPg0KPG1ldGEgaHR0cC1lcXVp
dj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPg0KPG1l
dGEgbmFtZT0iR2VuZXJhdG9yIiBjb250ZW50PSJNaWNyb3NvZnQgV29yZCAxNSAoZmlsdGVyZWQg
bWVkaXVtKSI+DQo8c3R5bGU+PCEtLQ0KLyogRm9udCBEZWZpbml0aW9ucyAqLw0KQGZvbnQtZmFj
ZQ0KCXtmb250LWZhbWlseToiQ2FtYnJpYSBNYXRoIjsNCglwYW5vc2UtMToyIDQgNSAzIDUgNCA2
IDMgMiA0O30NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6Q2FsaWJyaTsNCglwYW5vc2UtMToy
IDE1IDUgMiAyIDIgNCAzIDIgNDt9DQovKiBTdHlsZSBEZWZpbml0aW9ucyAqLw0KcC5Nc29Ob3Jt
YWwsIGxpLk1zb05vcm1hbCwgZGl2Lk1zb05vcm1hbA0KCXttYXJnaW46MGluOw0KCW1hcmdpbi1i
b3R0b206LjAwMDFwdDsNCglmb250LXNpemU6MTEuMHB0Ow0KCWZvbnQtZmFtaWx5OiJDYWxpYnJp
IixzYW5zLXNlcmlmO30NCmE6bGluaywgc3Bhbi5Nc29IeXBlcmxpbmsNCgl7bXNvLXN0eWxlLXBy
aW9yaXR5Ojk5Ow0KCWNvbG9yOmJsdWU7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQph
OnZpc2l0ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQNCgl7bXNvLXN0eWxlLXByaW9yaXR5
Ojk5Ow0KCWNvbG9yOiM5NTRGNzI7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQouTXNv
Q2hwRGVmYXVsdA0KCXttc28tc3R5bGUtdHlwZTpleHBvcnQtb25seTt9DQpAcGFnZSBXb3JkU2Vj
dGlvbjENCgl7c2l6ZTo4LjVpbiAxMS4waW47DQoJbWFyZ2luOjEuMGluIDEuMGluIDEuMGluIDEu
MGluO30NCmRpdi5Xb3JkU2VjdGlvbjENCgl7cGFnZTpXb3JkU2VjdGlvbjE7fQ0KLS0+PC9zdHls
ZT4NCjwvaGVhZD4NCjxib2R5IGxhbmc9IkVOLVVTIiBsaW5rPSJibHVlIiB2bGluaz0iIzk1NEY3
MiI+DQo8ZGl2IGNsYXNzPSJXb3JkU2VjdGlvbjEiPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+SGVs
bG8sPC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8cCBj
bGFzcz0iTXNvTm9ybWFsIj5IYXZlIDMgbm9kZXMgcnVubmluZyBib3RoIG9WaXJ0IGFuZCBHbHVz
dGVyIG9uIDQgU1NE4oCZcyBlYWNoLiBBdCB0aGUgbW9tZW50LCB0aGVyZSBhcmUgdHdvIHBoeXNp
Y2FsIG5pY3MsIG9uZSBoYXMgcHVibGljIGludGVybmV0IGFjY2VzcyBhbmQgdGhlIG90aGVyIGlz
IGEgbm9uLXJvdXRhYmxlIG5ldHdvcmsgdXNlZCBmb3Igb3ZpcnRtZ210ICZhbXA7IGdsdXN0ZXIu
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8cCBjbGFz
cz0iTXNvTm9ybWFsIj5JbiB0aGUgbG9naWNhbCBuZXR3b3JrcywgSSBoYXZlIHNlbGVjdGVkIGds
dXN0ZXIgZm9yIHRoZSBub25yb3V0YWJsZSBuZXR3b3JrIHJ1bm5pbmcgb3ZpcnRtZ210IGFuZCBn
bHVzdGVyIGhvd2V2ZXIsIHR3byBWTeKAmXMgcmFuZG9tbHkgcGF1c2UgZm9yIHdoYXQgc2VlbXMg
bGlrZSBubyByZWFzb24uIFRoZXkgY2FuIGJvdGggYmUgcmVzdW1lZCB3aXRob3V0IGlzc3VlLjwv
cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxvOnA+Jm5ic3A7PC9vOnA+PC9wPg0KPHAgY2xhc3M9
Ik1zb05vcm1hbCI+T25lIHRlc3QgVk0gaGFzIDRHQiBvZiBtZW1vcnkgYW5kIGEgc21hbGwgZGlz
ayDigJMgbm8gcHJvYmxlbXMgd2l0aCB0aGlzIG9uZS4gVHdvIG90aGVycyBoYXZlIDgwMEdCIGRp
c2tzIGFuZCAzMkdCIG9mIFJBTSDigJMgYm90aCB2beKAmXMgZXhoaWJpdCB0aGUgc2FtZSBpc3N1
ZS48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBw
dDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPjxvOnA+Jm5i
c3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJm
b250LXNpemU6MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90Oyxz
ZXJpZiI+SSBhbHNvIHNlZSB0aGVzZSBpbiB0aGUgb1ZpcnQgZGFzaGJvYXJkOjxvOnA+PC9vOnA+
PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6
MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+PG86
cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1
b3Q7LHNlcmlmIj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz
cDsmbmJzcDsmbmJzcDsmbmJzcDsNCjxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN
c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90
O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+RmFpbGVkIHRvIHVwZGF0ZSBPVkYgZGlza3Mg
OWU2MDMyOGQtMjlhZi00NTMzLTg0ZjktNjMzZDg3ZjU0OGE3LCBPVkYgZGF0YSBpc24ndCB1cGRh
dGVkIG9uIHRob3NlIE9WRiBzdG9yZXMgKERhdGEgQ2VudGVyIHh4eHh4LCBTdG9yYWdlIERvbWFp
biBzci12b2x1bWUwMSkuPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h
bCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMg
TmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBj
bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWls
eTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPkp1biAyMywgMjAxNiA5OjU0OjAz
IFBNPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1
b3Q7LHNlcmlmIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9y
bWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1l
cyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPlZEU00gY29tbWFuZCBmYWlsZWQ6IENvdWxkIG5vdCBh
Y3F1aXJlIHJlc291cmNlLiBQcm9iYWJseSByZXNvdXJjZSBmYWN0b3J5IHRocmV3IGFuIGV4Y2Vw
dGlvbi46ICgpPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNw
YW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJv
bWFuJnF1b3Q7LHNlcmlmIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0i
TXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVv
dDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPi8vLy8vLy8vLy8vLy8vLzxvOnA+PC9vOnA+
PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6
MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+PG86
cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1
b3Q7LHNlcmlmIj5WTSB4eHh4eCBoYXMgYmVlbiBwYXVzZWQgZHVlIHRvIHVua25vd24gc3RvcmFn
ZSBlcnJvci48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3Bh
biBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9t
YW4mcXVvdDssc2VyaWYiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN
c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90
O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+Ly8vLy8vLy8vLy8vLy8vPG86cD48L286cD48
L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTox
Mi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj48bzpw
PiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls
ZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVv
dDssc2VyaWYiPkluIHRoZSBlcnJvciBsb2cgb24gdGhlIGVuZ2luZSwgSSBzZWUgdGhlc2U6PG86
cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv
bnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNl
cmlmIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48
c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcg
Um9tYW4mcXVvdDssc2VyaWYiPkVSUk9SIFtvcmcub3ZpcnQuZW5naW5lLmNvcmUuZGFsLmRiYnJv
a2VyLmF1ZGl0bG9naGFuZGxpbmcuQXVkaXRMb2dEaXJlY3Rvcl0gKEZvcmtKb2luUG9vbC0xLXdv
cmtlci03KSBbMTBjYWY5M2VdIENvcnJlbGF0aW9uIElEOiBudWxsLCBDYWxsIFN0YWNrOiBudWxs
LCBDdXN0b20gRXZlbnQgSUQ6DQogLTEsIE1lc3NhZ2U6IFZNIHh4eHh4eCBoYXMgYmVlbiBwYXVz
ZWQgZHVlIHRvIHVua25vd24gc3RvcmFnZSBlcnJvci48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8
cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZh
bWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPjxvOnA+Jm5ic3A7PC9vOnA+
PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6
MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+SU5G
TyZuYnNwOyBbb3JnLm92aXJ0LmVuZ2luZS5jb3JlLmRhbC5kYmJyb2tlci5hdWRpdGxvZ2hhbmRs
aW5nLkF1ZGl0TG9nRGlyZWN0b3JdIChGb3JrSm9pblBvb2wtMS13b3JrZXItMTEpIFsxMGNhZjkz
ZV0gQ29ycmVsYXRpb24gSUQ6IG51bGwsIENhbGwgU3RhY2s6IG51bGwsIEN1c3RvbSBFdmVudCBJ
RDoNCiAtMSwgTWVzc2FnZTogVk0geHh4eHh4IGhhcyByZWNvdmVyZWQgZnJvbSBwYXVzZWQgYmFj
ayB0byB1cC48bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3Bh
biBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9t
YW4mcXVvdDssc2VyaWYiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJN
c29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90
O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+Ly8vLy8vLy8vLy8vLy8vPG86cD48L286cD48
L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTox
Mi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj48bzpw
PiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHls
ZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVv
dDssc2VyaWYiPkhvc3RuYW1lcyBhcmUgYWxsIGxvY2FsIHRvIC9ldGMvaG9zdHMgb24gYWxsIHNl
cnZlcnMg4oCTIHRoZXkgYWxzbyByZXNvbHZlIHdpdGhvdXQgaXNzdWUgZnJvbSBlYWNoIGhvc3Qu
PG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9
ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7
LHNlcmlmIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBO
ZXcgUm9tYW4mcXVvdDssc2VyaWYiPi8vLy8vLy8vLy8vLy8vPG86cD48L286cD48L3NwYW4+PC9w
Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9u
dC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj48bzpwPiZuYnNwOzwv
bzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1z
aXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYi
PjIwMTYtMDYtMjMgMjI6MDg6NTksNjExIFdBUk4mbmJzcDsgW29yZy5vdmlydC5lbmdpbmUuY29y
ZS52ZHNicm9rZXIuZ2x1c3Rlci5HbHVzdGVyVm9sdW1lc0xpc3RSZXR1cm5Gb3JYbWxScGNdIChE
ZWZhdWx0UXVhcnR6U2NoZWR1bGVyX1dvcmtlci03NikgWzFjMWNmNGZdIENvdWxkIG5vdCBhc3Nv
Y2lhdGUNCiBicmljayAnb3ZpcnQzNDM1Oi9tbnQvZGF0YS9zci12b2x1bWUwMScgb2Ygdm9sdW1l
ICc5M2UzNmNkYy1hYjFiLTQxZWMtYWM3Zi05NjZjZjM4NTZiNTknIHdpdGggY29ycmVjdCBuZXR3
b3JrIGFzIG5vIGdsdXN0ZXIgbmV0d29yayBmb3VuZCBpbiBjbHVzdGVyICc3NWJkNjRkZS0wNGIy
LTRhOTktOWNkMC1iNjNlOTE5YjlhY2EnPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9
Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1
b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj4yMDE2LTA2LTIzIDIyOjA4OjU5LDYxNCBX
QVJOJm5ic3A7IFtvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3Rl
clZvbHVtZXNMaXN0UmV0dXJuRm9yWG1sUnBjXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3Jr
ZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBub3QgYXNzb2NpYXRlDQogYnJpY2sgJ292aXJ0MzYzNzov
bW50L2RhdGEvc3Itdm9sdW1lMDEnIG9mIHZvbHVtZSAnOTNlMzZjZGMtYWIxYi00MWVjLWFjN2Yt
OTY2Y2YzODU2YjU5JyB3aXRoIGNvcnJlY3QgbmV0d29yayBhcyBubyBnbHVzdGVyIG5ldHdvcmsg
Zm91bmQgaW4gY2x1c3RlciAnNzViZDY0ZGUtMDRiMi00YTk5LTljZDAtYjYzZTkxOWI5YWNhJzxv
OnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJm
b250LXNpemU6MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90Oyxz
ZXJpZiI+MjAxNi0wNi0yMyAyMjowODo1OSw2MTYgV0FSTiZuYnNwOyBbb3JnLm92aXJ0LmVuZ2lu
ZS5jb3JlLnZkc2Jyb2tlci5nbHVzdGVyLkdsdXN0ZXJWb2x1bWVzTGlzdFJldHVybkZvclhtbFJw
Y10gKERlZmF1bHRRdWFydHpTY2hlZHVsZXJfV29ya2VyLTc2KSBbMWMxY2Y0Zl0gQ291bGQgbm90
IGFzc29jaWF0ZQ0KIGJyaWNrICdvdmlydDM4Mzk6L21udC9kYXRhL3NyLXZvbHVtZTAxJyBvZiB2
b2x1bWUgJzkzZTM2Y2RjLWFiMWItNDFlYy1hYzdmLTk2NmNmMzg1NmI1OScgd2l0aCBjb3JyZWN0
IG5ldHdvcmsgYXMgbm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRl
LTA0YjItNGE5OS05Y2QwLWI2M2U5MTliOWFjYSc8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBj
bGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWls
eTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPjIwMTYtMDYtMjMgMjI6MDg6NTks
NjE4IFdBUk4mbmJzcDsgW29yZy5vdmlydC5lbmdpbmUuY29yZS52ZHNicm9rZXIuZ2x1c3Rlci5H
bHVzdGVyVm9sdW1lc0xpc3RSZXR1cm5Gb3JYbWxScGNdIChEZWZhdWx0UXVhcnR6U2NoZWR1bGVy
X1dvcmtlci03NikgWzFjMWNmNGZdIENvdWxkIG5vdCBhc3NvY2lhdGUNCiBicmljayAnb3ZpcnQz
NDM1Oi9tbnQvZGF0YS9kaXN0cmlidXRlZCcgb2Ygdm9sdW1lICdiODg3YjA1ZS0yZWE2LTQ5NmUt
OTU1Mi0xNTVkNjU4ZWVhYTYnIHdpdGggY29ycmVjdCBuZXR3b3JrIGFzIG5vIGdsdXN0ZXIgbmV0
d29yayBmb3VuZCBpbiBjbHVzdGVyICc3NWJkNjRkZS0wNGIyLTRhOTktOWNkMC1iNjNlOTE5Yjlh
Y2EnPG86cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1
b3Q7LHNlcmlmIj4yMDE2LTA2LTIzIDIyOjA4OjU5LDYyMCBXQVJOJm5ic3A7IFtvcmcub3ZpcnQu
ZW5naW5lLmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9y
WG1sUnBjXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3Vs
ZCBub3QgYXNzb2NpYXRlDQogYnJpY2sgJ292aXJ0MzYzNzovbW50L2RhdGEvZGlzdHJpYnV0ZWQn
IG9mIHZvbHVtZSAnYjg4N2IwNWUtMmVhNi00OTZlLTk1NTItMTU1ZDY1OGVlYWE2JyB3aXRoIGNv
cnJlY3QgbmV0d29yayBhcyBubyBnbHVzdGVyIG5ldHdvcmsgZm91bmQgaW4gY2x1c3RlciAnNzVi
ZDY0ZGUtMDRiMi00YTk5LTljZDAtYjYzZTkxOWI5YWNhJzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4N
CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0O2ZvbnQt
ZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+MjAxNi0wNi0yMyAyMjow
ODo1OSw2MjIgV0FSTiZuYnNwOyBbb3JnLm92aXJ0LmVuZ2luZS5jb3JlLnZkc2Jyb2tlci5nbHVz
dGVyLkdsdXN0ZXJWb2x1bWVzTGlzdFJldHVybkZvclhtbFJwY10gKERlZmF1bHRRdWFydHpTY2hl
ZHVsZXJfV29ya2VyLTc2KSBbMWMxY2Y0Zl0gQ291bGQgbm90IGFzc29jaWF0ZQ0KIGJyaWNrICdv
dmlydDM4Mzk6L21udC9kYXRhL2Rpc3RyaWJ1dGVkJyBvZiB2b2x1bWUgJ2I4ODdiMDVlLTJlYTYt
NDk2ZS05NTUyLTE1NWQ2NThlZWFhNicgd2l0aCBjb3JyZWN0IG5ldHdvcmsgYXMgbm8gZ2x1c3Rl
ciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5OS05Y2QwLWI2M2U5
MTliOWFjYSc8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3Bh
biBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9t
YW4mcXVvdDssc2VyaWYiPjIwMTYtMDYtMjMgMjI6MDg6NTksNjI0IFdBUk4mbmJzcDsgW29yZy5v
dmlydC5lbmdpbmUuY29yZS52ZHNicm9rZXIuZ2x1c3Rlci5HbHVzdGVyVm9sdW1lc0xpc3RSZXR1
cm5Gb3JYbWxScGNdIChEZWZhdWx0UXVhcnR6U2NoZWR1bGVyX1dvcmtlci03NikgWzFjMWNmNGZd
IENvdWxkIG5vdCBhc3NvY2lhdGUNCiBicmljayAnb3ZpcnQzNDM1Oi9tbnQvZGF0YS9pc28nIG9m
IHZvbHVtZSAnODlmMzI0NTctYzhjMy00OTBlLWI0OTEtMTZkZDI3ZGUwMDczJyB3aXRoIGNvcnJl
Y3QgbmV0d29yayBhcyBubyBnbHVzdGVyIG5ldHdvcmsgZm91bmQgaW4gY2x1c3RlciAnNzViZDY0
ZGUtMDRiMi00YTk5LTljZDAtYjYzZTkxOWI5YWNhJzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxw
IGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0O2ZvbnQtZmFt
aWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+MjAxNi0wNi0yMyAyMjowODo1
OSw2MjYgV0FSTiZuYnNwOyBbb3JnLm92aXJ0LmVuZ2luZS5jb3JlLnZkc2Jyb2tlci5nbHVzdGVy
LkdsdXN0ZXJWb2x1bWVzTGlzdFJldHVybkZvclhtbFJwY10gKERlZmF1bHRRdWFydHpTY2hlZHVs
ZXJfV29ya2VyLTc2KSBbMWMxY2Y0Zl0gQ291bGQgbm90IGFzc29jaWF0ZQ0KIGJyaWNrICdvdmly
dDM2Mzc6L21udC9kYXRhL2lzbycgb2Ygdm9sdW1lICc4OWYzMjQ1Ny1jOGMzLTQ5MGUtYjQ5MS0x
NmRkMjdkZTAwNzMnIHdpdGggY29ycmVjdCBuZXR3b3JrIGFzIG5vIGdsdXN0ZXIgbmV0d29yayBm
b3VuZCBpbiBjbHVzdGVyICc3NWJkNjRkZS0wNGIyLTRhOTktOWNkMC1iNjNlOTE5YjlhY2EnPG86
cD48L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZv
bnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNl
cmlmIj4yMDE2LTA2LTIzIDIyOjA4OjU5LDYyOCBXQVJOJm5ic3A7IFtvcmcub3ZpcnQuZW5naW5l
LmNvcmUudmRzYnJva2VyLmdsdXN0ZXIuR2x1c3RlclZvbHVtZXNMaXN0UmV0dXJuRm9yWG1sUnBj
XSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsxYzFjZjRmXSBDb3VsZCBub3Qg
YXNzb2NpYXRlDQogYnJpY2sgJ292aXJ0MzgzOTovbW50L2RhdGEvaXNvJyBvZiB2b2x1bWUgJzg5
ZjMyNDU3LWM4YzMtNDkwZS1iNDkxLTE2ZGQyN2RlMDA3Mycgd2l0aCBjb3JyZWN0IG5ldHdvcmsg
YXMgbm8gZ2x1c3RlciBuZXR3b3JrIGZvdW5kIGluIGNsdXN0ZXIgJzc1YmQ2NGRlLTA0YjItNGE5
OS05Y2QwLWI2M2U5MTliOWFjYSc8bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNv
Tm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEyLjBwdDtmb250LWZhbWlseTomcXVvdDtU
aW1lcyBOZXcgUm9tYW4mcXVvdDssc2VyaWYiPjIwMTYtMDYtMjMgMjI6MDg6NTksNjI5IElORk8m
bmJzcDsgW29yZy5vdmlydC5lbmdpbmUuY29yZS52ZHNicm9rZXIuZ2x1c3Rlci5HbHVzdGVyVm9s
dW1lc0xpc3RWRFNDb21tYW5kXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcl9Xb3JrZXItNzYpIFsx
YzFjZjRmXSBGSU5JU0gsIEdsdXN0ZXJWb2x1bWVzTGlzdFZEU0NvbW1hbmQsDQogcmV0dXJuOiB7
Yjg4N2IwNWUtMmVhNi00OTZlLTk1NTItMTU1ZDY1OGVlYWE2PW9yZy5vdmlydC5lbmdpbmUuY29y
ZS5jb21tb24uYnVzaW5lc3NlbnRpdGllcy5nbHVzdGVyLkdsdXN0ZXJWb2x1bWVFbnRpdHlAZDhj
OTAzOWIsIDkzZTM2Y2RjLWFiMWItNDFlYy1hYzdmLTk2NmNmMzg1NmI1OT1vcmcub3ZpcnQuZW5n
aW5lLmNvcmUuY29tbW9uLmJ1c2luZXNzZW50aXRpZXMuZ2x1c3Rlci5HbHVzdGVyVm9sdW1lRW50
aXR5QGZlNWFiMDE5LCA4OWYzMjQ1Ny1jOGMzLTQ5MGUtYjQ5MS0xNmRkMjdkZTAwNzM9b3JnLm92
aXJ0LmVuZ2luZS5jb3JlLmNvbW1vbi5idXNpbmVzc2VudGl0aWVzLmdsdXN0ZXIuR2x1c3RlclZv
bHVtZUVudGl0eUA5YTU2ZDYzM30sDQogbG9nIGlkOiA0ODVhMDYxMTxvOnA+PC9vOnA+PC9zcGFu
PjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0
O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBSb21hbiZxdW90OyxzZXJpZiI+MjAxNi0wNi0y
MyAyMjowOTowNCw2NDUgSU5GTyZuYnNwOyBbb3JnLm92aXJ0LmVuZ2luZS5jb3JlLnZkc2Jyb2tl
ci5nbHVzdGVyLkdsdXN0ZXJWb2x1bWVzTGlzdFZEU0NvbW1hbmRdIChEZWZhdWx0UXVhcnR6U2No
ZWR1bGVyX1dvcmtlci04OSkgW10gU1RBUlQsIEdsdXN0ZXJWb2x1bWVzTGlzdFZEU0NvbW1hbmQo
SG9zdE5hbWUNCiA9IG92aXJ0MzgzOSwgR2x1c3RlclZvbHVtZXNMaXN0VkRTUGFyYW1ldGVyczp7
cnVuQXN5bmM9J3RydWUnLCBob3N0SWQ9JzMyYzUwMGU1LTI2OGQtNDI2YS05YTRhLTEwODUzNWU2
NzcyMid9KSwgbG9nIGlkOiA0MWI2NDc5ZDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjwvZGl2Pg0K
PC9ib2R5Pg0KPC9odG1sPg0K
--_000_CO2PR0801MB0743180FC142ED11D7D5D3E0A62E0CO2PR0801MB0743_--
8 years, 5 months
oVirt 3.6 to 4.0 Upgrade
by Brett I. Holcomb
In order to not hijack another thread I wanted to separate this from the
"latest CentOS libvirt updates safe?" thread since this is different
than what the OP on that thread wants to do.
I've been digging through the 4.0 documentation since I'd like to
upgrade in the not to distant future so I'm doing research and I'm confused.
I'm running 3.6.6 in a hosted Engine environment. My engine runs in a
vm on the host. The host is a physical box and the VMs are stored on a
NAS accessed by an iSCSI LUN, I have no other hosts running so I can
not migrate.
According to this link, https://www.ovirt.org/release/4.0.0/, I'm told
to simply run yum update ovirt-engine-setup and then engine-setup but I
assume that's for a non hosted-engine environment. I then go to the
link for Hosted_Engine_HOwto#Upgrade_Hosted_Engine guide and am told to
do this.
Set hosted-engine maintenance mode to global and other stuff that is
written assuming I have some place to migrate my VMs to. I do not have
another host.
So how do I properly move to oVirt 4.0 from 3.6.6 on a single physical
host running a hosted Engine VM?
Thanks.
8 years, 5 months
Maintenance and hosted engine issue with Ovirt 4.0
by Bertrand Caplet
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--3h4m2hcgdjFHtq8mNeaCD5hu0pIJG26iX
Content-Type: multipart/mixed; boundary="GFM2vDbBGUeA0wNJT7d6kjCp8ADn59Dsq"
From: Bertrand Caplet <bertrand.caplet(a)chunkz.net>
To: users <users(a)ovirt.org>
Message-ID: <4e5a6b1b-4360-2582-190f-d9d96fac3b2c(a)chunkz.net>
Subject: Maintenance and hosted engine issue with Ovirt 4.0
--GFM2vDbBGUeA0wNJT7d6kjCp8ADn59Dsq
Content-Type: multipart/alternative;
boundary="------------C3B1797A5CA6C32E68FD0BE3"
This is a multi-part message in MIME format.
--------------C3B1797A5CA6C32E68FD0BE3
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hi there,
I have hosted engine configured in my infrastructure and I just upgraded
from Ovirt 3.6 to Ovirt 4.0 yesterday.
Upgrade of hosted engine and my 2 nodes did ok. But now when I put one
node in maintenance, it prepares for maintenance ; unset SPM if it was
then migrate all the VMs to the another node. All of this steps are ok
but VM stays locked and in migration mode like this :
=2E Btw for the hosted engine I did migrate it manually.
So all the others VMs are stuck locked and in migration mode.
I did noticed every 10 minutes or so (pretty random), the
ovirt-hosted-engine HA is sending mail in this order :
1. EngineUnexpectedlyDown
2. (StartState-ReinitializeFSM sometimes)
3. EngineDown-EngineStart
4. EngineStart-EngineStarting
5. EngineStarting-EngineUnexpectedlyDown
6. Repeat
The hosted engine is pingable all this long, the web UI is reacheable
all this long too.
Anyone having this type of issues ? Do I open a bug on BugZilla ?
Thanks in advance,
Regards,
--=20
CHUNKZ.NET - script kiddie and computer technician
Bertrand Caplet, Flers (FR)
Feel free to send encrypted/signed messages
Key ID: 6E494EB9
GPG FP: CB1B 664A 9165 98F8 459F 0807 CA35 B76F 6E49 4EB9
--------------C3B1797A5CA6C32E68FD0BE3
Content-Type: multipart/related;
boundary="------------DF0929E39F7F44B41DB6C2AC"
--------------DF0929E39F7F44B41DB6C2AC
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"content-type" content=3D"text/html; charset=3Dutf=
-8">
</head>
<body bgcolor=3D"#FFFFFF" text=3D"#000000">
<p>Hi there,<br>
I have hosted engine configured in my infrastructure and I just
upgraded from Ovirt 3.6 to Ovirt 4.0 yesterday.</p>
<p>Upgrade of hosted engine and my 2 nodes did ok. But now when I
put one node in maintenance, it prepares for maintenance ; unset
SPM if it was then migrate all the VMs to the another node. All of
this steps are ok but VM stays locked and in migration mode like
this :<br>
<img src=3D"cid:part1.10023D7D.B57AAA47@chunkz.net" alt=3D"">. Btw =
for
the hosted engine I did migrate it manually.</p>
<p>So all the others VMs are stuck locked and in migration mode. <br>=
I did noticed every 10 minutes or so (pretty random), the
ovirt-hosted-engine HA is sending mail in this order :</p>
<ol>
<li>EngineUnexpectedlyDown</li>
<li>(StartState-ReinitializeFSM sometimes)<br>
</li>
<li>EngineDown-EngineStart</li>
<li>EngineStart-EngineStarting</li>
<li>EngineStarting-EngineUnexpectedlyDown</li>
<li>Repeat</li>
</ol>
<p>The hosted engine is pingable all this long, the web UI is
reacheable all this long too.</p>
<p>Anyone having this type of issues ? Do I open a bug on BugZilla ?<=
br>
Thanks in advance,<br>
Regards,</p>
<pre class=3D"moz-signature" cols=3D"72">--=20
CHUNKZ.NET - script kiddie and computer technician
Bertrand Caplet, Flers (FR)
Feel free to send encrypted/signed messages
Key ID: 6E494EB9
GPG FP: CB1B 664A 9165 98F8 459F 0807 CA35 B76F 6E49 4EB9</pre>
</body>
</html>
--------------DF0929E39F7F44B41DB6C2AC
Content-Type: image/png;
name="fommfmefonkedboc.png"
Content-Transfer-Encoding: base64
Content-ID: <part1.10023D7D.B57AAA47(a)chunkz.net>
Content-Disposition: inline;
filename="fommfmefonkedboc.png"
iVBORw0KGgoAAAANSUhEUgAAABYAAAAUCAIAAAAGHlpnAAAC20lEQVQ4jbWUz08TQRTH38mb
JzXeTLz4JxiTRhOKeIda4tXLHk16QDhZAnJgS0sCCmmUAgYVEgXa0FJrQ+svaLu0lN8trFBK
+SFCpd0tszO73fFQKEJq1BBf3mFmvpnPe3kz74GA5DM6/C/EQjwV4GJchI/zW6ek5EY6wMVC
4djC0vpvEYvLqckoj7Aq5NSp6cT0/EpR2vwmcBH+AKvZnBqdXYnO8iUQiaQQisxjQrGMMrJM
ZfreFS5I8cT6eHgDE4rzNCchkqejnokSiBCXQjKVCM1kcxlJJRh//jRpt3vbW2wD/S4xT7BC
0xkxeyAhon74MlMCEQitZw/yRKEYqyJSM1nVPRZpsfSpkmq2tA47AzlJzSEVK3Q/q7g9oRKI
8eDq4tJ2OLKKiTo85Gsyd9SbX5jaXyH5AMu0ucX2euAdJnRzW/y68mPMP30CYevptfX0mi2d
27uYm1xJpXZaLc+kfF5WqYiwolBCiCJTk7krufF9PSXE4mmvL3qMaGhoZI6s8fHj9L6SFeT+
t05zc3cn221hn0uUYklpY1++sfszIl7mdyNTG24Pd4iw9fQWLnu8vsLiyVMrJnSO3xn3J1xD
wfqO3oF496O2Lsegb35pD+fpMr/n88Wc7qMXqa2tYximkI53bI5hmIe1dZgoM/GMw8Etb21V
tOvAdON63Z3tXXFfUBAhc/ObTtcUv7p3iChELhalsEWE2p0LybXERbcGpGpAVecl3f2+B4Ho
qqTIg66PS2u7x7+TKWXDjkByLXHBowGkA3QXUDWgqkuivmnCNOKYSibXTvQIwzA1NTUsy1qt
VqvVyrJsIakroxqQ7oGoA6ESkB5QNSAdCPprI5rTbVZEMAxTRFy1awBVAdJBTg85HSAdiJWH
J0h/zn/rzwiIlENQC5FyCJcDpwVOC0EtBMsgWAHBMgjdvjx68wTCYDAYjUaDwcCyrNFo/LW6
fzUvSpbzrCPnn/wniysT9kzcu9gAAAAASUVORK5CYII=
--------------DF0929E39F7F44B41DB6C2AC--
--------------C3B1797A5CA6C32E68FD0BE3--
--GFM2vDbBGUeA0wNJT7d6kjCp8ADn59Dsq--
--3h4m2hcgdjFHtq8mNeaCD5hu0pIJG26iX
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
iQEcBAEBCAAGBQJXb/IoAAoJEMo1t29uSU65+RAIAL8pHJrSmvNoYJfJ1LRZ3um1
frq6pP+9ChcSE+eBl+Cvb2T1wB1cJiuxrmKqrVnh1wN9CSwc8mVJe77aPhyY8exg
5pqRXmzh0t8A+hQ0KvARZso++CkcgXx24EiZysM8KLQWfILkV22Sf/0XystdMFZd
eTet81/9WA7IQNcGYR4Lp/Tz8b9QiBm0Z9zoRVRQN4GTzUm9MWm7utubDkDYtiJf
oIKKAP0c8ll7YJ27KhUfQ/XiNH988TPx1V4P8SzADMnq31T9wXS8/YrmNV5o3roJ
p6sDOtpmtSEas2rj8JT+4dbSxMQb5puYTGL17wxKNwbGnxaS2CGI9V7c9vu+WyU=
=1BC8
-----END PGP SIGNATURE-----
--3h4m2hcgdjFHtq8mNeaCD5hu0pIJG26iX--
8 years, 6 months
oVirt 4.0 Host install fail cause of dnf api
by Pilař Vojtěch
--_000_c9bbad56edaa4f53be9de7805b8be891EX13nconzolocal_
Content-Type: text/plain; charset="iso-8859-2"
Content-Transfer-Encoding: quoted-printable
Hi all,
iam trying to install host from oVirt Engine Web Admin, but with no success=
so far. Everything dies on sigCheckPkg bug from dnf (https://bugzilla.redh=
at.com/show_bug.cgi?id=3D1344270).
2016-06-25 19:36:22 INFO otopi.plugins.otopi.packagers.dnfpackager dnfpacka=
ger.info:79 DNF Downloaded libselinux-python-2.4-4.fc23.x86_64.rpm
The 'sigCheckPkg' function is not a part of DNF API and will be removed in =
the upcoming DNF release. Please use only officially supported API function=
s. DNF API documentation is available at https://dnf.readthedocs.org/en/lat=
est/api.html.
2016-06-25 19:36:22 ERROR otopi.plugins.otopi.packagers.dnfpackager dnfpack=
ager.error:84 DNF 'NoneType' object is not iterable
2016-06-25 19:36:22 DEBUG otopi.plugins.otopi.packagers.dnfpackager dnfpack=
ager.verbose:75 DNF Closing transaction with rollback
Is there any workaround? I see no way to deploy hosts.
(Fedora 23, oVirt 4.0)
Thank you for help
--_000_c9bbad56edaa4f53be9de7805b8be891EX13nconzolocal_
Content-Type: text/html; charset="iso-8859-2"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-=
2">
<style type=3D"text/css" style=3D"display:none"><!--P{margin-top:0;margin-b=
ottom:0;} .ms-cui-menu {background-color:#ffffff;border:1px rgb(171, 171, 1=
71) solid;font-family:"Segoe UI WPC","Segoe UI",Tahoma,"Microsoft Sans Seri=
f",Verdana,sans-serif;font-size:10pt;color:rgb(51, 51, 51);} .ms-cui-menuse=
ction-title {display:none;} .ms-cui-ctl {vertical-align:text-top;text-decor=
ation:none;color:rgb(51, 51, 51);} .ms-cui-ctl-on {background-color:rgb(223=
, 237, 250);opacity: 0.8;} .ms-cui-img-cont-float {display:inline-block;mar=
gin-top:2px} .ms-cui-smenu-inner {padding-top:0px;} .ms-owa-paste-option-ic=
on {margin: 2px 4px 0px 4px;vertical-align:sub;padding-bottom: 2px;display:=
inline-block;} .ms-rtePasteFlyout-option:hover {background-color:rgb(223, 2=
37, 250) !important;opacity:1 !important;} .ms-rtePasteFlyout-option {paddi=
ng:8px 4px 8px 4px;outline:none;} .ms-cui-menusection {float:left; width:85=
px;height:24px;overflow:hidden}--></style>
</head>
<body>
<div style=3D"font-size:12pt;color:#000000;background-color:#FFFFFF;font-fa=
mily:Calibri,Arial,Helvetica,sans-serif;">
<p><br>
</p>
<p>Hi all,<br>
<br>
iam trying to install host from oVirt Engine Web Admin, but with no success=
so far. Everything dies on sigCheckPkg bug from dnf (https://bugzilla.redh=
at.com/show_bug.cgi?id=3D1344270).<br>
<br>
<span style=3D"font-size: 10pt;">2016-06-25 19:36:22 INFO otopi.plugins.oto=
pi.packagers.dnfpackager dnfpackager.info:79 DNF Downloaded libselinux-pyth=
on-2.4-4.fc23.x86_64.rpm</span><br style=3D"font-size: 10pt;">
<span style=3D"font-size: 10pt;">The 'sigCheckPkg' function is not a part o=
f DNF API and will be removed in the upcoming DNF release. Please use only =
officially supported API functions. DNF API documentation is available at h=
ttps://dnf.readthedocs.org/en/latest/api.html.</span><br style=3D"font-size=
: 10pt;">
<span style=3D"font-size: 10pt;">2016-06-25 19:36:22 ERROR otopi.plugins.ot=
opi.packagers.dnfpackager dnfpackager.error:84 DNF 'NoneType' object is not=
iterable</span><br style=3D"font-size: 10pt;">
<span style=3D"font-size: 10pt;">2016-06-25 19:36:22 DEBUG otopi.plugins.ot=
opi.packagers.dnfpackager dnfpackager.verbose:75 DNF Closing transaction wi=
th rollback</span><br>
<br>
Is there any workaround? I see no way to deploy hosts.<br>
<br>
(Fedora 23, oVirt 4.0)<br>
<br>
Thank you for help<br>
</p>
</div>
</body>
</html>
--_000_c9bbad56edaa4f53be9de7805b8be891EX13nconzolocal_--
8 years, 6 months
oVirt/RHEV and HP Blades and HP iSCSI SAN
by Colin Coe
Hi all
We run four RHEV datacenters, two PROD, one DEV and one TEST/Training.
They are all working OK but I'd like a definitive answer on how I should
be configuring the networking side as I'm pretty sure we're getting
sub-optimal networking performance.
All datacenters are housed in HP C7000 Blade enclosures. The PROD
datacenters use HP 4730 iSCSI SAN clusters, each datacenter has a cluster
of two 4730s. These are configured RAID5 internally with NRAID1. The DEV
and TEST datacenters are using P4500 iSCSI SANs and each datacenter has a
cluster of three P4500s configured with RAID10 internally and NRAID5.
The HP C7000 each have two Flex10/10D interconnect modules configured in a
redundant ring so that we can upgrade the interconnects without dropping
network connectivity to the infrastructure. We use fat RHEL-H 7.2
hypervisors (HP BL460) and these are all configured with six network
interfaces:
- eno1 and eno2 are bond0 which is the rhevm interface
- eno3 and eno4 are bond1 and all the VM VLANs are trunked over this bond
using 802.1q
- eno5 and eno6 are bond2 and dedicated to iSCSI traffic
Is this the "correct" way to do this? If not, what should I be doing
instead?
Thanks
CC
8 years, 6 months
Ovirt 4.0 Engine Setup Failure
by Melissa Mesler
I am doing a clean install of Ovirt 4.0. Upon executing engine-setup
with all default values, it fails. This is the error during setup:
[ ERROR ] Failed to execute stage 'Misc configuration': Command
'/usr/bin/ovirt-aaa-jdbc-tool' failed to execute
Any ideas?
8 years, 6 months
Error mounting hosted engine Volume (Glusterfs) via VDSM
by Ralf Schenk
This is a multi-part message in MIME format.
--------------490BE4DF07D0809CD094F385
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Hello,
I think options for mounting the hosted-engine Volume changed in latest
vdsm to support mounting from backup-volfile-servers.
[root@microcloud28 ~]# rpm -qi vdsm
Name : vdsm
Version : 4.17.28
Release : 1.el7
Architecture: noarch
Install Date: Fri 10 Jun 2016 11:17:37 AM CEST
Group : Applications/System
Size : 3828639
License : GPLv2+
Signature : RSA/SHA1, Fri 03 Jun 2016 12:53:20 AM CEST, Key ID
7aebbe8261e8806c
Source RPM : vdsm-4.17.28-1.el7.src.rpm
Now my hosts have problems to mount the Volume. On hosted-engine setup I
configured the (Replica 3) volume to be
"glusterfs.rxmgmt.databay.de:/engine" which ist a Round-Robin DNS to my
gluster hosts and _not_ the DNS-Name of any gluster-brick.
Now VDSM logs:
jsonrpc.Executor/3::DEBUG::2016-06-25
19:40:02,520::fileUtils::143::Storage.fileUtils::(createdir) Cre
ating directory:
/rhev/data-center/mnt/glusterSD/glusterfs.rxmgmt.databay.de:_engine
mode: None
jsonrpc.Executor/3::DEBUG::2016-06-25
19:40:02,520::storageServer::364::Storage.StorageServer.MountCon
nection::(_get_backup_servers_option) Using bricks:
['microcloud21.rxmgmt.databay.de', 'microcloud24.r
xmgmt.databay.de', 'microcloud27.rxmgmt.databay.de']
jsonrpc.Executor/3::WARNING::2016-06-25
19:40:02,520::storageServer::370::Storage.StorageServer.MountC
onnection::(_get_backup_servers_option) gluster server
u'glusterfs.rxmgmt.databay.de' is not in bricks
['microcloud21.rxmgmt.databay.de', 'microcloud24.rxmgmt.databay.de',
'microcloud27.rxmgmt.databay.de'
], possibly mounting duplicate servers
jsonrpc.Executor/3::DEBUG::2016-06-25
19:40:02,520::mount::229::Storage.Misc.excCmd::(_runcmd) /usr/bi
n/taskset --cpu-list 0-7 /usr/bin/sudo -n /usr/bin/systemd-run --scope
--slice=3Dvdsm-glusterfs /usr/bin
/mount -o
backup-volfile-servers=3Dmicrocloud21.rxmgmt.databay.de:microcloud24.rxmg=
mt.databay.de:microcl
oud27.rxmgmt.databay.de glusterfs.rxmgmt.databay.de:/engine
/rhev/data-center/mnt/glusterSD/glusterfs.
rxmgmt.databay.de:_engine (cwd None)
jsonrpc.Executor/3::ERROR::2016-06-25
19:40:02,540::hsm::2473::Storage.HSM::(connectStorageServer) Cou
ld not connect to storageServer
Traceback (most recent call last):
File "/usr/share/vdsm/storage/hsm.py", line 2470, in connectStorageServ=
er
conObj.connect()
File "/usr/share/vdsm/storage/storageServer.py", line 237, in connect
six.reraise(t, v, tb)
File "/usr/share/vdsm/storage/storageServer.py", line 229, in connect
self._mount.mount(self.options, self._vfsType, cgroup=3Dself.CGROUP)
File "/usr/share/vdsm/storage/mount.py", line 225, in mount
return self._runcmd(cmd, timeout)
File "/usr/share/vdsm/storage/mount.py", line 241, in _runcmd
raise MountError(rc, ";".join((out, err)))
MountError: (32, ';Running scope as unit run-13461.scope.\nmount.nfs: an
incorrect mount option was specified\n')
So the mount is tried as NFS which hasn't the option "-o
backup-volfile-servers=3D...".
As a consequence the host is disabled in engine. The only way to get it
up is mounting the volume manually to
/rhev/data-center/mnt/glusterSD/glusterfs.
rxmgmt.databay.de:_engine and activate it manually in Management-GUI.
Should and can I change the hosted_storage entry-point globally to i.e.
"microcloud21.rxmgmt.databay.de" or wouldn't it be better globally that
VDSM uses "-t glusterfs" to try to mount the gluster-Volume regardless
which DNS Name for the gluster-service is used ?
Ovirt is:
ovirt-release36.noarch 1:3.6.6-1
Bye
--=20
*Ralf Schenk*
fon +49 (0) 24 05 / 40 83 70
fax +49 (0) 24 05 / 40 83 759
mail *rs(a)databay.de* <mailto:rs@databay.de>
=09
*Databay AG*
Jens-Otto-Krag-Stra=C3=9Fe 11
D-52146 W=C3=BCrselen
*www.databay.de* <http://www.databay.de>
Sitz/Amtsgericht Aachen =E2=80=A2 HRB:8437 =E2=80=A2 USt-IdNr.: DE 210844=
202
Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm.
Philipp Hermanns
Aufsichtsratsvorsitzender: Klaus Scholzen (RA)
------------------------------------------------------------------------
--------------490BE4DF07D0809CD094F385
Content-Type: multipart/related;
boundary="------------9EB1620A3DC18A1D6499F226"
--------------9EB1620A3DC18A1D6499F226
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Hello,</p>
<p>I think options for mounting the hosted-engine Volume changed in
latest vdsm to support mounting from backup-volfile-servers.</p>
<p><tt>[root@microcloud28 ~]# rpm -qi vdsm</tt><tt><br>
</tt><tt>Name : vdsm</tt><tt><br>
</tt><tt>Version : 4.17.28</tt><tt><br>
</tt><tt>Release : 1.el7</tt><tt><br>
</tt><tt>Architecture: noarch</tt><tt><br>
</tt><tt>Install Date: Fri 10 Jun 2016 11:17:37 AM CEST</tt><tt><br>
</tt><tt>Group : Applications/System</tt><tt><br>
</tt><tt>Size : 3828639</tt><tt><br>
</tt><tt>License : GPLv2+</tt><tt><br>
</tt><tt>Signature : RSA/SHA1, Fri 03 Jun 2016 12:53:20 AM CEST,
Key ID 7aebbe8261e8806c</tt><tt><br>
</tt><tt>Source RPM : vdsm-4.17.28-1.el7.src.rpm</tt><tt><br>
</tt></p>
<p>Now my hosts have problems to mount the Volume. On hosted-engine
setup I configured the (Replica 3) volume to be
"glusterfs.rxmgmt.databay.de:/engine" which ist a Round-Robin DNS
to my gluster hosts and _not_ the DNS-Name of any gluster-brick.<br>
</p>
<p>Now VDSM logs:</p>
<p><tt>jsonrpc.Executor/3::DEBUG::2016-06-25
19:40:02,520::fileUtils::143::Storage.fileUtils::(createdir) Cre</tt><tt><br>
</tt><tt>ating directory:
/rhev/data-center/mnt/glusterSD/glusterfs.rxmgmt.databay.de:_engine
mode: None</tt><tt><br>
</tt><tt>jsonrpc.Executor/3::DEBUG::2016-06-25
19:40:02,520::storageServer::364::Storage.StorageServer.MountCon</tt><tt><br>
</tt><tt>nection::(_get_backup_servers_option) Using bricks:
['microcloud21.rxmgmt.databay.de', 'microcloud24.r</tt><tt><br>
</tt><tt>xmgmt.databay.de', 'microcloud27.rxmgmt.databay.de']</tt><tt><br>
</tt><tt>jsonrpc.Executor/3::WARNING::2016-06-25
19:40:02,520::storageServer::370::Storage.StorageServer.MountC</tt><tt><br>
</tt><tt>onnection::(_get_backup_servers_option) gluster server
u'glusterfs.rxmgmt.databay.de' is not in bricks</tt><tt><br>
</tt><tt> ['microcloud21.rxmgmt.databay.de',
'microcloud24.rxmgmt.databay.de',
'microcloud27.rxmgmt.databay.de'</tt><tt><br>
</tt><tt>], possibly mounting duplicate servers</tt><tt><br>
</tt><tt>jsonrpc.Executor/3::DEBUG::2016-06-25
19:40:02,520::mount::229::Storage.Misc.excCmd::(_runcmd) /usr/bi</tt><tt><br>
</tt><tt>n/taskset --cpu-list 0-7 /usr/bin/sudo -n
/usr/bin/systemd-run --scope --slice=vdsm-glusterfs /usr/bin</tt><tt><br>
</tt><tt>/mount -o
backup-volfile-servers=microcloud21.rxmgmt.databay.de:microcloud24.rxmgmt.databay.de:microcl</tt><tt><br>
</tt><tt>oud27.rxmgmt.databay.de
glusterfs.rxmgmt.databay.de:/engine
/rhev/data-center/mnt/glusterSD/glusterfs.</tt><tt><br>
</tt><tt>rxmgmt.databay.de:_engine (cwd None)</tt><tt><br>
</tt><tt>jsonrpc.Executor/3::ERROR::2016-06-25
19:40:02,540::hsm::2473::Storage.HSM::(connectStorageServer) Cou</tt><tt><br>
</tt><tt>ld not connect to storageServer</tt><tt><br>
</tt><tt>Traceback (most recent call last):</tt><tt><br>
</tt><tt> File "/usr/share/vdsm/storage/hsm.py", line 2470, in
connectStorageServer</tt><tt><br>
</tt><tt> conObj.connect()</tt><tt><br>
</tt><tt> File "/usr/share/vdsm/storage/storageServer.py", line
237, in connect</tt><tt><br>
</tt><tt> six.reraise(t, v, tb)</tt><tt><br>
</tt><tt> File "/usr/share/vdsm/storage/storageServer.py", line
229, in connect</tt><tt><br>
</tt><tt> self._mount.mount(self.options, self._vfsType,
cgroup=self.CGROUP)</tt><tt><br>
</tt><tt> File "/usr/share/vdsm/storage/mount.py", line 225, in
mount</tt><tt><br>
</tt><tt> return self._runcmd(cmd, timeout)</tt><tt><br>
</tt><tt> File "/usr/share/vdsm/storage/mount.py", line 241, in
_runcmd</tt><tt><br>
</tt><tt> raise MountError(rc, ";".join((out, err)))</tt><tt><br>
</tt><tt>MountError: (32, ';Running scope as unit
run-13461.scope.\nmount.nfs: an incorrect mount option was
specified\n')</tt><tt><br>
</tt></p>
<p>So the mount is tried as NFS which hasn't the option "-o
backup-volfile-servers=...".</p>
<p>As a consequence the host is disabled in engine. The only way to
get it up is mounting the volume manually to
/rhev/data-center/mnt/glusterSD/glusterfs.<br>
rxmgmt.databay.de:_engine and activate it manually in
Management-GUI.<br>
</p>
<p>Should and can I change the hosted_storage entry-point globally
to i.e. "microcloud21.rxmgmt.databay.de" or wouldn't it be better
globally that VDSM uses "-t glusterfs" to try to mount the
gluster-Volume regardless which DNS Name for the gluster-service
is used ?</p>
<p>Ovirt is:</p>
<p><tt>ovirt-release36.noarch 1:3.6.6-1</tt><br>
</p>
Bye<br>
<div class="moz-signature">-- <br>
<p>
</p>
<table border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td colspan="3"><img
src="cid:part1.2FE99626.D833EF80@databay.de" height="30"
border="0" width="151"></td>
</tr>
<tr>
<td valign="top"> <font face="Verdana, Arial, sans-serif"
size="-1"><br>
<b>Ralf Schenk</b><br>
fon +49 (0) 24 05 / 40 83 70<br>
fax +49 (0) 24 05 / 40 83 759<br>
mail <a href="mailto:rs@databay.de"><font
color="#FF0000"><b>rs(a)databay.de</b></font></a><br>
</font> </td>
<td width="30"> </td>
<td valign="top"> <font face="Verdana, Arial, sans-serif"
size="-1"><br>
<b>Databay AG</b><br>
Jens-Otto-Krag-Straße 11<br>
D-52146 Würselen<br>
<a href="http://www.databay.de"><font color="#FF0000"><b>www.databay.de</b></font></a>
</font> </td>
</tr>
<tr>
<td colspan="3" valign="top"> <font face="Verdana, Arial,
sans-serif" size="1"><br>
Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE
210844202<br>
Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch
Yavari, Dipl.-Kfm. Philipp Hermanns<br>
Aufsichtsratsvorsitzender: Klaus Scholzen (RA) </font>
</td>
</tr>
</tbody>
</table>
<hr color="#000000" noshade="noshade" size="1" width="100%">
</div>
</body>
</html>
--------------9EB1620A3DC18A1D6499F226
Content-Type: image/gif;
name="logo_databay_email.gif"
Content-Transfer-Encoding: base64
Content-ID: <part1.2FE99626.D833EF80(a)databay.de>
Content-Disposition: inline;
filename="logo_databay_email.gif"
R0lGODlhlwAeAMQAAObm5v9QVf/R0oKBgfDw8NfX105MTLi3t/r6+sfHx/+rrf98gC0sLP8L
EhIQEKalpf/g4ZmYmHd2dmppaf8uNP/y8v8cIv+Ym//AwkE/P46NjRwbG11cXP8ABwUDA///
/yH5BAAAAAAALAAAAACXAB4AAAX/4CeOYnUJZKqubOu+cCzPNA0tVnfVfO//wGAKk+t0Ap+K
QMFUYCDCqHRKJVUWDaPRUsFktZ1G4AKtms9o1gKsFVS+7I5ll67bpd647hPQawNld4KDMQJF
bA07F35aFBiEkJEpfXEBjx8KjI0Vkp2DEIdaCySgFBShbEgrCQOtrq+uEQcALQewrQUjEbe8
rgkkD7y5KhMZB3drqSoVFQhdlHGXKQYe1dbX2BvHKwzY1RMiAN7j1xEjBeTmKeIeD3cYCxRf
FigvChRxFJwkBBvk5A7cpZhAjgGCDwn+kfslgto4CSoSehh2BwEEBQvowDAUR0EKdArHZTg4
4oDCXBFC/3qj9SEluZEpHnjYQFIGgpo1KgSasYjNKBImrzF4NaFbNgIjCGRQeIyVKwneOLzS
cLCAg38OWI4Y4GECgQcSOEwYcADnh6/FNjAwoGFYAQ0atI4AAFeEFwsLFLiJUQEfGH0kNGAD
x8+oNQdIRQg+7NCaOhIgD8sVgYADNsPVGI5YWjRqzQTdHDDIYHRDLokaUhCglkFEJi0NKJhl
0RP2TsvXUg88KiLBVWsZrF6DmMKlNYMqglqTik1guN8OBgAgkGCpB+L9ugK4iSCBvwEfECw1
kILrBpa1jVCQIQBRvbP+rlEcQVAoSevWyv6uhpwE12uEkQAAZucpVw1xIsjkgf8B863mQVYt
eQATCZYJZJ5WBfij2wfpHcEeHGG8Z+BMszVWDXkfKLhceJhBSAJ+1ThH32AfRFZNayNAtUFi
wFSTSwEHJIYAAQU84IADwyjIEALU9MchG+vFgIF7W2GDI2T7HfjBgNcgKQKMHmwjgnCSpeCb
ULRkdxhF1CDY40RjgmUAA/v1J5FAKW2gGSZscBFDMraNgJs1AYpAAGYP5jJoNQ4Y4Gh8jpFg
HH9mgbmWo1l6oA4C3Ygp6UwEIFBfNRtkMIBlKMLnAXgAXLWhXXH85EIFqMhGGZgDEKArABGA
ed0HI4bk5qgnprCYSt88B6dqS0FEEAMPJDCdCJYViur/B1BlwGMJqDTwnhqxJgUpo0ceOQ4D
0yEakpMm/jqCRMgWm2I1j824Y6vLvuuPjHnqOJkIgP6xzwp5sCFNsCFp88Gxh11lrjfDcNrc
CEx64/CD3iAHlQcMUEQXvcA+qBkBB4Q2X1CusjBlJdKMYAKI6g28MbKN5hJsBAXknHOwutn4
oFYqkpqAzjnPbE0u1PxmwAQGXLWBbvhuIIEGEnRjlAHO4SvhbCNAkwoGzEBwgV9U0lfu2WiX
OkDEGaCdKgl0nk2YkWdPOCDabvaGdkAftL1LlgwCM+7Tq11V71IO7LkM2XE0YAHMYMhqqK6U
V165CpaHukLmiXFO8XSVzzakX+UH6TrmAajPNxfqByTQec41AeBPvSwIALkmAnuiexCsca3C
BajgfsROuxcPA8kHQJX4DAIwjnsAvhsvfXHWKEwDAljg7sj03L9wwAQTxOWD2AE0YP75eCkw
cPfs+xACADs=
--------------9EB1620A3DC18A1D6499F226--
--------------490BE4DF07D0809CD094F385--
8 years, 6 months
Setup new enviroment
by Andy Michielsen
Hello all,
I was just wondering what your opinions would be in setting up a new oVirt enviroment.
I have 4 old servers, 3 with 64 Gigs of ram and 2 tera's of disk space an one with 32 Gigs of ram and 1,2 Gb. Each has 2 hexcore cpu's. Each server has at least 2 nic's.
I would like to use each server in a seperate cluster with there own local storage as this would all only be used as a test enviroment but still would like to manage them from one interface. Deploy new vm's from templates etc.
Can I still use the all in one installation for engine and node ? Or can I install the engine on a seperate host, physical or virtual.
What would be a good way to use the network ?
Any advice would be greatly appriciated. Thanks in advance.
8 years, 6 months