Upgrade form 4.0.4 to 4.0.5: unable to run VM

Single host with self hosted engine. All seems ok after rebooting host and exiting local maintenance. But when I try to start a VM I get VM racclient1 is down with error. Exit message: Unable to get volume size for domain 556abaa8-0fcc-4042-963b-f27db5e03837 volume e0524893-1f78-4e6b-8e5e-83217bc0dc5b. I don't know if it is related, but even after this update I continue to get the SSL error in vdsmd service: [root@ractor ~]# systemctl status vdsmd -l ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/etc/systemd/system/vdsmd.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2016-11-15 14:32:17 CET; 7min ago Process: 2247 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 2336 (vdsm) CGroup: /system.slice/vdsmd.service ├─2336 /usr/bin/python /usr/share/vdsm/vdsm ├─2494 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 80 --max-threads 10 --max-queued-requests 10 ├─3588 /usr/libexec/ioprocess --read-pipe-fd 40 --write-pipe-fd 39 --max-threads 10 --max-queued-requests 10 ├─3601 /usr/libexec/ioprocess --read-pipe-fd 48 --write-pipe-fd 47 --max-threads 10 --max-queued-requests 10 ├─3609 /usr/libexec/ioprocess --read-pipe-fd 56 --write-pipe-fd 55 --max-threads 10 --max-queued-requests 10 ├─3616 /usr/libexec/ioprocess --read-pipe-fd 63 --write-pipe-fd 61 --max-threads 10 --max-queued-requests 10 └─3623 /usr/libexec/ioprocess --read-pipe-fd 73 --write-pipe-fd 71 --max-threads 10 --max-queued-requests 10 Nov 15 14:39:22 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:24 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:27 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:30 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:42 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:50 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:52 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:55 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof [root@ractor ~]# See initial posting thread here: http://lists.ovirt.org/pipermail/users/2016-July/041264.html and also my further updates here: http://lists.ovirt.org/pipermail/users/2016-October/043355.html Gianluca

On Tue, Nov 15, 2016 at 2:51 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
Single host with self hosted engine. All seems ok after rebooting host and exiting local maintenance. But when I try to start a VM I get
VM racclient1 is down with error. Exit message: Unable to get volume size for domain 556abaa8-0fcc-4042-963b-f27db5e03837 volume e0524893-1f78-4e6b-8e5e-83217bc0dc5b.
I don't know if it is related, but even after this update I continue to get the SSL error in vdsmd service:
[root@ractor ~]# systemctl status vdsmd -l ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/etc/systemd/system/vdsmd.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2016-11-15 14:32:17 CET; 7min ago Process: 2247 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 2336 (vdsm) CGroup: /system.slice/vdsmd.service ├─2336 /usr/bin/python /usr/share/vdsm/vdsm ├─2494 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 80 --max-threads 10 --max-queued-requests 10 ├─3588 /usr/libexec/ioprocess --read-pipe-fd 40 --write-pipe-fd 39 --max-threads 10 --max-queued-requests 10 ├─3601 /usr/libexec/ioprocess --read-pipe-fd 48 --write-pipe-fd 47 --max-threads 10 --max-queued-requests 10 ├─3609 /usr/libexec/ioprocess --read-pipe-fd 56 --write-pipe-fd 55 --max-threads 10 --max-queued-requests 10 ├─3616 /usr/libexec/ioprocess --read-pipe-fd 63 --write-pipe-fd 61 --max-threads 10 --max-queued-requests 10 └─3623 /usr/libexec/ioprocess --read-pipe-fd 73 --write-pipe-fd 71 --max-threads 10 --max-queued-requests 10
Nov 15 14:39:22 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:24 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:27 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:30 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:42 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:50 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:52 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:55 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof [root@ractor ~]#
See initial posting thread here:
http://lists.ovirt.org/pipermail/users/2016-July/041264.html
and also my further updates here: http://lists.ovirt.org/pipermail/users/2016-October/043355.html
Gianluca
After a couple of minutes it seems it resolved itself. This is the sequence of events I see in engine web admin: https://drive.google.com/file/d/0BwoPbcrMv8mvY3pJWWVYUVBVb1k/view?usp=sharin... Boot time was at 14:32 and from image it seems that on 14:39 all should have been already ok... but perhaps further settlement needed after first "Storage Pool Manager runs on ....." message? When I tried to start the VM all the storage domains resulted up in webadmin.... Gianluca

On Tue, Nov 15, 2016 at 3:04 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
On Tue, Nov 15, 2016 at 2:51 PM, Gianluca Cecchi < gianluca.cecchi@gmail.com> wrote:
Single host with self hosted engine. All seems ok after rebooting host and exiting local maintenance. But when I try to start a VM I get
VM racclient1 is down with error. Exit message: Unable to get volume size for domain 556abaa8-0fcc-4042-963b-f27db5e03837 volume e0524893-1f78-4e6b-8e5e-83217bc0dc5b.
I don't know if it is related, but even after this update I continue to get the SSL error in vdsmd service:
The SSL error is due to a bad handling of EOF on the underlying connection with M2Crypto library: https://bugzilla.redhat.com/show_bug.cgi?id=1383118 You see many of them since ovirt-ha-agent is opening and closing multiple connections: https://bugzilla.redhat.com/show_bug.cgi?id=1349829 A bit annoying but absolutely harmless.
[root@ractor ~]# systemctl status vdsmd -l ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/etc/systemd/system/vdsmd.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2016-11-15 14:32:17 CET; 7min ago Process: 2247 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 2336 (vdsm) CGroup: /system.slice/vdsmd.service ├─2336 /usr/bin/python /usr/share/vdsm/vdsm ├─2494 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 80 --max-threads 10 --max-queued-requests 10 ├─3588 /usr/libexec/ioprocess --read-pipe-fd 40 --write-pipe-fd 39 --max-threads 10 --max-queued-requests 10 ├─3601 /usr/libexec/ioprocess --read-pipe-fd 48 --write-pipe-fd 47 --max-threads 10 --max-queued-requests 10 ├─3609 /usr/libexec/ioprocess --read-pipe-fd 56 --write-pipe-fd 55 --max-threads 10 --max-queued-requests 10 ├─3616 /usr/libexec/ioprocess --read-pipe-fd 63 --write-pipe-fd 61 --max-threads 10 --max-queued-requests 10 └─3623 /usr/libexec/ioprocess --read-pipe-fd 73 --write-pipe-fd 71 --max-threads 10 --max-queued-requests 10
Nov 15 14:39:22 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:24 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:27 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:30 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:42 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:50 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:52 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:55 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof [root@ractor ~]#
See initial posting thread here:
http://lists.ovirt.org/pipermail/users/2016-July/041264.html
and also my further updates here: http://lists.ovirt.org/pipermail/users/2016-October/043355.html
Gianluca
After a couple of minutes it seems it resolved itself.
This is the sequence of events I see in engine web admin: https://drive.google.com/file/d/0BwoPbcrMv8mvY3pJWWVYUVBVb1k/ view?usp=sharing
Boot time was at 14:32 and from image it seems that on 14:39 all should have been already ok... but perhaps further settlement needed after first "Storage Pool Manager runs on ....." message? When I tried to start the VM all the storage domains resulted up in webadmin....
Are your NFS1 and ISO storage domain active now?
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

On Tue, Nov 15, 2016 at 4:39 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
Boot time was at 14:32 and from image it seems that on 14:39 all should have been already ok... but perhaps further settlement needed after first "Storage Pool Manager runs on ....." message? When I tried to start the VM all the storage domains resulted up in webadmin....
Are your NFS1 and ISO storage domain active now?
Yes, NFS1, ISO and hosted_storage result all up in webadmin gui Storage tab

On Tue, Nov 15, 2016 at 5:00 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
On Tue, Nov 15, 2016 at 4:39 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
Boot time was at 14:32 and from image it seems that on 14:39 all should have been already ok... but perhaps further settlement needed after first "Storage Pool Manager runs on ....." message? When I tried to start the VM all the storage domains resulted up in webadmin....
Are your NFS1 and ISO storage domain active now?
Yes, NFS1, ISO and hosted_storage result all up in webadmin gui Storage tab
Can you please attach VDSM logs for that timeframe?

On Tue, Nov 15, 2016 at 5:05 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
On Tue, Nov 15, 2016 at 5:00 PM, Gianluca Cecchi < gianluca.cecchi@gmail.com> wrote:
On Tue, Nov 15, 2016 at 4:39 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
Boot time was at 14:32 and from image it seems that on 14:39 all should have been already ok... but perhaps further settlement needed after first "Storage Pool Manager runs on ....." message? When I tried to start the VM all the storage domains resulted up in webadmin....
Are your NFS1 and ISO storage domain active now?
Yes, NFS1, ISO and hosted_storage result all up in webadmin gui Storage tab
Can you please attach VDSM logs for that timeframe?
vdsm.log.3.xz starts at 14:01 https://drive.google.com/file/d/0BwoPbcrMv8mvY0otTlVFc0tXY0U/view?usp=sharin... vdsm.log.2.xz starts at 15:01 https://drive.google.com/file/d/0BwoPbcrMv8mva3NWRFhlVGcxdWc/view?usp=sharin... Gianluca

On Tue, Nov 15, 2016 at 5:16 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
On Tue, Nov 15, 2016 at 5:05 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
On Tue, Nov 15, 2016 at 5:00 PM, Gianluca Cecchi < gianluca.cecchi@gmail.com> wrote:
On Tue, Nov 15, 2016 at 4:39 PM, Simone Tiraboschi <stirabos@redhat.com> wrote:
Boot time was at 14:32 and from image it seems that on 14:39 all should have been already ok... but perhaps further settlement needed after first "Storage Pool Manager runs on ....." message? When I tried to start the VM all the storage domains resulted up in webadmin....
Are your NFS1 and ISO storage domain active now?
Yes, NFS1, ISO and hosted_storage result all up in webadmin gui Storage tab
Can you please attach VDSM logs for that timeframe?
vdsm.log.3.xz starts at 14:01 https://drive.google.com/file/d/0BwoPbcrMv8mvY0otTlVFc0tXY0U/ view?usp=sharing
vdsm.log.2.xz starts at 15:01 https://drive.google.com/file/d/0BwoPbcrMv8mva3NWRFhlVGcxdWc/ view?usp=sharing
Gianluca
One note: it seems to me that actually on other occasions when starting from powered off state it apparently starts but after a few minutes it goes down and recomes up in a few minutes again.... Donna if it depends on single environment setup or if it is true in general, because it is difficult in general that a global stop of the infra and clean start is made very often....

Hi, Did you try to follow the instructions at: http://lists.ovirt.org/pipermail/users/2014-April/023861.html Specifically the portion in section B? -derek PS: I'm been confused about what maintenance mode means on a single-host system. I thought maintenance mode shuts down the engine? But then how can you access/update the engine if it's shut down? Gianluca Cecchi <gianluca.cecchi@gmail.com> writes:
Single host with self hosted engine. All seems ok after rebooting host and exiting local maintenance. But when I try to start a VM I get
VM racclient1 is down with error. Exit message: Unable to get volume size for domain 556abaa8-0fcc-4042-963b-f27db5e03837 volume e0524893-1f78-4e6b-8e5e-83217bc0dc5b.
I don't know if it is related, but even after this update I continue to get the SSL error in vdsmd service:
[root@ractor ~]# systemctl status vdsmd -l ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/etc/systemd/system/vdsmd.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2016-11-15 14:32:17 CET; 7min ago Process: 2247 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 2336 (vdsm) CGroup: /system.slice/vdsmd.service ├─2336 /usr/bin/python /usr/share/vdsm/vdsm ├─2494 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 80 --max-threads 10 --max-queued-requests 10 ├─3588 /usr/libexec/ioprocess --read-pipe-fd 40 --write-pipe-fd 39 --max-threads 10 --max-queued-requests 10 ├─3601 /usr/libexec/ioprocess --read-pipe-fd 48 --write-pipe-fd 47 --max-threads 10 --max-queued-requests 10 ├─3609 /usr/libexec/ioprocess --read-pipe-fd 56 --write-pipe-fd 55 --max-threads 10 --max-queued-requests 10 ├─3616 /usr/libexec/ioprocess --read-pipe-fd 63 --write-pipe-fd 61 --max-threads 10 --max-queued-requests 10 └─3623 /usr/libexec/ioprocess --read-pipe-fd 73 --write-pipe-fd 71 --max-threads 10 --max-queued-requests 10
Nov 15 14:39:22 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:24 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:27 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:30 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:42 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:47 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:50 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:52 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof Nov 15 14:39:55 ractor.mydomain vdsm[2336]: vdsm vds.dispatcher ERROR SSL error during reading data: unexpected eof [root@ractor ~]#
See initial posting thread here:
http://lists.ovirt.org/pipermail/users/2016-July/041264.html
and also my further updates here: http://lists.ovirt.org/pipermail/users/2016-October/043355.html
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Derek Atkins 617-623-3745 derek@ihtfp.com www.ihtfp.com Computer and Internet Security Consultant
participants (3)
-
Derek Atkins
-
Gianluca Cecchi
-
Simone Tiraboschi