[ovirt-users] ovirt 4.0.4?==?utf-8?q? : unable to upload images

Wed Nov 2 05:26:56 EDT 2016

Hello,

same problem:

3 host cluster, log of one hosts, same on two others:

[root at virt2 ~]#     journalctl -x -u ovirt-imageio-daemon
-- Logs begin at Mon 2016-10-31 12:45:30 +04, end at Wed 2016-11-02
13:03:28 +04. --
Oct 31 12:45:38 virt2.management.gnc.am systemd[1]: Starting oVirt
ImageIO Daemon...
-- Subject: Unit ovirt-imageio-daemon.service has begun start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit ovirt-imageio-daemon.service has begun starting up.
Oct 31 12:45:38 virt2.management.gnc.am systemd[1]: Started oVirt
ImageIO Daemon.
-- Subject: Unit ovirt-imageio-daemon.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit ovirt-imageio-daemon.service has finished starting up.
--
-- The start-up result is done.
Nov 01 13:21:24 virt2.management.gnc.am ovirt-imageio-daemon[1575]: /
- - [01/Nov/2016 13:21:24] "PUT
/tickets/d122778d-beb4-426f-8074-70e033253670 HTTP/1.1" 200 0
Nov 01 13:21:44 virt2.management.gnc.am ovirt-imageio-daemon[1575]: /
- - [01/Nov/2016 13:21:44] "DELETE
/tickets/d122778d-beb4-426f-8074-70e033253670 HTTP/1.1" 204 0
Nov 01 13:28:48 virt2.management.gnc.am ovirt-imageio-daemon[1575]: /
- - [01/Nov/2016 13:28:48] "PUT
/tickets/87eeb8c4-2184-4793-8843-5835e2fac025 HTTP/1.1" 200 0
Nov 01 13:29:03 virt2.management.gnc.am ovirt-imageio-daemon[1575]: /
- - [01/Nov/2016 13:29:03] "DELETE
/tickets/87eeb8c4-2184-4793-8843-5835e2fac025 HTTP/1.1" 204 0
Nov 01 13:37:50 virt2.management.gnc.am ovirt-imageio-daemon[1575]: /
- - [01/Nov/2016 13:37:50] "PUT
/tickets/5d78deac-b373-43c7-b0ef-9dc94ef3324b HTTP/1.1" 200 0
Nov 01 13:38:12 virt2.management.gnc.am ovirt-imageio-daemon[1575]: /
- - [01/Nov/2016 13:38:12] "DELETE
/tickets/5d78deac-b373-43c7-b0ef-9dc94ef3324b HTTP/1.1" 204 0
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
Traceback (most recent call last):
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/SocketServer.py", line 593, in
process_request_thread
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
self.finish_request(request, client_address)
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/SocketServer.py", line 334, in
finish_request
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
self.RequestHandlerClass(request, client_address, self)
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/SocketServer.py", line 649, in __init__
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
self.handle()
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 116, in
handle
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
self.raw_requestline = self.rfile.readline()
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/socket.py", line 447, in readline
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
data = self._sock.recv(self._rbufsize)
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/ssl.py", line 736, in recv
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
return self.read(buflen)
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
File "/usr/lib64/python2.7/ssl.py", line 630, in read
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]: v
= self._sslobj.read(len or 1024)
Nov 01 14:12:22 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
SSLError: [SSL: TLSV1_ALERT_UNKNOWN_CA] tlsv1 alert unknown ca
(_ssl.c:1936)
Nov 01 14:12:27 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
192.168.1.75 - - [01/Nov/2016 14:12:27] "GET / HTTP/1.1" 404 119
Nov 01 14:12:27 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
192.168.1.75 - - [01/Nov/2016 14:12:27] "GET /favicon.ico HTTP/1.1"
404 130
Nov 01 14:12:27 virt2.management.gnc.am ovirt-imageio-daemon[1575]:
192.168.1.75 - - [01/Nov/2016 14:12:27] "GET /favicon.ico HTTP/1.1"
404 130

On engine:

[root at ovirt-engine ~]# tail -f /var/log/ovirt-imageio-proxy/image-proxy.log

(Thread-15 ) INFO 2016-11-02 07:59:30,437
session:259:root:(_decode_proxy_ticket) Proxy ticket valid: {u'iat':
1478073567, u'imaged-uri': u'https://virt1.management.gnc.am:54322',
u'nbf': 1478073567, u'exp': 1478077167, u'transfer-ticket':
u'7d83b9c5-2e0b-4ef2-a004-ee6c7
b4d7901'}
(Thread-15 ) INFO 2016-11-02 07:59:30,437
session:191:root:(_create_update_session) Established session:
expiration: '1478077167', imaged-host-uri:
'https://virt1.management.gnc.am:54322', proxy-ticket:
'eyJzYWx0IjoiTjdxdnFucE83MUU9IiwiZGF0YSI6IntcbiAgXCJuYmZcIiA6...MjAx
NjExMDIwNzU5MjciLCJ2YWxpZFRvIjoiMjAxNjExMDIwODU5MjcifQ==', session-id:
'a52f988f-3a8c-4511-a8fb-fa8485b2cfad', transfer-ticket:
'7d83b9c5-2e0b-4ef2-a004-ee6c7b4d7901'
(Thread-15 ) INFO 2016-11-02 07:59:30,439
connectionpool:735:requests.packages.urllib3.connectionpool:(_new_conn)
Starting new HTTPS connection (1): virt1.management.gnc.am
(Thread-15 ) ERROR 2016-11-02 07:59:30,447
image_handler:186:root:(make_imaged_request) Failed communicating with
vdsm-imaged: An SSL error occurred.
Traceback (most recent call last):
 File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/image_handler.py",
line 177, in make_imaged_request
   timeout=timeout, stream=stream)
 File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
   r = adapter.send(request, **kwargs)
 File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 431, in send
   raise SSLError(e, request=request)
SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed
(_ssl.c:765)
(Thread-16 ) INFO 2016-11-02 07:59:33,467
session:259:root:(_decode_proxy_ticket) Proxy ticket valid: {u'iat':
1478073567, u'imaged-uri': u'https://virt1.management.gnc.am:54322',
u'nbf': 1478073567, u'exp': 1478077167, u'transfer-ticket':
u'7d83b9c5-2e0b-4ef2-a004-ee6c7
b4d7901'}
(Thread-16 ) INFO 2016-11-02 07:59:33,467
session:191:root:(_create_update_session) Established session:
expiration: '1478077167', imaged-host-uri:
'https://virt1.management.gnc.am:54322', proxy-ticket:
'eyJzYWx0IjoiTjdxdnFucE83MUU9IiwiZGF0YSI6IntcbiAgXCJuYmZcIiA6...MjAx
NjExMDIwNzU5MjciLCJ2YWxpZFRvIjoiMjAxNjExMDIwODU5MjcifQ==', session-id:
'44909f91-ad71-455a-a548-0ccf2350b72e', transfer-ticket:
'7d83b9c5-2e0b-4ef2-a004-ee6c7b4d7901'
(Thread-16 ) INFO 2016-11-02 07:59:33,468
connectionpool:735:requests.packages.urllib3.connectionpool:(_new_conn)
Starting new HTTPS connection (1): virt1.management.gnc.am
(Thread-16 ) ERROR 2016-11-02 07:59:33,476
image_handler:186:root:(make_imaged_request) Failed communicating with
vdsm-imaged: An SSL error occurred.
Traceback (most recent call last):
 File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/image_handler.py",
line 177, in make_imaged_request
   timeout=timeout, stream=stream)
 File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
   r = adapter.send(request, **kwargs)
 File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 431, in send
   raise SSLError(e, request=request)
SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed
(_ssl.c:765)
(Thread-17 ) INFO 2016-11-02 07:59:36,498
session:259:root:(_decode_proxy_ticket) Proxy ticket valid: {u'iat':
1478073567, u'imaged-uri': u'https://virt1.management.gnc.am:54322',
u'nbf': 1478073567, u'exp': 1478077167, u'transfer-ticket':
u'7d83b9c5-2e0b-4ef2-a004-ee6c7
b4d7901'}
(Thread-17 ) INFO 2016-11-02 07:59:36,498
session:191:root:(_create_update_session) Established session:
expiration: '1478077167', imaged-host-uri:
'https://virt1.management.gnc.am:54322', proxy-ticket:
'eyJzYWx0IjoiTjdxdnFucE83MUU9IiwiZGF0YSI6IntcbiAgXCJuYmZcIiA6...MjAx
NjExMDIwNzU5MjciLCJ2YWxpZFRvIjoiMjAxNjExMDIwODU5MjcifQ==', session-id:
'ef47ebdd-6381-4aa3-b62a-10c0588f0a84', transfer-ticket:
'7d83b9c5-2e0b-4ef2-a004-ee6c7b4d7901'
(Thread-17 ) INFO 2016-11-02 07:59:36,499
connectionpool:735:requests.packages.urllib3.connectionpool:(_new_conn)
Starting new HTTPS connection (1): virt1.management.gnc.am
(Thread-17 ) ERROR 2016-11-02 07:59:36,508
image_handler:186:root:(make_imaged_request) Failed communicating with
vdsm-imaged: An SSL error occurred.
Traceback (most recent call last):
 File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/image_handler.py",
line 177, in make_imaged_request
   timeout=timeout, stream=stream)
 File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
   r = adapter.send(request, **kwargs)
 File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 431, in send
   raise SSLError(e, request=request)
SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed
(_ssl.c:765)
(Thread-18 ) INFO 2016-11-02 07:59:39,659
session:259:root:(_decode_proxy_ticket) Proxy ticket valid: {u'iat':
1478073567, u'imaged-uri': u'https://virt1.management.gnc.am:54322',
u'nbf': 1478073567, u'exp': 1478077167, u'transfer-ticket':
u'7d83b9c5-2e0b-4ef2-a004-ee6c7
b4d7901'}
(Thread-18 ) INFO 2016-11-02 07:59:39,659
session:191:root:(_create_update_session) Established session:
expiration: '1478077167', imaged-host-uri:
'https://virt1.management.gnc.am:54322', proxy-ticket:
'eyJzYWx0IjoiTjdxdnFucE83MUU9IiwiZGF0YSI6IntcbiAgXCJuYmZcIiA6...MjAx
NjExMDIwNzU5MjciLCJ2YWxpZFRvIjoiMjAxNjExMDIwODU5MjcifQ==', session-id:
'177decb1-1fe5-4195-924c-2f6c3bdf2849', transfer-ticket:
'7d83b9c5-2e0b-4ef2-a004-ee6c7b4d7901'
(Thread-18 ) INFO 2016-11-02 07:59:39,661
connectionpool:735:requests.packages.urllib3.connectionpool:(_new_conn)
Starting new HTTPS connection (1): virt1.management.gnc.am
(Thread-18 ) ERROR 2016-11-02 07:59:39,669
image_handler:186:root:(make_imaged_request) Failed communicating with
vdsm-imaged: An SSL error occurred.
Traceback (most recent call last):
 File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/image_handler.py",
line 177, in make_imaged_request
   timeout=timeout, stream=stream)
 File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
   r = adapter.send(request, **kwargs)
 File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 431, in send
   raise SSLError(e, request=request)
SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed
(_ssl.c:765)
^C

It seems that browser is not a problem but connection between
ovirt-imageio-proxy on engine and vdsm on hosts.

Best regards,
Misak Khachatryan

On Wed, Nov 2, 2016 at 12:41 PM, Amit Aviram <aaviram at redhat.com> wrote:
>
>
> On Wed, Nov 2, 2016 at 8:48 AM, Yedidyah Bar David <didi at redhat.com> wrote:
>>
>> On Tue, Nov 1, 2016 at 10:42 PM, Claude Durocher
>> <claude.durocher at cptaq.gouv.qc.ca> wrote:
>> > We have a setup with ovirt 4.0.4 (hosted engine) and I try to import a
>> > Ubuntu qcow cloud image. When I try to import, it stops with the error
>> > 'Unable to upload image to disk ... due to a network error. Make sure
>> > ovirt-imageio-proxy service is installed and configured, and
>> > ovirt-engine's
>> > certificate is registered as a valid CA in the browser'.
>> >
>> > The ovirt-imageio-proxy service is running on the engine.  No errors in
>> > the
>> > log (just a mention that the service has started up). I also imported
>> > the
>> > server CA in my browser (Firefox 49 on Ubuntu).
>>
>> Please check:
>>
>> https://bugzilla.redhat.com/show_bug.cgi?id=1317253
>>
>> https://www.ovirt.org/develop/release-management/features/storage/image-upload/
>>
>> Do you have on your host 'ovirt-imageio-daemon' installed and running?
>>
>> Did you manually configure iptables on the host? If so, you need port
>> 54322 open.
>>
>> If still stuck, please check/attach:
>>
>> On engine machine:
>>
>> /var/log/ovirt-engine/*
>> /var/log/ovirt-imageio-proxy/*
>> /var/log/httpd/*
>>
>> On host:
>>
>> /var/log/messages
>> journalctl
>>
>> Thanks,
>
> Please also attach your browser logs.
>
>>
>> --
>> Didi
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>