Problem deploying ovirt-hosted-engine to iSCSI
Hi, I'm back to testing oVirt again but have come across a problem when trying to deploy the ovirt hosted engine with iSCSI. The deploy asks questions about iSCSI, finds the iSCSI target, asks for the iqn, then goes to start the storage server but stops there, hanging forever. In this state I can see that the iSCSI session has logged in and the drive appears in the system (as sdb) but that's it. It appears as though it's getting stuck when it tries to get the list of luns. Has anyone else come across this issue? Any ideas where I can start with troubleshooting? Cheers, Justin.
What are you using for your ISCSI shares? Can you mount the share elsewhere and see if its creating the domain. I had a similar problem using FreeNAS for ISCSI shares, and it was because I didn't define a size for the lun. Donny D cloudspin.me -----Original Message----- From: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of Justin Clacherty Sent: Tuesday, February 24, 2015 5:56 AM To: users@ovirt.org Subject: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI Hi, I'm back to testing oVirt again but have come across a problem when trying to deploy the ovirt hosted engine with iSCSI. The deploy asks questions about iSCSI, finds the iSCSI target, asks for the iqn, then goes to start the storage server but stops there, hanging forever. In this state I can see that the iSCSI session has logged in and the drive appears in the system (as sdb) but that's it. It appears as though it's getting stuck when it tries to get the list of luns. Has anyone else come across this issue? Any ideas where I can start with troubleshooting? Cheers, Justin. _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On 24/02/2015 11:40 pm, Donny Davis wrote:
What are you using for your ISCSI shares? It's Linux-IO configured using targetcli.
Can you mount the share elsewhere and see if its creating the domain. I had a similar problem using FreeNAS for ISCSI shares, and it was because I didn't define a size for the lun.
I can mount and use the luns on other machines without issue.
Donny D cloudspin.me
-----Original Message----- From: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of Justin Clacherty Sent: Tuesday, February 24, 2015 5:56 AM To: users@ovirt.org Subject: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI
Hi,
I'm back to testing oVirt again but have come across a problem when trying to deploy the ovirt hosted engine with iSCSI. The deploy asks questions about iSCSI, finds the iSCSI target, asks for the iqn, then goes to start the storage server but stops there, hanging forever.
In this state I can see that the iSCSI session has logged in and the drive appears in the system (as sdb) but that's it. It appears as though it's getting stuck when it tries to get the list of luns. Has anyone else come across this issue? Any ideas where I can start with troubleshooting?
Cheers, Justin.
----- Original Message -----
From: "Justin Clacherty" <justin@redfish.com.au> To: "Donny Davis" <donny@cloudspin.me> Cc: users@ovirt.org Sent: Tuesday, February 24, 2015 3:09:40 PM Subject: Re: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI
On 24/02/2015 11:40 pm, Donny Davis wrote:
What are you using for your ISCSI shares? It's Linux-IO configured using targetcli.
Can you mount the share elsewhere and see if its creating the domain. I had a similar problem using FreeNAS for ISCSI shares, and it was because I didn't define a size for the lun.
I can mount and use the luns on other machines without issue.
Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks
Donny D cloudspin.me
-----Original Message----- From: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of Justin Clacherty Sent: Tuesday, February 24, 2015 5:56 AM To: users@ovirt.org Subject: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI
Hi,
I'm back to testing oVirt again but have come across a problem when trying to deploy the ovirt hosted engine with iSCSI. The deploy asks questions about iSCSI, finds the iSCSI target, asks for the iqn, then goes to start the storage server but stops there, hanging forever.
In this state I can see that the iSCSI session has logged in and the drive appears in the system (as sdb) but that's it. It appears as though it's getting stuck when it tries to get the list of luns. Has anyone else come across this issue? Any ideas where I can start with troubleshooting?
Cheers, Justin.
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------040406060007070805090307 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 8bit On 25/02/2015 12:35 AM, Simone Tiraboschi wrote:
Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks
Sure. Once the iscsi target is logged in the call to vdsClient never returns. See below. [root@host0 ~]# vdsClient -s 0 getDeviceList 3 [] [root@host0 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 55.9G 0 disk ├─sda1 8:1 0 500M 0 part /boot ├─sda2 8:2 0 5.6G 0 part [SWAP] └─sda3 8:3 0 49.8G 0 part /home sr0 11:0 1 1024M 0 rom [root@host0 ~]# iscsiadm -m session iscsiadm: No active sessions. [root@host0 ~]# iscsiadm --mode discovery --type sendtargets --portal 10.50.0.200 10.51.0.200:3260,1 iqn.2015-02.local.redfish:san0 10.50.0.200:3260,1 iqn.2015-02.local.redfish:san0 [root@host0 ~]# iscsiadm --mode node --targetname iqn.2015-02.local.redfish:san0 --portal 10.50.0.200 --login Logging in to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] (multiple) Login to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] successful. [root@host0 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 55.9G 0 disk ├─sda1 8:1 0 500M 0 part /boot ├─sda2 8:2 0 5.6G 0 part [SWAP] └─sda3 8:3 0 49.8G 0 part /home sdb 8:16 0 30G 0 disk sr0 11:0 1 1024M 0 rom [root@host0 ~]# vdsClient -s 0 getDeviceList 3 --------------040406060007070805090307 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> On 25/02/2015 12:35 AM, Simone Tiraboschi wrote:<br> <blockquote cite="mid:100281481.10146472.1424788516161.JavaMail.zimbra@redhat.com" type="cite">Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks<br> </blockquote> <br> Sure. Once the iscsi target is logged in the call to vdsClient never returns. See below.<br> <br> <font face="Courier New, Courier, monospace">[root@host0 ~]# vdsClient -s 0 getDeviceList 3<br> []<br> <br> [root@host0 ~]# lsblk<br> NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT<br> sda 8:0 0 55.9G 0 disk<br> ├─sda1 8:1 0 500M 0 part /boot<br> ├─sda2 8:2 0 5.6G 0 part [SWAP]<br> └─sda3 8:3 0 49.8G 0 part /home<br> sr0 11:0 1 1024M 0 rom<br> [root@host0 ~]# iscsiadm -m session<br> iscsiadm: No active sessions.<br> [root@host0 ~]# iscsiadm --mode discovery --type sendtargets --portal 10.50.0.200<br> 10.51.0.200:3260,1 iqn.2015-02.local.redfish:san0<br> 10.50.0.200:3260,1 iqn.2015-02.local.redfish:san0<br> [root@host0 ~]# iscsiadm --mode node --targetname iqn.2015-02.local.redfish:san0 --portal 10.50.0.200 --login<br> Logging in to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] (multiple)<br> Login to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] successful.<br> [root@host0 ~]# lsblk<br> NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT<br> sda 8:0 0 55.9G 0 disk<br> ├─sda1 8:1 0 500M 0 part /boot<br> ├─sda2 8:2 0 5.6G 0 part [SWAP]<br> └─sda3 8:3 0 49.8G 0 part /home<br> sdb 8:16 0 30G 0 disk<br> sr0 11:0 1 1024M 0 rom<br> [root@host0 ~]# vdsClient -s 0 getDeviceList 3<br> <br> <br> </font><br> </body> </html> --------------040406060007070805090307--
--------------010707070800020208070509 Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 8bit On 25/02/2015 12:35 AM, Simone Tiraboschi wrote:
Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks
Sure. Once the iscsi target is logged in the call to vdsClient never returns. After a few minutes I hit ctrl-c, that's what caused the traceback. See below for the output. [root@host0 ~]# vdsClient -s 0 getDeviceList 3 [] [root@host0 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 55.9G 0 disk ├─sda1 8:1 0 500M 0 part /boot ├─sda2 8:2 0 5.6G 0 part [SWAP] └─sda3 8:3 0 49.8G 0 part /home sr0 11:0 1 1024M 0 rom [root@host0 ~]# iscsiadm -m session iscsiadm: No active sessions. [root@host0 ~]# iscsiadm --mode discovery --type sendtargets --portal 10.50.0.200 10.51.0.200:3260,1 iqn.2015-02.local.redfish:san0 10.50.0.200:3260,1 iqn.2015-02.local.redfish:san0 [root@host0 ~]# iscsiadm --mode node --targetname iqn.2015-02.local.redfish:san0 --portal 10.50.0.200 --login Logging in to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] (multiple) Login to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] successful. [root@host0 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 55.9G 0 disk ├─sda1 8:1 0 500M 0 part /boot ├─sda2 8:2 0 5.6G 0 part [SWAP] └─sda3 8:3 0 49.8G 0 part /home sdb 8:16 0 30G 0 disk sr0 11:0 1 1024M 0 rom [root@host0 ~]# vdsClient -s 0 getDeviceList 3 ^CTraceback (most recent call last): File "/usr/share/vdsm/vdsClient.py", line 2683, in <module> code, message = commands[command][0](commandArgs) File "/usr/share/vdsm/vdsClient.py", line 626, in getDeviceList devices = self.s.getDeviceList(*args) File "/usr/lib64/python2.7/xmlrpclib.py", line 1224, in __call__ return self.__send(self.__name, args) File "/usr/lib64/python2.7/xmlrpclib.py", line 1578, in __request verbose=self.__verbose File "/usr/lib64/python2.7/xmlrpclib.py", line 1264, in request return self.single_request(host, handler, request_body, verbose) File "/usr/lib64/python2.7/xmlrpclib.py", line 1294, in single_request response = h.getresponse(buffering=True) File "/usr/lib64/python2.7/httplib.py", line 1045, in getresponse response.begin() File "/usr/lib64/python2.7/httplib.py", line 409, in begin version, status, reason = self._read_status() File "/usr/lib64/python2.7/httplib.py", line 365, in _read_status line = self.fp.readline(_MAXLINE + 1) File "/usr/lib64/python2.7/socket.py", line 476, in readline data = self._sock.recv(self._rbufsize) File "/usr/lib64/python2.7/ssl.py", line 241, in recv return self.read(buflen) File "/usr/lib64/python2.7/ssl.py", line 160, in read return self._sslobj.read(len) KeyboardInterrupt --------------010707070800020208070509 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> On 25/02/2015 12:35 AM, Simone Tiraboschi wrote:<br> <blockquote cite="mid:100281481.10146472.1424788516161.JavaMail.zimbra@redhat.com" type="cite">Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks<br> </blockquote> <br> Sure. Once the iscsi target is logged in the call to vdsClient never returns. After a few minutes I hit ctrl-c, that's what caused the traceback. See below for the output.<br> <br> <font face="Courier New, Courier, monospace">[root@host0 ~]# vdsClient -s 0 getDeviceList 3<br> []<br> <br> [root@host0 ~]# lsblk<br> NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT<br> sda 8:0 0 55.9G 0 disk<br> ├─sda1 8:1 0 500M 0 part /boot<br> ├─sda2 8:2 0 5.6G 0 part [SWAP]<br> └─sda3 8:3 0 49.8G 0 part /home<br> sr0 11:0 1 1024M 0 rom<br> [root@host0 ~]# iscsiadm -m session<br> iscsiadm: No active sessions.<br> [root@host0 ~]# iscsiadm --mode discovery --type sendtargets --portal 10.50.0.200<br> 10.51.0.200:3260,1 iqn.2015-02.local.redfish:san0<br> 10.50.0.200:3260,1 iqn.2015-02.local.redfish:san0<br> [root@host0 ~]# iscsiadm --mode node --targetname iqn.2015-02.local.redfish:san0 --portal 10.50.0.200 --login<br> Logging in to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] (multiple)<br> Login to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] successful.<br> [root@host0 ~]# lsblk<br> NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT<br> sda 8:0 0 55.9G 0 disk<br> ├─sda1 8:1 0 500M 0 part /boot<br> ├─sda2 8:2 0 5.6G 0 part [SWAP]<br> └─sda3 8:3 0 49.8G 0 part /home<br> sdb 8:16 0 30G 0 disk<br> sr0 11:0 1 1024M 0 rom<br> [root@host0 ~]# vdsClient -s 0 getDeviceList 3<br> ^CTraceback (most recent call last):<br> File "/usr/share/vdsm/vdsClient.py", line 2683, in <module><br> code, message = commands[command][0](commandArgs)<br> File "/usr/share/vdsm/vdsClient.py", line 626, in getDeviceList<br> devices = self.s.getDeviceList(*args)<br> File "/usr/lib64/python2.7/xmlrpclib.py", line 1224, in __call__<br> return self.__send(self.__name, args)<br> File "/usr/lib64/python2.7/xmlrpclib.py", line 1578, in __request<br> verbose=self.__verbose<br> File "/usr/lib64/python2.7/xmlrpclib.py", line 1264, in request<br> return self.single_request(host, handler, request_body, verbose)<br> File "/usr/lib64/python2.7/xmlrpclib.py", line 1294, in single_request<br> response = h.getresponse(buffering=True)<br> File "/usr/lib64/python2.7/httplib.py", line 1045, in getresponse<br> response.begin()<br> File "/usr/lib64/python2.7/httplib.py", line 409, in begin<br> version, status, reason = self._read_status()<br> File "/usr/lib64/python2.7/httplib.py", line 365, in _read_status<br> line = self.fp.readline(_MAXLINE + 1)<br> File "/usr/lib64/python2.7/socket.py", line 476, in readline<br> data = self._sock.recv(self._rbufsize)<br> File "/usr/lib64/python2.7/ssl.py", line 241, in recv<br> return self.read(buflen)<br> File "/usr/lib64/python2.7/ssl.py", line 160, in read<br> return self._sslobj.read(len)<br> KeyboardInterrupt<br> <br> <br> <br> </font><br> </body> </html> --------------010707070800020208070509--
----- Original Message -----
From: "Justin Clacherty" <justin@redfish.com.au> To: "Simone Tiraboschi" <stirabos@redhat.com> Cc: "Donny Davis" <donny@cloudspin.me>, users@ovirt.org Sent: Wednesday, February 25, 2015 5:26:37 AM Subject: Re: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI
On 25/02/2015 12:35 AM, Simone Tiraboschi wrote:
Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks
Sure. Once the iscsi target is logged in the call to vdsClient never returns. After a few minutes I hit ctrl-c, that's what caused the traceback. See below for the output.
Could you please upload somewhere your VDSM logs (/var/log/vdsm/vdsm.log)?
[root@host0 ~]# vdsClient -s 0 getDeviceList 3 []
[root@host0 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 55.9G 0 disk ├─sda1 8:1 0 500M 0 part /boot ├─sda2 8:2 0 5.6G 0 part [SWAP] └─sda3 8:3 0 49.8G 0 part /home sr0 11:0 1 1024M 0 rom [root@host0 ~]# iscsiadm -m session iscsiadm: No active sessions. [root@host0 ~]# iscsiadm --mode discovery --type sendtargets --portal 10.50.0.200 10.51.0.200:3260,1 iqn.2015-02.local.redfish:san0 10.50.0.200:3260,1 iqn.2015-02.local.redfish:san0 [root@host0 ~]# iscsiadm --mode node --targetname iqn.2015-02.local.redfish:san0 --portal 10.50.0.200 --login Logging in to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] (multiple) Login to [iface: default, target: iqn.2015-02.local.redfish:san0, portal: 10.50.0.200,3260] successful. [root@host0 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 55.9G 0 disk ├─sda1 8:1 0 500M 0 part /boot ├─sda2 8:2 0 5.6G 0 part [SWAP] └─sda3 8:3 0 49.8G 0 part /home sdb 8:16 0 30G 0 disk sr0 11:0 1 1024M 0 rom [root@host0 ~]# vdsClient -s 0 getDeviceList 3 ^CTraceback (most recent call last): File "/usr/share/vdsm/vdsClient.py", line 2683, in <module> code, message = commands[command][0](commandArgs) File "/usr/share/vdsm/vdsClient.py", line 626, in getDeviceList devices = self.s.getDeviceList(*args) File "/usr/lib64/python2.7/xmlrpclib.py", line 1224, in __call__ return self.__send(self.__name, args) File "/usr/lib64/python2.7/xmlrpclib.py", line 1578, in __request verbose=self.__verbose File "/usr/lib64/python2.7/xmlrpclib.py", line 1264, in request return self.single_request(host, handler, request_body, verbose) File "/usr/lib64/python2.7/xmlrpclib.py", line 1294, in single_request response = h.getresponse(buffering=True) File "/usr/lib64/python2.7/httplib.py", line 1045, in getresponse response.begin() File "/usr/lib64/python2.7/httplib.py", line 409, in begin version, status, reason = self._read_status() File "/usr/lib64/python2.7/httplib.py", line 365, in _read_status line = self.fp.readline(_MAXLINE + 1) File "/usr/lib64/python2.7/socket.py", line 476, in readline data = self._sock.recv(self._rbufsize) File "/usr/lib64/python2.7/ssl.py", line 241, in recv return self.read(buflen) File "/usr/lib64/python2.7/ssl.py", line 160, in read return self._sslobj.read(len) KeyboardInterrupt
On 25/02/2015 6:23 PM, Simone Tiraboschi wrote:
----- Original Message -----
From: "Justin Clacherty" <justin@redfish.com.au> To: "Simone Tiraboschi" <stirabos@redhat.com> Cc: "Donny Davis" <donny@cloudspin.me>, users@ovirt.org Sent: Wednesday, February 25, 2015 5:26:37 AM Subject: Re: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI
Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks Sure. Once the iscsi target is logged in the call to vdsClient never returns. After a few minutes I hit ctrl-c, that's what caused the
On 25/02/2015 12:35 AM, Simone Tiraboschi wrote: traceback. See below for the output. Could you please upload somewhere your VDSM logs (/var/log/vdsm/vdsm.log)?
I have it connecting now. I tested it on another machine again and it wasn't working. Changed the MTU back to 1500 on both the SAN and the host and now it works fine. Not sure why MTU of 9000 doesn't work, but I'll worry about that later. Thanks.
----- Original Message -----
On 25/02/2015 6:23 PM, Simone Tiraboschi wrote:
----- Original Message -----
From: "Justin Clacherty" <justin@redfish.com.au> To: "Simone Tiraboschi" <stirabos@redhat.com> Cc: "Donny Davis" <donny@cloudspin.me>, users@ovirt.org Sent: Wednesday, February 25, 2015 5:26:37 AM Subject: Re: [ovirt-users] Problem deploying ovirt-hosted-engine to iSCSI
Can you please paste here the output of vdsClient -s 0 getDeviceList 3 thanks Sure. Once the iscsi target is logged in the call to vdsClient never returns. After a few minutes I hit ctrl-c, that's what caused the
On 25/02/2015 12:35 AM, Simone Tiraboschi wrote: traceback. See below for the output. Could you please upload somewhere your VDSM logs (/var/log/vdsm/vdsm.log)?
I have it connecting now. I tested it on another machine again and it wasn't working. Changed the MTU back to 1500 on both the SAN and the host and now it works fine. Not sure why MTU of 9000 doesn't work, but I'll worry about that later.
Maybe some intermediate device can not handle taht jumbo frame? - fabian
On 26/02/2015 7:40 PM, Fabian Deutsch wrote:
----- Original Message -----
I have it connecting now. I tested it on another machine again and it wasn't working. Changed the MTU back to 1500 on both the SAN and the host and now it works fine. Not sure why MTU of 9000 doesn't work, but I'll worry about that later. Maybe some intermediate device can not handle taht jumbo frame?
There's only a switch which is configured for MTU of 9000. Doesn't matter for now, I'll figure it out later.
participants (4)
-
Donny Davis -
Fabian Deutsch -
Justin Clacherty -
Simone Tiraboschi