Hi,

I tested uploading an ISO to Gluster on my setup and it worked fine.

The size is OK:

# ls -lsh /rhev/data-center/mnt/glusterSD/*********:_fred1/f80e6d34-7c4c-4c0b-9451-dd140812c4ee/images/fa2209bc-d34c-4f3e-a425-9a085d72c3ba/0deef094-05a3-49c4-a347-ca423bd57a87
1.6G -rw-rw----. 1 vdsm kvm 1.6G Jan 17 10:06 /rhev/data-center/mnt/glusterSD/********:_fred1/f80e6d34-7c4c-4c0b-9451-dd140812c4ee/images/fa2209bc-d34c-4f3e-a425-9a085d72c3ba/0deef094-05a3-49c4-a347-ca423bd57a87


Are you seeing any other issues with your Gluster setup?
Creating regular disks, copy/move disks to this SD?

Thanks,
Fred

On Tue, Jan 16, 2018 at 4:25 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:


On Tue, Jan 16, 2018 at 2:30 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:


On Tue, Jan 16, 2018 at 2:21 PM, Gianluca Cecchi <gianluca.cecchi@gmail.com> wrote:
On Tue, Jan 16, 2018 at 6:48 AM, Fred Rolland <frolland@redhat.com> wrote:
Hi,
I will look into it.

Is it also not working also for non-iso images?

Thanks,
Fred

 
Hello,
I get the same with a disk.
I have tried with a raw disk of size 1Gb.
When I upload I can set the size (why?) while with the iso image I could not.
The disk is recognized as "data" in upload window (the iso fie was correctly recognized as "iso"), but in image-proxy.log I get

(Thread-42 ) INFO 2018-01-16 14:15:50,530 web:95:web:(log_start) START [192.168.150.101] GET /info/
(Thread-42 ) INFO 2018-01-16 14:15:50,532 web:102:web:(log_finish) FINISH [192.168.150.101] GET /info/: [200] 20 (0.00s)
(Thread-43 ) INFO 2018-01-16 14:16:12,659 web:95:web:(log_start) START [192.168.150.105] PUT /tickets/
(Thread-43 ) INFO 2018-01-16 14:16:12,661 auth2:170:auth2:(add_signed_ticket) Adding new ticket: <Ticket id=u'81569ab3-1b92-
4744-8a58-f1948afa20b7', url=u'https://ovirt01.localdomain.local:54322' at 0x7f048c03c610>
(Thread-43 ) INFO 2018-01-16 14:16:12,662 web:102:web:(log_finish) FINISH [192.168.150.105] PUT /tickets/: [200] 0 (0.00s)
(Thread-44 ) INFO 2018-01-16 14:16:13,800 web:95:web:(log_start) START [192.168.150.101] OPTIONS /images/81569ab3-1b92-4744-
8a58-f1948afa20b7
(Thread-44 ) INFO 2018-01-16 14:16:13,814 web:102:web:(log_finish) FINISH [192.168.150.101] OPTIONS /images/81569ab3-1b92-47
44-8a58-f1948afa20b7: [204] 0 (0.02s)
(Thread-45 ) INFO 2018-01-16 14:16:13,876 web:95:web:(log_start) START [192.168.150.101] PUT /images/81569ab3-1b92-4744-8a58
-f1948afa20b7
(Thread-45 ) WARNING 2018-01-16 14:16:13,877 web:112:web:(log_error) ERROR [192.168.150.101] PUT /images/81569ab3-1b92-4744-8a58-f1948afa20b7: [401] Not authorized (0.00s)

Gianluca


BTW: 
I don't know if its is in some way related with the upload problems, but in my engine .log I see these kind of messages every 5 or such seconds:

2018-01-16 14:27:38,428+01 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [61e72c38] START, GlusterServersListVDSCommand(HostName = ovirt02.localdomain.local, VdsIdVDSCommandParametersBase:{hostId='cb9cc605-fceb-4689-ad35-43ba883f4556'}), log id: 65e60794
2018-01-16 14:27:38,858+01 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3) [61e72c38] FINISH, GlusterServersListVDSCommand, return: [192.168.150.103/24:CONNECTED, ovirt03.localdomain.local:CONNECTED, ovirt01.localdomain.local:CONNECTED], log id: 65e60794
2018-01-16 14:27:38,867+01 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler3) [61e72c38] START, GlusterVolumesListVDSCommand(HostName = ovirt02.localdomain.local, GlusterVolumesListVDSParameters:{hostId='cb9cc605-fceb-4689-ad35-43ba883f4556'}), log id: 6e01993d
2018-01-16 14:27:39,221+01 WARN  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler3) [61e72c38] Could not associate brick 'ovirt02.localdomain.local:/gluster/brick1/engine' of volume '6e2bd1d7-9c8e-4c54-9d85-f36e1b871771' with correct network as no gluster network found in cluster '582badbe-0080-0197-013b-0000000001c6'
2018-01-16 14:27:39,231+01 WARN  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler3) [61e72c38] Could not associate brick 'ovirt02.localdomain.local:/gluster/brick2/data' of volume '2238c6db-48c5-4071-8929-879cedcf39bf' with correct network as no gluster network found in cluster '582badbe-0080-0197-013b-0000000001c6'
2018-01-16 14:27:39,253+01 WARN  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler3) [61e72c38] Could not associate brick 'ovirt02.localdomain.local:/gluster/brick4/iso' of volume '28f99f11-3529-43a1-895c-abf1c66884ab' with correct network as no gluster network found in cluster '582badbe-0080-0197-013b-0000000001c6'
2018-01-16 14:27:39,255+01 INFO  [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler3) [61e72c38] FINISH, GlusterVolumesListVDSCommand, return: {2238c6db-48c5-4071-8929-879cedcf39bf=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa6e9a1e, df0ccd1d-5de6-42b8-a163-ec65c3698da3=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31c29088, 6e2bd1d7-9c8e-4c54-9d85-f36e1b871771=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae82860f, 28f99f11-3529-43a1-895c-abf1c66884ab=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b6a11e5}, log id: 6e01993d

Actualy te gluster network seems ok.

Eg

[root@ovirt01 glusterfs]# gluster volume info data
 
Volume Name: data
Type: Replicate
Volume ID: 2238c6db-48c5-4071-8929-879cedcf39bf
Status: Started
Snapshot Count: 0
Number of Bricks: 1 x (2 + 1) = 3
Transport-type: tcp
Bricks:
Brick1: ovirt01.localdomain.local:/gluster/brick2/data
Brick2: ovirt02.localdomain.local:/gluster/brick2/data
Brick3: ovirt03.localdomain.local:/gluster/brick2/data (arbiter)
Options Reconfigured:
performance.strict-o-direct: on
nfs.disable: on
user.cifs: off
network.ping-timeout: 30
cluster.shd-max-threads: 6
cluster.shd-wait-qlength: 10000
cluster.locking-scheme: granular
cluster.data-self-heal-algorithm: full
performance.low-prio-threads: 32
features.shard-block-size: 512MB
features.shard: on
storage.owner-gid: 36
storage.owner-uid: 36
cluster.server-quorum-type: server
cluster.quorum-type: auto
network.remote-dio: off
cluster.eager-lock: enable
performance.stat-prefetch: off
performance.io-cache: off
performance.read-ahead: off
performance.quick-read: off
performance.readdir-ahead: on
transport.address-family: inet
[root@ovirt01 glusterfs]# 

[root@ovirt01 glusterfs]# gluster volume heal data info 
Brick ovirt01.localdomain.local:/gluster/brick2/data
Status: Connected
Number of entries: 0

Brick ovirt02.localdomain.local:/gluster/brick2/data
Status: Connected
Number of entries: 0

Brick ovirt03.localdomain.local:/gluster/brick2/data
Status: Connected
Number of entries: 0

[root@ovirt01 glusterfs]# 

Gianluca



At host side:

[root@ovirt01 glusterfs]# systemctl status ovirt-imageio-daemon -l
● ovirt-imageio-daemon.service - oVirt ImageIO Daemon
   Loaded: loaded (/usr/lib/systemd/system/ovirt-imageio-daemon.service; disabled; vendor preset: disabled)
   Active: active (running) since Sat 2018-01-13 06:49:20 CET; 3 days ago
 Main PID: 1004 (ovirt-imageio-d)
   CGroup: /system.slice/ovirt-imageio-daemon.service
           └─1004 /usr/bin/python /usr/bin/ovirt-imageio-daemon

Jan 13 06:49:19 ovirt01.localdomain.local systemd[1]: Starting oVirt ImageIO Daemon...
Jan 13 06:49:20 ovirt01.localdomain.local systemd[1]: Started oVirt ImageIO Daemon.
[root@ovirt01 glusterfs]#

and in /var/log/ovirt-imageio-daemon/daemon.log

2018-01-16 14:16:12,625 INFO    (ticket.server) [web] START [/] PUT /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:12,626 INFO    (ticket.server) [tickets] Adding ticket <Ticket active=False expires=4580999 filename=None ops=[u'write'] size=1073741824 transferred=0 url=u'file:///rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791' uuid=u'81569ab3-1b92-4744-8a58-f1948afa20b7' at 0x24cde10>
2018-01-16 14:16:12,628 INFO    (ticket.server) [web] FINISH [/] PUT /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 0 (0.00s)
2018-01-16 14:16:13,800 INFO    (ticket.server) [web] START [/] GET /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:13,800 INFO    (ticket.server) [tickets] Retrieving ticket 81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:13,802 INFO    (ticket.server) [web] FINISH [/] GET /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 355 (0.00s)
2018-01-16 14:16:15,846 INFO    (ticket.server) [web] START [/] GET /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:15,846 INFO    (ticket.server) [tickets] Retrieving ticket 81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:15,847 INFO    (ticket.server) [web] FINISH [/] GET /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 355 (0.00s)
2018-01-16 14:16:19,865 INFO    (ticket.server) [web] START [/] GET /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:19,865 INFO    (ticket.server) [tickets] Retrieving ticket 81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:19,866 INFO    (ticket.server) [web] FINISH [/] GET /tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 355 (0.00s)
 
and it seems the file is there???

root@ovirt01 ovirt-imageio-daemon]# ll /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
-rw-rw----. 1 vdsm kvm 1073741824 Jan 16 14:15 /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
[root@ovirt01 ovirt-imageio-daemon]# 

[root@ovirt01 ovirt-imageio-daemon]# qemu-img info /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
image: /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
file format: raw
virtual size: 1.0G (1073741824 bytes)
disk size: 0
[root@ovirt01 ovirt-imageio-daemon]# 

but size zero:
[root@ovirt01 ovirt-imageio-daemon]# ls -ls /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
0 -rw-rw----. 1 vdsm kvm 1073741824 Jan 16 14:15 /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
[root@ovirt01 ovirt-imageio-daemon]# 


And the same if I go back when I tried to upload iso:

2018-01-14 18:23:24,867 INFO    (ticket.server) [web] START [/] PUT /tickets/b89f35d3-c09b-4dcb-bc13-abf18feb8cd0
2018-01-14 18:23:24,868 INFO    (ticket.server) [tickets] Adding ticket <Ticket active=False expires=4423031 filename=None o
ps=[u'write'] size=830472192 transferred=0 url=u'file:///rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4
096-003e-4908-825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894' uuid=u'b89
f35d3-c09b-4dcb-bc13-abf18feb8cd0' at 0x24cde50>
2018-01-14 18:23:24,868 INFO    (ticket.server) [web] FINISH [/] PUT /tickets/b89f35d3-c09b-4dcb-bc13-abf18feb8cd0: [200] 0 
(0.00s)

and

[root@ovirt01 ovirt-imageio-daemon]# ll /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
-rw-rw----. 1 vdsm kvm 830472192 Jan 14 18:23 /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
[root@ovirt01 ovirt-imageio-daemon]# 

ls -s gives 0 and in fact if I try to mount as loop device the supposed iso files I get the error about "wrong fs type" ...

[root@ovirt01 ovirt-imageio-daemon]# ls -ls /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
0 -rw-rw----. 1 vdsm kvm 830472192 Jan 14 18:23 /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
[root@ovirt01 ovirt-imageio-daemon]# 

HIH debugging,
Gianluca