Hi,
I tested uploading an ISO to Gluster on my setup and it worked fine.
The size is OK:
# ls -lsh
/rhev/data-center/mnt/glusterSD/*********:_fred1/f80e6d34-7c4c-4c0b-9451-dd140812c4ee/images/fa2209bc-d34c-4f3e-a425-9a085d72c3ba/0deef094-05a3-49c4-a347-ca423bd57a87
1.6G -rw-rw----. 1 vdsm kvm 1.6G Jan 17 10:06
/rhev/data-center/mnt/glusterSD/********:_fred1/f80e6d34-7c4c-4c0b-9451-dd140812c4ee/images/fa2209bc-d34c-4f3e-a425-9a085d72c3ba/0deef094-05a3-49c4-a347-ca423bd57a87
Are you seeing any other issues with your Gluster setup?
Creating regular disks, copy/move disks to this SD?
Thanks,
Fred
On Tue, Jan 16, 2018 at 4:25 PM, Gianluca Cecchi <gianluca.cecchi(a)gmail.com>
wrote:
On Tue, Jan 16, 2018 at 2:30 PM, Gianluca Cecchi <
gianluca.cecchi(a)gmail.com> wrote:
>
>
> On Tue, Jan 16, 2018 at 2:21 PM, Gianluca Cecchi <
> gianluca.cecchi(a)gmail.com> wrote:
>
>> On Tue, Jan 16, 2018 at 6:48 AM, Fred Rolland <frolland(a)redhat.com>
>> wrote:
>>
>>> Hi,
>>> I will look into it.
>>>
>>> Is it also not working also for non-iso images?
>>>
>>> Thanks,
>>> Fred
>>>
>>>
>> Hello,
>> I get the same with a disk.
>> I have tried with a raw disk of size 1Gb.
>> When I upload I can set the size (why?) while with the iso image I could
>> not.
>> The disk is recognized as "data" in upload window (the iso fie was
>> correctly recognized as "iso"), but in image-proxy.log I get
>>
>> (Thread-42 ) INFO 2018-01-16 14:15:50,530 web:95:web:(log_start) START
>> [192.168.150.101] GET /info/
>> (Thread-42 ) INFO 2018-01-16 14:15:50,532 web:102:web:(log_finish)
>> FINISH [192.168.150.101] GET /info/: [200] 20 (0.00s)
>> (Thread-43 ) INFO 2018-01-16 14:16:12,659 web:95:web:(log_start) START
>> [192.168.150.105] PUT /tickets/
>> (Thread-43 ) INFO 2018-01-16 14:16:12,661 auth2:170:auth2:(add_signed_ticket)
>> Adding new ticket: <Ticket id=u'81569ab3-1b92-
>> 4744-8a58-f1948afa20b7',
url=u'https://ovirt01.localdomain.local:54322'
>> at 0x7f048c03c610>
>> (Thread-43 ) INFO 2018-01-16 14:16:12,662 web:102:web:(log_finish)
>> FINISH [192.168.150.105] PUT /tickets/: [200] 0 (0.00s)
>> (Thread-44 ) INFO 2018-01-16 14:16:13,800 web:95:web:(log_start) START
>> [192.168.150.101] OPTIONS /images/81569ab3-1b92-4744-
>> 8a58-f1948afa20b7
>> (Thread-44 ) INFO 2018-01-16 14:16:13,814 web:102:web:(log_finish)
>> FINISH [192.168.150.101] OPTIONS /images/81569ab3-1b92-47
>> 44-8a58-f1948afa20b7: [204] 0 (0.02s)
>> (Thread-45 ) INFO 2018-01-16 14:16:13,876 web:95:web:(log_start) START
>> [192.168.150.101] PUT /images/81569ab3-1b92-4744-8a58
>> -f1948afa20b7
>> (Thread-45 ) WARNING 2018-01-16 14:16:13,877 web:112:web:(log_error)
>> ERROR [192.168.150.101] PUT /images/81569ab3-1b92-4744-8a58-f1948afa20b7:
>> [401] Not authorized (0.00s)
>>
>> Gianluca
>>
>
>
> BTW:
> I don't know if its is in some way related with the upload problems, but
> in my engine .log I see these kind of messages every 5 or such seconds:
>
> 2018-01-16 14:27:38,428+01 INFO [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3)
> [61e72c38] START, GlusterServersListVDSCommand(HostName =
> ovirt02.localdomain.local, VdsIdVDSCommandParametersBase:
> {hostId='cb9cc605-fceb-4689-ad35-43ba883f4556'}), log id: 65e60794
> 2018-01-16 14:27:38,858+01 INFO [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler3)
> [61e72c38] FINISH, GlusterServersListVDSCommand, return: [
> 192.168.150.103/24:CONNECTED, ovirt03.localdomain.local:CONNECTED,
> ovirt01.localdomain.local:CONNECTED], log id: 65e60794
> 2018-01-16 14:27:38,867+01 INFO [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler3)
> [61e72c38] START, GlusterVolumesListVDSCommand(HostName =
> ovirt02.localdomain.local, GlusterVolumesListVDSParameter
> s:{hostId='cb9cc605-fceb-4689-ad35-43ba883f4556'}), log id: 6e01993d
> 2018-01-16 14:27:39,221+01 WARN [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler3)
> [61e72c38] Could not associate brick
'ovirt02.localdomain.local:/gluster/brick1/engine'
> of volume '6e2bd1d7-9c8e-4c54-9d85-f36e1b871771' with correct network as
> no gluster network found in cluster '582badbe-0080-0197-013b-00000
> 00001c6'
> 2018-01-16 14:27:39,231+01 WARN [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler3)
> [61e72c38] Could not associate brick
'ovirt02.localdomain.local:/gluster/brick2/data'
> of volume '2238c6db-48c5-4071-8929-879cedcf39bf' with correct network as
> no gluster network found in cluster '582badbe-0080-0197-013b-00000
> 00001c6'
> 2018-01-16 14:27:39,253+01 WARN [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler3)
> [61e72c38] Could not associate brick
'ovirt02.localdomain.local:/gluster/brick4/iso'
> of volume '28f99f11-3529-43a1-895c-abf1c66884ab' with correct network as
> no gluster network found in cluster '582badbe-0080-0197-013b-00000
> 00001c6'
> 2018-01-16 14:27:39,255+01 INFO [org.ovirt.engine.core.vdsbrok
> er.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler3)
> [61e72c38] FINISH, GlusterVolumesListVDSCommand, return:
> {2238c6db-48c5-4071-8929-879cedcf39bf=org.ovirt.engine.core.
> common.businessentities.gluster.GlusterVolumeEntity@aa6e9a1e,
> df0ccd1d-5de6-42b8-a163-ec65c3698da3=org.ovirt.engine.core.
> common.businessentities.gluster.GlusterVolumeEntity@31c29088,
> 6e2bd1d7-9c8e-4c54-9d85-f36e1b871771=org.ovirt.engine.core.
> common.businessentities.gluster.GlusterVolumeEntity@ae82860f,
> 28f99f11-3529-43a1-895c-abf1c66884ab=org.ovirt.engine.core.
> common.businessentities.gluster.GlusterVolumeEntity@1b6a11e5}, log id:
> 6e01993d
>
> Actualy te gluster network seems ok.
>
> Eg
>
> [root@ovirt01 glusterfs]# gluster volume info data
>
> Volume Name: data
> Type: Replicate
> Volume ID: 2238c6db-48c5-4071-8929-879cedcf39bf
> Status: Started
> Snapshot Count: 0
> Number of Bricks: 1 x (2 + 1) = 3
> Transport-type: tcp
> Bricks:
> Brick1: ovirt01.localdomain.local:/gluster/brick2/data
> Brick2: ovirt02.localdomain.local:/gluster/brick2/data
> Brick3: ovirt03.localdomain.local:/gluster/brick2/data (arbiter)
> Options Reconfigured:
> performance.strict-o-direct: on
> nfs.disable: on
> user.cifs: off
> network.ping-timeout: 30
> cluster.shd-max-threads: 6
> cluster.shd-wait-qlength: 10000
> cluster.locking-scheme: granular
> cluster.data-self-heal-algorithm: full
> performance.low-prio-threads: 32
> features.shard-block-size: 512MB
> features.shard: on
> storage.owner-gid: 36
> storage.owner-uid: 36
> cluster.server-quorum-type: server
> cluster.quorum-type: auto
> network.remote-dio: off
> cluster.eager-lock: enable
> performance.stat-prefetch: off
> performance.io-cache: off
> performance.read-ahead: off
> performance.quick-read: off
> performance.readdir-ahead: on
> transport.address-family: inet
> [root@ovirt01 glusterfs]#
>
> [root@ovirt01 glusterfs]# gluster volume heal data info
> Brick ovirt01.localdomain.local:/gluster/brick2/data
> Status: Connected
> Number of entries: 0
>
> Brick ovirt02.localdomain.local:/gluster/brick2/data
> Status: Connected
> Number of entries: 0
>
> Brick ovirt03.localdomain.local:/gluster/brick2/data
> Status: Connected
> Number of entries: 0
>
> [root@ovirt01 glusterfs]#
>
> Gianluca
>
>
At host side:
[root@ovirt01 glusterfs]# systemctl status ovirt-imageio-daemon -l
● ovirt-imageio-daemon.service - oVirt ImageIO Daemon
Loaded: loaded (/usr/lib/systemd/system/ovirt-imageio-daemon.service;
disabled; vendor preset: disabled)
Active: active (running) since Sat 2018-01-13 06:49:20 CET; 3 days ago
Main PID: 1004 (ovirt-imageio-d)
CGroup: /system.slice/ovirt-imageio-daemon.service
└─1004 /usr/bin/python /usr/bin/ovirt-imageio-daemon
Jan 13 06:49:19 ovirt01.localdomain.local systemd[1]: Starting oVirt
ImageIO Daemon...
Jan 13 06:49:20 ovirt01.localdomain.local systemd[1]: Started oVirt
ImageIO Daemon.
[root@ovirt01 glusterfs]#
and in /var/log/ovirt-imageio-daemon/daemon.log
2018-01-16 14:16:12,625 INFO (ticket.server) [web] START [/] PUT
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:12,626 INFO (ticket.server) [tickets] Adding ticket
<Ticket active=False expires=4580999 filename=None ops=[u'write']
size=1073741824 transferred=0 url=u'file:///rhev/data-
center/mnt/glusterSD/ovirt01.localdomain.local:data/
190f4096-003e-4908-825a-6c231e60276d/images/93b51148-
5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791'
uuid=u'81569ab3-1b92-4744-8a58-f1948afa20b7' at 0x24cde10>
2018-01-16 14:16:12,628 INFO (ticket.server) [web] FINISH [/] PUT
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 0 (0.00s)
2018-01-16 14:16:13,800 INFO (ticket.server) [web] START [/] GET
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:13,800 INFO (ticket.server) [tickets] Retrieving
ticket 81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:13,802 INFO (ticket.server) [web] FINISH [/] GET
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 355 (0.00s)
2018-01-16 14:16:15,846 INFO (ticket.server) [web] START [/] GET
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:15,846 INFO (ticket.server) [tickets] Retrieving
ticket 81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:15,847 INFO (ticket.server) [web] FINISH [/] GET
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 355 (0.00s)
2018-01-16 14:16:19,865 INFO (ticket.server) [web] START [/] GET
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:19,865 INFO (ticket.server) [tickets] Retrieving
ticket 81569ab3-1b92-4744-8a58-f1948afa20b7
2018-01-16 14:16:19,866 INFO (ticket.server) [web] FINISH [/] GET
/tickets/81569ab3-1b92-4744-8a58-f1948afa20b7: [200] 355 (0.00s)
and it seems the file is there???
root@ovirt01 ovirt-imageio-daemon]# ll /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-
9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
-rw-rw----. 1 vdsm kvm 1073741824 Jan 16 14:15 /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-
9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
[root@ovirt01 ovirt-imageio-daemon]#
[root@ovirt01 ovirt-imageio-daemon]# qemu-img info /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-
9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
image: /rhev/data-center/mnt/glusterSD/ovirt01.localdomain.
local:data/190f4096-003e-4908-825a-6c231e60276d/images/
93b51148-5a79-4c1a-a173-9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
file format: raw
virtual size: 1.0G (1073741824 bytes)
disk size: 0
[root@ovirt01 ovirt-imageio-daemon]#
but size zero:
[root@ovirt01 ovirt-imageio-daemon]# ls -ls /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-
9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
0 -rw-rw----. 1 vdsm kvm 1073741824 Jan 16 14:15 /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/93b51148-5a79-4c1a-a173-
9510f3807822/9dd4cdcb-5785-496e-8b46-7b25a3e97791
[root@ovirt01 ovirt-imageio-daemon]#
And the same if I go back when I tried to upload iso:
2018-01-14 18:23:24,867 INFO (ticket.server) [web] START [/] PUT
/tickets/b89f35d3-c09b-4dcb-bc13-abf18feb8cd0
2018-01-14 18:23:24,868 INFO (ticket.server) [tickets] Adding ticket
<Ticket active=False expires=4423031 filename=None o
ps=[u'write'] size=830472192 transferred=0 url=u'file:///rhev/data-
center/mnt/glusterSD/ovirt01.localdomain.local:data/190f4
096-003e-4908-825a-6c231e60276d/images/74c1ff00-
efbc-494f-ac5c-b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894'
uuid=u'b89
f35d3-c09b-4dcb-bc13-abf18feb8cd0' at 0x24cde50>
2018-01-14 18:23:24,868 INFO (ticket.server) [web] FINISH [/] PUT
/tickets/b89f35d3-c09b-4dcb-bc13-abf18feb8cd0: [200] 0
(0.00s)
and
[root@ovirt01 ovirt-imageio-daemon]# ll /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-
b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
-rw-rw----. 1 vdsm kvm 830472192 Jan 14 18:23 /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-
b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
[root@ovirt01 ovirt-imageio-daemon]#
ls -s gives 0 and in fact if I try to mount as loop device the supposed
iso files I get the error about "wrong fs type" ...
[root@ovirt01 ovirt-imageio-daemon]# ls -ls /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-
b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
0 -rw-rw----. 1 vdsm kvm 830472192 Jan 14 18:23 /rhev/data-center/mnt/
glusterSD/ovirt01.localdomain.local:data/190f4096-003e-4908-
825a-6c231e60276d/images/74c1ff00-efbc-494f-ac5c-
b3c84ea02ae4/cb5d0551-e8ff-4a93-b107-a6138770d894
[root@ovirt01 ovirt-imageio-daemon]#
HIH debugging,
Gianluca