<div dir="ltr"><div><div>Hi,<br><br></div>I tested uploading an ISO to Gluster on my setup and it worked fine.<br><br></div>The size is OK:<br><div><br># ls -lsh /rhev/data-center/mnt/glusterSD/*********:_fred1/f80e6d34-7c4c-4c0b-9451-dd140812c4ee/images/fa2209bc-d34c-4f3e-a425-9a085d72c3ba/0deef094-05a3-49c4-a347-ca423bd57a87<br>1.6G -rw-rw----. 1 vdsm kvm 1.6G Jan 17 10:06 /rhev/data-center/mnt/glusterSD/********:_fred1/f80e6d34-7c4c-4c0b-9451-dd140812c4ee/images/fa2209bc-d34c-4f3e-a425-9a085d72c3ba/0deef094-05a3-49c4-a347-ca423bd57a87</div><div><br></div><div><br></div><div>Are you seeing any other issues with your Gluster setup?</div><div>Creating regular disks, copy/move disks to this SD?</div><div><br></div><div>Thanks,</div><div>Fred<br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 16, 2018 at 4:25 PM, Gianluca Cecchi <span dir="ltr"><<a href="mailto:gianluca.cecchi@gmail.com" target="_blank">gianluca.cecchi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Tue, Jan 16, 2018 at 2:30 PM, Gianluca Cecchi <span dir="ltr"><<a href="mailto:gianluca.cecchi@gmail.com" target="_blank">gianluca.cecchi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div class="m_-7620281257213860147gmail-h5"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 16, 2018 at 2:21 PM, Gianluca Cecchi <span dir="ltr"><<a href="mailto:gianluca.cecchi@gmail.com" target="_blank">gianluca.cecchi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span class="m_-7620281257213860147gmail-m_-2513188929172332398gmail-"><div class="gmail_extra"><div class="gmail_quote">On Tue, Jan 16, 2018 at 6:48 AM, Fred Rolland <span dir="ltr"><<a href="mailto:frolland@redhat.com" target="_blank">frolland@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hi,<div dir="auto">I will look into it.</div><div dir="auto"><br></div><div dir="auto">Is it also not working also for non-iso images?</div><div dir="auto"><br></div><div dir="auto">Thanks,</div><div dir="auto">Fred</div></div><div class="gmail_extra"><br></div></blockquote><div> </div></div></div></span><div class="gmail_extra">Hello,</div><div class="gmail_extra">I get the same with a disk.</div><div class="gmail_extra">I have tried with a raw disk of size 1Gb.</div><div class="gmail_extra">When I upload I can set the size (why?) while with the iso image I could not.</div><div class="gmail_extra">The disk is recognized as "data" in upload window (the iso fie was correctly recognized as "iso"), but in image-proxy.log I get</div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">(Thread-42 ) INFO 2018-01-16 14:15:50,530 web:95:web:(log_start) START [192.168.150.101] GET /info/</div><div class="gmail_extra">(Thread-42 ) INFO 2018-01-16 14:15:50,532 web:102:web:(log_finish) FINISH [192.168.150.101] GET /info/: [200] 20 (0.00s)</div><div class="gmail_extra">(Thread-43 ) INFO 2018-01-16 14:16:12,659 web:95:web:(log_start) START [192.168.150.105] PUT /tickets/</div><div class="gmail_extra">(Thread-43 ) INFO 2018-01-16 14:16:12,661 auth2:170:auth2:(add_signed_ti<wbr>cket) Adding new ticket: <Ticket id=u'81569ab3-1b92-</div><div class="gmail_extra">4744-8a58-f1948afa20b7', url=u'<a href="https://ovirt01.localdomain.local:54322" target="_blank">https://ovirt01.localdom<wbr>ain.local:54322</a>' at 0x7f048c03c610></div><div class="gmail_extra">(Thread-43 ) INFO 2018-01-16 14:16:12,662 web:102:web:(log_finish) FINISH [192.168.150.105] PUT /tickets/: [200] 0 (0.00s)</div><div class="gmail_extra">(Thread-44 ) INFO 2018-01-16 14:16:13,800 web:95:web:(log_start) START [192.168.150.101] OPTIONS /images/81569ab3-1b92-4744-</div><div class="gmail_extra">8a58-f1948afa20b7</div><div class="gmail_extra">(Thread-44 ) INFO 2018-01-16 14:16:13,814 web:102:web:(log_finish) FINISH [192.168.150.101] OPTIONS /images/81569ab3-1b92-47</div><div class="gmail_extra">44-8a58-f1948afa20b7: [204] 0 (0.02s)</div><div class="gmail_extra">(Thread-45 ) INFO 2018-01-16 14:16:13,876 web:95:web:(log_start) START [192.168.150.101] PUT /images/81569ab3-1b92-4744-8a5<wbr>8</div><div class="gmail_extra">-f1948afa20b7</div><div class="gmail_extra">(Thread-45 ) WARNING 2018-01-16 14:16:13,877 web:112:web:(log_error) ERROR [192.168.150.101] PUT /images/81569ab3-1b92-4744-8a5<wbr>8-f1948afa20b7: [401] Not authorized (0.00s)</div><span class="m_-7620281257213860147gmail-m_-2513188929172332398gmail-HOEnZb"><font color="#888888"><div><br></div><div>Gianluca</div></font></span></div></div>
</blockquote></div><br></div><div class="gmail_extra"><br></div></div></div><div class="gmail_extra">BTW: </div><div class="gmail_extra">I don't know if its is in some way related with the upload problems, but in my engine .log I see these kind of messages every 5 or such seconds:</div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">2018-01-16 14:27:38,428+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterServersListV<wbr>DSCommand] (DefaultQuartzScheduler3) [61e72c38] START, GlusterServersListVDSCommand(H<wbr>ostName = ovirt02.localdomain.local, VdsIdVDSCommandParametersBase:<wbr>{hostId='cb9cc605-fceb-4689-ad<wbr>35-43ba883f4556'}), log id: 65e60794</div><div class="gmail_extra">2018-01-16 14:27:38,858+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterServersListV<wbr>DSCommand] (DefaultQuartzScheduler3) [61e72c38] FINISH, GlusterServersListVDSCommand, return: [<a href="http://192.168.150.103/24:CONNECTED" target="_blank">192.168.150.103/24:CONNECTED</a>, ovirt03.localdomain.local:CONN<wbr>ECTED, ovirt01.localdomain.local:CONN<wbr>ECTED], log id: 65e60794</div><div class="gmail_extra">2018-01-16 14:27:38,867+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterVolumesListV<wbr>DSCommand] (DefaultQuartzScheduler3) [61e72c38] START, GlusterVolumesListVDSCommand(H<wbr>ostName = ovirt02.localdomain.local, GlusterVolumesListVDSParameter<wbr>s:{hostId='cb9cc605-fceb-4689-<wbr>ad35-43ba883f4556'}), log id: 6e01993d</div><div class="gmail_extra">2018-01-16 14:27:39,221+01 WARN [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterVolumesListR<wbr>eturn] (DefaultQuartzScheduler3) [61e72c38] Could not associate brick 'ovirt02.localdomain.local:/gl<wbr>uster/brick1/engine' of volume '6e2bd1d7-9c8e-4c54-9d85-f36e1<wbr>b871771' with correct network as no gluster network found in cluster '582badbe-0080-0197-013b-00000<wbr>00001c6'</div><div class="gmail_extra">2018-01-16 14:27:39,231+01 WARN [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterVolumesListR<wbr>eturn] (DefaultQuartzScheduler3) [61e72c38] Could not associate brick 'ovirt02.localdomain.local:/gl<wbr>uster/brick2/data' of volume '2238c6db-48c5-4071-8929-879ce<wbr>dcf39bf' with correct network as no gluster network found in cluster '582badbe-0080-0197-013b-00000<wbr>00001c6'</div><div class="gmail_extra">2018-01-16 14:27:39,253+01 WARN [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterVolumesListR<wbr>eturn] (DefaultQuartzScheduler3) [61e72c38] Could not associate brick 'ovirt02.localdomain.local:/gl<wbr>uster/brick4/iso' of volume '28f99f11-3529-43a1-895c-abf1c<wbr>66884ab' with correct network as no gluster network found in cluster '582badbe-0080-0197-013b-00000<wbr>00001c6'</div><div class="gmail_extra">2018-01-16 14:27:39,255+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.gluster.GlusterVolumesListV<wbr>DSCommand] (DefaultQuartzScheduler3) [61e72c38] FINISH, GlusterVolumesListVDSCommand, return: {2238c6db-48c5-4071-8929-879ce<wbr>dcf39bf=org.ovirt.engine.core.<wbr>common.businessentities.gluste<wbr>r.GlusterVolumeEntity@aa6e9a1e<wbr>, df0ccd1d-5de6-42b8-a163-ec65c3<wbr>698da3=org.ovirt.engine.core.<wbr>common.businessentities.gluste<wbr>r.GlusterVolumeEntity@31c29088<wbr>, 6e2bd1d7-9c8e-4c54-9d85-f36e1b<wbr>871771=org.ovirt.engine.core.<wbr>common.businessentities.gluste<wbr>r.GlusterVolumeEntity@ae82860f<wbr>, 28f99f11-3529-43a1-895c-abf1c6<wbr>6884ab=org.ovirt.engine.core.<wbr>common.businessentities.gluste<wbr>r.GlusterVolumeEntity@1b6a11e5<wbr>}, log id: 6e01993d</div><div><br></div><div>Actualy te gluster network seems ok.</div><div><br></div><div>Eg</div><div><br></div><div><div>[root@ovirt01 glusterfs]# gluster volume info data</div><div> </div><div>Volume Name: data</div><div>Type: Replicate</div><div>Volume ID: 2238c6db-48c5-4071-8929-879ced<wbr>cf39bf</div><div>Status: Started</div><div>Snapshot Count: 0</div><div>Number of Bricks: 1 x (2 + 1) = 3</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: ovirt01.localdomain.local:/glu<wbr>ster/brick2/data</div><div>Brick2: ovirt02.localdomain.local:/glu<wbr>ster/brick2/data</div><div>Brick3: ovirt03.localdomain.local:/glu<wbr>ster/brick2/data (arbiter)</div><div>Options Reconfigured:</div><div>performance.strict-o-direct: on</div><div>nfs.disable: on</div><div>user.cifs: off</div><div>network.ping-timeout: 30</div><div>cluster.shd-max-threads: 6</div><div>cluster.shd-wait-qlength: 10000</div><div>cluster.locking-scheme: granular</div><div>cluster.data-self-heal-algorit<wbr>hm: full</div><div>performance.low-prio-threads: 32</div><div>features.shard-block-size: 512MB</div><div>features.shard: on</div><div>storage.owner-gid: 36</div><div>storage.owner-uid: 36</div><div>cluster.server-quorum-type: server</div><div>cluster.quorum-type: auto</div><div>network.remote-dio: off</div><div>cluster.eager-lock: enable</div><div>performance.stat-prefetch: off</div><div>performance.io-cache: off</div><div>performance.read-ahead: off</div><div>performance.quick-read: off</div><div>performance.readdir-ahead: on</div><div>transport.address-family: inet</div><div>[root@ovirt01 glusterfs]# </div></div><div><br></div><div><div>[root@ovirt01 glusterfs]# gluster volume heal data info </div><div>Brick ovirt01.localdomain.local:/glu<wbr>ster/brick2/data</div><div>Status: Connected</div><div>Number of entries: 0</div><div><br></div><div>Brick ovirt02.localdomain.local:/glu<wbr>ster/brick2/data</div><div>Status: Connected</div><div>Number of entries: 0</div><div><br></div><div>Brick ovirt03.localdomain.local:/glu<wbr>ster/brick2/data</div><div>Status: Connected</div><div>Number of entries: 0</div><div><br></div><div>[root@ovirt01 glusterfs]# </div></div><span class="m_-7620281257213860147gmail-HOEnZb"><font color="#888888"><div><br></div><div>Gianluca</div><div><br></div></font></span></div></div></blockquote><div><br></div><div><br></div></div></div><div>At host side:</div><div><br></div><div><div>[root@ovirt01 glusterfs]# systemctl status ovirt-imageio-daemon -l</div><div>● ovirt-imageio-daemon.service - oVirt ImageIO Daemon</div><div> Loaded: loaded (/usr/lib/systemd/system/<wbr>ovirt-imageio-daemon.service; disabled; vendor preset: disabled)</div><div> Active: active (running) since Sat 2018-01-13 06:49:20 CET; 3 days ago</div><div> Main PID: 1004 (ovirt-imageio-d)</div><div> CGroup: /system.slice/ovirt-imageio-<wbr>daemon.service</div><div> └─1004 /usr/bin/python /usr/bin/ovirt-imageio-daemon</div><div><br></div><div>Jan 13 06:49:19 ovirt01.localdomain.local systemd[1]: Starting oVirt ImageIO Daemon...</div><div>Jan 13 06:49:20 ovirt01.localdomain.local systemd[1]: Started oVirt ImageIO Daemon.</div><div>[root@ovirt01 glusterfs]#</div></div><div><br></div><div>and in /var/log/ovirt-imageio-<wbr>daemon/daemon.log</div><div><br></div><div>2018-01-16 14:16:12,625 INFO (ticket.server) [web] START [/] PUT /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7</div><div>2018-01-16 14:16:12,626 INFO (ticket.server) [tickets] Adding ticket <Ticket active=False expires=4580999 filename=None ops=[u'write'] size=1073741824 transferred=0 url=u'file:///rhev/data-<wbr>center/mnt/glusterSD/ovirt01.<wbr>localdomain.local:data/<wbr>190f4096-003e-4908-825a-<wbr>6c231e60276d/images/93b51148-<wbr>5a79-4c1a-a173-9510f3807822/<wbr>9dd4cdcb-5785-496e-8b46-<wbr>7b25a3e97791' uuid=u'81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7' at 0x24cde10></div><div>2018-01-16 14:16:12,628 INFO (ticket.server) [web] FINISH [/] PUT /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7: [200] 0 (0.00s)</div><div>2018-01-16 14:16:13,800 INFO (ticket.server) [web] START [/] GET /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7</div><div>2018-01-16 14:16:13,800 INFO (ticket.server) [tickets] Retrieving ticket 81569ab3-1b92-4744-8a58-<wbr>f1948afa20b7</div><div>2018-01-16 14:16:13,802 INFO (ticket.server) [web] FINISH [/] GET /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7: [200] 355 (0.00s)</div><div>2018-01-16 14:16:15,846 INFO (ticket.server) [web] START [/] GET /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7</div><div>2018-01-16 14:16:15,846 INFO (ticket.server) [tickets] Retrieving ticket 81569ab3-1b92-4744-8a58-<wbr>f1948afa20b7</div><div>2018-01-16 14:16:15,847 INFO (ticket.server) [web] FINISH [/] GET /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7: [200] 355 (0.00s)</div><div>2018-01-16 14:16:19,865 INFO (ticket.server) [web] START [/] GET /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7</div><div>2018-01-16 14:16:19,865 INFO (ticket.server) [tickets] Retrieving ticket 81569ab3-1b92-4744-8a58-<wbr>f1948afa20b7</div><div>2018-01-16 14:16:19,866 INFO (ticket.server) [web] FINISH [/] GET /tickets/81569ab3-1b92-4744-<wbr>8a58-f1948afa20b7: [200] 355 (0.00s)</div><div> </div><div>and it seems the file is there???</div><div><br></div></div><div class="gmail_extra">root@ovirt01 ovirt-imageio-daemon]# ll /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>93b51148-5a79-4c1a-a173-<wbr>9510f3807822/9dd4cdcb-5785-<wbr>496e-8b46-7b25a3e97791</div><div class="gmail_extra">-rw-rw----. 1 vdsm kvm 1073741824 Jan 16 14:15 /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>93b51148-5a79-4c1a-a173-<wbr>9510f3807822/9dd4cdcb-5785-<wbr>496e-8b46-7b25a3e97791</div><div class="gmail_extra">[root@ovirt01 ovirt-imageio-daemon]# </div><div><br></div><div><div>[root@ovirt01 ovirt-imageio-daemon]# qemu-img info /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>93b51148-5a79-4c1a-a173-<wbr>9510f3807822/9dd4cdcb-5785-<wbr>496e-8b46-7b25a3e97791</div><div>image: /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>93b51148-5a79-4c1a-a173-<wbr>9510f3807822/9dd4cdcb-5785-<wbr>496e-8b46-7b25a3e97791</div><div>file format: raw</div><div>virtual size: 1.0G (1073741824 bytes)</div><div>disk size: 0</div><div>[root@ovirt01 ovirt-imageio-daemon]# </div></div><div><br></div><div>but size zero:</div><div><div>[root@ovirt01 ovirt-imageio-daemon]# ls -ls /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>93b51148-5a79-4c1a-a173-<wbr>9510f3807822/9dd4cdcb-5785-<wbr>496e-8b46-7b25a3e97791</div><div>0 -rw-rw----. 1 vdsm kvm 1073741824 Jan 16 14:15 /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>93b51148-5a79-4c1a-a173-<wbr>9510f3807822/9dd4cdcb-5785-<wbr>496e-8b46-7b25a3e97791</div><div>[root@ovirt01 ovirt-imageio-daemon]# </div></div><div><br></div><div><br></div><div>And the same if I go back when I tried to upload iso:</div><div><br></div><div><div>2018-01-14 18:23:24,867 INFO (ticket.server) [web] START [/] PUT /tickets/b89f35d3-c09b-4dcb-<wbr>bc13-abf18feb8cd0</div><div>2018-01-14 18:23:24,868 INFO (ticket.server) [tickets] Adding ticket <Ticket active=False expires=4423031 filename=None o</div><div>ps=[u'write'] size=830472192 transferred=0 url=u'file:///rhev/data-<wbr>center/mnt/glusterSD/ovirt01.<wbr>localdomain.local:data/190f4</div><div>096-003e-4908-825a-<wbr>6c231e60276d/images/74c1ff00-<wbr>efbc-494f-ac5c-b3c84ea02ae4/<wbr>cb5d0551-e8ff-4a93-b107-<wbr>a6138770d894' uuid=u'b89</div><div>f35d3-c09b-4dcb-bc13-<wbr>abf18feb8cd0' at 0x24cde50></div><div>2018-01-14 18:23:24,868 INFO (ticket.server) [web] FINISH [/] PUT /tickets/b89f35d3-c09b-4dcb-<wbr>bc13-abf18feb8cd0: [200] 0 </div><div>(0.00s)</div></div><div><br></div><div>and</div><div><br></div><div><div>[root@ovirt01 ovirt-imageio-daemon]# ll /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>74c1ff00-efbc-494f-ac5c-<wbr>b3c84ea02ae4/cb5d0551-e8ff-<wbr>4a93-b107-a6138770d894</div><div>-rw-rw----. 1 vdsm kvm 830472192 Jan 14 18:23 /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>74c1ff00-efbc-494f-ac5c-<wbr>b3c84ea02ae4/cb5d0551-e8ff-<wbr>4a93-b107-a6138770d894</div><div>[root@ovirt01 ovirt-imageio-daemon]# </div></div><div><br></div><div>ls -s gives 0 and in fact if I try to mount as loop device the supposed iso files I get the error about "wrong fs type" ...</div><div><br></div><div><div>[root@ovirt01 ovirt-imageio-daemon]# ls -ls /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>74c1ff00-efbc-494f-ac5c-<wbr>b3c84ea02ae4/cb5d0551-e8ff-<wbr>4a93-b107-a6138770d894</div><div>0 -rw-rw----. 1 vdsm kvm 830472192 Jan 14 18:23 /rhev/data-center/mnt/<wbr>glusterSD/ovirt01.localdomain.<wbr>local:data/190f4096-003e-4908-<wbr>825a-6c231e60276d/images/<wbr>74c1ff00-efbc-494f-ac5c-<wbr>b3c84ea02ae4/cb5d0551-e8ff-<wbr>4a93-b107-a6138770d894</div><div>[root@ovirt01 ovirt-imageio-daemon]# </div></div><div><br></div><div>HIH debugging,</div><div>Gianluca</div></div></div>
</blockquote></div><br></div>