<div dir="ltr"><br><br><div class="gmail_quote"><div dir="ltr">On Thu, Dec 7, 2017 at 1:22 AM Gianluca Cecchi <<a href="mailto:gianluca.cecchi@gmail.com">gianluca.cecchi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Wed, Dec 6, 2017 at 11:42 PM, Nir Soffer <span dir="ltr"><<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_quote"><span class="m_6038285226615943421gmail-"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><br></div><div>BTW: I notice that the disk seems preallocated even if original qcow2 is thin... is this expected?</div><div>This obviously also impacts the time to upload (20Gb virtual disk with actual 1.2Gb occupied needs the time equivalent for full 20Gb...)</div></div></div></div></blockquote><div><br></div></span><div>We upload exactly the file you provided, there is no way we can upload 20G from 1.2G file :-)</div></div></div></blockquote><div><br></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div>But the upload process at a medium rate of 40-50MB/s has last about 9 minutes that confirms the 20Gb size</div><div>The disk at source has been created as virtio type and format qcow2 from virt-manager and then only installed a CentOS 7.2 OS with infrastructure server configuration.</div><div>Apart from qemu-img also ls:</div><div><div># ls -lhs c7lab1.qcow2 </div><div>1.3G -rw------- 1 root root 21G Dec 6 23:05 c7lab1.qcow2</div></div></div></div></div></blockquote><div><br></div><div>The fiile size is 21G - matching what you see. This is the size we upload.</div><div><br></div><div>1.3G is the used size on the file system, we cannot upload only used blocks.</div><div>qemu-img info "Disk size" is not the file size the the used size, not useful </div><div>for upload.</div><div><br></div><div>Maybe this file was crated with preallocation=full?</div><div><br></div><div>To optimize this file for upload, you can do:<br></div><div><br></div><div> qemu convert -p -f qcow2 -O qcow2 c7lab1.qcow2 c7lab1-opt.qcow2</div><div><br></div><div>I think the output file size will be shrink.</div><div><br></div><div>You can also compress it:</div><div><br></div><div><div> qemu convert -p -c -f qcow2 -O qcow2 c7lab1.qcow2 c7lab1-compressed.qcow2</div><br class="inbox-inbox-Apple-interchange-newline"></div><div>Please share the results.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br></div><div>On target after upload:</div><div><br></div><div><div>[root@ovirt01 251063f6-5570-4bdc-b28f-21e82aa5e185]# ls -lhs 77aacfb3-9e67-4ad2-96f6-242b5ba4d9e0</div><div>21G -rw-rw----. 1 vdsm kvm 21G Dec 6 23:44 77aacfb3-9e67-4ad2-96f6-242b5ba4d9e0</div><div>[root@ovirt01 251063f6-5570-4bdc-b28f-21e82aa5e185]# </div></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><div><br></div><div>But maybe we created the file in the wrong format?</div><div><br></div><div>Can you share vdsm logs from the spm, showing how the disk was created?</div><span class="m_6038285226615943421gmail-"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><br></div></div></div></blockquote></span></div></div></blockquote><div><br></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div>First message at beginning of upload:</div><div><br></div><div><div>2017-12-06 23:09:50,183+0100 INFO (jsonrpc/4) [vdsm.api] START createVolume(sdUUID=u'572eabe7-15d0-42c2-8fa9-0bd773e22e2e', spUUID=u'00000001-0001-0001-0001-000000000343', imgUUID=u'251063f6-5570-4bdc-b28f-21e82aa5e185', size=u'22548578304', volFormat=4, preallocate=2, diskType=2, volUUID=u'77aacfb3-9e67-4ad2-96f6-242b5ba4d9e0', desc=u'{"DiskAlias":"c7lab1","DiskDescription":""}', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000', initialSize=None) from=192.168.1.212,56846, flow_id=18c6bd3b-76ab-45f9-b8c7-09c727f44c91, task_id=e7cc67e6-4b61-4bb3-81b1-6bc687ea5ee9 (api:46)</div></div><div><br></div><div><br></div><div>Last message that corresponds to completion of upload:</div><div><br></div><div><div>2017-12-06 23:21:03,914+0100 INFO (jsonrpc/4) [storage.VolumeManifest] 572eabe7-15d0-42c2-8fa9-0bd773e22e2e/251063f6-5570-4bdc-b28f-21e82aa5e185/77aacfb3-9e67-4ad2-96f6-242b5ba4d9e0 info is {'status': 'OK', 'domain': '572eabe7-15d0-42c2-8fa9-0bd773e22e2e', 'voltype': 'LEAF', 'description': '{"DiskAlias":"c7lab1","DiskDescription":""}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'generation': 0, 'image': '251063f6-5570-4bdc-b28f-21e82aa5e185', 'ctime': '1512598190', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '21496266752', 'children': [], 'pool': '', 'capacity': '22548578304', 'uuid': u'77aacfb3-9e67-4ad2-96f6-242b5ba4d9e0', 'truesize': '21496602624', 'type': 'SPARSE', 'lease': {'owners': [], 'version': None}} (volume:272)</div><div>2017-12-06 23:21:03,915+0100 INFO (jsonrpc/4) [vdsm.api] FINISH getVolumeInfo return={'info': {'status': 'OK', 'domain': '572eabe7-15d0-42c2-8fa9-0bd773e22e2e', 'voltype': 'LEAF', 'description': '{"DiskAlias":"c7lab1","DiskDescription":""}', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'generation': 0, 'image': '251063f6-5570-4bdc-b28f-21e82aa5e185', 'ctime': '1512598190', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '21496266752', 'children': [], 'pool': '', 'capacity': '22548578304', 'uuid': u'77aacfb3-9e67-4ad2-96f6-242b5ba4d9e0', 'truesize': '21496602624', 'type': 'SPARSE', 'lease': {'owners': [], 'version': None}}} from=192.168.1.212,56840, flow_id=18c6bd3b-76ab-45f9-b8c7-09c727f44c91, task_id=6b268651-4a7f-4366-9d01-829deaa16bfd (api:52)</div></div><div><br></div><div>Full vdsm.log.gz in between here:</div><div><br></div><div><a href="https://drive.google.com/file/d/1IZIKDXyNN3bc6035C5Rc5WiI_UZ_g0ZV/view?usp=sharing" target="_blank">https://drive.google.com/file/d/1IZIKDXyNN3bc6035C5Rc5WiI_UZ_g0ZV/view?usp=sharing</a><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><span class="m_6038285226615943421gmail-"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"></div></div></div></blockquote><div><br></div></span><div>NFS version?</div></div></div></blockquote><div><br></div><div>The mount done from the host is this:</div><div><br></div><div>[root@ovirt01 /] # mount | grep NFS_DOMAIN</div><div>ovirt01:/NFS_DOMAIN on /rhev/data-center/mnt/ovirt01:_NFS__DOMAIN type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,timeo=600,retrans=6,sec=sys,mountaddr=192.168.1.211,mountvers=3,mountport=20048,mountproto=udp,local_lock=none,addr=192.168.1.211)<br></div><div><br></div><div>This is a test system so that I only have one host and the NFS mount is done over an XFS local filesystem exported by itself, but I think this should not be relevant for this particular test...</div><div><br></div><div>Another note: it seems that in events there is no message related to image upload completion. I only see:</div><div></div><div><br></div><div>Dec 6, 2017 11:09:51 PM Add-Disk operation of 'c7lab1' was initiated by the system.<br></div><div>Dec 6, 2017 11:09:49 PM Image Upload with disk c7lab1 was initiated by admin@internal-authz.<br></div><div><br></div><div>and no message around 23:21 when the upload completes.</div><div>Thanks,</div><div>Gianluca</div><div><br></div><div><br></div></div></div></div>
</blockquote></div></div>