5:24 a.m.
--_000_D86C48DF8800164BBE50B87623F7AC9585F500F2ln2wio001devtra_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
If I create a preallocated disk for a VM, I see the disk image file listing=
as the size I requested (100G):
cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas__01b__oVirt__prod__01/=
53560d43-874a-49c5-9c5a-8b90487c79f8/images/d97f7706-3662-40bf-9358-80e0dc5=
1bff4
root@ovirt_host> ls -l
total 105064644
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.meta
and the corresponding space used on disk matches
root@ ovirt_host > du -sh *
101G 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
If I then migrate that storage (while the VM is shutdown) to a new storage =
domain, the size on disk does not match the allocated size. In this case th=
ere is nothing in the disk yet so it shows as 0.
cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovirt__uatprod/1f2c2b48-1e=
77-4c98-a6da-5dc09b78cead/images/d97f7706-3662-40bf-9358-80e0dc51bff4
root@ ovirt_host> ls -l
total 1032
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.meta
root@ ovirt_host > du -sh *
0 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
oVirt still lists the disk as preallocated in the GUI but it is in fact thi=
n provisioned.
I see the same issue if I clone a preallocated VM. The size on disk ends up=
being the equivalent of a thin-provisioned disk. I also had the issue when=
importing VM's from an export domain when I had selected preallocated in t=
he import dialog box.
Is this a known issue? Should preallocated not mean preallocated on physica=
l disk?
Ovirt Engine is running 3.6.4.1-1.el6
The ovirt nodes are running:
OS Version: RHEL - 7 - 2.1511.el7.centos.2.10
Kernel Version: 3.10.0 - 327.4.5.el7.x86_64
KVM Version: 2.3.0 - 31.el7_2.7.1
LIBVIRT Version: libvirt-1.2.17-13.el7_2.2
VDSM Version: vdsm-4.17.23.2-0.el7.centos
SPICE Version: 0.12.4 - 15.el7
GlusterFS Version: [N/A]
CEPH Version: librbd1-0.80.7-3.el7
Many thanks,
Simon
--_000_D86C48DF8800164BBE50B87623F7AC9585F500F2ln2wio001devtra_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml"
xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word"
=
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml"
xmlns=3D"http:=
//www.w3.org/TR/REC-html40" <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3Dus-ascii"=
<meta name=3D"Generator" content=3D"Microsoft
Word 15 (filtered medium)" <style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.gdol3hyccnd
{mso-style-name:gdol3hyccnd;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" / </xml><![endif]--><!--[if gte mso
9]><xml <o:shapelayout
v:ext=3D"edit" <o:idmap v:ext=3D"edit"
data=3D"1" /
</o:shapelayout></xml><![endif]--
</head <body lang=3D"EN-US"
link=3D"#0563C1" vlink=3D"#954F72" <div
class=3D"WordSection1" <p
class=3D"MsoNormal">If I create a preallocated disk for a VM, I see the =
disk image file listing as the size I requested (100G):<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas=
__01b__oVirt__prod__01/53560d43-874a-49c5-9c5a-8b90487c79f8/images/d97f7706=
-3662-40bf-9358-80e0dc51bff4<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ovirt_host> ls
-l<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">total
105064644<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm kvm 107374182400 Aug 5
10:57=
75c14559-e18f-4cc8-a3fe-bc0de507720b<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm
kvm =
1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease<o:p></=
o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-r--r-- 1 vdsm
kvm &=
nbsp; 313 Aug 5 10:57
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">and the corresponding
space used on disk matches<o:p=
></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ ovirt_host > du -sh
*<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">101G
75c14559-e18f-4cc8-a3fe-bc0de=
507720b<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">1.1M
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.lease<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">4.0K
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">If I then migrate that
storage (while the VM is shut=
down) to a new storage domain, the size on disk does not match the allocate=
d size. In this case there is nothing in the disk yet so it shows as 0.<o:p=
></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovi=
rt__uatprod/1f2c2b48-1e77-4c98-a6da-5dc09b78cead/images/d97f7706-3662-40bf-=
9358-80e0dc51bff4<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ ovirt_host> ls
-l<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">total
1032<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm kvm 107374182400 Aug 5
11:06=
75c14559-e18f-4cc8-a3fe-bc0de507720b<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm
kvm =
1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease<o:p></=
o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-r--r-- 1 vdsm
kvm &=
nbsp; 313 Aug 5 11:06
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier
New",serif"><o:p> </o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ ovirt_host > du -sh
*<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier
New",serif">0
75c14559-e18f-=
4cc8-a3fe-bc0de507720b<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">1.1M
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.lease<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">4.0K
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">oVirt still lists the
disk as preallocated in the GU=
I but it is in fact thin provisioned.<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">I see the same issue if
I clone a preallocated VM. T=
he size on disk ends up being the equivalent of a thin-provisioned disk. I =
also had the issue when importing VM’s from an export domain when I h=
ad selected preallocated in the import dialog
box.<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">Is this a known issue?
Should preallocated not mean =
preallocated on physical disk?<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">Ovirt Engine is running
3.6.4.1-1.el6<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">The ovirt nodes are
running: <o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">OS
Version:  =
;
&=
nbsp; RHEL - 7 -
2.1511.el7.centos.2.10<o:p></o:p></p <p
class=3D"MsoNormal">Kernel Version:
=
3.10.0 - 327.4.5.el7=
.x86_64<o:p></o:p></p <p
class=3D"MsoNormal">KVM Version:
&nb=
sp;
2.3.0=
- 31.el7_2.7.1<o:p></o:p></p <p
class=3D"MsoNormal">LIBVIRT
Version: =
libvirt-1.2.17-13.el7_2.2<=
o:p></o:p></p <p
class=3D"MsoNormal">VDSM Version:
&n=
bsp;
vdsm-4.17.23.2-0.el7.c=
entos<o:p></o:p></p <p
class=3D"MsoNormal">SPICE Version:
&=
nbsp;
0.12.4 - 15.el7=
<o:p></o:p></p <p
class=3D"MsoNormal">GlusterFS
Version: &nbs=
p; [N/A]<o:p></o:p></p <p class=3D"MsoNormal">CEPH
Version: &n=
bsp;
librbd1-0.=
80.7-3.el7<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">Many
thanks,<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p
class=3D"MsoNormal">Simon<o:p></o:p></p </div
</body </html
--_000_D86C48DF8800164BBE50B87623F7AC9585F500F2ln2wio001devtra_--
11:37 a.m.
--_000_D86C48DF8800164BBE50B87623F7AC9585F5111Dln2wio001devtra_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Another example. This one was moved to a new storage domain
root@ovirt_host1> qemu-img info dd6f25f6-7830-4024-915f-a20268797c34
image: dd6f25f6-7830-4024-915f-a20268797c34
file format: raw
virtual size: 200G (214748364800 bytes)
disk size: 5.0G
root@ ovirt_host1> cat dd6f25f6-7830-4024-915f-a20268797c34.meta
DOMAIN=3D53560d43-874a-49c5-9c5a-8b90487c79f8
VOLTYPE=3DLEAF
CTIME=3D1470305678
FORMAT=3DRAW
IMAGE=3D741976cd-d1cb-4031-bdbe-6a745dff16ef
DISKTYPE=3D2
PUUID=3D00000000-0000-0000-0000-000000000000
LEGALITY=3DLEGAL
MTIME=3D0
POOL_UUID=3D
SIZE=3D419430400
TYPE=3DPREALLOCATED
DESCRIPTION=3D
EOF
This one has not been moved:
root(a)ny2-lvb-066.mgt> qemu-img info 155f0d33-c280-4236-8d1e-fcb88f9a1242
image: 155f0d33-c280-4236-8d1e-fcb88f9a1242
file format: raw
virtual size: 90G (96636764160 bytes)
disk size: 90G
root(a)ny2-lvb-066.mgt> cat 155f0d33-c280-4236-8d1e-fcb88f9a1242.meta
DOMAIN=3D59bde2ff-e10d-477e-91c1-6355abff0999
CTIME=3D1464946639
FORMAT=3DRAW
DISKTYPE=3D2
LEGALITY=3DLEGAL
SIZE=3D188743680
VOLTYPE=3DLEAF
DESCRIPTION=3D{"DiskAlias":"ny2-laa-010.prod_Disk1","DiskDescription":""}
IMAGE=3D82158182-81a4-458e-a41b-663756962666
PUUID=3D00000000-0000-0000-0000-000000000000
MTIME=3D0
POOL_UUID=3D
TYPE=3DPREALLOCATED
EOF
See the mismatch between "virtual size" and "disk size" on the one
that was=
moved.
TIA,
Simon
From: users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of=
Simon Barrett
Sent: Friday, 5 August, 2016 10:25
To: users(a)ovirt.org
Subject: [ovirt-users] preallocated storage issue?
If I create a preallocated disk for a VM, I see the disk image file listing=
as the size I requested (100G):
cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas__01b__oVirt__prod__01/=
53560d43-874a-49c5-9c5a-8b90487c79f8/images/d97f7706-3662-40bf-9358-80e0dc5=
1bff4
root@ovirt_host> ls -l
total 105064644
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.meta
and the corresponding space used on disk matches
root@ ovirt_host > du -sh *
101G 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
If I then migrate that storage (while the VM is shutdown) to a new storage =
domain, the size on disk does not match the allocated size. In this case th=
ere is nothing in the disk yet so it shows as 0.
cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovirt__uatprod/1f2c2b48-1e=
77-4c98-a6da-5dc09b78cead/images/d97f7706-3662-40bf-9358-80e0dc51bff4
root@ ovirt_host> ls -l
total 1032
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.meta
root@ ovirt_host > du -sh *
0 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
oVirt still lists the disk as preallocated in the GUI but it is in fact thi=
n provisioned.
I see the same issue if I clone a preallocated VM. The size on disk ends up=
being the equivalent of a thin-provisioned disk. I also had the issue when=
importing VM's from an export domain when I had selected preallocated in t=
he import dialog box.
Is this a known issue? Should preallocated not mean preallocated on physica=
l disk?
Ovirt Engine is running 3.6.4.1-1.el6
The ovirt nodes are running:
OS Version: RHEL - 7 - 2.1511.el7.centos.2.10
Kernel Version: 3.10.0 - 327.4.5.el7.x86_64
KVM Version: 2.3.0 - 31.el7_2.7.1
LIBVIRT Version: libvirt-1.2.17-13.el7_2.2
VDSM Version: vdsm-4.17.23.2-0.el7.centos
SPICE Version: 0.12.4 - 15.el7
GlusterFS Version: [N/A]
CEPH Version: librbd1-0.80.7-3.el7
Many thanks,
Simon
--_000_D86C48DF8800164BBE50B87623F7AC9585F5111Dln2wio001devtra_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml"
xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word"
=
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml"
xmlns=3D"http:=
//www.w3.org/TR/REC-html40" <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3Dus-ascii"=
<meta name=3D"Generator" content=3D"Microsoft
Word 15 (filtered medium)" <style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.gdol3hyccnd
{mso-style-name:gdol3hyccnd;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" / </xml><![endif]--><!--[if gte mso
9]><xml <o:shapelayout
v:ext=3D"edit" <o:idmap v:ext=3D"edit"
data=3D"1" /
</o:shapelayout></xml><![endif]--
</head <body lang=3D"EN-US"
link=3D"#0563C1" vlink=3D"#954F72" <div
class=3D"WordSection1" <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">Another
example. This =
one was moved to a new storage domain<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">root@ovirt_host1> q=
emu-img info
dd6f25f6-7830-4024-915f-a20268797c34<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">image: dd6f25f6-7830-4=
024-915f-a20268797c34<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">file format: raw<o:p><=
/o:p></span></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">virtual
size: 200G (21=
4748364800 bytes)<o:p></o:p></span></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">disk size:
5.0G<o:p></=
o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">root@
ovirt_host1> =
cat
dd6f25f6-7830-4024-915f-a20268797c34.meta<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">DOMAIN=3D53560d43-874a=
-49c5-9c5a-8b90487c79f8<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">VOLTYPE=3DLEAF<o:p></o=
:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">CTIME=3D1470305678<o:p=
></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">FORMAT=3DRAW<o:p></o:p=
></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">IMAGE=3D741976cd-d1cb-=
4031-bdbe-6a745dff16ef<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">DISKTYPE=3D2<o:p></o:p=
></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">PUUID=3D00000000-0000-=
0000-0000-000000000000<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">LEGALITY=3DLEGAL<o:p><=
/o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">MTIME=3D0<o:p></o:p></=
span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">POOL_UUID=3D<o:p></o:p=
></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">SIZE=3D419430400<o:p><=
/o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">TYPE=3DPREALLOCATED<o:=
p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">DESCRIPTION=3D<o:p></o=
:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">EOF<o:p></o:p></span><=
/p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">This one
has not been =
moved:<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">root@ny2-lvb-066.mgt&g=
t; qemu-img info
155f0d33-c280-4236-8d1e-fcb88f9a1242<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">image: 155f0d33-c280-4=
236-8d1e-fcb88f9a1242<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">file format: raw<o:p><=
/o:p></span></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">virtual
size: 90G (966=
36764160 bytes)<o:p></o:p></span></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">disk size:
90G<o:p></o=
:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">root@ny2-lvb-066.mgt&g=
t; cat
155f0d33-c280-4236-8d1e-fcb88f9a1242.meta<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">DOMAIN=3D59bde2ff-e10d=
-477e-91c1-6355abff0999<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">CTIME=3D1464946639<o:p=
></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">FORMAT=3DRAW<o:p></o:p=
></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">DISKTYPE=3D2<o:p></o:p=
></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">LEGALITY=3DLEGAL<o:p><=
/o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">SIZE=3D188743680<o:p><=
/o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">VOLTYPE=3DLEAF<o:p></o=
:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">DESCRIPTION=3D{"D=
iskAlias":"ny2-laa-010.prod_Disk1","DiskDescription&quo=
t;:""}<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">IMAGE=3D82158182-81a4-=
458e-a41b-663756962666<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">PUUID=3D00000000-0000-=
0000-0000-000000000000<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D">MTIME=3D0<o:p></o:p></=
span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">POOL_UUID=3D<o:p></o:p=
></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">TYPE=3DPREALLOCATED<o:=
p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">EOF<o:p></o:p></span><=
/p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span style=3D"color:#1F497D">See the
mismatch betwe=
en “virtual size” and “disk size” on the one that
w=
as moved.<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">TIA,<o:p></o:p></span>=
</p <p class=3D"MsoNormal"><span
style=3D"color:#1F497D"><o:p> </o:p></spa=
n></p <p
class=3D"MsoNormal"><span
style=3D"color:#1F497D">Simon<o:p></o:p></span=
></p <p
class=3D"MsoNormal"><a name=3D"_MailEndCompose"><span
style=3D"color:#1F=
497D"><o:p> </o:p></span></a></p <div <div
style=3D"border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in =
0in 0in" <p
class=3D"MsoNormal"><b>From:</b> users-bounces(a)ovirt.org
[mailto:users-b=
ounces(a)ovirt.org]
<b>On Behalf Of </b>Simon Barrett<br
<b>Sent:</b> Friday, 5 August, 2016 10:25<br <b>To:</b> users(a)ovirt.org<br <b>Subject:</b> [ovirt-users] preallocated storage
issue?<o:p></o:p></p
</div </div <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">If I create a
preallocated disk for a VM, I see the =
disk image file listing as the size I requested (100G):<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas=
__01b__oVirt__prod__01/53560d43-874a-49c5-9c5a-8b90487c79f8/images/d97f7706=
-3662-40bf-9358-80e0dc51bff4<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ovirt_host> ls
-l<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">total
105064644<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm kvm 107374182400 Aug 5
10:57=
75c14559-e18f-4cc8-a3fe-bc0de507720b<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm
kvm =
1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease<o:p></=
o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-r--r-- 1 vdsm
kvm &=
nbsp; 313 Aug 5 10:57
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">and the corresponding
space used on disk matches<o:p=
></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ ovirt_host > du -sh
*<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">101G
75c14559-e18f-4cc8-a3fe-bc0de=
507720b<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">1.1M
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.lease<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">4.0K
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">If I then migrate that
storage (while the VM is shut=
down) to a new storage domain, the size on disk does not match the allocate=
d size. In this case there is nothing in the disk yet so it shows as 0.<o:p=
></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovi=
rt__uatprod/1f2c2b48-1e77-4c98-a6da-5dc09b78cead/images/d97f7706-3662-40bf-=
9358-80e0dc51bff4<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ ovirt_host> ls
-l<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">total
1032<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm kvm 107374182400 Aug 5
11:06=
75c14559-e18f-4cc8-a3fe-bc0de507720b<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-rw---- 1 vdsm
kvm =
1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease<o:p></=
o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">-rw-r--r-- 1 vdsm
kvm &=
nbsp; 313 Aug 5 11:06
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier
New",serif"><o:p> </o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">root@ ovirt_host > du -sh
*<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier
New",serif">0
75c14559-e18f-=
4cc8-a3fe-bc0de507720b<o:p></o:p></span></p <p class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">1.1M
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.lease<o:p></o:p></span></p <p
class=3D"MsoNormal"><span
style=3D"font-size:10.0pt;font-family:"Co=
urier New",serif">4.0K
75c14559-e18f-4cc8-a3fe-bc0de=
507720b.meta<o:p></o:p></span></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">oVirt still lists the
disk as preallocated in the GU=
I but it is in fact thin provisioned.<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">I see the same issue if
I clone a preallocated VM. T=
he size on disk ends up being the equivalent of a thin-provisioned disk. I =
also had the issue when importing VM’s from an export domain when I h=
ad selected preallocated in the import dialog
box.<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">Is this a known issue?
Should preallocated not mean =
preallocated on physical disk?<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">Ovirt Engine is running
3.6.4.1-1.el6<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">The ovirt nodes are
running: <o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">OS
Version:  =
;
&=
nbsp; RHEL - 7 -
2.1511.el7.centos.2.10<o:p></o:p></p <p
class=3D"MsoNormal">Kernel Version:
=
3.10.0 - 327.4.5.el7=
.x86_64<o:p></o:p></p <p
class=3D"MsoNormal">KVM Version:
&nb=
sp;
2.3.0=
- 31.el7_2.7.1<o:p></o:p></p <p
class=3D"MsoNormal">LIBVIRT
Version: =
libvirt-1.2.17-13.el7_2.2<=
o:p></o:p></p <p
class=3D"MsoNormal">VDSM Version:
&n=
bsp;
vdsm-4.17.23.2-0.el7.c=
entos<o:p></o:p></p <p
class=3D"MsoNormal">SPICE Version:
&=
nbsp;
0.12.4 - 15.el7=
<o:p></o:p></p <p
class=3D"MsoNormal">GlusterFS
Version: &nbs=
p; [N/A]<o:p></o:p></p <p class=3D"MsoNormal">CEPH
Version: &n=
bsp;
librbd1-0.=
80.7-3.el7<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p class=3D"MsoNormal">Many
thanks,<o:p></o:p></p <p
class=3D"MsoNormal"><o:p> </o:p></p <p
class=3D"MsoNormal">Simon<o:p></o:p></p </div
</body </html
--_000_D86C48DF8800164BBE50B87623F7AC9585F5111Dln2wio001devtra_--
3:53 a.m.
Simon hi,
What storage type are you using in source and target storage domains ?
(NFS, ISCSI....)
Can you share the logs?
Thanks,
Fred
On Fri, Aug 5, 2016 at 6:37 PM, Simon Barrett <
Simon.Barrett(a)tradingscreen.com> wrote:
Another example. This one was moved to a new storage domain
root@ovirt_host1> qemu-img info dd6f25f6-7830-4024-915f-a20268797c34
image: dd6f25f6-7830-4024-915f-a20268797c34
file format: raw
virtual size: 200G (214748364800 bytes)
disk size: 5.0G
root@ ovirt_host1> cat dd6f25f6-7830-4024-915f-a20268797c34.meta
DOMAIN=53560d43-874a-49c5-9c5a-8b90487c79f8
VOLTYPE=LEAF
CTIME=1470305678
FORMAT=RAW
IMAGE=741976cd-d1cb-4031-bdbe-6a745dff16ef
DISKTYPE=2
PUUID=00000000-0000-0000-0000-000000000000
LEGALITY=LEGAL
MTIME=0
POOL_UUID=
SIZE=419430400
TYPE=PREALLOCATED
DESCRIPTION=
EOF
This one has not been moved:
root(a)ny2-lvb-066.mgt> qemu-img info 155f0d33-c280-4236-8d1e-fcb88f9a1242
image: 155f0d33-c280-4236-8d1e-fcb88f9a1242
file format: raw
virtual size: 90G (96636764160 bytes)
disk size: 90G
root(a)ny2-lvb-066.mgt> cat 155f0d33-c280-4236-8d1e-fcb88f9a1242.meta
DOMAIN=59bde2ff-e10d-477e-91c1-6355abff0999
CTIME=1464946639
FORMAT=RAW
DISKTYPE=2
LEGALITY=LEGAL
SIZE=188743680
VOLTYPE=LEAF
DESCRIPTION={"DiskAlias":"ny2-laa-010.prod_Disk1","DiskDescription":""}
IMAGE=82158182-81a4-458e-a41b-663756962666
PUUID=00000000-0000-0000-0000-000000000000
MTIME=0
POOL_UUID=
TYPE=PREALLOCATED
EOF
See the mismatch between “virtual size” and “disk size” on the one that
was moved.
TIA,
Simon
*From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
Behalf Of *Simon Barrett
*Sent:* Friday, 5 August, 2016 10:25
*To:* users(a)ovirt.org
*Subject:* [ovirt-users] preallocated storage issue?
If I create a preallocated disk for a VM, I see the disk image file
listing as the size I requested (100G):
cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas__01b__
oVirt__prod__01/53560d43-874a-49c5-9c5a-8b90487c79f8/images/
d97f7706-3662-40bf-9358-80e0dc51bff4
root@ovirt_host> ls -l
total 105064644
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-
bc0de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-
bc0de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-
bc0de507720b.meta
and the corresponding space used on disk matches
root@ ovirt_host > du -sh *
101G 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
If I then migrate that storage (while the VM is shutdown) to a new storage
domain, the size on disk does not match the allocated size. In this case
there is nothing in the disk yet so it shows as 0.
cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovirt__
uatprod/1f2c2b48-1e77-4c98-a6da-5dc09b78cead/images/
d97f7706-3662-40bf-9358-80e0dc51bff4
root@ ovirt_host> ls -l
total 1032
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-
bc0de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-
bc0de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-
bc0de507720b.meta
root@ ovirt_host > du -sh *
0 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
oVirt still lists the disk as preallocated in the GUI but it is in fact
thin provisioned.
I see the same issue if I clone a preallocated VM. The size on disk ends
up being the equivalent of a thin-provisioned disk. I also had the issue
when importing VM’s from an export domain when I had selected preallocated
in the import dialog box.
Is this a known issue? Should preallocated not mean preallocated on
physical disk?
Ovirt Engine is running 3.6.4.1-1.el6
The ovirt nodes are running:
OS Version: RHEL - 7 - 2.1511.el7.centos.2.10
Kernel Version: 3.10.0 - 327.4.5.el7.x86_64
KVM Version: 2.3.0 - 31.el7_2.7.1
LIBVIRT Version: libvirt-1.2.17-13.el7_2.2
VDSM Version: vdsm-4.17.23.2-0.el7.centos
SPICE Version: 0.12.4 - 15.el7
GlusterFS Version: [N/A]
CEPH Version: librbd1-0.80.7-3.el7
Many thanks,
Simon
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
4:13 a.m.
--_000_12FFB2BB1DD36E1489f30f181d2c4973b6267bb642b6062cmailout_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
Storage is NFS. What logs would you like to see?
Many thanks.
Simon
On Sun, Aug 7, 2016 at 8:53 AM +0100, "Fred Rolland"
<frolland(a)redhat.com<m=
ailto:frolland@redhat.com>> wrote:
Simon hi,
What storage type are you using in source and target storage domains ? (NFS=
, ISCSI....)
Can you share the logs?
Thanks,
Fred
On Fri, Aug 5, 2016 at 6:37 PM, Simon Barrett <Simon.Barrett(a)tradingscreen.=
com<mailto:Simon.Barrett@tradingscreen.com>> wrote:
Another example. This one was moved to a new storage domain
root@ovirt_host1> qemu-img info dd6f25f6-7830-4024-915f-a20268797c34
image: dd6f25f6-7830-4024-915f-a20268797c34
file format: raw
virtual size: 200G (214748364800 bytes)
disk size: 5.0G
root@ ovirt_host1> cat dd6f25f6-7830-4024-915f-a20268797c34.meta
DOMAIN=3D53560d43-874a-49c5-9c5a-8b90487c79f8
VOLTYPE=3DLEAF
CTIME=3D1470305678
FORMAT=3DRAW
IMAGE=3D741976cd-d1cb-4031-bdbe-6a745dff16ef
DISKTYPE=3D2
PUUID=3D00000000-0000-0000-0000-000000000000
LEGALITY=3DLEGAL
MTIME=3D0
POOL_UUID=3D
SIZE=3D419430400
TYPE=3DPREALLOCATED
DESCRIPTION=3D
EOF
This one has not been moved:
root(a)ny2-lvb-066.mgt> qemu-img info 155f0d33-c280-4236-8d1e-fcb88f9a1242
image: 155f0d33-c280-4236-8d1e-fcb88f9a1242
file format: raw
virtual size: 90G (96636764160 bytes)
disk size: 90G
root(a)ny2-lvb-066.mgt> cat 155f0d33-c280-4236-8d1e-fcb88f9a1242.meta
DOMAIN=3D59bde2ff-e10d-477e-91c1-6355abff0999
CTIME=3D1464946639
FORMAT=3DRAW
DISKTYPE=3D2
LEGALITY=3DLEGAL
SIZE=3D188743680
VOLTYPE=3DLEAF
DESCRIPTION=3D{"DiskAlias":"ny2-laa-010.prod_Disk1","DiskDescription":""}
IMAGE=3D82158182-81a4-458e-a41b-663756962666
PUUID=3D00000000-0000-0000-0000-000000000000
MTIME=3D0
POOL_UUID=3D
TYPE=3DPREALLOCATED
EOF
See the mismatch between =93virtual size=94 and =93disk size=94 on the one =
that was moved.
TIA,
Simon
From: users-bounces@ovirt.org<mailto:users-bounces@ovirt.org> [mailto:users=
-bounces@ovirt.org<mailto:users-bounces@ovirt.org>] On Behalf Of Simon Barr=
ett
Sent: Friday, 5 August, 2016 10:25
To: users@ovirt.org<mailto:users@ovirt.org>
Subject: [ovirt-users] preallocated storage issue?
If I create a preallocated disk for a VM, I see the disk image file listing=
as the size I requested (100G):
cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas__01b__oVirt__prod__01/=
53560d43-874a-49c5-9c5a-8b90487c79f8/images/d97f7706-3662-40bf-9358-80e0dc5=
1bff4
root@ovirt_host> ls -l
total 105064644
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.meta
and the corresponding space used on disk matches
root@ ovirt_host > du -sh *
101G 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
If I then migrate that storage (while the VM is shutdown) to a new storage =
domain, the size on disk does not match the allocated size. In this case th=
ere is nothing in the disk yet so it shows as 0.
cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovirt__uatprod/1f2c2b48-1e=
77-4c98-a6da-5dc09b78cead/images/d97f7706-3662-40bf-9358-80e0dc51bff4
root@ ovirt_host> ls -l
total 1032
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-bc0=
de507720b.meta
root@ ovirt_host > du -sh *
0 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
oVirt still lists the disk as preallocated in the GUI but it is in fact thi=
n provisioned.
I see the same issue if I clone a preallocated VM. The size on disk ends up=
being the equivalent of a thin-provisioned disk. I also had the issue when=
importing VM=92s from an export domain when I had selected preallocated in=
the import dialog box.
Is this a known issue? Should preallocated not mean preallocated on physica=
l disk?
Ovirt Engine is running 3.6.4.1-1.el6
The ovirt nodes are running:
OS Version: RHEL - 7 - 2.1511.el7.centos.2.10
Kernel Version: 3.10.0 - 327.4.5.el7.x86_64
KVM Version: 2.3.0 - 31.el7_2.7.1
LIBVIRT Version: libvirt-1.2.17-13.el7_2.2
VDSM Version: vdsm-4.17.23.2-0.el7.centos
SPICE Version: 0.12.4 - 15.el7
GlusterFS Version: [N/A]
CEPH Version: librbd1-0.80.7-3.el7
Many thanks,
Simon
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
--_000_12FFB2BB1DD36E1489f30f181d2c4973b6267bb642b6062cmailout_
Content-Type: text/html; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html;
charset=3DWindows-1=
252">
</head>
<body>
<p dir=3D"auto">Storage is NFS. What logs would you like to
see?</p>
<p dir=3D"auto">Many thanks.</p>
<p dir=3D"auto">Simon<br>
</p>
<br>
<br>
<br>
<div class=3D"gmail_quote">On Sun, Aug 7, 2016 at 8:53 AM +0100,
"=
Fred Rolland" <span dir=3D"ltr">
<<a href=3D"mailto:frolland@redhat.com"
target=3D"_blank">frolland@redha=
t.com</a>></span> wrote:<br>
<br>
</div>
<div>
<div dir=3D"ltr">
<div>
<div>
<div>Simon hi,<br>
<br>
</div>
What storage type are you using in source and target storage domains ? (NFS=
, ISCSI....)<br>
<br>
</div>
<div>Can you share the logs?<br>
</div>
<div><br>
</div>
Thanks,<br>
</div>
Fred<br>
</div>
<div class=3D"gmail_extra"><br>
<div class=3D"gmail_quote">On Fri, Aug 5, 2016 at 6:37 PM, Simon Barrett
<s=
pan dir=3D"ltr">
<<a href=3D"mailto:Simon.Barrett@tradingscreen.com"
target=3D"_blank">Si=
mon.Barrett(a)tradingscreen.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;
border-left:1=
px #ccc solid; padding-left:1ex">
<div lang=3D"EN-US">
<div>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">Another example. This =
one was moved to a new storage domain<u></u
<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">root@ovirt_host1> q=
emu-img info
dd6f25f6-7830-4024-915f-<wbr>a20268797c34<u></u><u></u></span>=
</p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">image: dd6f25f6-7830-4=
024-915f-<wbr>a20268797c34<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"color:#1f497d">file
format: raw<u></u=
<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"color:#1f497d">virtual
size: 200G (21=
4748364800 bytes)<u></u<u></u></span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">disk size: 5.0G<u></u>=
<u></u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span style=3D"color:#1f497d">root@
ovirt_host1> =
cat dd6f25f6-7830-4024-915f-<wbr>a20268797c34.meta<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">DOMAIN=3D53560d43-874a=
-49c5-<wbr>9c5a-8b90487c79f8<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">VOLTYPE=3DLEAF<u></u><=
u></u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">CTIME=3D1470305678<u><=
/u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">FORMAT=3DRAW<u></u><u>=
</u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">IMAGE=3D741976cd-d1cb-=
4031-bdbe-<wbr>6a745dff16ef<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">DISKTYPE=3D2<u></u><u>=
</u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">PUUID=3D00000000-0000-=
0000-0000-<wbr>000000000000<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">LEGALITY=3DLEGAL<u></u=
<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">MTIME=3D0<u></u><u></u=
</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">POOL_UUID=3D<u></u><u>=
</u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">SIZE=3D419430400<u></u=
<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">TYPE=3DPREALLOCATED<u>=
</u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">DESCRIPTION=3D<u></u><=
u></u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">EOF<u></u><u></u></spa=
n></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span style=3D"color:#1f497d">This
one has not been =
moved:<u></u<u></u></span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">root@ny2-lvb-066.mgt&g=
t; qemu-img info
155f0d33-c280-4236-8d1e-<wbr>fcb88f9a1242<u></u><u></u></s=
pan></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">image: 155f0d33-c280-4=
236-8d1e-<wbr>fcb88f9a1242<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"color:#1f497d">file
format: raw<u></u=
<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"color:#1f497d">virtual
size: 90G (966=
36764160 bytes)<u></u<u></u></span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">disk size: 90G<u></u><=
u></u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">root@ny2-lvb-066.mgt&g=
t; cat
155f0d33-c280-4236-8d1e-<wbr>fcb88f9a1242.meta<u></u><u></u></span><=
/p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">DOMAIN=3D59bde2ff-e10d=
-477e-<wbr>91c1-6355abff0999<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">CTIME=3D1464946639<u><=
/u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">FORMAT=3DRAW<u></u><u>=
</u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">DISKTYPE=3D2<u></u><u>=
</u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">LEGALITY=3DLEGAL<u></u=
<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">SIZE=3D188743680<u></u=
<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">VOLTYPE=3DLEAF<u></u><=
u></u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">DESCRIPTION=3D{"D=
iskAlias":"ny2-<wbr>laa-010.prod_Disk1","<wbr>DiskDescr=
iption":""}<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">IMAGE=3D82158182-81a4-=
458e-a41b-<wbr>663756962666<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">PUUID=3D00000000-0000-=
0000-0000-<wbr>000000000000<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">MTIME=3D0<u></u><u></u=
</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">POOL_UUID=3D<u></u><u>=
</u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">TYPE=3DPREALLOCATED<u>=
</u<u></u></span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d">EOF<u></u><u></u></spa=
n></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span style=3D"color:#1f497d">See
the mismatch betwe=
en =93virtual size=94 and =93disk size=94 on the one that was moved.<u></u>=
<u></u</span></p>
<p
class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">TIA,<u></u><u></u></sp=
an></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d"><u></u> <u></u></=
span></p>
<p class=3D"MsoNormal"><span
style=3D"color:#1f497d">Simon<u></u><u></u></s=
pan></p>
<p class=3D"MsoNormal"><a
name=3D"m_-1913405386986670952__MailEndCompose"><=
span
style=3D"color:#1f497d"><u></u> <u></u></span></a></p>
<div>
<div style=3D"border:none; border-top:solid #e1e1e1 1.0pt; padding:3.0pt 0i=
n 0in 0in">
<p class=3D"MsoNormal"><b>From:</b> <a
href=3D"mailto:users-bounces@ovirt.o=
rg" target=3D"_blank">
users-bounces(a)ovirt.org</a> [mailto:<a
href=3D"mailto:users-bounces@ovirt.o=
rg" target=3D"_blank">users-bounces(a)ovirt.<wbr>org</a>]
<b>On Behalf Of </b>Simon Barrett<br>
<b>Sent:</b> Friday, 5 August, 2016 10:25<br>
<b>To:</b> <a href=3D"mailto:users@ovirt.org"
target=3D"_blank">users@ovirt=
.org</a><br>
<b>Subject:</b> [ovirt-users] preallocated storage
issue?<u></u><u></u></p>
</div>
</div>
<div>
<div class=3D"h5">
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">If I create a preallocated disk for a VM, I see the
=
disk image file listing as the size I requested
(100G):<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">cd
/rhev/data-center/mnt/storage_<wbr>host1:_vol_pa=
1__nas__01b__<wbr>oVirt__prod__01/53560d43-874a-<wbr>49c5-9c5a-8b90487c79f8=
/images/<wbr>d97f7706-3662-40bf-9358-<wbr>80e0dc51bff4<u></u><u></u></span>=
</p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">root@ovirt_host> ls -l<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">total 105064644<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">-rw-rw---- 1 vdsm kvm 107374182400 Aug 5
10:5=
7 75c14559-e18f-4cc8-a3fe-<wbr>bc0de507720b<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">-rw-rw---- 1 vdsm
kvm =
1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-<wbr>bc0de507720b.lease<=
u></u<u></u></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">-rw-r--r-- 1 vdsm
kvm =
313 Aug 5 10:57
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b.meta<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">and the corresponding space used on disk
matches<u><=
/u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">root@ ovirt_host > du -sh
*<u></u><u></u></span>=
</p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">101G
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b<u></u<u></u></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">1.1M
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b.lease<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">4.0K
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b.meta<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">If I then migrate that storage (while the VM is
shut=
down) to a new storage domain, the size on disk does not match the allocate=
d size. In this case there is nothing in the disk yet so it shows as 0.<u><=
/u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">cd
/rhev/data-center/mnt/storage_<wbr>host2:_vol_pa=
1__ovirt__<wbr>uatprod/1f2c2b48-1e77-4c98-<wbr>a6da-5dc09b78cead/images/<wb=
r>d97f7706-3662-40bf-9358-<wbr>80e0dc51bff4<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">root@ ovirt_host> ls -l<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">total 1032<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">-rw-rw---- 1 vdsm kvm 107374182400 Aug 5
11:0=
6 75c14559-e18f-4cc8-a3fe-<wbr>bc0de507720b<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">-rw-rw---- 1 vdsm
kvm =
1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-<wbr>bc0de507720b.lease<=
u></u<u></u></span></p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">-rw-r--r-- 1 vdsm
kvm =
313 Aug 5 11:06
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b.meta<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif"><u></u> <u></u</span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">root@ ovirt_host > du -sh
*<u></u><u></u></span>=
</p>
<p class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier
New",serif">0
75c14559-e18f=
-4cc8-a3fe-<wbr>bc0de507720b<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">1.1M
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b.lease<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><span style=3D"font-size:10.0pt;
font-family:"C=
ourier New",serif">4.0K
75c14559-e18f-4cc8-a3fe-<wbr=
>bc0de507720b.meta<u></u<u></u></span></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">oVirt still lists the disk as preallocated in the
GU=
I but it is in fact thin provisioned.<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">I see the same issue if I clone a preallocated VM.
T=
he size on disk ends up being the equivalent of a thin-provisioned disk. I =
also had the issue when importing VM=92s from an export domain when I had s=
elected preallocated in the import dialog
box.<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">Is this a known issue? Should preallocated not mean
=
preallocated on physical disk?<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">Ovirt Engine is running
3.6.4.1-1.el6<u></u><u></u><=
/p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">The ovirt nodes are running:
<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">OS
Version:  =
;
&=
nbsp; RHEL - 7 -
2.1511.el7.centos.2.10<u></u><u></u></p>
<p class=3D"MsoNormal">Kernel Version:
=
3.10.0 - 327.4.5.el7=
.x86_64<u></u><u></u></p>
<p class=3D"MsoNormal">KVM
Version: &nb=
sp;
2.3.0=
- 31.el7_2.7.1<u></u><u></u></p>
<p class=3D"MsoNormal">LIBVIRT
Version: =
libvirt-1.2.17-13.el7_2.2<=
u></u><u></u></p>
<p class=3D"MsoNormal">VDSM Version:
&n=
bsp;
vdsm-4.17.23.2-0.el7.c=
entos<u></u><u></u></p>
<p class=3D"MsoNormal">SPICE Version:
&=
nbsp;
0.12.4 - 15.el7=
<u></u><u></u></p>
<p class=3D"MsoNormal">GlusterFS
Version: &nbs=
p;
[N/A]<u></u><u></u></p>
<p class=3D"MsoNormal">CEPH Version:
&n=
bsp;
librbd1-0.=
80.7-3.el7<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p class=3D"MsoNormal">Many
thanks,<u></u><u></u></p>
<p
class=3D"MsoNormal"><u></u> <u></u></p>
<p
class=3D"MsoNormal">Simon<u></u><u></u></p>
</div>
</div>
</div>
</div>
<br>
______________________________<wbr>_________________<br>
Users mailing list<br>
<a href=3D"mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href=3D"http://lists.ovirt.org/mailman/listinfo/users"
rel=3D"noreferrer=
"
target=3D"_blank">http://lists.ovirt.org/<wbr>mailman/...
br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</body>
</html>
--_000_12FFB2BB1DD36E1489f30f181d2c4973b6267bb642b6062cmailout_--
5:55 a.m.
Simon,
What is happening is that when we create a preallocated disk on NFS, we
fill the file with zeros in order to "allocate" the space.
However, while copying the disk we use qemu-img that will ignore the zeros.
Quick way to demonstrate:
[root@white-vdsd test]# dd if=/dev/zero of=myfile.txt bs=1M count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00172084 s, 609 MB/s
[root@white-vdsd test]# du -h myfile.txt
1.0M myfile.txt
[root@white-vdsd test]# ls -lh myfile.txt
-rw-r--r-- 1 root root 1.0M Aug 7 12:39 myfile.txt
[root@white-vdsd test]# qemu-img convert myfile.txt myfile2.txt
[root@white-vdsd test]# ls -lh myfile2.txt
-rw-r--r-- 1 root root 1.0M Aug 7 12:41 myfile2.txt
[root@white-vdsd test]# du -h myfile2.txt
0 myfile2.txt
[root@white-vdsd test]# qemu-img info myfile.txt
image: myfile.txt
file format: raw
virtual size: 1.0M (1048576 bytes)
disk size: 1.0M
[root@white-vdsd test]# qemu-img info myfile2.txt
image: myfile2.txt
file format: raw
virtual size: 1.0M (1048576 bytes)
disk size: 0
I hope this explains what you see.
Regards,
Fred
On Sun, Aug 7, 2016 at 11:13 AM, Simon Barrett <
Simon.Barrett(a)tradingscreen.com> wrote:
Storage is NFS. What logs would you like to see?
Many thanks.
Simon
On Sun, Aug 7, 2016 at 8:53 AM +0100, "Fred Rolland"
<frolland(a)redhat.com>
wrote:
Simon hi,
What storage type are you using in source and target storage domains ?
(NFS, ISCSI....)
Can you share the logs?
Thanks,
Fred
On Fri, Aug 5, 2016 at 6:37 PM, Simon Barrett <
Simon.Barrett(a)tradingscreen.com> wrote:
> Another example. This one was moved to a new storage domain
>
>
>
> root@ovirt_host1> qemu-img info dd6f25f6-7830-4024-915f-a20268797c34
>
> image: dd6f25f6-7830-4024-915f-a20268797c34
>
> file format: raw
>
> virtual size: 200G (214748364800 bytes)
>
> disk size: 5.0G
>
>
>
> root@ ovirt_host1> cat dd6f25f6-7830-4024-915f-a20268797c34.meta
>
> DOMAIN=53560d43-874a-49c5-9c5a-8b90487c79f8
>
> VOLTYPE=LEAF
>
> CTIME=1470305678
>
> FORMAT=RAW
>
> IMAGE=741976cd-d1cb-4031-bdbe-6a745dff16ef
>
> DISKTYPE=2
>
> PUUID=00000000-0000-0000-0000-000000000000
>
> LEGALITY=LEGAL
>
> MTIME=0
>
> POOL_UUID=
>
> SIZE=419430400
>
> TYPE=PREALLOCATED
>
> DESCRIPTION=
>
> EOF
>
>
>
>
>
> This one has not been moved:
>
>
>
> root(a)ny2-lvb-066.mgt> qemu-img info 155f0d33-c280-4236-8d1e-fcb88f9a1242
>
> image: 155f0d33-c280-4236-8d1e-fcb88f9a1242
>
> file format: raw
>
> virtual size: 90G (96636764160 bytes)
>
> disk size: 90G
>
>
>
> root(a)ny2-lvb-066.mgt> cat 155f0d33-c280-4236-8d1e-fcb88f9a1242.meta
>
> DOMAIN=59bde2ff-e10d-477e-91c1-6355abff0999
>
> CTIME=1464946639
>
> FORMAT=RAW
>
> DISKTYPE=2
>
> LEGALITY=LEGAL
>
> SIZE=188743680
>
> VOLTYPE=LEAF
>
>
DESCRIPTION={"DiskAlias":"ny2-laa-010.prod_Disk1","DiskDescription":""}
>
> IMAGE=82158182-81a4-458e-a41b-663756962666
>
> PUUID=00000000-0000-0000-0000-000000000000
>
> MTIME=0
>
> POOL_UUID=
>
> TYPE=PREALLOCATED
>
> EOF
>
>
>
> See the mismatch between “virtual size” and “disk size” on the one that
> was moved.
>
>
>
> TIA,
>
>
>
> Simon
>
>
>
> *From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
> Behalf Of *Simon Barrett
> *Sent:* Friday, 5 August, 2016 10:25
> *To:* users(a)ovirt.org
> *Subject:* [ovirt-users] preallocated storage issue?
>
>
>
> If I create a preallocated disk for a VM, I see the disk image file
> listing as the size I requested (100G):
>
>
>
> cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas__01b__oVir
> t__prod__01/53560d43-874a-49c5-9c5a-8b90487c79f8/images/d97f
> 7706-3662-40bf-9358-80e0dc51bff4
>
> root@ovirt_host> ls -l
>
> total 105064644
>
> -rw-rw---- 1 vdsm kvm 107374182400 Aug 5 10:57
> 75c14559-e18f-4cc8-a3fe-bc0de507720b
>
> -rw-rw---- 1 vdsm kvm 1048576 Aug 5 10:57
> 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
>
> -rw-r--r-- 1 vdsm kvm 313 Aug 5 10:57
> 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
>
>
>
> and the corresponding space used on disk matches
>
>
>
> root@ ovirt_host > du -sh *
>
> 101G 75c14559-e18f-4cc8-a3fe-bc0de507720b
>
> 1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
>
> 4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
>
>
>
> If I then migrate that storage (while the VM is shutdown) to a new
> storage domain, the size on disk does not match the allocated size. In this
> case there is nothing in the disk yet so it shows as 0.
>
>
>
> cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovirt__uatprod
> /1f2c2b48-1e77-4c98-a6da-5dc09b78cead/images/d97f7706-
> 3662-40bf-9358-80e0dc51bff4
>
> root@ ovirt_host> ls -l
>
> total 1032
>
> -rw-rw---- 1 vdsm kvm 107374182400 Aug 5 11:06
> 75c14559-e18f-4cc8-a3fe-bc0de507720b
>
> -rw-rw---- 1 vdsm kvm 1048576 Aug 5 11:06
> 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
>
> -rw-r--r-- 1 vdsm kvm 313 Aug 5 11:06
> 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
>
>
>
> root@ ovirt_host > du -sh *
>
> 0 75c14559-e18f-4cc8-a3fe-bc0de507720b
>
> 1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
>
> 4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
>
>
>
> oVirt still lists the disk as preallocated in the GUI but it is in fact
> thin provisioned.
>
>
>
> I see the same issue if I clone a preallocated VM. The size on disk ends
> up being the equivalent of a thin-provisioned disk. I also had the issue
> when importing VM’s from an export domain when I had selected preallocated
> in the import dialog box.
>
>
>
> Is this a known issue? Should preallocated not mean preallocated on
> physical disk?
>
>
>
> Ovirt Engine is running 3.6.4.1-1.el6
>
>
>
> The ovirt nodes are running:
>
>
>
> OS Version: RHEL - 7 - 2.1511.el7.centos.2.10
>
> Kernel Version: 3.10.0 - 327.4.5.el7.x86_64
>
> KVM Version: 2.3.0 - 31.el7_2.7.1
>
> LIBVIRT Version: libvirt-1.2.17-13.el7_2.2
>
> VDSM Version: vdsm-4.17.23.2-0.el7.centos
>
> SPICE Version: 0.12.4 - 15.el7
>
> GlusterFS Version: [N/A]
>
> CEPH Version: librbd1-0.80.7-3.el7
>
>
>
> Many thanks,
>
>
>
> Simon
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
3:37 a.m.
--_000_D86C48DF8800164BBE50B87623F7AC9585F582A2ln2wio001devtra_
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
TWFueSB0aGFua3MgZm9yIHRoZSBpbmZvcm1hdGlvbiBhbmQgaXQgZG9lcyBleHBsYWluIHdoYXQg
SeKAmW0gc2VlaW5nLg0KDQpJcyB0aGlzIHRoZSBleHBlY3RlZCByZXN1bHQgdGhvdWdoIG9yIGlz
IGl0IGEga25vd24gYnVnPyBJZiB1c2luZyBxZW11LWltZyB0byBtb3ZlIGltYWdlcyBhbHdheXMg
cmVzdWx0cyBpbiBhIGRpc2sgaW1hZ2UgdGhhdCBzdGF0ZXMgaXQgaXMgcHJlYWxsb2NhdGVkIGJ1
dCBkb2VzIG5vdCBhbGxvY2F0ZSB0aGUgc3BhY2UsIGhvdyBkbyBJIG1vdmUgcHJlYWxsb2NhdGVk
IGRpc2sgaW1hZ2VzPyBJIGtub3cgSSBjYW4gZG8gdGhlIHNhbWUgd2l0aGluIHRoZSBWTSBhbmQg
d3JpdGUgYSB2ZXJ5IGxhcmdlIGZpbGUgZnVsbCBvZiB6ZXJvcyB0byBncm93IHRoZSBpbWFnZSB0
byBmdWxsIGNhcGFjaXR5IG9uIGRpc2sgYnV0IGlzIHRoYXQgdGhlIGNvcnJlY3QgYXBwcm9hY2g/
DQoNClRoYW5rcyBhZ2FpbiwNCg0KU2ltb24NCg0KRnJvbTogRnJlZCBSb2xsYW5kIFttYWlsdG86
ZnJvbGxhbmRAcmVkaGF0LmNvbV0NClNlbnQ6IFN1bmRheSwgNyBBdWd1c3QsIDIwMTYgMTA6NTUN
ClRvOiBTaW1vbiBCYXJyZXR0IDxTaW1vbi5CYXJyZXR0QHRyYWRpbmdzY3JlZW4uY29tPg0KQ2M6
IHVzZXJzQG92aXJ0Lm9yZw0KU3ViamVjdDogUmU6IFtvdmlydC11c2Vyc10gcHJlYWxsb2NhdGVk
IHN0b3JhZ2UgaXNzdWU/DQoNClNpbW9uLA0KV2hhdCBpcyBoYXBwZW5pbmcgaXMgdGhhdCB3aGVu
IHdlIGNyZWF0ZSBhIHByZWFsbG9jYXRlZCBkaXNrIG9uIE5GUywgd2UgZmlsbCB0aGUgZmlsZSB3
aXRoIHplcm9zIGluIG9yZGVyIHRvICJhbGxvY2F0ZSIgdGhlIHNwYWNlLg0KSG93ZXZlciwgd2hp
bGUgY29weWluZyB0aGUgZGlzayB3ZSB1c2UgcWVtdS1pbWcgdGhhdCB3aWxsIGlnbm9yZSB0aGUg
emVyb3MuDQoNClF1aWNrIHdheSB0byBkZW1vbnN0cmF0ZToNCg0KW3Jvb3RAd2hpdGUtdmRzZCB0
ZXN0XSMgZGQgaWY9L2Rldi96ZXJvIG9mPW15ZmlsZS50eHQgYnM9MU0gY291bnQ9MQ0KMSswIHJl
Y29yZHMgaW4NCjErMCByZWNvcmRzIG91dA0KMTA0ODU3NiBieXRlcyAoMS4wIE1CLCAxLjAgTWlC
KSBjb3BpZWQsIDAuMDAxNzIwODQgcywgNjA5IE1CL3MNCg0KW3Jvb3RAd2hpdGUtdmRzZCB0ZXN0
XSMgZHUgLWggbXlmaWxlLnR4dA0KMS4wTSAgICBteWZpbGUudHh0DQoNCltyb290QHdoaXRlLXZk
c2QgdGVzdF0jIGxzIC1saCBteWZpbGUudHh0DQotcnctci0tci0tIDEgcm9vdCByb290IDEuME0g
QXVnICA3IDEyOjM5IG15ZmlsZS50eHQNCg0KW3Jvb3RAd2hpdGUtdmRzZCB0ZXN0XSMgcWVtdS1p
bWcgY29udmVydCBteWZpbGUudHh0IG15ZmlsZTIudHh0DQoNCltyb290QHdoaXRlLXZkc2QgdGVz
dF0jIGxzIC1saCBteWZpbGUyLnR4dA0KLXJ3LXItLXItLSAxIHJvb3Qgcm9vdCAxLjBNIEF1ZyAg
NyAxMjo0MSBteWZpbGUyLnR4dA0KDQpbcm9vdEB3aGl0ZS12ZHNkIHRlc3RdIyBkdSAtaCBteWZp
bGUyLnR4dA0KMCAgICBteWZpbGUyLnR4dA0KDQpbcm9vdEB3aGl0ZS12ZHNkIHRlc3RdIyBxZW11
LWltZyBpbmZvIG15ZmlsZS50eHQNCmltYWdlOiBteWZpbGUudHh0DQpmaWxlIGZvcm1hdDogcmF3
DQp2aXJ0dWFsIHNpemU6IDEuME0gKDEwNDg1NzYgYnl0ZXMpDQpkaXNrIHNpemU6IDEuME0NCg0K
W3Jvb3RAd2hpdGUtdmRzZCB0ZXN0XSMgcWVtdS1pbWcgaW5mbyBteWZpbGUyLnR4dA0KaW1hZ2U6
IG15ZmlsZTIudHh0DQpmaWxlIGZvcm1hdDogcmF3DQp2aXJ0dWFsIHNpemU6IDEuME0gKDEwNDg1
NzYgYnl0ZXMpDQpkaXNrIHNpemU6IDANCkkgaG9wZSB0aGlzIGV4cGxhaW5zIHdoYXQgeW91IHNl
ZS4NClJlZ2FyZHMsDQpGcmVkDQoNCg0KT24gU3VuLCBBdWcgNywgMjAxNiBhdCAxMToxMyBBTSwg
U2ltb24gQmFycmV0dCA8U2ltb24uQmFycmV0dEB0cmFkaW5nc2NyZWVuLmNvbTxtYWlsdG86U2lt
b24uQmFycmV0dEB0cmFkaW5nc2NyZWVuLmNvbT4+IHdyb3RlOg0KDQpTdG9yYWdlIGlzIE5GUy4g
V2hhdCBsb2dzIHdvdWxkIHlvdSBsaWtlIHRvIHNlZT8NCg0KTWFueSB0aGFua3MuDQoNClNpbW9u
DQoNCg0KT24gU3VuLCBBdWcgNywgMjAxNiBhdCA4OjUzIEFNICswMTAwLCAiRnJlZCBSb2xsYW5k
IiA8ZnJvbGxhbmRAcmVkaGF0LmNvbTxtYWlsdG86ZnJvbGxhbmRAcmVkaGF0LmNvbT4+IHdyb3Rl
Og0KU2ltb24gaGksDQpXaGF0IHN0b3JhZ2UgdHlwZSBhcmUgeW91IHVzaW5nIGluIHNvdXJjZSBh
bmQgdGFyZ2V0IHN0b3JhZ2UgZG9tYWlucyA/IChORlMsIElTQ1NJLi4uLikNCkNhbiB5b3Ugc2hh
cmUgdGhlIGxvZ3M/DQoNClRoYW5rcywNCkZyZWQNCg0KT24gRnJpLCBBdWcgNSwgMjAxNiBhdCA2
OjM3IFBNLCBTaW1vbiBCYXJyZXR0IDxTaW1vbi5CYXJyZXR0QHRyYWRpbmdzY3JlZW4uY29tPG1h
aWx0bzpTaW1vbi5CYXJyZXR0QHRyYWRpbmdzY3JlZW4uY29tPj4gd3JvdGU6DQpBbm90aGVyIGV4
YW1wbGUuIFRoaXMgb25lIHdhcyBtb3ZlZCB0byBhIG5ldyBzdG9yYWdlIGRvbWFpbg0KDQpyb290
QG92aXJ0X2hvc3QxPiBxZW11LWltZyBpbmZvIGRkNmYyNWY2LTc4MzAtNDAyNC05MTVmLWEyMDI2
ODc5N2MzNA0KaW1hZ2U6IGRkNmYyNWY2LTc4MzAtNDAyNC05MTVmLWEyMDI2ODc5N2MzNA0KZmls
ZSBmb3JtYXQ6IHJhdw0KdmlydHVhbCBzaXplOiAyMDBHICgyMTQ3NDgzNjQ4MDAgYnl0ZXMpDQpk
aXNrIHNpemU6IDUuMEcNCg0Kcm9vdEAgb3ZpcnRfaG9zdDE+IGNhdCBkZDZmMjVmNi03ODMwLTQw
MjQtOTE1Zi1hMjAyNjg3OTdjMzQubWV0YQ0KRE9NQUlOPTUzNTYwZDQzLTg3NGEtNDljNS05YzVh
LThiOTA0ODdjNzlmOA0KVk9MVFlQRT1MRUFGDQpDVElNRT0xNDcwMzA1Njc4DQpGT1JNQVQ9UkFX
DQpJTUFHRT03NDE5NzZjZC1kMWNiLTQwMzEtYmRiZS02YTc0NWRmZjE2ZWYNCkRJU0tUWVBFPTIN
ClBVVUlEPTAwMDAwMDAwLTAwMDAtMDAwMC0wMDAwLTAwMDAwMDAwMDAwMA0KTEVHQUxJVFk9TEVH
QUwNCk1USU1FPTANClBPT0xfVVVJRD0NClNJWkU9NDE5NDMwNDAwDQpUWVBFPVBSRUFMTE9DQVRF
RA0KREVTQ1JJUFRJT049DQpFT0YNCg0KDQpUaGlzIG9uZSBoYXMgbm90IGJlZW4gbW92ZWQ6DQoN
CnJvb3RAbnkyLWx2Yi0wNjYubWd0PG1haWx0bzpyb290QG55Mi1sdmItMDY2Lm1ndD4+IHFlbXUt
aW1nIGluZm8gMTU1ZjBkMzMtYzI4MC00MjM2LThkMWUtZmNiODhmOWExMjQyDQppbWFnZTogMTU1
ZjBkMzMtYzI4MC00MjM2LThkMWUtZmNiODhmOWExMjQyDQpmaWxlIGZvcm1hdDogcmF3DQp2aXJ0
dWFsIHNpemU6IDkwRyAoOTY2MzY3NjQxNjAgYnl0ZXMpDQpkaXNrIHNpemU6IDkwRw0KDQpyb290
QG55Mi1sdmItMDY2Lm1ndDxtYWlsdG86cm9vdEBueTItbHZiLTA2Ni5tZ3Q+PiBjYXQgMTU1ZjBk
MzMtYzI4MC00MjM2LThkMWUtZmNiODhmOWExMjQyLm1ldGENCkRPTUFJTj01OWJkZTJmZi1lMTBk
LTQ3N2UtOTFjMS02MzU1YWJmZjA5OTkNCkNUSU1FPTE0NjQ5NDY2MzkNCkZPUk1BVD1SQVcNCkRJ
U0tUWVBFPTINCkxFR0FMSVRZPUxFR0FMDQpTSVpFPTE4ODc0MzY4MA0KVk9MVFlQRT1MRUFGDQpE
RVNDUklQVElPTj17IkRpc2tBbGlhcyI6Im55Mi1sYWEtMDEwLnByb2RfRGlzazEiLCJEaXNrRGVz
Y3JpcHRpb24iOiIifQ0KSU1BR0U9ODIxNTgxODItODFhNC00NThlLWE0MWItNjYzNzU2OTYyNjY2
DQpQVVVJRD0wMDAwMDAwMC0wMDAwLTAwMDAtMDAwMC0wMDAwMDAwMDAwMDANCk1USU1FPTANClBP
T0xfVVVJRD0NClRZUEU9UFJFQUxMT0NBVEVEDQpFT0YNCg0KU2VlIHRoZSBtaXNtYXRjaCBiZXR3
ZWVuIOKAnHZpcnR1YWwgc2l6ZeKAnSBhbmQg4oCcZGlzayBzaXpl4oCdIG9uIHRoZSBvbmUgdGhh
dCB3YXMgbW92ZWQuDQoNClRJQSwNCg0KU2ltb24NCg0KRnJvbTogdXNlcnMtYm91bmNlc0Bvdmly
dC5vcmc8bWFpbHRvOnVzZXJzLWJvdW5jZXNAb3ZpcnQub3JnPiBbbWFpbHRvOnVzZXJzLWJvdW5j
ZXNAb3ZpcnQub3JnPG1haWx0bzp1c2Vycy1ib3VuY2VzQG92aXJ0Lm9yZz5dIE9uIEJlaGFsZiBP
ZiBTaW1vbiBCYXJyZXR0DQpTZW50OiBGcmlkYXksIDUgQXVndXN0LCAyMDE2IDEwOjI1DQpUbzog
dXNlcnNAb3ZpcnQub3JnPG1haWx0bzp1c2Vyc0BvdmlydC5vcmc+DQpTdWJqZWN0OiBbb3ZpcnQt
dXNlcnNdIHByZWFsbG9jYXRlZCBzdG9yYWdlIGlzc3VlPw0KDQpJZiBJIGNyZWF0ZSBhIHByZWFs
bG9jYXRlZCBkaXNrIGZvciBhIFZNLCBJIHNlZSB0aGUgZGlzayBpbWFnZSBmaWxlIGxpc3Rpbmcg
YXMgdGhlIHNpemUgSSByZXF1ZXN0ZWQgKDEwMEcpOg0KDQpjZCAvcmhldi9kYXRhLWNlbnRlci9t
bnQvc3RvcmFnZV9ob3N0MTpfdm9sX3BhMV9fbmFzX18wMWJfX29WaXJ0X19wcm9kX18wMS81MzU2
MGQ0My04NzRhLTQ5YzUtOWM1YS04YjkwNDg3Yzc5ZjgvaW1hZ2VzL2Q5N2Y3NzA2LTM2NjItNDBi
Zi05MzU4LTgwZTBkYzUxYmZmNA0Kcm9vdEBvdmlydF9ob3N0PiBscyAtbA0KdG90YWwgMTA1MDY0
NjQ0DQotcnctcnctLS0tIDEgdmRzbSBrdm0gMTA3Mzc0MTgyNDAwIEF1ZyAgNSAxMDo1NyA3NWMx
NDU1OS1lMThmLTRjYzgtYTNmZS1iYzBkZTUwNzcyMGINCi1ydy1ydy0tLS0gMSB2ZHNtIGt2bSAg
ICAgIDEwNDg1NzYgQXVnICA1IDEwOjU3IDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3
NzIwYi5sZWFzZQ0KLXJ3LXItLXItLSAxIHZkc20ga3ZtICAgICAgICAgIDMxMyBBdWcgIDUgMTA6
NTcgNzVjMTQ1NTktZTE4Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiLm1ldGENCg0KYW5kIHRoZSBj
b3JyZXNwb25kaW5nIHNwYWNlIHVzZWQgb24gZGlzayBtYXRjaGVzDQoNCnJvb3RAIG92aXJ0X2hv
c3QgPiBkdSAtc2ggKg0KMTAxRyAgICA3NWMxNDU1OS1lMThmLTRjYzgtYTNmZS1iYzBkZTUwNzcy
MGINCjEuMU0gICAgNzVjMTQ1NTktZTE4Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiLmxlYXNlDQo0
LjBLICAgIDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYi5tZXRhDQoNCklmIEkg
dGhlbiBtaWdyYXRlIHRoYXQgc3RvcmFnZSAod2hpbGUgdGhlIFZNIGlzIHNodXRkb3duKSB0byBh
IG5ldyBzdG9yYWdlIGRvbWFpbiwgdGhlIHNpemUgb24gZGlzayBkb2VzIG5vdCBtYXRjaCB0aGUg
YWxsb2NhdGVkIHNpemUuIEluIHRoaXMgY2FzZSB0aGVyZSBpcyBub3RoaW5nIGluIHRoZSBkaXNr
IHlldCBzbyBpdCBzaG93cyBhcyAwLg0KDQpjZCAvcmhldi9kYXRhLWNlbnRlci9tbnQvc3RvcmFn
ZV9ob3N0Mjpfdm9sX3BhMV9fb3ZpcnRfX3VhdHByb2QvMWYyYzJiNDgtMWU3Ny00Yzk4LWE2ZGEt
NWRjMDliNzhjZWFkL2ltYWdlcy9kOTdmNzcwNi0zNjYyLTQwYmYtOTM1OC04MGUwZGM1MWJmZjQN
CnJvb3RAIG92aXJ0X2hvc3Q+IGxzIC1sDQp0b3RhbCAxMDMyDQotcnctcnctLS0tIDEgdmRzbSBr
dm0gMTA3Mzc0MTgyNDAwIEF1ZyAgNSAxMTowNiA3NWMxNDU1OS1lMThmLTRjYzgtYTNmZS1iYzBk
ZTUwNzcyMGINCi1ydy1ydy0tLS0gMSB2ZHNtIGt2bSAgICAgIDEwNDg1NzYgQXVnICA1IDExOjA2
IDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYi5sZWFzZQ0KLXJ3LXItLXItLSAx
IHZkc20ga3ZtICAgICAgICAgIDMxMyBBdWcgIDUgMTE6MDYgNzVjMTQ1NTktZTE4Zi00Y2M4LWEz
ZmUtYmMwZGU1MDc3MjBiLm1ldGENCg0Kcm9vdEAgb3ZpcnRfaG9zdCA+IGR1IC1zaCAqDQowICAg
ICAgIDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYg0KMS4xTSAgICA3NWMxNDU1
OS1lMThmLTRjYzgtYTNmZS1iYzBkZTUwNzcyMGIubGVhc2UNCjQuMEsgICAgNzVjMTQ1NTktZTE4
Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiLm1ldGENCg0Kb1ZpcnQgc3RpbGwgbGlzdHMgdGhlIGRp
c2sgYXMgcHJlYWxsb2NhdGVkIGluIHRoZSBHVUkgYnV0IGl0IGlzIGluIGZhY3QgdGhpbiBwcm92
aXNpb25lZC4NCg0KSSBzZWUgdGhlIHNhbWUgaXNzdWUgaWYgSSBjbG9uZSBhIHByZWFsbG9jYXRl
ZCBWTS4gVGhlIHNpemUgb24gZGlzayBlbmRzIHVwIGJlaW5nIHRoZSBlcXVpdmFsZW50IG9mIGEg
dGhpbi1wcm92aXNpb25lZCBkaXNrLiBJIGFsc28gaGFkIHRoZSBpc3N1ZSB3aGVuIGltcG9ydGlu
ZyBWTeKAmXMgZnJvbSBhbiBleHBvcnQgZG9tYWluIHdoZW4gSSBoYWQgc2VsZWN0ZWQgcHJlYWxs
b2NhdGVkIGluIHRoZSBpbXBvcnQgZGlhbG9nIGJveC4NCg0KSXMgdGhpcyBhIGtub3duIGlzc3Vl
PyBTaG91bGQgcHJlYWxsb2NhdGVkIG5vdCBtZWFuIHByZWFsbG9jYXRlZCBvbiBwaHlzaWNhbCBk
aXNrPw0KDQpPdmlydCBFbmdpbmUgaXMgcnVubmluZyAzLjYuNC4xLTEuZWw2DQoNClRoZSBvdmly
dCBub2RlcyBhcmUgcnVubmluZzoNCg0KT1MgVmVyc2lvbjogICAgICAgICAgICAgICAgICAgICAg
ICBSSEVMIC0gNyAtIDIuMTUxMS5lbDcuY2VudG9zLjIuMTANCktlcm5lbCBWZXJzaW9uOiAgICAg
ICAgICAgICAgICAgMy4xMC4wIC0gMzI3LjQuNS5lbDcueDg2XzY0DQpLVk0gVmVyc2lvbjogICAg
ICAgICAgICAgICAgICAgIDIuMy4wIC0gMzEuZWw3XzIuNy4xDQpMSUJWSVJUIFZlcnNpb246ICAg
ICAgICAgICAgICAgbGlidmlydC0xLjIuMTctMTMuZWw3XzIuMg0KVkRTTSBWZXJzaW9uOiAgICAg
ICAgICAgICAgICAgdmRzbS00LjE3LjIzLjItMC5lbDcuY2VudG9zDQpTUElDRSBWZXJzaW9uOiAg
ICAgICAgICAgICAgICAgIDAuMTIuNCAtIDE1LmVsNw0KR2x1c3RlckZTIFZlcnNpb246ICAgICAg
ICAgICBbTi9BXQ0KQ0VQSCBWZXJzaW9uOiAgICAgICAgICAgICAgICAgICBsaWJyYmQxLTAuODAu
Ny0zLmVsNw0KDQpNYW55IHRoYW5rcywNCg0KU2ltb24NCg0KX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX18NClVzZXJzIG1haWxpbmcgbGlzdA0KVXNlcnNAb3Zp
cnQub3JnPG1haWx0bzpVc2Vyc0BvdmlydC5vcmc+DQpodHRwOi8vbGlzdHMub3ZpcnQub3JnL21h
aWxtYW4vbGlzdGluZm8vdXNlcnMNCg0KDQo=
--_000_D86C48DF8800164BBE50B87623F7AC9585F582A2ln2wio001devtra_
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: base64
PGh0bWwgeG1sbnM6dj0idXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNvbTp2bWwiIHhtbG5zOm89InVy
bjpzY2hlbWFzLW1pY3Jvc29mdC1jb206b2ZmaWNlOm9mZmljZSIgeG1sbnM6dz0idXJuOnNjaGVt
YXMtbWljcm9zb2Z0LWNvbTpvZmZpY2U6d29yZCIgeG1sbnM6bT0iaHR0cDovL3NjaGVtYXMubWlj
cm9zb2Z0LmNvbS9vZmZpY2UvMjAwNC8xMi9vbW1sIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcv
VFIvUkVDLWh0bWw0MCI+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIg
Y29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjxtZXRhIG5hbWU9IkdlbmVyYXRv
ciIgY29udGVudD0iTWljcm9zb2Z0IFdvcmQgMTUgKGZpbHRlcmVkIG1lZGl1bSkiPg0KPHN0eWxl
PjwhLS0NCi8qIEZvbnQgRGVmaW5pdGlvbnMgKi8NCkBmb250LWZhY2UNCgl7Zm9udC1mYW1pbHk6
IkNhbWJyaWEgTWF0aCI7DQoJcGFub3NlLTE6MiA0IDUgMyA1IDQgNiAzIDIgNDt9DQpAZm9udC1m
YWNlDQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7DQoJcGFub3NlLTE6MiAxNSA1IDIgMiAyIDQgMyAy
IDQ7fQ0KLyogU3R5bGUgRGVmaW5pdGlvbnMgKi8NCnAuTXNvTm9ybWFsLCBsaS5Nc29Ob3JtYWws
IGRpdi5Nc29Ob3JtYWwNCgl7bWFyZ2luOjBpbjsNCgltYXJnaW4tYm90dG9tOi4wMDAxcHQ7DQoJ
Zm9udC1zaXplOjEyLjBwdDsNCglmb250LWZhbWlseToiVGltZXMgTmV3IFJvbWFuIixzZXJpZjt9
DQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5rDQoJe21zby1zdHlsZS1wcmlvcml0eTo5OTsNCglj
b2xvcjpibHVlOw0KCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQ0KYTp2aXNpdGVkLCBzcGFu
Lk1zb0h5cGVybGlua0ZvbGxvd2VkDQoJe21zby1zdHlsZS1wcmlvcml0eTo5OTsNCgljb2xvcjpw
dXJwbGU7DQoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9DQpwDQoJe21zby1zdHlsZS1wcmlv
cml0eTo5OTsNCgltc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzsNCgltYXJnaW4tcmlnaHQ6MGluOw0K
CW1zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvOw0KCW1hcmdpbi1sZWZ0OjBpbjsNCglmb250LXNp
emU6MTIuMHB0Ow0KCWZvbnQtZmFtaWx5OiJUaW1lcyBOZXcgUm9tYW4iLHNlcmlmO30NCnNwYW4u
aG9lbnpiDQoJe21zby1zdHlsZS1uYW1lOmhvZW56Yjt9DQpzcGFuLkVtYWlsU3R5bGUxOQ0KCXtt
c28tc3R5bGUtdHlwZTpwZXJzb25hbC1yZXBseTsNCglmb250LWZhbWlseToiQ2FsaWJyaSIsc2Fu
cy1zZXJpZjsNCgljb2xvcjojMUY0OTdEO30NCi5Nc29DaHBEZWZhdWx0DQoJe21zby1zdHlsZS10
eXBlOmV4cG9ydC1vbmx5Ow0KCWZvbnQtZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlmO30NCkBw
YWdlIFdvcmRTZWN0aW9uMQ0KCXtzaXplOjguNWluIDExLjBpbjsNCgltYXJnaW46MS4waW4gMS4w
aW4gMS4waW4gMS4waW47fQ0KZGl2LldvcmRTZWN0aW9uMQ0KCXtwYWdlOldvcmRTZWN0aW9uMTt9
DQotLT48L3N0eWxlPjwhLS1baWYgZ3RlIG1zbyA5XT48eG1sPg0KPG86c2hhcGVkZWZhdWx0cyB2
OmV4dD0iZWRpdCIgc3BpZG1heD0iMTAyNiIgLz4NCjwveG1sPjwhW2VuZGlmXS0tPjwhLS1baWYg
Z3RlIG1zbyA5XT48eG1sPg0KPG86c2hhcGVsYXlvdXQgdjpleHQ9ImVkaXQiPg0KPG86aWRtYXAg
djpleHQ9ImVkaXQiIGRhdGE9IjEiIC8+DQo8L286c2hhcGVsYXlvdXQ+PC94bWw+PCFbZW5kaWZd
LS0+DQo8L2hlYWQ+DQo8Ym9keSBsYW5nPSJFTi1VUyIgbGluaz0iYmx1ZSIgdmxpbms9InB1cnBs
ZSI+DQo8ZGl2IGNsYXNzPSJXb3JkU2VjdGlvbjEiPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNw
YW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90
OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPk1hbnkgdGhhbmtzIGZvciB0aGUgaW5mb3JtYXRp
b24gYW5kIGl0IGRvZXMgZXhwbGFpbiB3aGF0IEnigJltIHNlZWluZy48bzpwPjwvbzpwPjwvc3Bh
bj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBw
dDtmb250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3
RCI+PG86cD4mbmJzcDs8L286cD48L3NwYW4+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNw
YW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90
OyxzYW5zLXNlcmlmO2NvbG9yOiMxRjQ5N0QiPklzIHRoaXMgdGhlIGV4cGVjdGVkIHJlc3VsdCB0
aG91Z2ggb3IgaXMgaXQgYSBrbm93biBidWc/IElmIHVzaW5nIHFlbXUtaW1nIHRvIG1vdmUgaW1h
Z2VzIGFsd2F5cyByZXN1bHRzIGluIGEgZGlzayBpbWFnZSB0aGF0IHN0YXRlcyBpdCBpcyBwcmVh
bGxvY2F0ZWQgYnV0IGRvZXMNCiBub3QgYWxsb2NhdGUgdGhlIHNwYWNlLCBob3cgZG8gSSBtb3Zl
IHByZWFsbG9jYXRlZCBkaXNrIGltYWdlcz8gSSBrbm93IEkgY2FuIGRvIHRoZSBzYW1lIHdpdGhp
biB0aGUgVk0gYW5kIHdyaXRlIGEgdmVyeSBsYXJnZSBmaWxlIGZ1bGwgb2YgemVyb3MgdG8gZ3Jv
dyB0aGUgaW1hZ2UgdG8gZnVsbCBjYXBhY2l0eSBvbiBkaXNrIGJ1dCBpcyB0aGF0IHRoZSBjb3Jy
ZWN0IGFwcHJvYWNoPzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi
PjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkm
cXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48
L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtm
b250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+
VGhhbmtzIGFnYWluLDxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi
PjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NhbGlicmkm
cXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48
L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtm
b250LWZhbWlseTomcXVvdDtDYWxpYnJpJnF1b3Q7LHNhbnMtc2VyaWY7Y29sb3I6IzFGNDk3RCI+
U2ltb248bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48YSBuYW1l
PSJfTWFpbEVuZENvbXBvc2UiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTEuMHB0O2ZvbnQtZmFt
aWx5OiZxdW90O0NhbGlicmkmcXVvdDssc2Fucy1zZXJpZjtjb2xvcjojMUY0OTdEIj48bzpwPiZu
YnNwOzwvbzpwPjwvc3Bhbj48L2E+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PGI+PHNwYW4g
c3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90Oyxz
YW5zLXNlcmlmIj5Gcm9tOjwvc3Bhbj48L2I+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMS4wcHQ7
Zm9udC1mYW1pbHk6JnF1b3Q7Q2FsaWJyaSZxdW90OyxzYW5zLXNlcmlmIj4gRnJlZCBSb2xsYW5k
IFttYWlsdG86ZnJvbGxhbmRAcmVkaGF0LmNvbV0NCjxicj4NCjxiPlNlbnQ6PC9iPiBTdW5kYXks
IDcgQXVndXN0LCAyMDE2IDEwOjU1PGJyPg0KPGI+VG86PC9iPiBTaW1vbiBCYXJyZXR0ICZsdDtT
aW1vbi5CYXJyZXR0QHRyYWRpbmdzY3JlZW4uY29tJmd0Ozxicj4NCjxiPkNjOjwvYj4gdXNlcnNA
b3ZpcnQub3JnPGJyPg0KPGI+U3ViamVjdDo8L2I+IFJlOiBbb3ZpcnQtdXNlcnNdIHByZWFsbG9j
YXRlZCBzdG9yYWdlIGlzc3VlPzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4NCjxwIGNsYXNzPSJNc29O
b3JtYWwiPjxvOnA+Jm5ic3A7PC9vOnA+PC9wPg0KPGRpdj4NCjxkaXY+DQo8ZGl2Pg0KPGRpdj4N
CjxkaXY+DQo8ZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4t
Ym90dG9tOjEyLjBwdCI+U2ltb24sPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJN
c29Ob3JtYWwiPldoYXQgaXMgaGFwcGVuaW5nIGlzIHRoYXQgd2hlbiB3ZSBjcmVhdGUgYSBwcmVh
bGxvY2F0ZWQgZGlzayBvbiBORlMsIHdlIGZpbGwgdGhlIGZpbGUgd2l0aCB6ZXJvcyBpbiBvcmRl
ciB0byAmcXVvdDthbGxvY2F0ZSZxdW90OyB0aGUgc3BhY2UuPG86cD48L286cD48L3A+DQo8L2Rp
dj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPkhvd2V2ZXIsIHdoaWxlIGNvcHlpbmcgdGhlIGRpc2sg
d2UgdXNlIHFlbXUtaW1nIHRoYXQgd2lsbCBpZ25vcmUgdGhlIHplcm9zLjxvOnA+PC9vOnA+PC9w
Pg0KPC9kaXY+DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48
L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEy
LjBwdCI+UXVpY2sgd2F5IHRvIGRlbW9uc3RyYXRlOjxicj4NCjxicj4NCltyb290QHdoaXRlLXZk
c2QgdGVzdF0jIGRkIGlmPS9kZXYvemVybyBvZj1teWZpbGUudHh0IGJzPTFNIGNvdW50PTE8YnI+
DQoxJiM0MzswIHJlY29yZHMgaW48YnI+DQoxJiM0MzswIHJlY29yZHMgb3V0PGJyPg0KMTA0ODU3
NiBieXRlcyAoMS4wIE1CLCAxLjAgTWlCKSBjb3BpZWQsIDAuMDAxNzIwODQgcywgNjA5IE1CL3M8
YnI+DQo8YnI+DQpbcm9vdEB3aGl0ZS12ZHNkIHRlc3RdIyBkdSAtaCBteWZpbGUudHh0PGJyPg0K
MS4wTSZuYnNwOyZuYnNwOyZuYnNwOyBteWZpbGUudHh0PGJyPg0KPGJyPg0KW3Jvb3RAd2hpdGUt
dmRzZCB0ZXN0XSMgbHMgLWxoIG15ZmlsZS50eHQ8YnI+DQotcnctci0tci0tIDEgcm9vdCByb290
IDEuME0gQXVnJm5ic3A7IDcgMTI6MzkgbXlmaWxlLnR4dDxicj4NCjxicj4NCltyb290QHdoaXRl
LXZkc2QgdGVzdF0jIHFlbXUtaW1nIGNvbnZlcnQgbXlmaWxlLnR4dCBteWZpbGUyLnR4dDxicj4N
Cjxicj4NCltyb290QHdoaXRlLXZkc2QgdGVzdF0jIGxzIC1saCBteWZpbGUyLnR4dDxicj4NCi1y
dy1yLS1yLS0gMSByb290IHJvb3QgMS4wTSBBdWcmbmJzcDsgNyAxMjo0MSBteWZpbGUyLnR4dDxi
cj4NCjxicj4NCltyb290QHdoaXRlLXZkc2QgdGVzdF0jIGR1IC1oIG15ZmlsZTIudHh0PGJyPg0K
MCZuYnNwOyZuYnNwOyZuYnNwOyBteWZpbGUyLnR4dDxicj4NCjxicj4NCltyb290QHdoaXRlLXZk
c2QgdGVzdF0jIHFlbXUtaW1nIGluZm8gbXlmaWxlLnR4dDxicj4NCmltYWdlOiBteWZpbGUudHh0
PGJyPg0KZmlsZSBmb3JtYXQ6IHJhdzxicj4NCnZpcnR1YWwgc2l6ZTogMS4wTSAoMTA0ODU3NiBi
eXRlcyk8YnI+DQpkaXNrIHNpemU6IDEuME08YnI+DQo8YnI+DQpbcm9vdEB3aGl0ZS12ZHNkIHRl
c3RdIyBxZW11LWltZyBpbmZvIG15ZmlsZTIudHh0PGJyPg0KaW1hZ2U6IG15ZmlsZTIudHh0PGJy
Pg0KZmlsZSBmb3JtYXQ6IHJhdzxicj4NCnZpcnR1YWwgc2l6ZTogMS4wTSAoMTA0ODU3NiBieXRl
cyk8YnI+DQpkaXNrIHNpemU6IDA8bzpwPjwvbzpwPjwvcD4NCjwvZGl2Pg0KPHAgY2xhc3M9Ik1z
b05vcm1hbCIgc3R5bGU9Im1hcmdpbi1ib3R0b206MTIuMHB0Ij5JIGhvcGUgdGhpcyBleHBsYWlu
cyB3aGF0IHlvdSBzZWUuPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiPlJlZ2FyZHMsPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi
PkZyZWQ8bzpwPjwvbzpwPjwvcD4NCjxkaXY+DQo8ZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29O
b3JtYWwiPjxvOnA+Jm5ic3A7PC9vOnA+PC9wPg0KPC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9k
aXY+DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8
ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+T24gU3VuLCBBdWcgNywgMjAxNiBhdCAxMToxMyBB
TSwgU2ltb24gQmFycmV0dCAmbHQ7PGEgaHJlZj0ibWFpbHRvOlNpbW9uLkJhcnJldHRAdHJhZGlu
Z3NjcmVlbi5jb20iIHRhcmdldD0iX2JsYW5rIj5TaW1vbi5CYXJyZXR0QHRyYWRpbmdzY3JlZW4u
Y29tPC9hPiZndDsgd3JvdGU6PG86cD48L286cD48L3A+DQo8YmxvY2txdW90ZSBzdHlsZT0iYm9y
ZGVyOm5vbmU7Ym9yZGVyLWxlZnQ6c29saWQgI0NDQ0NDQyAxLjBwdDtwYWRkaW5nOjBpbiAwaW4g
MGluIDYuMHB0O21hcmdpbi1sZWZ0OjQuOHB0O21hcmdpbi1yaWdodDowaW4iPg0KPGRpdj4NCjxw
PlN0b3JhZ2UgaXMgTkZTLiBXaGF0IGxvZ3Mgd291bGQgeW91IGxpa2UgdG8gc2VlPzxvOnA+PC9v
OnA+PC9wPg0KPHA+TWFueSB0aGFua3MuPG86cD48L286cD48L3A+DQo8cD48c3BhbiBzdHlsZT0i
Y29sb3I6Izg4ODg4OCI+U2ltb248bzpwPjwvbzpwPjwvc3Bhbj48L3A+DQo8ZGl2Pg0KPGRpdj4N
CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEyLjBwdCI+PGJyPg0K
PGJyPg0KPG86cD48L286cD48L3A+DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9
Im1hcmdpbi1ib3R0b206MTIuMHB0Ij5PbiBTdW4sIEF1ZyA3LCAyMDE2IGF0IDg6NTMgQU0gJiM0
MzswMTAwLCAmcXVvdDtGcmVkIFJvbGxhbmQmcXVvdDsgJmx0OzxhIGhyZWY9Im1haWx0bzpmcm9s
bGFuZEByZWRoYXQuY29tIiB0YXJnZXQ9Il9ibGFuayI+ZnJvbGxhbmRAcmVkaGF0LmNvbTwvYT4m
Z3Q7IHdyb3RlOjxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8ZGl2Pg0KPGRpdj4NCjxkaXY+DQo8
ZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEy
LjBwdCI+U2ltb24gaGksPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEyLjBwdCI+V2hhdCBzdG9yYWdlIHR5cGUgYXJlIHlv
dSB1c2luZyBpbiBzb3VyY2UgYW5kIHRhcmdldCBzdG9yYWdlIGRvbWFpbnMgPyAoTkZTLCBJU0NT
SS4uLi4pPG86cD48L286cD48L3A+DQo8L2Rpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
Ij5DYW4geW91IHNoYXJlIHRoZSBsb2dzPzxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8ZGl2Pg0K
PHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8L2Rpdj4NCjxwIGNs
YXNzPSJNc29Ob3JtYWwiPlRoYW5rcyw8bzpwPjwvbzpwPjwvcD4NCjwvZGl2Pg0KPHAgY2xhc3M9
Ik1zb05vcm1hbCI+RnJlZDxvOnA+PC9vOnA+PC9wPg0KPC9kaXY+DQo8ZGl2Pg0KPHAgY2xhc3M9
Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1zb05v
cm1hbCI+T24gRnJpLCBBdWcgNSwgMjAxNiBhdCA2OjM3IFBNLCBTaW1vbiBCYXJyZXR0ICZsdDs8
YSBocmVmPSJtYWlsdG86U2ltb24uQmFycmV0dEB0cmFkaW5nc2NyZWVuLmNvbSIgdGFyZ2V0PSJf
YmxhbmsiPlNpbW9uLkJhcnJldHRAdHJhZGluZ3NjcmVlbi5jb208L2E+Jmd0OyB3cm90ZTo8bzpw
PjwvbzpwPjwvcD4NCjxibG9ja3F1b3RlIHN0eWxlPSJib3JkZXI6bm9uZTtib3JkZXItbGVmdDpz
b2xpZCAjQ0NDQ0NDIDEuMHB0O3BhZGRpbmc6MGluIDBpbiAwaW4gNi4wcHQ7bWFyZ2luLWxlZnQ6
NC44cHQ7bWFyZ2luLXJpZ2h0OjBpbiI+DQo8ZGl2Pg0KPGRpdj4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6
YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPkFub3RoZXIgZXhhbXBsZS4gVGhpcyBv
bmUgd2FzIG1vdmVkIHRvIGEgbmV3IHN0b3JhZ2UgZG9tYWluPC9zcGFuPjxvOnA+PC9vOnA+PC9w
Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21z
by1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+Jm5i
c3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz
dHlsZT0iY29sb3I6IzFGNDk3RCI+cm9vdEBvdmlydF9ob3N0MSZndDsgcWVtdS1pbWcgaW5mbyBk
ZDZmMjVmNi03ODMwLTQwMjQtOTE1Zi1hMjAyNjg3OTdjMzQ8L3NwYW4+PG86cD48L286cD48L3A+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv
LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5pbWFn
ZTogZGQ2ZjI1ZjYtNzgzMC00MDI0LTkxNWYtYTIwMjY4Nzk3YzM0PC9zcGFuPjxvOnA+PC9vOnA+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv
O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+
ZmlsZSBmb3JtYXQ6IHJhdzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6
YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPnZpcnR1YWwgc2l6ZTogMjAwRyAoMjE0
NzQ4MzY0ODAwIGJ5dGVzKTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6
YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPmRpc2sgc2l6ZTogNS4wRzwvc3Bhbj48
bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv
cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9y
OiMxRjQ5N0QiPiZuYnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6
YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPnJvb3RAIG92aXJ0X2hvc3QxJmd0OyBj
YXQgZGQ2ZjI1ZjYtNzgzMC00MDI0LTkxNWYtYTIwMjY4Nzk3YzM0Lm1ldGE8L3NwYW4+PG86cD48
L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0
OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0
OTdEIj5ET01BSU49NTM1NjBkNDMtODc0YS00OWM1LTljNWEtOGI5MDQ4N2M3OWY4PC9zcGFuPjxv
OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w
LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6
IzFGNDk3RCI+Vk9MVFlQRT1MRUFGPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1z
b05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9t
LWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+Q1RJTUU9MTQ3MDMwNTY3ODwv
c3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFy
Z2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9
ImNvbG9yOiMxRjQ5N0QiPkZPUk1BVD1SQVc8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFz
cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i
b3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5JTUFHRT03NDE5NzZj
ZC1kMWNiLTQwMzEtYmRiZS02YTc0NWRmZjE2ZWY8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBj
bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdp
bi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5ESVNLVFlQRT0y
PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t
YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHls
ZT0iY29sb3I6IzFGNDk3RCI+UFVVSUQ9MDAwMDAwMDAtMDAwMC0wMDAwLTAwMDAtMDAwMDAwMDAw
MDAwPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz
dHlsZT0iY29sb3I6IzFGNDk3RCI+TEVHQUxJVFk9TEVHQUw8L3NwYW4+PG86cD48L286cD48L3A+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv
LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5NVElN
RT0wPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz
dHlsZT0iY29sb3I6IzFGNDk3RCI+UE9PTF9VVUlEPTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxw
IGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFy
Z2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPlNJWkU9NDE5
NDMwNDAwPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9
Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh
biBzdHlsZT0iY29sb3I6IzFGNDk3RCI+VFlQRT1QUkVBTExPQ0FURUQ8L3NwYW4+PG86cD48L286
cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1
dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdE
Ij5ERVNDUklQVElPTj08L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1
dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5FT0Y8L3NwYW4+PG86cD48L286cD48L3A+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv
LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj4mbmJz
cDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNv
LW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0
eWxlPSJjb2xvcjojMUY0OTdEIj4mbmJzcDs8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFz
cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i
b3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5UaGlzIG9uZSBoYXMg
bm90IGJlZW4gbW92ZWQ6PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h
bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph
dXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv
O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+
PGEgaHJlZj0ibWFpbHRvOnJvb3RAbnkyLWx2Yi0wNjYubWd0Ij5yb290QG55Mi1sdmItMDY2Lm1n
dDwvYT4mZ3Q7IHFlbXUtaW1nIGluZm8gMTU1ZjBkMzMtYzI4MC00MjM2LThkMWUtZmNiODhmOWEx
MjQyPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz
dHlsZT0iY29sb3I6IzFGNDk3RCI+aW1hZ2U6IDE1NWYwZDMzLWMyODAtNDIzNi04ZDFlLWZjYjg4
ZjlhMTI0Mjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl
PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNw
YW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPmZpbGUgZm9ybWF0OiByYXc8L3NwYW4+PG86cD48L286
cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1
dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdE
Ij52aXJ0dWFsIHNpemU6IDkwRyAoOTY2MzY3NjQxNjAgYnl0ZXMpPC9zcGFuPjxvOnA+PC9vOnA+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv
O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+
ZGlzayBzaXplOiA5MEc8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1
dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj4mbmJzcDs8L3NwYW4+PG86cD48L286cD48
L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87
bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj48
YSBocmVmPSJtYWlsdG86cm9vdEBueTItbHZiLTA2Ni5tZ3QiPnJvb3RAbnkyLWx2Yi0wNjYubWd0
PC9hPiZndDsgY2F0IDE1NWYwZDMzLWMyODAtNDIzNi04ZDFlLWZjYjg4ZjlhMTI0Mi5tZXRhPC9z
cGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJn
aW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0i
Y29sb3I6IzFGNDk3RCI+RE9NQUlOPTU5YmRlMmZmLWUxMGQtNDc3ZS05MWMxLTYzNTVhYmZmMDk5
OTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t
bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5
bGU9ImNvbG9yOiMxRjQ5N0QiPkNUSU1FPTE0NjQ5NDY2Mzk8L3NwYW4+PG86cD48L286cD48L3A+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv
LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5GT1JN
QVQ9UkFXPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9
Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh
biBzdHlsZT0iY29sb3I6IzFGNDk3RCI+RElTS1RZUEU9Mjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4N
CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t
bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPkxFR0FM
SVRZPUxFR0FMPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5
bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48
c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+U0laRT0xODg3NDM2ODA8L3NwYW4+PG86cD48L286
cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1
dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdE
Ij5WT0xUWVBFPUxFQUY8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1
dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5ERVNDUklQVElPTj17JnF1b3Q7RGlza0Fs
aWFzJnF1b3Q7OiZxdW90O255Mi1sYWEtMDEwLnByb2RfRGlzazEmcXVvdDssJnF1b3Q7RGlza0Rl
c2NyaXB0aW9uJnF1b3Q7OiZxdW90OyZxdW90O308L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBj
bGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdp
bi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5JTUFHRT04MjE1
ODE4Mi04MWE0LTQ1OGUtYTQxYi02NjM3NTY5NjI2NjY8L3NwYW4+PG86cD48L286cD48L3A+DQo8
cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h
cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5QVVVJRD0w
MDAwMDAwMC0wMDAwLTAwMDAtMDAwMC0wMDAwMDAwMDAwMDA8L3NwYW4+PG86cD48L286cD48L3A+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv
LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJjb2xvcjojMUY0OTdEIj5NVElN
RT0wPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz
dHlsZT0iY29sb3I6IzFGNDk3RCI+UE9PTF9VVUlEPTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxw
IGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFy
Z2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPlRZUEU9UFJF
QUxMT0NBVEVEPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5
bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48
c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+RU9GPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAg
Y2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJn
aW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+Jm5ic3A7PC9z
cGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJn
aW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0i
Y29sb3I6IzFGNDk3RCI+U2VlIHRoZSBtaXNtYXRjaCBiZXR3ZWVuIOKAnHZpcnR1YWwgc2l6ZeKA
nSBhbmQg4oCcZGlzayBzaXpl4oCdIG9uIHRoZSBvbmUgdGhhdCB3YXMgbW92ZWQuPC9zcGFuPjxv
OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w
LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iY29sb3I6
IzFGNDk3RCI+Jm5ic3A7PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h
bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph
dXRvIj48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+VElBLDwvc3Bhbj48bzpwPjwvbzpwPjwv
cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt
c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImNvbG9yOiMxRjQ5N0QiPiZu
YnNwOzwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJt
c28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4g
c3R5bGU9ImNvbG9yOiMxRjQ5N0QiPlNpbW9uPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xh
c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4t
Ym90dG9tLWFsdDphdXRvIj48YSBuYW1lPSJtXzQyNjUyNDU1OTkwNTEzODMxNzNfbV8tMTkxMzQw
NTM4Njk4NjY3Ij48c3BhbiBzdHlsZT0iY29sb3I6IzFGNDk3RCI+Jm5ic3A7PC9zcGFuPjwvYT48
bzpwPjwvbzpwPjwvcD4NCjxkaXY+DQo8ZGl2IHN0eWxlPSJib3JkZXI6bm9uZTtib3JkZXItdG9w
OnNvbGlkICNFMUUxRTEgMS4wcHQ7cGFkZGluZzozLjBwdCAwaW4gMGluIDBpbiI+DQo8cCBjbGFz
cz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1i
b3R0b20tYWx0OmF1dG8iPjxiPkZyb206PC9iPg0KPGEgaHJlZj0ibWFpbHRvOnVzZXJzLWJvdW5j
ZXNAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+dXNlcnMtYm91bmNlc0BvdmlydC5vcmc8L2E+
IFttYWlsdG86PGEgaHJlZj0ibWFpbHRvOnVzZXJzLWJvdW5jZXNAb3ZpcnQub3JnIiB0YXJnZXQ9
Il9ibGFuayI+dXNlcnMtYm91bmNlc0BvdmlydC5vcmc8L2E+XQ0KPGI+T24gQmVoYWxmIE9mIDwv
Yj5TaW1vbiBCYXJyZXR0PGJyPg0KPGI+U2VudDo8L2I+IEZyaWRheSwgNSBBdWd1c3QsIDIwMTYg
MTA6MjU8YnI+DQo8Yj5Ubzo8L2I+IDxhIGhyZWY9Im1haWx0bzp1c2Vyc0BvdmlydC5vcmciIHRh
cmdldD0iX2JsYW5rIj51c2Vyc0BvdmlydC5vcmc8L2E+PGJyPg0KPGI+U3ViamVjdDo8L2I+IFtv
dmlydC11c2Vyc10gcHJlYWxsb2NhdGVkIHN0b3JhZ2UgaXNzdWU/PG86cD48L286cD48L3A+DQo8
L2Rpdj4NCjwvZGl2Pg0KPGRpdj4NCjxkaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i
bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPiZuYnNw
OzxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4t
dG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj5JZiBJIGNyZWF0ZSBhIHBy
ZWFsbG9jYXRlZCBkaXNrIGZvciBhIFZNLCBJIHNlZSB0aGUgZGlzayBpbWFnZSBmaWxlIGxpc3Rp
bmcgYXMgdGhlIHNpemUgSSByZXF1ZXN0ZWQgKDEwMEcpOjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xh
c3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4t
Ym90dG9tLWFsdDphdXRvIj4mbmJzcDs8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6
YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291
cmllciBOZXcmcXVvdDssc2VyaWYiPmNkIC9yaGV2L2RhdGEtY2VudGVyL21udC9zdG9yYWdlX2hv
c3QxOl92b2xfcGExX19uYXNfXzAxYl9fb1ZpcnRfX3Byb2RfXzAxLzUzNTYwZDQzLTg3NGEtNDlj
NS05YzVhLThiOTA0ODdjNzlmOC9pbWFnZXMvZDk3Zjc3MDYtMzY2Mi00MGJmLTkzNTgtODBlMGRj
NTFiZmY0PC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9
Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3Bh
biBzdHlsZT0iZm9udC1zaXplOjEwLjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZx
dW90OyxzZXJpZiI+cm9vdEBvdmlydF9ob3N0Jmd0OyBscyAtbDwvc3Bhbj48bzpwPjwvbzpwPjwv
cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt
c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7
Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDssc2VyaWYiPnRvdGFsIDEwNTA2NDY0
NDwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t
bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDss
c2VyaWYiPi1ydy1ydy0tLS0gMSB2ZHNtIGt2bSAxMDczNzQxODI0MDAgQXVnJm5ic3A7IDUgMTA6
NTcgNzVjMTQ1NTktZTE4Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiPC9zcGFuPjxvOnA+PC9vOnA+
PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRv
O21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEwLjBw
dDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyxzZXJpZiI+LXJ3LXJ3LS0tLSAx
IHZkc20ga3ZtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IDEwNDg1NzYgQXVnJm5ic3A7
IDUgMTA6NTcgNzVjMTQ1NTktZTE4Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiLmxlYXNlPC9zcGFu
PjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4t
dG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9u
dC1zaXplOjEwLjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90OyxzZXJpZiI+
LXJ3LXItLXItLSAxIHZkc20ga3ZtJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7
Jm5ic3A7Jm5ic3A7Jm5ic3A7IDMxMyBBdWcmbmJzcDsgNSAxMDo1NyA3NWMxNDU1OS1lMThmLTRj
YzgtYTNmZS1iYzBkZTUwNzcyMGIubWV0YTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNz
PSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJv
dHRvbS1hbHQ6YXV0byI+Jm5ic3A7PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1
dG8iPmFuZCB0aGUgY29ycmVzcG9uZGluZyBzcGFjZSB1c2VkIG9uIGRpc2sgbWF0Y2hlczxvOnA+
PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFs
dDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj4mbmJzcDs8bzpwPjwvbzpwPjwvcD4N
CjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28t
bWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9u
dC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDssc2VyaWYiPnJvb3RAIG92aXJ0X2hvc3Qg
Jmd0OyBkdSAtc2ggKjwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwi
IHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0
byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmll
ciBOZXcmcXVvdDssc2VyaWYiPjEwMUcmbmJzcDsmbmJzcDsmbmJzcDsgNzVjMTQ1NTktZTE4Zi00
Y2M4LWEzZmUtYmMwZGU1MDc3MjBiPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1z
b05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9t
LWFsdDphdXRvIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjEwLjBwdDtmb250LWZhbWlseTomcXVv
dDtDb3VyaWVyIE5ldyZxdW90OyxzZXJpZiI+MS4xTSZuYnNwOyZuYnNwOyZuYnNwOyA3NWMxNDU1
OS1lMThmLTRjYzgtYTNmZS1iYzBkZTUwNzcyMGIubGVhc2U8L3NwYW4+PG86cD48L286cD48L3A+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNv
LW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2Zv
bnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7LHNlcmlmIj40LjBLJm5ic3A7Jm5ic3A7
Jm5ic3A7IDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYi5tZXRhPC9zcGFuPjxv
OnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1tYXJnaW4tdG9w
LWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj4mbmJzcDs8bzpwPjwvbzpwPjwv
cD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bztt
c28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+SWYgSSB0aGVuIG1pZ3JhdGUgdGhhdCBzdG9yYWdl
ICh3aGlsZSB0aGUgVk0gaXMgc2h1dGRvd24pIHRvIGEgbmV3IHN0b3JhZ2UgZG9tYWluLCB0aGUg
c2l6ZSBvbiBkaXNrIGRvZXMgbm90IG1hdGNoIHRoZSBhbGxvY2F0ZWQgc2l6ZS4gSW4gdGhpcyBj
YXNlIHRoZXJlIGlzIG5vdGhpbmcgaW4gdGhlIGRpc2sNCiB5ZXQgc28gaXQgc2hvd3MgYXMgMC48
bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv
cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+Jm5ic3A7PG86cD48L286cD48
L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87
bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0
O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7LHNlcmlmIj5jZCAvcmhldi9kYXRh
LWNlbnRlci9tbnQvc3RvcmFnZV9ob3N0Mjpfdm9sX3BhMV9fb3ZpcnRfX3VhdHByb2QvMWYyYzJi
NDgtMWU3Ny00Yzk4LWE2ZGEtNWRjMDliNzhjZWFkL2ltYWdlcy9kOTdmNzcwNi0zNjYyLTQwYmYt
OTM1OC04MGUwZGM1MWJmZjQ8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y
bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0
OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0Nv
dXJpZXIgTmV3JnF1b3Q7LHNlcmlmIj5yb290QCBvdmlydF9ob3N0Jmd0OyBscyAtbDwvc3Bhbj48
bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRv
cC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQt
c2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDssc2VyaWYiPnRv
dGFsIDEwMzI8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHls
ZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxz
cGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3
JnF1b3Q7LHNlcmlmIj4tcnctcnctLS0tIDEgdmRzbSBrdm0gMTA3Mzc0MTgyNDAwIEF1ZyZuYnNw
OyA1IDExOjA2IDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYjwvc3Bhbj48bzpw
PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h
bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6
ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDssc2VyaWYiPi1ydy1y
dy0tLS0gMSB2ZHNtIGt2bSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAxMDQ4NTc2IEF1
ZyZuYnNwOyA1IDExOjA2IDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYi5sZWFz
ZTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t
bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5
bGU9ImZvbnQtc2l6ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDss
c2VyaWYiPi1ydy1yLS1yLS0gMSB2ZHNtIGt2bSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAzMTMgQXVnJm5ic3A7IDUgMTE6MDYgNzVjMTQ1NTkt
ZTE4Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiLm1ldGE8L3NwYW4+PG86cD48L286cD48L3A+DQo8
cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1h
cmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQt
ZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7LHNlcmlmIj4mbmJzcDs8L3NwYW4+PG86cD48
L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0
OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6
MTAuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O0NvdXJpZXIgTmV3JnF1b3Q7LHNlcmlmIj5yb290QCBv
dmlydF9ob3N0ICZndDsgZHUgLXNoICo8L3NwYW4+PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0i
TXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0
b20tYWx0OmF1dG8iPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTAuMHB0O2ZvbnQtZmFtaWx5OiZx
dW90O0NvdXJpZXIgTmV3JnF1b3Q7LHNlcmlmIj4wJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7Jm5ic3A7IDc1YzE0NTU5LWUxOGYtNGNjOC1hM2ZlLWJjMGRlNTA3NzIwYjwvc3Bhbj48bzpw
PjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1h
bHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6
ZToxMC4wcHQ7Zm9udC1mYW1pbHk6JnF1b3Q7Q291cmllciBOZXcmcXVvdDssc2VyaWYiPjEuMU0m
bmJzcDsmbmJzcDsmbmJzcDsgNzVjMTQ1NTktZTE4Zi00Y2M4LWEzZmUtYmMwZGU1MDc3MjBiLmxl
YXNlPC9zcGFuPjxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj48c3BhbiBz
dHlsZT0iZm9udC1zaXplOjEwLjBwdDtmb250LWZhbWlseTomcXVvdDtDb3VyaWVyIE5ldyZxdW90
OyxzZXJpZiI+NC4wSyZuYnNwOyZuYnNwOyZuYnNwOyA3NWMxNDU1OS1lMThmLTRjYzgtYTNmZS1i
YzBkZTUwNzcyMGIubWV0YTwvc3Bhbj48bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6
YXV0byI+Jm5ic3A7PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0i
bXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPm9WaXJ0
IHN0aWxsIGxpc3RzIHRoZSBkaXNrIGFzIHByZWFsbG9jYXRlZCBpbiB0aGUgR1VJIGJ1dCBpdCBp
cyBpbiBmYWN0IHRoaW4gcHJvdmlzaW9uZWQuPG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv
Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t
YWx0OmF1dG8iPiZuYnNwOzxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5
bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj5J
IHNlZSB0aGUgc2FtZSBpc3N1ZSBpZiBJIGNsb25lIGEgcHJlYWxsb2NhdGVkIFZNLiBUaGUgc2l6
ZSBvbiBkaXNrIGVuZHMgdXAgYmVpbmcgdGhlIGVxdWl2YWxlbnQgb2YgYSB0aGluLXByb3Zpc2lv
bmVkIGRpc2suIEkgYWxzbyBoYWQgdGhlIGlzc3VlIHdoZW4gaW1wb3J0aW5nIFZN4oCZcyBmcm9t
IGFuIGV4cG9ydA0KIGRvbWFpbiB3aGVuIEkgaGFkIHNlbGVjdGVkIHByZWFsbG9jYXRlZCBpbiB0
aGUgaW1wb3J0IGRpYWxvZyBib3guPG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFs
IiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1
dG8iPiZuYnNwOzxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1z
by1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj5JcyB0aGlz
IGEga25vd24gaXNzdWU/IFNob3VsZCBwcmVhbGxvY2F0ZWQgbm90IG1lYW4gcHJlYWxsb2NhdGVk
IG9uIHBoeXNpY2FsIGRpc2s/PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz
dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i
PiZuYnNwOzxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5bGU9Im1zby1t
YXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj5PdmlydCBFbmdp
bmUgaXMgcnVubmluZyAzLjYuNC4xLTEuZWw2PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNv
Tm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20t
YWx0OmF1dG8iPiZuYnNwOzxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIgc3R5
bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRvIj5U
aGUgb3ZpcnQgbm9kZXMgYXJlIHJ1bm5pbmc6DQo8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJN
c29Ob3JtYWwiIHN0eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRv
bS1hbHQ6YXV0byI+Jm5ic3A7PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz
dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i
Pk9TIFZlcnNpb246Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7ICZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBSSEVMIC0gNyAtIDIuMTUxMS5lbDcuY2Vu
dG9zLjIuMTA8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJtc28t
bWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+S2VybmVsIFZl
cnNpb246Jm5ic3A7ICZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu
YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAzLjEwLjAgLSAzMjcuNC41
LmVsNy54ODZfNjQ8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxlPSJt
c28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+S1ZNIFZl
cnNpb246Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7ICZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu
YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw
OyAyLjMuMCAtIDMxLmVsN18yLjcuMTxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1h
bCIgc3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDph
dXRvIj5MSUJWSVJUIFZlcnNpb246Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7
Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IGxpYnZpcnQt
MS4yLjE3LTEzLmVsN18yLjI8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0
eWxlPSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+
VkRTTSBWZXJzaW9uOiZuYnNwOyAmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm
bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgdmRzbS00LjE3
LjIzLjItMC5lbDcuY2VudG9zPG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBz
dHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8i
PlNQSUNFIFZlcnNpb246Jm5ic3A7Jm5ic3A7ICZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw
OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyAw
LjEyLjQgLSAxNS5lbDc8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl
PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+R2x1
c3RlckZTIFZlcnNpb246Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7
Jm5ic3A7Jm5ic3A7Jm5ic3A7IFtOL0FdPG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9y
bWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0
OmF1dG8iPkNFUEggVmVyc2lvbjombmJzcDsmbmJzcDsmbmJzcDsgJm5ic3A7Jm5ic3A7Jm5ic3A7
Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i
c3A7Jm5ic3A7IGxpYnJiZDEtMC44MC43LTMuZWw3PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0i
TXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0
b20tYWx0OmF1dG8iPiZuYnNwOzxvOnA+PC9vOnA+PC9wPg0KPHAgY2xhc3M9Ik1zb05vcm1hbCIg
c3R5bGU9Im1zby1tYXJnaW4tdG9wLWFsdDphdXRvO21zby1tYXJnaW4tYm90dG9tLWFsdDphdXRv
Ij5NYW55IHRoYW5rcyw8bzpwPjwvbzpwPjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiIHN0eWxl
PSJtc28tbWFyZ2luLXRvcC1hbHQ6YXV0bzttc28tbWFyZ2luLWJvdHRvbS1hbHQ6YXV0byI+Jm5i
c3A7PG86cD48L286cD48L3A+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIiBzdHlsZT0ibXNvLW1hcmdp
bi10b3AtYWx0OmF1dG87bXNvLW1hcmdpbi1ib3R0b20tYWx0OmF1dG8iPlNpbW9uPG86cD48L286
cD48L3A+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9kaXY+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3Jt
YWwiIHN0eWxlPSJtYXJnaW4tYm90dG9tOjEyLjBwdCI+PGJyPg0KX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX188YnI+DQpVc2VycyBtYWlsaW5nIGxpc3Q8YnI+
DQo8YSBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+VXNlcnNA
b3ZpcnQub3JnPC9hPjxicj4NCjxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1h
bi9saXN0aW5mby91c2VycyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcv
bWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48bzpwPjwvbzpwPjwvcD4NCjwvYmxvY2txdW90ZT4N
CjwvZGl2Pg0KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PG86cD4mbmJzcDs8L286cD48L3A+DQo8L2Rp
dj4NCjwvZGl2Pg0KPC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9ibG9ja3F1b3RlPg0KPC9kaXY+
DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48bzpwPiZuYnNwOzwvbzpwPjwvcD4NCjwvZGl2Pg0KPC9k
aXY+DQo8L2JvZHk+DQo8L2h0bWw+DQo=
--_000_D86C48DF8800164BBE50B87623F7AC9585F582A2ln2wio001devtra_--
4:14 a.m.
Eventually, the option of preallocated disk on NFS will not be available in
oVirt.
The underlying file systems in NFS are usually implementing sparse file.
There might even be a file system implementation that will ignore those
zeroes that we fill.
If you need a "real" preallocated disk, block storage will do the job for
you.
Regards,
Fred
On Mon, Aug 8, 2016 at 10:37 AM, Simon Barrett <
Simon.Barrett(a)tradingscreen.com> wrote:
Many thanks for the information and it does explain what I’m seeing.
Is this the expected result though or is it a known bug? If using qemu-img
to move images always results in a disk image that states it is
preallocated but does not allocate the space, how do I move preallocated
disk images? I know I can do the same within the VM and write a very large
file full of zeros to grow the image to full capacity on disk but is that
the correct approach?
Thanks again,
Simon
*From:* Fred Rolland [mailto:frolland@redhat.com]
*Sent:* Sunday, 7 August, 2016 10:55
*To:* Simon Barrett <Simon.Barrett(a)tradingscreen.com>
*Cc:* users(a)ovirt.org
*Subject:* Re: [ovirt-users] preallocated storage issue?
Simon,
What is happening is that when we create a preallocated disk on NFS, we
fill the file with zeros in order to "allocate" the space.
However, while copying the disk we use qemu-img that will ignore the zeros.
Quick way to demonstrate:
[root@white-vdsd test]# dd if=/dev/zero of=myfile.txt bs=1M count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00172084 s, 609 MB/s
[root@white-vdsd test]# du -h myfile.txt
1.0M myfile.txt
[root@white-vdsd test]# ls -lh myfile.txt
-rw-r--r-- 1 root root 1.0M Aug 7 12:39 myfile.txt
[root@white-vdsd test]# qemu-img convert myfile.txt myfile2.txt
[root@white-vdsd test]# ls -lh myfile2.txt
-rw-r--r-- 1 root root 1.0M Aug 7 12:41 myfile2.txt
[root@white-vdsd test]# du -h myfile2.txt
0 myfile2.txt
[root@white-vdsd test]# qemu-img info myfile.txt
image: myfile.txt
file format: raw
virtual size: 1.0M (1048576 bytes)
disk size: 1.0M
[root@white-vdsd test]# qemu-img info myfile2.txt
image: myfile2.txt
file format: raw
virtual size: 1.0M (1048576 bytes)
disk size: 0
I hope this explains what you see.
Regards,
Fred
On Sun, Aug 7, 2016 at 11:13 AM, Simon Barrett <
Simon.Barrett(a)tradingscreen.com> wrote:
Storage is NFS. What logs would you like to see?
Many thanks.
Simon
On Sun, Aug 7, 2016 at 8:53 AM +0100, "Fred Rolland"
<frolland(a)redhat.com>
wrote:
Simon hi,
What storage type are you using in source and target storage domains ?
(NFS, ISCSI....)
Can you share the logs?
Thanks,
Fred
On Fri, Aug 5, 2016 at 6:37 PM, Simon Barrett <
Simon.Barrett(a)tradingscreen.com> wrote:
Another example. This one was moved to a new storage domain
root@ovirt_host1> qemu-img info dd6f25f6-7830-4024-915f-a20268797c34
image: dd6f25f6-7830-4024-915f-a20268797c34
file format: raw
virtual size: 200G (214748364800 bytes)
disk size: 5.0G
root@ ovirt_host1> cat dd6f25f6-7830-4024-915f-a20268797c34.meta
DOMAIN=53560d43-874a-49c5-9c5a-8b90487c79f8
VOLTYPE=LEAF
CTIME=1470305678
FORMAT=RAW
IMAGE=741976cd-d1cb-4031-bdbe-6a745dff16ef
DISKTYPE=2
PUUID=00000000-0000-0000-0000-000000000000
LEGALITY=LEGAL
MTIME=0
POOL_UUID=
SIZE=419430400
TYPE=PREALLOCATED
DESCRIPTION=
EOF
This one has not been moved:
root(a)ny2-lvb-066.mgt> qemu-img info 155f0d33-c280-4236-8d1e-fcb88f9a1242
image: 155f0d33-c280-4236-8d1e-fcb88f9a1242
file format: raw
virtual size: 90G (96636764160 bytes)
disk size: 90G
root(a)ny2-lvb-066.mgt> cat 155f0d33-c280-4236-8d1e-fcb88f9a1242.meta
DOMAIN=59bde2ff-e10d-477e-91c1-6355abff0999
CTIME=1464946639
FORMAT=RAW
DISKTYPE=2
LEGALITY=LEGAL
SIZE=188743680
VOLTYPE=LEAF
DESCRIPTION={"DiskAlias":"ny2-laa-010.prod_Disk1","DiskDescription":""}
IMAGE=82158182-81a4-458e-a41b-663756962666
PUUID=00000000-0000-0000-0000-000000000000
MTIME=0
POOL_UUID=
TYPE=PREALLOCATED
EOF
See the mismatch between “virtual size” and “disk size” on the one that
was moved.
TIA,
Simon
*From:* users-bounces(a)ovirt.org [mailto:users-bounces@ovirt.org] *On
Behalf Of *Simon Barrett
*Sent:* Friday, 5 August, 2016 10:25
*To:* users(a)ovirt.org
*Subject:* [ovirt-users] preallocated storage issue?
If I create a preallocated disk for a VM, I see the disk image file
listing as the size I requested (100G):
cd /rhev/data-center/mnt/storage_host1:_vol_pa1__nas__01b__
oVirt__prod__01/53560d43-874a-49c5-9c5a-8b90487c79f8/images/
d97f7706-3662-40bf-9358-80e0dc51bff4
root@ovirt_host> ls -l
total 105064644
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-
bc0de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-
bc0de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 10:57 75c14559-e18f-4cc8-a3fe-
bc0de507720b.meta
and the corresponding space used on disk matches
root@ ovirt_host > du -sh *
101G 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
If I then migrate that storage (while the VM is shutdown) to a new storage
domain, the size on disk does not match the allocated size. In this case
there is nothing in the disk yet so it shows as 0.
cd /rhev/data-center/mnt/storage_host2:_vol_pa1__ovirt__
uatprod/1f2c2b48-1e77-4c98-a6da-5dc09b78cead/images/
d97f7706-3662-40bf-9358-80e0dc51bff4
root@ ovirt_host> ls -l
total 1032
-rw-rw---- 1 vdsm kvm 107374182400 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-
bc0de507720b
-rw-rw---- 1 vdsm kvm 1048576 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-
bc0de507720b.lease
-rw-r--r-- 1 vdsm kvm 313 Aug 5 11:06 75c14559-e18f-4cc8-a3fe-
bc0de507720b.meta
root@ ovirt_host > du -sh *
0 75c14559-e18f-4cc8-a3fe-bc0de507720b
1.1M 75c14559-e18f-4cc8-a3fe-bc0de507720b.lease
4.0K 75c14559-e18f-4cc8-a3fe-bc0de507720b.meta
oVirt still lists the disk as preallocated in the GUI but it is in fact
thin provisioned.
I see the same issue if I clone a preallocated VM. The size on disk ends
up being the equivalent of a thin-provisioned disk. I also had the issue
when importing VM’s from an export domain when I had selected preallocated
in the import dialog box.
Is this a known issue? Should preallocated not mean preallocated on
physical disk?
Ovirt Engine is running 3.6.4.1-1.el6
The ovirt nodes are running:
OS Version: RHEL - 7 - 2.1511.el7.centos.2.10
Kernel Version: 3.10.0 - 327.4.5.el7.x86_64
KVM Version: 2.3.0 - 31.el7_2.7.1
LIBVIRT Version: libvirt-1.2.17-13.el7_2.2
VDSM Version: vdsm-4.17.23.2-0.el7.centos
SPICE Version: 0.12.4 - 15.el7
GlusterFS Version: [N/A]
CEPH Version: librbd1-0.80.7-3.el7
Many thanks,
Simon
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
3064
days inactive
3067
days old
6 comments
2 participants
participants (2)
-
Fred Rolland -
Simon Barrett