10:41 a.m.
I have few VMs in Redhat Virtualisation environment RHeV ( using Rhevm4.1 ) managed by
a third party
Now I am in the process of migrating those VMs to my cloud setup with OpenStack ussuri
version with KVM hypervisor and Glance storage.
The third party is making down each VM and giving the each VM image with their attached
volume disks along with it.
There are three folders which contain images for each VM .
These folders contain the base OS image, and attached LVM disk images ( from time to time
they added hard disks and used LVM for storing data ) where data is stored.
Is there a way to get all these images to be exported as Single image file Instead of
multiple image files from Rhevm it self. Is this possible ?
If possible how to combine e all these disk images to a single image and that image can
upload to our cloud glance storage as a single image ?
Is this possible or Am I asking a Stupid question which theoretically not possible ?
Thanks in Advance for sharing your thoughts,
Kris.
4:52 p.m.
On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
I have few VMs in Redhat Virtualisation environment RHeV ( using Rhevm4.1 ) managed
by a third party
Now I am in the process of migrating those VMs to my cloud setup with OpenStack ussuri
version with KVM hypervisor and Glance storage.
The third party is making down each VM and giving the each VM image with their attached
volume disks along with it.
There are three folders which contain images for each VM .
These folders contain the base OS image, and attached LVM disk images ( from time to time
they added hard disks and used LVM for storing data ) where data is stored.
Is there a way to get all these images to be exported as Single image file Instead of
multiple image files from Rhevm it self. Is this possible ?
If possible how to combine e all these disk images to a single image and that image can
upload to our cloud glance storage as a single image ?
It is not clear what is the vm you are trying to export. If you share
the libvirt xml
of this vm it will be more clear. You can use "sudo virsh -r dumpxml vm-name".
RHV supports download of disks to one image per disk, which you can move
to another system.
We also have export to ova, which creates one tar file with all exported disks,
if this helps.
Nir
6:29 p.m.
I have asked our VM maintainer to run the command
# virsh -r dumpxml vm-name_blah //as Super user
But no output : No matching domains found that was the TTY output on
that rhevm node when I executed the command.
Then I tried to execute # virsh list // it doesn't list any VMs !!!
( How come this ? Does the Rhevm node need to enable any CLI with License
key or something to list Vms or to dumpxml with virsh ? or its CLI
commands ?
Any way I want to know what I have to ask the maintainer to provide a
working a working CLI or ? which do the tasks expected to do with
command line utilities in rhevm.
I have one more question : Which command can I execute on an rhevm node
to manually export ( not through GUI portal) a VMs to required format ?
For example; 1. I need to get one VM and disks attached to it as raw
images. Is this possible how?
and another 2. VM and disk attached to it as Ova or( what other good
format) which suitable to upload to glance ?
Each VMs are around 200 to 300 GB with disk volumes ( so where should be
the images exported to which path to specify ? to the host node(if the host
doesn't have space or NFS mount ? how to specify the target location where
the VM image get stored in case of NFS mount ( available ?)
Thanks in advance
On Mon, Aug 2, 2021 at 8:22 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
>
> I have few VMs in Redhat Virtualisation environment RHeV ( using
Rhevm4.1 ) managed by a third party
>
> Now I am in the process of migrating those VMs to my cloud setup with
OpenStack ussuri version with KVM hypervisor and Glance storage.
>
> The third party is making down each VM and giving the each VM image
with their attached volume disks along with it.
>
> There are three folders which contain images for each VM .
> These folders contain the base OS image, and attached LVM disk images (
from time to time they added hard disks and used LVM for storing data )
where data is stored.
>
> Is there a way to get all these images to be exported as Single image
file Instead of multiple image files from Rhevm it self. Is this possible
?
>
> If possible how to combine e all these disk images to a single image and
that image can upload to our cloud glance storage as a single image ?
It is not clear what is the vm you are trying to export. If you share
the libvirt xml
of this vm it will be more clear. You can use "sudo virsh -r dumpxml
vm-name".
RHV supports download of disks to one image per disk, which you can move
to another system.
We also have export to ova, which creates one tar file with all exported
disks,
if this helps.
Nir
10:07 p.m.
On Tue, Aug 3, 2021 at 7:29 PM KK CHN <kkchn.in(a)gmail.com> wrote:
I have asked our VM maintainer to run the command
# virsh -r dumpxml vm-name_blah //as Super user
But no output : No matching domains found that was the TTY output on that rhevm node
when I executed the command.
Then I tried to execute # virsh list // it doesn't list any VMs !!! ( How
come this ? Does the Rhevm node need to enable any CLI with License key or something to
list Vms or to dumpxml with virsh ? or its CLI commands ?
RHV undefine the vms when they are not running.
Any way I want to know what I have to ask the maintainer to
provide a working a working CLI or ? which do the tasks expected to do with command
line utilities in rhevm.
If the vm is not running you can get the vm configuration from ovirt
using the API:
GET /api/vms/{vm-id}
You may need more API calls to get info about the disks, follow the <links>
in the returned xml.
I have one more question : Which command can I execute on an rhevm
node to manually export ( not through GUI portal) a VMs to required format ?
For example; 1. I need to get one VM and disks attached to it as raw images. Is
this possible how?
and another 2. VM and disk attached to it as Ova or( what other good format) which
suitable to upload to glance ?
Arik can add more info on exporting.
Each VMs are around 200 to 300 GB with disk volumes ( so where
should be the images exported to which path to specify ? to the host node(if the host
doesn't have space or NFS mount ? how to specify the target location where the VM
image get stored in case of NFS mount ( available ?)
You have 2 options:
- Download the disks using the SDK
- Export the VM to OVA
When exporting to OVA, you will always get qcow2 images, which you can later
convert to raw using "qemu-img convert"
When downloading the disks, you control the image format, for example
this will download
the disk in any format, collapsing all snapshots to the raw format:
$ python3 /usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
-c engine-dev 3649d84b-6f35-4314-900a-5e8024e3905c /var/tmp/disk1.raw
This requires ovirt.conf file:
$ cat ~/.config/ovirt.conf
[engine-dev]
engine_url = https://engine-dev
username = admin@internal
password = mypassword
cafile = /etc/pki/vdsm/certs/cacert.pem
Nir
Thanks in advance
On Mon, Aug 2, 2021 at 8:22 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>
> On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
> >
> > I have few VMs in Redhat Virtualisation environment RHeV ( using Rhevm4.1 )
managed by a third party
> >
> > Now I am in the process of migrating those VMs to my cloud setup with
OpenStack ussuri version with KVM hypervisor and Glance storage.
> >
> > The third party is making down each VM and giving the each VM image with their
attached volume disks along with it.
> >
> > There are three folders which contain images for each VM .
> > These folders contain the base OS image, and attached LVM disk images ( from
time to time they added hard disks and used LVM for storing data ) where data is stored.
> >
> > Is there a way to get all these images to be exported as Single image file
Instead of multiple image files from Rhevm it self. Is this possible ?
> >
> > If possible how to combine e all these disk images to a single image and that
image can upload to our cloud glance storage as a single image ?
>
> It is not clear what is the vm you are trying to export. If you share
> the libvirt xml
> of this vm it will be more clear. You can use "sudo virsh -r dumpxml
vm-name".
>
> RHV supports download of disks to one image per disk, which you can move
> to another system.
>
> We also have export to ova, which creates one tar file with all exported disks,
> if this helps.
>
> Nir
>
3:54 a.m.
On Wed, Aug 4, 2021 at 1:38 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
On Tue, Aug 3, 2021 at 7:29 PM KK CHN <kkchn.in(a)gmail.com>
wrote:
>
> I have asked our VM maintainer to run the command
>
> # virsh -r dumpxml vm-name_blah //as Super user
>
> But no output : No matching domains found that was the TTY output on
that rhevm node when I executed the command.
>
> Then I tried to execute # virsh list // it doesn't list any VMs
!!! ( How come this ? Does the Rhevm node need to enable any CLI with
License key or something to list Vms or to dumpxml with virsh ? or its
CLI commands ?
RHV undefine the vms when they are not running.
> Any way I want to know what I have to ask the maintainer to provide
a working a working CLI or ? which do the tasks expected to do with
command line utilities in rhevm.
>
If the vm is not running you can get the vm configuration from ovirt
using the API:
GET /api/vms/{vm-id}
You may need more API calls to get info about the disks, follow the <links>
in the returned xml.
> I have one more question : Which command can I execute on an rhevm
node to manually export ( not through GUI portal) a VMs to required
format ?
>
> For example; 1. I need to get one VM and disks attached to it as
raw images. Is this possible how?
>
> and another 2. VM and disk attached to it as Ova or( what other good
format) which suitable to upload to glance ?
Arik can add more info on exporting.
> Each VMs are around 200 to 300 GB with disk volumes ( so where should
be the images exported to which path to specify ? to the host node(if the
host doesn't have space or NFS mount ? how to specify the target location
where the VM image get stored in case of NFS mount ( available ?)
You have 2 options:
- Download the disks using the SDK
- Export the VM to OVA
When exporting to OVA, you will always get qcow2 images, which you can
later
convert to raw using "qemu-img convert"
When downloading the disks, you control the image format, for example
this will download
the disk in any format, collapsing all snapshots to the raw format:
$ python3
/usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
-c engine-dev 3649d84b-6f35-4314-900a-5e8024e3905c /var/tmp/disk1.raw
To perform this which modules/packages need to be installed in the rhevm
host node
? Does the rhevm hosts come with python3 installed by default ?
or I need to install python3 on rhevm node ? Then using pip3 to install
the download_disk.py / what the module name to install this sdk ? any
dependency before installing this sdk ? like java need to be installed on
the rhevm node ?
One doubt: came across virt v2v while google search, can virtv2v be
used in rhevm node to export VMs to images ? or only from other
hypervisors to rhevm only virt v2v supports ?
This requires ovirt.conf file: // ovirt.conf file need to be created
? or already there in any rhevm node?
$ cat ~/.config/ovirt.conf
[engine-dev]
engine_url = https://engine-dev
username = admin@internal
password = mypassword
cafile = /etc/pki/vdsm/certs/cacert.pem
Nir
> Thanks in advance
>
>
> On Mon, Aug 2, 2021 at 8:22 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>>
>> On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
>> >
>> > I have few VMs in Redhat Virtualisation environment RHeV ( using
Rhevm4.1 ) managed by a third party
>> >
>> > Now I am in the process of migrating those VMs to my cloud setup
with OpenStack ussuri version with KVM hypervisor and Glance storage.
>> >
>> > The third party is making down each VM and giving the each VM image
with their attached volume disks along with it.
>> >
>> > There are three folders which contain images for each VM .
>> > These folders contain the base OS image, and attached LVM disk images
( from time to time they added hard disks and used LVM for storing data )
where data is stored.
>> >
>> > Is there a way to get all these images to be exported as Single
image file Instead of multiple image files from Rhevm it self. Is this
possible ?
>> >
>> > If possible how to combine e all these disk images to a single image
and that image can upload to our cloud glance storage as a single image ?
>>
>> It is not clear what is the vm you are trying to export. If you share
>> the libvirt xml
>> of this vm it will be more clear. You can use "sudo virsh -r dumpxml
vm-name".
>>
>> RHV supports download of disks to one image per disk, which you can move
>> to another system.
>>
>> We also have export to ova, which creates one tar file with all
exported disks,
>> if this helps.
>>
>> Nir
>>
9:30 a.m.
New subject: Combining Virtual machine image with multiple disks attached
On Wednesday, 4 August 2021 03:54:36 CEST KK CHN wrote:
On Wed, Aug 4, 2021 at 1:38 AM Nir Soffer <nsoffer(a)redhat.com>
wrote:
> On Tue, Aug 3, 2021 at 7:29 PM KK CHN <kkchn.in(a)gmail.com> wrote:
> > I have asked our VM maintainer to run the command
> >
> > # virsh -r dumpxml vm-name_blah //as Super user
> >
> > But no output : No matching domains found that was the TTY output on
>
> that rhevm node when I executed the command.
>
> > Then I tried to execute # virsh list // it doesn't list any VMs
>
> !!! ( How come this ? Does the Rhevm node need to enable any CLI with
> License key or something to list Vms or to dumpxml with virsh ? or
> its
> CLI commands ?
>
> RHV undefine the vms when they are not running.
>
> > Any way I want to know what I have to ask the maintainer to provide
>
> a working a working CLI or ? which do the tasks expected to do with
> command line utilities in rhevm.
>
> If the vm is not running you can get the vm configuration from ovirt
>
> using the API:
> GET /api/vms/{vm-id}
>
> You may need more API calls to get info about the disks, follow the
> <links>
> in the returned xml.
>
> > I have one more question : Which command can I execute on an rhevm
>
> node to manually export ( not through GUI portal) a VMs to required
> format ?
>
> > For example; 1. I need to get one VM and disks attached to it as
>
> raw images. Is this possible how?
>
> > and another 2. VM and disk attached to it as Ova or( what other good
>
> format) which suitable to upload to glance ?
>
> Arik can add more info on exporting.
>
> > Each VMs are around 200 to 300 GB with disk volumes ( so where should
>
> be the images exported to which path to specify ? to the host node(if the
> host doesn't have space or NFS mount ? how to specify the target location
> where the VM image get stored in case of NFS mount ( available ?)
>
> You have 2 options:
> - Download the disks using the SDK
> - Export the VM to OVA
>
> When exporting to OVA, you will always get qcow2 images, which you can
> later
> convert to raw using "qemu-img convert"
>
> When downloading the disks, you control the image format, for example
> this will download
>
> the disk in any format, collapsing all snapshots to the raw format:
> $ python3
>
> /usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
> -c engine-dev 3649d84b-6f35-4314-900a-5e8024e3905c /var/tmp/disk1.raw
>
> To perform this which modules/packages need to be installed in the rhevm
host node ? Does the rhevm hosts come with python3 installed by default ?
or I need to install python3 on rhevm node ?
You don't have to install anything on oVirt hosts. SDK has to be installed on
the machine from which you run the script. See
https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/README.adoc
for more details, how to install and use it.
Then using pip3 to install
the download_disk.py / what the module name to install this sdk ? any
dependency before installing this sdk ? like java need to be installed on
the rhevm node ?
One doubt: came across virt v2v while google search, can virtv2v be
used in rhevm node to export VMs to images ? or only from other
hypervisors to rhevm only virt v2v supports ?
This requires ovirt.conf file: // ovirt.conf file need to be created
? or already there in any rhevm node?
again, this has to be on the machine from which you run the script
> $ cat ~/.config/ovirt.conf
> [engine-dev]
> engine_url = https://engine-dev
> username = admin@internal
> password = mypassword
> cafile = /etc/pki/vdsm/certs/cacert.pem
>
> Nir
>
> > Thanks in advance
> >
> > On Mon, Aug 2, 2021 at 8:22 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
> >> On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
> >> > I have few VMs in Redhat Virtualisation environment RHeV ( using
>
> Rhevm4.1 ) managed by a third party
>
> >> > Now I am in the process of migrating those VMs to my cloud setup
>
> with OpenStack ussuri version with KVM hypervisor and Glance storage.
>
> >> > The third party is making down each VM and giving the each VM image
>
> with their attached volume disks along with it.
>
> >> > There are three folders which contain images for each VM .
> >> > These folders contain the base OS image, and attached LVM disk images
>
> ( from time to time they added hard disks and used LVM for storing data )
> where data is stored.
>
> >> > Is there a way to get all these images to be exported as Single
>
> image file Instead of multiple image files from Rhevm it self. Is this
> possible ?
>
> >> > If possible how to combine e all these disk images to a single image
>
> and that image can upload to our cloud glance storage as a single image
> ?>
> >> It is not clear what is the vm you are trying to export. If you share
> >> the libvirt xml
> >> of this vm it will be more clear. You can use "sudo virsh -r dumpxml
>
> vm-name".
>
> >> RHV supports download of disks to one image per disk, which you can
> >> move
> >> to another system.
> >>
> >> We also have export to ova, which creates one tar file with all
>
> exported disks,
>
> >> if this helps.
> >>
> >> Nir
7:35 a.m.
New subject: Combining Virtual machine image with multiple disks attached
Appreciate all for sharing the valuable information.
1. I am downloading centos 8 as the Python Ovirt SDK installation says
it works on Centos 8 and Need to setup a VM with this OS and install
ovirt Python SDK on this VM. The requirement is that this
Centos 8 VM should able to communicate with the Rhevm 4.1 Host node
where the ovirt shell ( Rhevm Shell [connected] # is
available right ?
2. pinging to the host with "Rhevm Shell [connected]# " and that
should be ssh ed from the CentOS 8 VM where python3 and oVirt SDK
installed and going to execute the script (with ovirt configuration file
on this VM.). Is these two connectivity checks are enough for executing
the script ? or any other protocols need to be enabled in the firewall
between these two machine?
3. while googling I saw a post
https://users.ovirt.narkive.com/CeEW3lcj/ovirt-users-clone-and-export-vm-...
action vm myvm export --storage_domain-name myexport
Will this command export ? and which format it will export to the export
domain ?
Is there any option to provide with this command to specify any
supported format the vm image to be exported ?
This need to be executed from "Rhevm Shell [connected]# " TTY right
?
On Wed, Aug 4, 2021 at 1:00 PM Vojtech Juranek <vjuranek(a)redhat.com> wrote:
On Wednesday, 4 August 2021 03:54:36 CEST KK CHN wrote:
> On Wed, Aug 4, 2021 at 1:38 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
> > On Tue, Aug 3, 2021 at 7:29 PM KK CHN <kkchn.in(a)gmail.com> wrote:
> > > I have asked our VM maintainer to run the command
> > >
> > > # virsh -r dumpxml vm-name_blah //as Super user
> > >
> > > But no output : No matching domains found that was the TTY output
on
> >
> > that rhevm node when I executed the command.
> >
> > > Then I tried to execute # virsh list // it doesn't list any VMs
> >
> > !!! ( How come this ? Does the Rhevm node need to enable any CLI
with
> > License key or something to list Vms or to dumpxml with virsh ? or
> > its
> > CLI commands ?
> >
> > RHV undefine the vms when they are not running.
> >
> > > Any way I want to know what I have to ask the maintainer to
provide
> >
> > a working a working CLI or ? which do the tasks expected to do with
> > command line utilities in rhevm.
> >
> > If the vm is not running you can get the vm configuration from ovirt
> >
> > using the API:
> > GET /api/vms/{vm-id}
> >
> > You may need more API calls to get info about the disks, follow the
> > <links>
> > in the returned xml.
> >
> > > I have one more question : Which command can I execute on an rhevm
> >
> > node to manually export ( not through GUI portal) a VMs to
required
> > format ?
> >
> > > For example; 1. I need to get one VM and disks attached to it
as
> >
> > raw images. Is this possible how?
> >
> > > and another 2. VM and disk attached to it as Ova or( what other
good
> >
> > format) which suitable to upload to glance ?
> >
> > Arik can add more info on exporting.
> >
> > > Each VMs are around 200 to 300 GB with disk volumes ( so where
should
> >
> > be the images exported to which path to specify ? to the host node(if
the
> > host doesn't have space or NFS mount ? how to specify the target
location
> > where the VM image get stored in case of NFS mount ( available ?)
> >
> > You have 2 options:
> > - Download the disks using the SDK
> > - Export the VM to OVA
> >
> > When exporting to OVA, you will always get qcow2 images, which you can
> > later
> > convert to raw using "qemu-img convert"
> >
> > When downloading the disks, you control the image format, for example
> > this will download
> >
> > the disk in any format, collapsing all snapshots to the raw format:
> > $ python3
> >
> > /usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
> > -c engine-dev 3649d84b-6f35-4314-900a-5e8024e3905c /var/tmp/disk1.raw
> >
> > To perform this which modules/packages need to be installed in the
rhevm
>
> host node ? Does the rhevm hosts come with python3 installed by default
?
> or I need to install python3 on rhevm node ?
You don't have to install anything on oVirt hosts. SDK has to be installed
on
the machine from which you run the script. See
https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/README.adoc
for more details, how to install and use it.
> Then using pip3 to install
> the download_disk.py / what the module name to install this sdk ? any
> dependency before installing this sdk ? like java need to be installed on
> the rhevm node ?
>
> One doubt: came across virt v2v while google search, can virtv2v be
> used in rhevm node to export VMs to images ? or only from other
> hypervisors to rhevm only virt v2v supports ?
>
> This requires ovirt.conf file: // ovirt.conf file need to be
created
> ? or already there in any rhevm node?
again, this has to be on the machine from which you run the script
> > $ cat ~/.config/ovirt.conf
> > [engine-dev]
> > engine_url = https://engine-dev
> > username = admin@internal
> > password = mypassword
> > cafile = /etc/pki/vdsm/certs/cacert.pem
> >
> > Nir
> >
> > > Thanks in advance
> > >
> > > On Mon, Aug 2, 2021 at 8:22 PM Nir Soffer <nsoffer(a)redhat.com>
wrote:
> > >> On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
> > >> > I have few VMs in Redhat Virtualisation environment RHeV (
using
> >
> > Rhevm4.1 ) managed by a third party
> >
> > >> > Now I am in the process of migrating those VMs to my cloud
setup
> >
> > with OpenStack ussuri version with KVM hypervisor and Glance
storage.
> >
> > >> > The third party is making down each VM and giving the each VM
image
> >
> > with their attached volume disks along with it.
> >
> > >> > There are three folders which contain images for each VM .
> > >> > These folders contain the base OS image, and attached LVM disk
images
> >
> > ( from time to time they added hard disks and used LVM for storing
data )
> > where data is stored.
> >
> > >> > Is there a way to get all these images to be exported as
Single
> >
> > image file Instead of multiple image files from Rhevm it self. Is
this
> > possible ?
> >
> > >> > If possible how to combine e all these disk images to a single
image
> >
> > and that image can upload to our cloud glance storage as a single
image
> > ?>
> > >> It is not clear what is the vm you are trying to export. If you
share
> > >> the libvirt xml
> > >> of this vm it will be more clear. You can use "sudo virsh -r
dumpxml
> >
> > vm-name".
> >
> > >> RHV supports download of disks to one image per disk, which you can
> > >> move
> > >> to another system.
> > >>
> > >> We also have export to ova, which creates one tar file with all
> >
> > exported disks,
> >
> > >> if this helps.
> > >>
> > >> Nir
4:09 p.m.
Hi all,
I have installed the ovirt-engine-sdk-python using pip3 in my python3
virtaul environment in my personal laptop
(base) kris@my-ThinkPad-X270:~$ pip install ovirt-engine-sdk-python
Collecting ovirt-engine-sdk-python
Downloading ovirt-engine-sdk-python-4.4.14.tar.gz (335 kB)
|████████████████████████████████| 335 kB 166 kB/s
Collecting pycurl>=7.19.0
Downloading pycurl-7.43.0.6.tar.gz (222 kB)
|████████████████████████████████| 222 kB 496 kB/s
Requirement already satisfied: six in
./training/lib/python3.7/site-packages (from ovirt-engine-sdk-python)
(1.15.0)
Building wheels for collected packages: ovirt-engine-sdk-python, pycurl
Building wheel for ovirt-engine-sdk-python (setup.py) ... done
Created wheel for ovirt-engine-sdk-python:
filename=ovirt_engine_sdk_python-4.4.14-cp37-cp37m-linux_x86_64.whl
size=300970
sha256=128ee03642c36094d62a04435bf5def1e5f8eb2c800f97132e8da02665d227a8
Stored in directory:
/home/kris/.cache/pip/wheels/2f/65/60/6a222dcdec777ae59bacb3f51a0a93e6cf9547b82cb0102db6
Building wheel for pycurl (setup.py) ... done
Created wheel for pycurl:
filename=pycurl-7.43.0.6-cp37-cp37m-linux_x86_64.whl size=269770
sha256=2cf705a2246041f9eaa5cbb19c530470edad7f476a0a7eb04c4877931699bea9
Stored in directory:
/home/kris/.cache/pip/wheels/f2/32/dc/9ccf4566cfe0a7a11ee304c11af36a1e341a16fa30e74fb26e
Successfully built ovirt-engine-sdk-python pycurl
Installing collected packages: pycurl, ovirt-engine-sdk-python
Successfully installed ovirt-engine-sdk-python-4.4.14 pycurl-7.43.0.6
WARNING: You are using pip version 21.0.1; however, version 21.2.2 is
available.
You should consider upgrading via the '/home/kris/training/bin/python3.7 -m
pip install --upgrade pip' command.
(base) kris@my-ThinkPad-X270:~$ which pip
/home/kris/anaconda3/bin/pip
(base) kris@my-ThinkPad-X270:~$ pip --version
pip 21.0.1 from /home/kris/training/lib/python3.7/site-packages/pip (python
3.7)
(base) kris@my-ThinkPad-X270:~$ pwd
/home/kris
and Created file in the user kris home directory in the same laptop // Is
what I am doing right ?
(base) kris@my-ThinkPad-X270:~$ cat ~/.config/ovirt.conf
[engine-dev]
engine_url=https://engine-dev // what is this engine url ? its the rhevm
ovirt url this our service provider may can provide right ?
username=admin@internal
password=mypassword
cafile=/etc/pki/vdsm/certs/cacert.pem // I dont have any cacert.pem
file in my laptop's /etc/pki/vdsm/certs/cacert.pem no folder at all like
this
(base) kris@my-ThinkPad-X270:~$ pwd
/home/kris
(base) kris@my-ThinkPad-X270:~$
But I couldn't find any examples folder where I can find the
download_disk.py // So I have downloaded files for
ovirt-engne-sdk-python-4.1.3.tar.gz
and untarred the files where I am able to find the download_disk.py
#####
(base)
kris@my-ThinkPad-X270:~/OVIRT_PYTON_SDK_SOURCE_FILES/ovirt-engine-sdk-python-4.1.3/examples$
ls
add_affinity_label.py add_vm_from_template_version.py
follow_vm_links.py set_vm_lease_storage_domain.py
add_bond.py add_vm_nic.py
get_display_ticket.py set_vm_serial_number.py
add_cluster.py add_vm.py
import_external_vm.py show_summary.py
add_data_center.py add_vm_snapshot.py
import_vm.py start_vm.py
add_floating_disk.py add_vm_with_sysprep.py
list_affinity_labels.py start_vm_with_boot_devices.py
add_group.py add_vnc_console.py
list_glance_images.py start_vm_with_cloud_init.py
add_host.py assign_affinity_label_to_vm.py
list_roles.py stop_vm.py
add_independet_vm.py assign_permission.py
list_tags_of_vm.py test_connection.py
add_instance_type.py assign_tag_to_vm.py
list_tags.py unassign_tag_to_vm.py
add_mac_pool.py attach_nfs_data_storage_domain.py
list_vm_disks.py update_data_center.py
add_nfs_data_storage_domain.py attach_nfs_iso_storage_domain.py
list_vm_snapshots.py update_fencing_options.py
add_nfs_iso_storage_domain.py change_vm_cd.py
list_vms.py update_quota_limits.py
add_openstack_image_provider.py clone_vm_from_snapshot.py
page_vms.py upload_disk.py
add_role.py connection_builder.py
remove_host.py vm_backup.py
add_tag.py disable_compression.py
remove_tag.py
add_user_ssh_public_key.py download_disk.py
remove_vm.py
add_vm_disk.py enable_serial_console.py
search_vms.py
(base)
kris@my-ThinkPad-X270:~/OVIRT_PYTON_SDK_SOURCE_FILES/ovirt-engine-sdk-python-4.1.3/examples$
Can I execute now the following from my laptop ? so that it will connect to
the rhevm host node and download the disks ?
(base) kris@my-ThinkPad-X270:$ python3 download_disk.py -c engine-dev
MY_vm_blah_Id /var/tmp/disk1.raw //is this correct ?
My laptop doesn't have space to accommodate 300 GB so can I attache a usb
harddisk and can I specify its mount point ? or any other suggestions or
correcton ? Because its a live host. I can't do trail and error on service
maintainer's rhevm host machines.
kindly correct me if any thing wrong in my steps . I have to perform this
script running on mylaptop to rhevm host machines without breaking
anything.
Kindly guide me.
Kris
On Wed, Aug 4, 2021 at 1:38 AM Nir Soffer <nsoffer(a)redhat.com> wrote:
On Tue, Aug 3, 2021 at 7:29 PM KK CHN <kkchn.in(a)gmail.com>
wrote:
>
> I have asked our VM maintainer to run the command
>
> # virsh -r dumpxml vm-name_blah //as Super user
>
> But no output : No matching domains found that was the TTY output on
that rhevm node when I executed the command.
>
> Then I tried to execute # virsh list // it doesn't list any VMs
!!! ( How come this ? Does the Rhevm node need to enable any CLI with
License key or something to list Vms or to dumpxml with virsh ? or its
CLI commands ?
RHV undefine the vms when they are not running.
> Any way I want to know what I have to ask the maintainer to provide
a working a working CLI or ? which do the tasks expected to do with
command line utilities in rhevm.
>
If the vm is not running you can get the vm configuration from ovirt
using the API:
GET /api/vms/{vm-id}
You may need more API calls to get info about the disks, follow the <links>
in the returned xml.
> I have one more question : Which command can I execute on an rhevm
node to manually export ( not through GUI portal) a VMs to required
format ?
>
> For example; 1. I need to get one VM and disks attached to it as
raw images. Is this possible how?
>
> and another 2. VM and disk attached to it as Ova or( what other good
format) which suitable to upload to glance ?
Arik can add more info on exporting.
> Each VMs are around 200 to 300 GB with disk volumes ( so where should
be the images exported to which path to specify ? to the host node(if the
host doesn't have space or NFS mount ? how to specify the target location
where the VM image get stored in case of NFS mount ( available ?)
You have 2 options:
- Download the disks using the SDK
- Export the VM to OVA
When exporting to OVA, you will always get qcow2 images, which you can
later
convert to raw using "qemu-img convert"
When downloading the disks, you control the image format, for example
this will download
the disk in any format, collapsing all snapshots to the raw format:
$ python3
/usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
-c engine-dev 3649d84b-6f35-4314-900a-5e8024e3905c /var/tmp/disk1.raw
This requires ovirt.conf file:
$ cat ~/.config/ovirt.conf
[engine-dev]
engine_url = https://engine-dev
username = admin@internal
password = mypassword
cafile = /etc/pki/vdsm/certs/cacert.pem
Nir
> Thanks in advance
>
>
> On Mon, Aug 2, 2021 at 8:22 PM Nir Soffer <nsoffer(a)redhat.com> wrote:
>>
>> On Mon, Aug 2, 2021 at 12:22 PM <kkchn.in(a)gmail.com> wrote:
>> >
>> > I have few VMs in Redhat Virtualisation environment RHeV ( using
Rhevm4.1 ) managed by a third party
>> >
>> > Now I am in the process of migrating those VMs to my cloud setup
with OpenStack ussuri version with KVM hypervisor and Glance storage.
>> >
>> > The third party is making down each VM and giving the each VM image
with their attached volume disks along with it.
>> >
>> > There are three folders which contain images for each VM .
>> > These folders contain the base OS image, and attached LVM disk images
( from time to time they added hard disks and used LVM for storing data )
where data is stored.
>> >
>> > Is there a way to get all these images to be exported as Single
image file Instead of multiple image files from Rhevm it self. Is this
possible ?
>> >
>> > If possible how to combine e all these disk images to a single image
and that image can upload to our cloud glance storage as a single image ?
>>
>> It is not clear what is the vm you are trying to export. If you share
>> the libvirt xml
>> of this vm it will be more clear. You can use "sudo virsh -r dumpxml
vm-name".
>>
>> RHV supports download of disks to one image per disk, which you can move
>> to another system.
>>
>> We also have export to ova, which creates one tar file with all
exported disks,
>> if this helps.
>>
>> Nir
>>
6:56 p.m.
New subject: Combining Virtual machine image with multiple disks attached
On Thu, Aug 5, 2021 at 5:12 PM KK CHN <kkchn.in(a)gmail.com> wrote:
I have installed the ovirt-engine-sdk-python using pip3 in my
python3 virtaul environment in my personal laptop
I'm not sure this is the right version. Use the rpms provided by ovirt instead.
...
and Created file in the user kris home directory in the same laptop
// Is what I am doing right ?
(base) kris@my-ThinkPad-X270:~$ cat ~/.config/ovirt.conf
[engine-dev]
This can be any name you like for this setup.
engine_url=https://engine-dev // what is this engine url ? its the
rhevm ovirt url this our service provider may can provide right ?
This is your engine url, the same url you access engine UI.
username=admin@internal
password=mypassword
cafile=/etc/pki/vdsm/certs/cacert.pem // I dont have any cacert.pem file in my
laptop's /etc/pki/vdsm/certs/cacert.pem no folder at all like this
This path works on ovirt host. You can download engine cafile from your
engine using:
curl -k
'https://engine-dev/ovirt-engine/services/pki-resource?resource=ca-certificate&format=X509-PEM-CA'
engine-dev.pem
and use the path to the cafile:
cafile=/home/kris/engine-dev.pem
...
But I couldn't find any examples folder where I can find the
download_disk.py // So I have downloaded files for ovirt-engne-sdk-python-4.1.3.tar.gz
and untarred the files where I am able to find the download_disk.py
You need to use ovirt sdk from 4.4. 4.1 sdk is too old.
Also if you try to run this on another host, you need to install
more packages.
1. Install ovirt release rpm
dnf install https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm
2. Install required packages
dnf install python3-ovirt-engine-sdk4 ovirt-imageio-client
$ rpm -q python3-ovirt-engine-sdk4 ovirt-imageio-client
python3-ovirt-engine-sdk4-4.4.13-1.el8.x86_64
ovirt-imageio-client-2.2.0-1.el8.x86_64
$ find /usr/share/ -name download_disk.py
/usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
Now you can use download_disk.py to download images from ovirt setup.
...
Can I execute now the following from my laptop ? so that it will
connect to the rhevm host node and download the disks ?
Yes
(base) kris@my-ThinkPad-X270:$ python3 download_disk.py -c
engine-dev MY_vm_blah_Id /var/tmp/disk1.raw //is this correct ?
Almost, see the help:
$ python3 /usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py -h
usage: download_disk.py [-h] -c CONFIG [--debug] [--logfile LOGFILE]
[-f {raw,qcow2}] [--use-proxy]
[--max-workers MAX_WORKERS]
[--buffer-size BUFFER_SIZE]
[--timeout-policy {legacy,pause,cancel}]
disk_uuid filename
Download disk
positional arguments:
disk_uuid Disk UUID to download.
filename Path to write downloaded image.
optional arguments:
-h, --help show this help message and exit
-c CONFIG, --config CONFIG
Use engine connection details from [CONFIG] section in
~/.config/ovirt.conf.
--debug Log debug level messages to logfile.
--logfile LOGFILE Log file name (default example.log).
-f {raw,qcow2}, --format {raw,qcow2}
Downloaded file format. For best compatibility, use
qcow2 (default qcow2).
--use-proxy Download via proxy on the engine host (less
efficient).
--max-workers MAX_WORKERS
Maximum number of workers to use for download. The
default (4) improves performance when downloading a
single disk. You may want to use lower number if you
download many disks in the same time.
--buffer-size BUFFER_SIZE
Buffer size per worker. The default (4194304) gives
good performance with the default number of workers.
If you use smaller number of workers you may want use
larger value.
--timeout-policy {legacy,pause,cancel}
The action to be made for a timed out transfer
Example command to download disk id 3649d84b-6f35-4314-900a-5e8024e3905c
from engine configuration myengine to file disk.img, converting the
format to raw:
$ python3 /usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
-c myengine --format raw 3649d84b-6f35-4314-900a-5e8024e3905c disk.img
[ 0.0 ] Connecting...
[ 0.5 ] Creating image transfer...
[ 2.8 ] Transfer ID: 62c99f08-e58c-4cc2-8c72-9aa9be835d0f
[ 2.8 ] Transfer host name: host4
[ 2.8 ] Downloading image...
[ 100.00% ] 6.00 GiB, 11.62 seconds, 528.83 MiB/s
[ 14.4 ] Finalizing image transfer...
You can check the image with qemu-img info:
$ qemu-img info disk.img
image: disk.img
file format: raw
virtual size: 6 GiB (6442450944 bytes)
disk size: 1.69 GiB
My laptop doesn't have space to accommodate 300 GB so can I
attache a usb harddisk and can I specify its mount point ?
This will work, or you can mount NFS server and download to the mountpoint, e.g:
$ mount | grep storage
storage:/export/02 on /tmp/export type nfs4
(rw,relatime,vers=4.2,rsize=262144,wsize=262144,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.122.52,local_lock=none,addr=192.168.122.32)
$ python3 /usr/share/doc/python3-ovirt-engine-sdk4/examples/download_disk.py
-c myengine --format raw 3649d84b-6f35-4314-900a-5e8024e3905c
/tmp/export/disk.img
[ 0.0 ] Connecting...
[ 0.2 ] Creating image transfer...
[ 2.4 ] Transfer ID: cb9d5a0f-1c3c-4d1f-aa49-85a1aedd0108
[ 2.4 ] Transfer host name: host4
[ 2.4 ] Downloading image...
[ 100.00% ] 6.00 GiB, 11.19 seconds, 549.27 MiB/s
[ 13.6 ] Finalizing image transfer...
or any other suggestions or correcton ? Because its a live host. I
can't do trail and error on service maintainer's rhevm host machines.
It makes sense to do all this on a vm, but downloading the image on the
actual host can be much faster, since we avoid the network.
However there is one big issue, I noticed that you mentioned ovirt 4.1 in your
original mail. This version is too old, you cannot use downoad_disk.py
from ovirt
4.4. to download images from ovirt 4.1.
In 4.1 you can download images from the UI, but only if the vm has no snapshots,
and only in the actual format of the disk (e.g. qcow2). If you need a
raw image you
will have to convert the image later using:
qemu-img convert -f qcow2 -O raw disk.qcow2 disk.raw
You can upgrade this system or at least part of it to 4.4 (engine and
one host) and
then you can download all the disk using the sdk, or use export ova if ova works
better for your use case.
Nir
1000
days inactive
1003
days old
8 comments
4 participants
participants (4)
-
KK CHN -
kkchn.in＠gmail.com
-
Nir Soffer -
Vojtech Juranek