From Blaster at 556nato.com Mon Dec 23 10:57:01 2013 Content-Type: multipart/mixed; boundary="===============8713059756590452338==" MIME-Version: 1.0 From: Blaster To: users at ovirt.org Subject: [Users] ISO datastore, permission denied Date: Mon, 23 Dec 2013 09:56:56 -0600 Message-ID: <52B85D48.4020905@556nato.com> --===============8713059756590452338== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------080401040704080402020309 Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed Content-Transfer-Encoding: 7bit I have an ISO datastore. In that datastore I'm using symlinks to point = to my ISOs on an NFS share. All was working great. Along comes Black Friday and a shiny new 3TB hard drive. Out goes the 5 = yo old 500gb drive with EXT 4 and in comes new 3TB drive with BTRFS. I installed new drive, shutdown VMs and use tar c | tar x to move data = over. unmount old, remount new. Fire up VMs, all us well. Create new = VM, attach boot ISO and I get: VM Gremlin is down. Exit message: internal error process exited while = connecting to monitor: qemu-system-x86_64: -drive = file=3D/rhev/data-center/mnt/_disk01_iso/4c70693a-d228-453e-b40d-93a214ec52= 4b/images/11111111-1111-1111-1111-111111111111/Fedora-Live-Desktop-x86_64-2= 0-1.iso,if=3Dnone,id=3Ddrive-ide0-1-0,readonly=3Don,format=3Draw,serial=3D: = could not open disk image = /rhev/data-center/mnt/_disk01_iso/4c70693a-d228-453e-b40d-93a214ec524b/imag= es/11111111-1111-1111-1111-111111111111/Fedora-Live-Desktop-x86_64-20-1.iso= : = Permission denied . huh? I search archives and see others have had this error in the = past...Follow the suggestions...Run the nfstest python script, passes, = check getsebool shows virt_use_nfs --> on. Also went through: http://www.ovirt.org/Troubleshooting_NFS_Storage_Issues My NFS server is Solaris 11.1, ZFS storage. If I copy the ISO directly to the directory it works fine. What am I = missing? --------------080401040704080402020309 Content-Type: text/html; charset=3DISO-8859-1 Content-Transfer-Encoding: 7bit I have an ISO datastore. In that datastore I'm using symlinks to point to my ISOs on an NFS share. All was working great.

Along comes Black Friday and a shiny new 3TB hard drive. Out goes the 5 yo old 500gb drive with EXT 4 and in comes new 3TB drive with BTRFS.

I installed new drive, shutdown VMs and use tar c | tar x to move data over. unmount old, remount new. Fire up VMs, all= us well. Create new VM, attach boot ISO and I get:

VM Gremlin is down. Exit message: internal error process exited while connecting to monitor: qemu-system-x86_64: -drive file=3D/rhev/data-center/mnt/_disk01_iso/4c70693a-d228-453e-b40d-93= a214ec524b/images/11111111-1111-1111-1111-111111111111/Fedora-Live-Desktop-= x86_64-20-1.iso,if=3Dnone,id=3Ddrive-ide0-1-0,readonly=3Don,format=3Draw,se= rial=3D: could not open disk image /rhev/data-center/mnt/_disk01_iso/4c70693a-d228-453e-b40d-93a214ec5= 24b/images/11111111-1111-1111-1111-111111111111/Fedora-Live-Desktop-x86_64-= 20-1.iso: Permission denied .

huh? I search archives and see others have had this error in the past...Follow the suggestions...Run the nfstest python script, passes, check getsebool shows virt_use_nfs --> on.

Also went through: http= ://www.ovirt.org/Troubleshooting_NFS_Storage_Issues

My NFS server is Solaris 11.1, ZFS storage.

If I copy the ISO directly to the directory it works fine. = What am I missing?
--------------080401040704080402020309-- --===============8713059756590452338== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wODA0MDEwNDA3MDQwODA0MDIwMjAzMDkKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PUlTTy04ODU5LTE7IGZvcm1hdD1mbG93ZWQKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog N2JpdAoKSSBoYXZlIGFuIElTTyBkYXRhc3RvcmUuICBJbiB0aGF0IGRhdGFzdG9yZSBJJ20gdXNp bmcgc3ltbGlua3MgdG8gcG9pbnQgCnRvIG15IElTT3Mgb24gYW4gTkZTIHNoYXJlLiAgQWxsIHdh cyB3b3JraW5nIGdyZWF0LgoKQWxvbmcgY29tZXMgQmxhY2sgRnJpZGF5IGFuZCBhIHNoaW55IG5l dyAzVEIgaGFyZCBkcml2ZS4gIE91dCBnb2VzIHRoZSA1IAp5byBvbGQgNTAwZ2IgZHJpdmUgd2l0 aCBFWFQgNCBhbmQgaW4gY29tZXMgbmV3IDNUQiBkcml2ZSB3aXRoIEJUUkZTLgoKSSBpbnN0YWxs ZWQgbmV3IGRyaXZlLCBzaHV0ZG93biBWTXMgYW5kIHVzZSB0YXIgYyB8IHRhciB4IHRvIG1vdmUg ZGF0YSAKb3Zlci4gICB1bm1vdW50IG9sZCwgcmVtb3VudCBuZXcuICBGaXJlIHVwIFZNcywgYWxs IHVzIHdlbGwuIENyZWF0ZSBuZXcgClZNLCBhdHRhY2ggYm9vdCBJU08gYW5kIEkgZ2V0OgpWTSBH cmVtbGluIGlzIGRvd24uIEV4aXQgbWVzc2FnZTogaW50ZXJuYWwgZXJyb3IgcHJvY2VzcyBleGl0 ZWQgd2hpbGUgCmNvbm5lY3RpbmcgdG8gbW9uaXRvcjogcWVtdS1zeXN0ZW0teDg2XzY0OiAtZHJp dmUgCmZpbGU9L3JoZXYvZGF0YS1jZW50ZXIvbW50L19kaXNrMDFfaXNvLzRjNzA2OTNhLWQyMjgt NDUzZS1iNDBkLTkzYTIxNGVjNTI0Yi9pbWFnZXMvMTExMTExMTEtMTExMS0xMTExLTExMTEtMTEx MTExMTExMTExL0ZlZG9yYS1MaXZlLURlc2t0b3AteDg2XzY0LTIwLTEuaXNvLGlmPW5vbmUsaWQ9 ZHJpdmUtaWRlMC0xLTAscmVhZG9ubHk9b24sZm9ybWF0PXJhdyxzZXJpYWw9OiAKY291bGQgbm90 IG9wZW4gZGlzayBpbWFnZSAKL3JoZXYvZGF0YS1jZW50ZXIvbW50L19kaXNrMDFfaXNvLzRjNzA2 OTNhLWQyMjgtNDUzZS1iNDBkLTkzYTIxNGVjNTI0Yi9pbWFnZXMvMTExMTExMTEtMTExMS0xMTEx LTExMTEtMTExMTExMTExMTExL0ZlZG9yYS1MaXZlLURlc2t0b3AteDg2XzY0LTIwLTEuaXNvOiAK UGVybWlzc2lvbiBkZW5pZWQgLgoKaHVoPyAgSSBzZWFyY2ggYXJjaGl2ZXMgYW5kIHNlZSBvdGhl cnMgaGF2ZSBoYWQgdGhpcyBlcnJvciBpbiB0aGUgCnBhc3QuLi5Gb2xsb3cgdGhlIHN1Z2dlc3Rp b25zLi4uUnVuIHRoZSBuZnN0ZXN0IHB5dGhvbiBzY3JpcHQsIHBhc3NlcywgCmNoZWNrIGdldHNl Ym9vbCBzaG93cyB2aXJ0X3VzZV9uZnMgLS0+IG9uLgoKQWxzbyB3ZW50IHRocm91Z2g6IGh0dHA6 Ly93d3cub3ZpcnQub3JnL1Ryb3VibGVzaG9vdGluZ19ORlNfU3RvcmFnZV9Jc3N1ZXMKCk15IE5G UyBzZXJ2ZXIgaXMgU29sYXJpcyAxMS4xLCBaRlMgc3RvcmFnZS4KCklmIEkgY29weSB0aGUgSVNP IGRpcmVjdGx5IHRvIHRoZSBkaXJlY3RvcnkgaXQgd29ya3MgZmluZS4gICBXaGF0IGFtIEkgCm1p c3Npbmc/CgotLS0tLS0tLS0tLS0tLTA4MDQwMTA0MDcwNDA4MDQwMjAyMDMwOQpDb250ZW50LVR5 cGU6IHRleHQvaHRtbDsgY2hhcnNldD1JU08tODg1OS0xCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rp bmc6IDdiaXQKCjxodG1sPgogIDxoZWFkPgoKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQt dHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PUlTTy04ODU5LTEiPgogIDwvaGVhZD4K ICA8Ym9keSBiZ2NvbG9yPSIjRkZGRkZGIiB0ZXh0PSIjMDAwMDAwIj4KICAgIEkgaGF2ZSBhbiBJ U08gZGF0YXN0b3JlLiZuYnNwOyBJbiB0aGF0IGRhdGFzdG9yZSBJJ20gdXNpbmcgc3ltbGlua3Mg dG8KICAgIHBvaW50IHRvIG15IElTT3Mgb24gYW4gTkZTIHNoYXJlLiZuYnNwOyBBbGwgd2FzIHdv cmtpbmcgZ3JlYXQuPGJyPgogICAgPGJyPgogICAgQWxvbmcgY29tZXMgQmxhY2sgRnJpZGF5IGFu ZCBhIHNoaW55IG5ldyAzVEIgaGFyZCBkcml2ZS4mbmJzcDsgT3V0IGdvZXMKICAgIHRoZSA1IHlv IG9sZCA1MDBnYiBkcml2ZSB3aXRoIEVYVCA0IGFuZCBpbiBjb21lcyBuZXcgM1RCIGRyaXZlIHdp dGgKICAgIEJUUkZTLjxicj4KICAgIDxicj4KICAgIEkgaW5zdGFsbGVkIG5ldyBkcml2ZSwgc2h1 dGRvd24gVk1zIGFuZCB1c2UgdGFyIGMgfCB0YXIgeCB0byBtb3ZlCiAgICBkYXRhIG92ZXIuJm5i c3A7Jm5ic3A7IHVubW91bnQgb2xkLCByZW1vdW50IG5ldy4mbmJzcDsgRmlyZSB1cCBWTXMsIGFs bCB1cyB3ZWxsLiZuYnNwOwogICAgQ3JlYXRlIG5ldyBWTSwgYXR0YWNoIGJvb3QgSVNPIGFuZCBJ IGdldDo8YnI+CiAgICA8ZGl2IHRhYmluZGV4PSIwIiB0aXRsZT0iVk0gR3JlbWxpbiBpcyBkb3du LiBFeGl0IG1lc3NhZ2U6IGludGVybmFsCiAgICAgIGVycm9yIHByb2Nlc3MgZXhpdGVkIHdoaWxl IGNvbm5lY3RpbmcgdG8gbW9uaXRvcjoKICAgICAgcWVtdS1zeXN0ZW0teDg2XzY0OiAtZHJpdmUK ICAgICAgZmlsZT0vcmhldi9kYXRhLWNlbnRlci9tbnQvX2Rpc2swMV9pc28vNGM3MDY5M2EtZDIy OC00NTNlLWI0MGQtOTNhMjE0ZWM1MjRiL2ltYWdlcy8xMTExMTExMS0xMTExLTExMTEtMTExMS0x MTExMTExMTExMTEvRmVkb3JhLUxpdmUtRGVza3RvcC14ODZfNjQtMjAtMS5pc28saWY9bm9uZSxp ZD1kcml2ZS1pZGUwLTEtMCxyZWFkb25seT1vbixmb3JtYXQ9cmF3LHNlcmlhbD06CiAgICAgIGNv dWxkIG5vdCBvcGVuIGRpc2sgaW1hZ2UKICAgICAgL3JoZXYvZGF0YS1jZW50ZXIvbW50L19kaXNr MDFfaXNvLzRjNzA2OTNhLWQyMjgtNDUzZS1iNDBkLTkzYTIxNGVjNTI0Yi9pbWFnZXMvMTExMTEx MTEtMTExMS0xMTExLTExMTEtMTExMTExMTExMTExL0ZlZG9yYS1MaXZlLURlc2t0b3AteDg2XzY0 LTIwLTEuaXNvOgogICAgICBQZXJtaXNzaW9uIGRlbmllZAogICAgICAuIiBzdHlsZT0ib3V0bGlu ZS1zdHlsZTogbm9uZTsiIF9fZ3d0X2NlbGw9ImNlbGwtZ3d0LXVpZC0zNzYzIj4KICAgICAgPGRp diBpZD0iZ3d0LXVpZC0zMzY4X2NvbDJfcm93MiI+Vk0gR3JlbWxpbiBpcyBkb3duLiBFeGl0IG1l c3NhZ2U6CiAgICAgICAgaW50ZXJuYWwgZXJyb3IgcHJvY2VzcyBleGl0ZWQgd2hpbGUgY29ubmVj dGluZyB0byBtb25pdG9yOgogICAgICAgIHFlbXUtc3lzdGVtLXg4Nl82NDogLWRyaXZlCiAgICAg ICAgZmlsZT0vcmhldi9kYXRhLWNlbnRlci9tbnQvX2Rpc2swMV9pc28vNGM3MDY5M2EtZDIyOC00 NTNlLWI0MGQtOTNhMjE0ZWM1MjRiL2ltYWdlcy8xMTExMTExMS0xMTExLTExMTEtMTExMS0xMTEx MTExMTExMTEvRmVkb3JhLUxpdmUtRGVza3RvcC14ODZfNjQtMjAtMS5pc28saWY9bm9uZSxpZD1k cml2ZS1pZGUwLTEtMCxyZWFkb25seT1vbixmb3JtYXQ9cmF3LHNlcmlhbD06CgogICAgICAgIGNv dWxkIG5vdCBvcGVuIGRpc2sgaW1hZ2UKICAgICAgICAvcmhldi9kYXRhLWNlbnRlci9tbnQvX2Rp c2swMV9pc28vNGM3MDY5M2EtZDIyOC00NTNlLWI0MGQtOTNhMjE0ZWM1MjRiL2ltYWdlcy8xMTEx MTExMS0xMTExLTExMTEtMTExMS0xMTExMTExMTExMTEvRmVkb3JhLUxpdmUtRGVza3RvcC14ODZf NjQtMjAtMS5pc286CgogICAgICAgIFBlcm1pc3Npb24gZGVuaWVkCiAgICAgICAgLjxicj4KICAg ICAgICA8YnI+CiAgICAgIDwvZGl2PgogICAgPC9kaXY+CiAgICBodWg/Jm5ic3A7IEkgc2VhcmNo IGFyY2hpdmVzIGFuZCBzZWUgb3RoZXJzIGhhdmUgaGFkIHRoaXMgZXJyb3IgaW4gdGhlCiAgICBw YXN0Li4uRm9sbG93IHRoZSBzdWdnZXN0aW9ucy4uLlJ1biB0aGUgbmZzdGVzdCBweXRob24gc2Ny aXB0LAogICAgcGFzc2VzLCBjaGVjayBnZXRzZWJvb2wgc2hvd3MgdmlydF91c2VfbmZzIC0tJmd0 OyBvbi48YnI+CiAgICA8YnI+CiAgICBBbHNvIHdlbnQgdGhyb3VnaDogPGEKICAgICAgaHJlZj0i aHR0cDovL3d3dy5vdmlydC5vcmcvVHJvdWJsZXNob290aW5nX05GU19TdG9yYWdlX0lzc3VlcyI+ aHR0cDovL3d3dy5vdmlydC5vcmcvVHJvdWJsZXNob290aW5nX05GU19TdG9yYWdlX0lzc3Vlczwv YT48YnI+CiAgICA8YnI+CiAgICBNeSBORlMgc2VydmVyIGlzIFNvbGFyaXMgMTEuMSwgWkZTIHN0 b3JhZ2UuPGJyPgogICAgPGJyPgogICAgSWYgSSBjb3B5IHRoZSBJU08gZGlyZWN0bHkgdG8gdGhl IGRpcmVjdG9yeSBpdCB3b3JrcyBmaW5lLiZuYnNwOyZuYnNwOyBXaGF0IGFtCiAgICBJIG1pc3Np bmc/PGJyPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS0wODA0MDEwNDA3MDQwODA0 MDIwMjAzMDktLQoK --===============8713059756590452338==--