3:10 a.m.
--_000_DDFE403B96084E3CA029EFC39908A6C9powersoftcom_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Hi there,
I seem to have run into a problem. my hosted engine vm is failing to start=
;
vdsm.log;
Thread-20::DEBUG::2015-01-27 16:53:37,999::fileSD::152::Storage.StorageDoma=
in::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.32:_V=
olumes_Raid1/443b4931-667f-441f-98d8-51384e67a0af
Thread-20::ERROR::2015-01-27 16:53:38,000::domainMonitor::256::Storage.Doma=
inMonitorThread::(_monitorDomain) Error while collecting domain 443b4931-66=
7f-441f-98d8-51384e67a0af monitoring information
Traceback (most recent call last):
File "/usr/share/vdsm/storage/domainMonitor.py", line 221, in _monitorDom=
ain
self.domain =3D sdCache.produce(self.sdUUID)
File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
domain.getRealDomain()
File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
return self._cache._realProduce(self._sdUUID)
File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
domain =3D self._findDomain(sdUUID)
File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
dom =3D findMethod(sdUUID)
File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomain
return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
File "/usr/share/vdsm/storage/fileSD.py", line 159, in __init__
validateFileSystemFeatures(sdUUID, self.mountpoint)
File "/usr/share/vdsm/storage/fileSD.py", line 88, in validateFileSystemF=
eatures
oop.getProcessPool(sdUUID).directTouch(testFilePath)
File "/usr/share/vdsm/storage/outOfProcess.py", line 320, in directTouch
ioproc.touch(path, flags, mode)
File "/usr/lib/python2.6/site-packages/ioprocess/__init__.py", line 507, =
in touch
self.timeout)
File "/usr/lib/python2.6/site-packages/ioprocess/__init__.py", line 391, =
in _sendCommand
raise OSError(errcode, errstr)
OSError: [Errno 13] Permission denied
I assume this is an nfs issue so I checked to see if I could create a file =
in the mounts from the host machine, which I could.
My test bed is usign an old OS X NFS via xraid adn the export is ;
/Volumes/Raid1 -maproot=3Droot:wheel -network 192.168.1.0 -mask 255.255.255=
.0
drwxr-xr-x 6 vdsm kvm 204 Jan 27 16:30 443b4931-667f-441f-98d8-51=
384e67a0af
drwxr-xr-x 4 vdsm kvm 136 Jan 27 12:32 data
drwxr-xr-x 4 vdsm kvm 136 Jan 27 00:18 iso
drwxr-xr-x 3 vdsm kvm 102 Jan 26 09:43 vm
the host machine seems to mount the shares fine....
drwxr-xr-x 5 vdsm kvm 4096 Jan 27 12:28 .
drwxr-xr-x 3 vdsm kvm 4096 Jan 27 10:04 ..
drwxr-xr-x 13 vdsm kvm 544 Jan 27 00:12 192.168.1.32:_Volumes_Raid1
drwxr-xr-x 2 vdsm kvm 4096 Jan 27 00:12 192.168.1.32:_Volumes_Raid1_data
drwxr-xr-x 2 vdsm kvm 4096 Jan 27 00:24 192.168.1.32:_Volumes_Raid1_iso
and as I said above I can create files in any one of those mounts
Is there a place I can look at to find the offending file? If that is the =
issue... Oddly enough everything worked until i rebooted, so I must have e=
ither changed something or something is buggered.
--_000_DDFE403B96084E3CA029EFC39908A6C9powersoftcom_
Content-Type: text/html; charset="us-ascii"
Content-ID: <24D10F8AA975974E9791EA01D2A22C0E(a)power-soft.net Content-Transfer-Encoding: quoted-printable
<html <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3Dus-ascii"=
</head <body
style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-lin=
e-break: after-white-space;" class=3D"" Hi
there,
<div class=3D""><br class=3D""
</div <div
class=3D""><br class=3D""
</div <div class=3D"">I
seem to have run into a problem. my hosted engine v=
m is failing to start;</div <div
class=3D""><br class=3D""
</div <div
class=3D"">vdsm.log;</div <div
class=3D""><br class=3D""
</div <div
class=3D""><br class=3D""
</div <div class=3D"" <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
<div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
>Traceback (most recent call last):</div <div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
<div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
> self.domain =3D sdCache.produce(self.sdUUID)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
> domain.getRealDomain()</div <div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
> return self._cache._realProduce(self._sdUUID)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
> domain =3D self._findDomain(sdUUID)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
> dom =3D findMethod(sdUUID)</div <div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
<div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
> validateFileSystemFeatures(sdUUID, self.mountpoint)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
> oop.getProcessPool(sdUUID).directTouch(testFilePath)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
> ioproc.touch(path, flags, mode)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
<div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
> self.timeout)</div <div
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"
class=3D""=
<div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
> raise OSError(errcode, errstr)</div <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
>OSError: [Errno 13] Permission denied</div
</div <div
class=3D""><br class=3D""
</div <div class=3D"">I
assume this is an nfs issue so I checked to see if I coul=
d create a file in the mounts from the host machine, which I could.</=
div <div class=3D""><br class=3D"" </div <div
class=3D"">My test bed is usign an old OS X NFS via xraid adn the expo=
rt is ;</div <div class=3D"" <div style=3D"margin: 0px; font-size: 11px;
font-family: Menlo;" class=3D""=
</div <div class=3D""><br class=3D"" </div <div
class=3D"" <div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
</div <div style=3D"margin: 0px;
font-size: 11px; font-family: Menlo;" class=3D""=
<div style=3D"margin: 0px;"
class=3D"">drwxr-xr-x 4 vdsm  =
; kvm 136 Jan 27 12:32 data</div <div style=3D"margin: 0px;"
class=3D"" <div style=3D"margin:
0px;" class=3D"">drwxr-xr-x 4 vdsm  =
; kvm 136 Jan 27 00:18 iso</div <div style=3D"margin: 0px;"
class=3D"" <div style=3D"margin:
0px;" class=3D"">drwxr-xr-x 3 vdsm  =
; kvm 102 Jan 26 09:43 vm</div <div style=3D"margin: 0px;"
class=3D""><br class=3D""
</div <div style=3D"margin:
0px;" class=3D"">the host machine seems to mount the =
shares fine....</div <div style=3D"margin:
0px;" class=3D""><br class=3D"" </div <div
style=3D"margin: 0px;" class=3D"" <div
style=3D"margin: 0px;" class=3D"">drwxr-xr-x 5 vdsm kvm
4096 Jan=
27 12:28 <span style=3D"font-variant-ligatures: no-common-ligatures; color=
: #4c7aff" class=3D""
.</span></div <div style=3D"margin:
0px;" class=3D"">drwxr-xr-x 3 vdsm kvm 4096 Jan=
27 10:04 <span style=3D"font-variant-ligatures: no-common-ligatures; color=
: #4c7aff" class=3D""
..</span></div <div style=3D"margin:
0px;" class=3D"">drwxr-xr-x 13 vdsm kvm 544 Jan=
27 00:12 <span style=3D"font-variant-ligatures: no-common-ligatures; color=
: #4c7aff" class=3D""
192.168.1.32:_Volumes_Raid1</span></div <div
style=3D"margin: 0px;" class=3D"">drwxr-xr-x 2 vdsm kvm
4096 Jan=
27 00:12 <span style=3D"font-variant-ligatures: no-common-ligatures; color=
: #4c7aff" class=3D""
192.168.1.32:_Volumes_Raid1_data</span></div <div
style=3D"margin: 0px;" class=3D"">drwxr-xr-x 2 vdsm kvm
4096 Jan=
27 00:24 <span style=3D"font-variant-ligatures: no-common-ligatures; color=
: #4c7aff" class=3D""
192.168.1.32:_Volumes_Raid1_iso</span></div
</div <div style=3D"margin:
0px;" class=3D""><br class=3D"" </div
</div </div </div <div
class=3D"">and as I said above I can create files in any one of those =
mounts</div <div
class=3D""><br class=3D""
</div <div
class=3D""><br class=3D""
</div <div class=3D"">Is
there a place I can look at to find the offending file? =
If that is the issue... Oddly enough everything worked until i =
rebooted, so I must have either changed something or something is buggered.=
</div <div
class=3D""><br class=3D""
</div <div
class=3D""><br class=3D""
</div <div
class=3D""><br class=3D""
</div </body </html
--_000_DDFE403B96084E3CA029EFC39908A6C9powersoftcom_--
Thread-20::DEBUG::2015-01-27
16:53:37,999::fileSD::152::Storage.StorageDom=
ain::(__init__) Reading domain in
path /rhev/data-center/mnt/192.168.1.32:_=
Volumes_Raid1/443b4931-667f-441f-98d8-51384e67a0af</divThread-20::ERROR::2015-01-27
16:53:38,000::domainMonitor::256::Storage.Dom=
ainMonitorThread::(_monitorDomain)
Error while collecting domain 443b4931-6=
67f-441f-98d8-51384e67a0af monitoring
information</div File
"/usr/share/vdsm/storage/domainMonitor.py", line 221=
, in
_monitorDomain</div File "/usr/share/vdsm/storage/sdc.py",
line 98, in produc=
e</div File "/usr/share/vdsm/storage/sdc.py",
line 52, in getRea=
lDomain</div File "/usr/share/vdsm/storage/sdc.py",
line 122, in _real=
Produce</div File "/usr/share/vdsm/storage/sdc.py",
line 141, in _find=
Domain</div File "/usr/share/vdsm/storage/nfsSD.py",
line 122, in fin=
dDomain</div return
NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUU=
ID))</div File "/usr/share/vdsm/storage/fileSD.py",
line 159, in __=
init__</div File "/usr/share/vdsm/storage/fileSD.py",
line 88, in val=
idateFileSystemFeatures</div File
"/usr/share/vdsm/storage/outOfProcess.py", line 320,=
in
directTouch</div File
"/usr/lib/python2.6/site-packages/ioprocess/__init__.py&q=
uot;, line
507, in touch</div File
"/usr/lib/python2.6/site-packages/ioprocess/__init__.py&q=
uot;, line
391, in _sendCommand</div/Volumes/Raid1 -maproot=3Droot:wheel -network 192.168.1.0 -mask
255.255.25=
5.0</divdrwxr-xr-x 6 vdsm kvm
204 Jan 27 1=
6:30
443b4931-667f-441f-98d8-51384e67a0af</div