<div dir="ltr">Did it change the file permissions when you copied svdsm.logger.conf.rpmnew? <div>can you reproduce it?<br><br><div class="gmail_quote"><div dir="ltr">On Tue, Aug 1, 2017 at 3:06 PM Richard Chan <<a href="mailto:richard@treeboxsolutions.com">richard@treeboxsolutions.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>Could this be the cause of the access issue (old system upgraded from 3.4 all the way to 4.1)?</div><div>## change in python class name??</div><div><br></div><div><div><div><div> [handler_logfile]</div><div>-class=logUtils.UserGroupEnforcingHandler</div><div>+class=vdsm.logUtils.UserGroupEnforcingHandler</div></div><div><br></div><div>When I copied svdsm.logger.conf.rpmnew over svdsm.logger.conf, it could start up.</div></div></div><div><br></div><div>Thanks!</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Aug 1, 2017 at 5:02 PM, Yaniv Bronheim <span dir="ltr"><<a href="mailto:ybronhei@redhat.com" target="_blank">ybronhei@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi,</div><div><br></div>Seems like I already bumped in such issue awhile ago - <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1216880" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1216880</a><div>but now I see what's wrong - it happens after failing to read /etc/vdsm/svdsm.logger.conf for some reason</div><div>then we have a bug in our fallback which tries to run</div><div><div> logging.basicConfig(filename='/dev/stdout', filemode='w+',</div><div> level=logging.DEBUG)</div></div><div><br></div><div>and this fails while running as systemd daemon</div><div><br></div><div>sorry about that. check why it can't load /etc/vdsm/svdsm.logger.conf and update us </div><div><div>after fixing the access issue check if you can run </div><div>logging.config.fileConfig("/etc/vdsm/svdsm.logger.conf" , disable_existing_loggers=False)</div></div><div>Then supervdsmd should start properly </div><div><br></div><div>I'll reopen the bugzilla and fix the wrong fallback to syslog print</div><div><br></div><div>Thanks!</div><div><br></div></div><div><div class="m_-5047681649313274256h5"><br><div class="gmail_quote"><div dir="ltr">On Sun, Jul 30, 2017 at 3:23 PM Richard Chan <<a href="mailto:richard@treeboxsolutions.com" target="_blank">richard@treeboxsolutions.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Yaniv,<div><br></div><div>On this one node, it happened from 3.6 -> 4.0. It persisted after 4.0->4.1.</div><div>Current: vdsm-4.19.24-1.el7.centos.x86_64</div><div><br></div><div><br></div><div>In systemd override I now have to have:</div><div>StandardOutput=null<br></div><div><br></div><div><br></div><div><br></div><div><div><br></div></div><div><div>Jul 29 01:19:21 xxxxxxxx systemd[1]: Starting Auxiliary vdsm service for running helper functions as root...</div><div>Jul 29 01:19:21 xxxxxxxx python2[39124]: detected unhandled Python exception in '/usr/share/vdsm/supervdsmServer'</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: Traceback (most recent call last):</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: File "/usr/share/vdsm/supervdsmServer", line 45, in <module></div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: level=logging.DEBUG)</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: File "/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: hdlr = FileHandler(filename, mode)</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: StreamHandler.__init__(self, self._open())</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: stream = open(self.baseFilename, self.mode)</div><div>Jul 29 01:19:21 xxxxxxxx daemonAdapter[39124]: IOError: [Errno 6] No such device or address: '/dev/stdout'</div><div>Jul 29 01:19:21 xxxxxxxx systemd[1]: supervdsmd.service: main process exited, code=exited, status=1/FAILURE</div></div><div><br></div><div><br></div><div class="gmail_extra"></div></div><div dir="ltr"><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jul 30, 2017 at 3:47 PM, Yaniv Kaul <span dir="ltr"><<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jul 28, 2017 at 8:37 PM, Richard Chan <span dir="ltr"><<a href="mailto:richard@treeboxsolutions.com" target="_blank">richard@treeboxsolutions.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>After an upgrade to 4.0 I have a single host that cannot start supervdsmd because of IOError on /dev/stdout. All other hosts upgraded correctly.</div></div></blockquote><div><br></div><div>Upgrade from which version? 3.6? Did you stay on 4.0 or continued to 4.1?</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>In the systemd unit I have to hack StandardOutput=null.</div><div><br></div><div>Any thing I have overlooked? The hosts are all identical and it is just this one </div><div>that has this weird behaviour.</div></div></blockquote><div><br></div><div>Any logs that you can share?</div><div> Y.</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span class="m_-5047681649313274256m_6658394691337652281m_3379688319398626409gmail-m_-3155408704238299680HOEnZb"><font color="#888888"><br clear="all"><span class="m_-5047681649313274256m_6658394691337652281m_3379688319398626409gmail-HOEnZb"><font color="#888888"><div><br></div>-- <br><div class="m_-5047681649313274256m_6658394691337652281m_3379688319398626409gmail-m_-3155408704238299680m_8202318129156376553gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Richard Chan</span></font></div><div dir="ltr"><br></div></div></div></div>
</font></span></font></span></div><span class="m_-5047681649313274256m_6658394691337652281m_3379688319398626409gmail-HOEnZb"><font color="#888888">
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
<br></font></span></blockquote></div><br></div></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><div dir="ltr"><div class="gmail_extra">-- <br><div class="m_-5047681649313274256m_6658394691337652281m_3379688319398626409gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Richard Chan</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Chief Architect</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><br></span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">TreeBox Solutions Pte Ltd</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">1 Commonwealth Lane #03-01</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Singapore 149544</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Tel: 6570 3725</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><a href="http://www.treeboxsolutions.com" target="_blank">http://www.treeboxsolutions.com</a></span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><br></span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><a href="http://Co.Reg.No" target="_blank">Co.Reg.No</a>. 201100585R<span style="white-space:pre-wrap"> </span></span></font></div></div></div></div></div>
</div></div>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
</blockquote></div><div dir="ltr">-- <br></div></div></div><div class="m_-5047681649313274256m_6658394691337652281gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Yaniv Bronhaim.</div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_-5047681649313274256gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Richard Chan</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Chief Architect</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><br></span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">TreeBox Solutions Pte Ltd</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">1 Commonwealth Lane #03-01</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Singapore 149544</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px">Tel: 6570 3725</span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><a href="http://www.treeboxsolutions.com" target="_blank">http://www.treeboxsolutions.com</a></span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><br></span></font></div><div dir="ltr"><font color="#000000" face="Droid Sans"><span style="font-size:15px"><a href="http://Co.Reg.No" target="_blank">Co.Reg.No</a>. 201100585R<span style="white-space:pre-wrap"> </span></span></font></div></div></div></div></div>
</div>
</blockquote></div></div></div><div dir="ltr">-- <br></div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Yaniv Bronhaim.</div></div>