<div dir="ltr"><div class="gmail_extra">On Wed, Jan 16, 2013 at 12:08 AM, Dan Kenigsberg wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div id=":13p">My question regarded a simple node-only reboot. I wonder if vdsm fails<br>
to start ALWAYS, or that this is an even more complex glitch.</div></blockquote></div><br>Just done another reboot and the same problem. It seems vdsmd doesn't start at all</div><div class="gmail_extra"><br></div><div class="gmail_extra">
<div class="gmail_extra">[root@f18ovn03 ~]# sudo systemctl status vdsmd.service</div><div class="gmail_extra">vdsmd.service - Virtual Desktop Server Manager</div><div class="gmail_extra"><span class="" style="white-space:pre"> </span> Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled)</div>
<div class="gmail_extra"><span class="" style="white-space:pre"> </span> Active: inactive (dead)</div><div class="gmail_extra"><span class="" style="white-space:pre"> </span> CGroup: name=systemd:/system/vdsmd.service</div>
<div><br></div><div style>Under /var/log/vdsm I see vdsm.log with timestamp of when I stopped the system:</div><div style><div>MainThread::INFO::2013-01-16 00:45:57,716::vdsm::95::vds::(run) VDSM main thread ended. Waiting for 16 other threads...</div>
<div>MainThread::INFO::2013-01-16 00:45:57,716::vdsm::99::vds::(run) <Thread(libvirtEventLoop, started daemon 140084926744320)></div><div>MainThread::INFO::2013-01-16 00:45:57,716::vdsm::99::vds::(run) <WorkerThread(Thread-5, started daemon 140084753970944)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,716::vdsm::99::vds::(run) <HostMonitor(HostMonitor, started daemon 140083713799936)></div><div>MainThread::INFO::2013-01-16 00:45:57,716::vdsm::99::vds::(run) <WorkerThread(Thread-7, started daemon 140084737185536)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,717::momIF::65::MOM::(stop) Shutting down MOM</div><div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <MomThread(MOM, started 140084200314624)></div><div>
MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <WorkerThread(Thread-4, started daemon 140084762363648)></div><div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <WorkerThread(Thread-10, started daemon 140084233885440)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <WorkerThread(Thread-9, started daemon 140084242278144)></div><div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <WorkerThread(Thread-1, started daemon 140084787541760)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <WorkerThread(Thread-3, started daemon 140084770756352)></div><div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <WorkerThread(Thread-8, started daemon 140084250670848)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,717::vdsm::99::vds::(run) <_MainThread(MainThread, started 140085026416448)></div><div>MainThread::INFO::2013-01-16 00:45:57,718::vdsm::99::vds::(run) <GuestManager(GuestManager, started daemon 140083688621824)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,718::vdsm::99::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140083680229120)></div><div>MainThread::INFO::2013-01-16 00:45:57,718::vdsm::99::vds::(run) <WorkerThread(Thread-2, started daemon 140084779149056)></div>
<div>MainThread::INFO::2013-01-16 00:45:57,718::vdsm::99::vds::(run) <WorkerThread(Thread-6, started daemon 140084745578240)></div><div>MainThread::INFO::2013-01-16 00:45:57,718::vmChannels::136::vds::(stop) VM channels listener was stopped.</div>
<div>MainThread::INFO::2013-01-16 00:45:57,718::vdsm::99::vds::(run) <Listener(VM Channels Listener, started daemon 140083705407232)></div><div><br></div></div><div style>If then I manually start it </div><div><div>
root@f18ovn03 vdsm]# systemctl start vdsmd.service</div><div>[root@f18ovn03 vdsm]# echo $?</div><div>0</div><div>[root@f18ovn03 vdsm]# systemctl status vdsmd.service</div><div>vdsmd.service - Virtual Desktop Server Manager</div>
<div><span class="" style="white-space:pre"> </span> Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled)</div><div><span class="" style="white-space:pre"> </span> Active: active (running) since Wed, 2013-01-16 01:09:44 CET; 10s ago</div>
<div><span class="" style="white-space:pre"> </span> Process: 2483 ExecStart=/lib/systemd/systemd-vdsmd start (code=exited, status=0/SUCCESS)</div><div><span class="" style="white-space:pre"> </span>Main PID: 2770 (respawn)</div>
<div><span class="" style="white-space:pre"> </span> CGroup: name=systemd:/system/vdsmd.service</div><div><span class="" style="white-space:pre"> </span> ├ 2770 /bin/bash -e /usr/share/vdsm/respawn --minlifetime 10 --daemon --masterpid /var/run/vdsm/respawn.p...</div>
<div><span class="" style="white-space:pre"> </span> ├ 2773 /usr/bin/python /usr/share/vdsm/vdsm</div><div><span class="" style="white-space:pre"> </span> ├ 2791 /usr/bin/sudo -n /usr/bin/python /usr/share/vdsm/supervdsmServer.py 75cc5638-f5c7-4431-bcbe-4a0cd8...</div>
<div><span class="" style="white-space:pre"> </span> └ 2792 /usr/bin/python /usr/share/vdsm/supervdsmServer.py 75cc5638-f5c7-4431-bcbe-4a0cd817a0e4 2773 /var/...</div><div><br></div><div>Jan 16 01:09:44 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> systemd-vdsmd[2483]: [27B blob data]</div>
<div>Jan 16 01:09:44 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> systemd[1]: Started Virtual Desktop Server Manager.</div><div>Jan 16 01:09:45 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> python[2773]: DIGEST-MD5 client step 2</div>
<div>Jan 16 01:09:45 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> python[2773]: DIGEST-MD5 client step 2</div><div>Jan 16 01:09:45 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> python[2773]: DIGEST-MD5 client step 3</div>
<div>Jan 16 01:09:45 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> vdsm[2773]: vdsm fileUtils WARNING Dir /rhev/data-center/mnt already exists</div><div>Jan 16 01:09:48 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> vdsm[2773]: vdsm Storage.LVM WARNING lvm pvs failed: 5 [' NQRb0Q-3C0k-3RRo-1LZZ...T01']</div>
<div>Jan 16 01:09:48 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> vdsm[2773]: vdsm Storage.LVM WARNING lvm vgs failed: 5 [' x3XSZx-avUC-0NNI-w5K4...T01']</div><div>Jan 16 01:09:48 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> vdsm[2773]: vdsm vds WARNING Unable to load the json rpc server module. Please m...lled.</div>
<div>Jan 16 01:09:51 <a href="http://f18ovn03.ceda.polimi.it">f18ovn03.ceda.polimi.it</a> vdsm[2773]: vdsm fileUtils WARNING Dir /rhev/data-center/hsm-tasks already exists</div></div><div><br></div><div style>Tried also to run anable again</div>
<div style>systemctl enable vdsmd.service </div><div style>and reboot but same behaviour.</div><div style>In notice that the same is true for ntpd service, configured as enabled but not started.</div><div style>When I manually start vdsmd, also ntpd starts, as it is in the required chain for vdsmd... strange</div>
<div style>Can it depend on delay on network/bridges initialization?</div><div style><br></div><div style>when the service has not manually started by me yet, the output of</div><div style>systemctl show vdsmd.service </div>
<div style><br></div><div style><br></div><div><div>Id=vdsmd.service</div><div>Names=vdsmd.service</div><div>Requires=multipathd.service libvirtd.service ntpd.service systemd-journald.socket basic.target</div><div>WantedBy=multi-user.target</div>
<div>Conflicts=libvirt-guests.service shutdown.target</div><div>Before=shutdown.target multi-user.target</div><div>After=systemd-journald.socket basic.target</div><div>Description=Virtual Desktop Server Manager</div><div>
LoadState=loaded</div><div>ActiveState=inactive</div><div>SubState=dead</div><div>FragmentPath=/usr/lib/systemd/system/vdsmd.service</div><div>UnitFileState=enabled</div><div>InactiveExitTimestampMonotonic=0</div><div>ActiveEnterTimestampMonotonic=0</div>
<div>ActiveExitTimestampMonotonic=0</div><div>InactiveEnterTimestampMonotonic=0</div><div>CanStart=yes</div><div>CanStop=yes</div><div>CanReload=no</div><div>CanIsolate=no</div><div>StopWhenUnneeded=no</div><div>RefuseManualStart=no</div>
<div>RefuseManualStop=no</div><div>AllowIsolate=no</div><div>DefaultDependencies=yes</div><div>OnFailureIsolate=no</div></div><div><div>IgnoreOnIsolate=no</div><div>IgnoreOnSnapshot=no</div><div>DefaultControlGroup=name=systemd:/system/vdsmd.service</div>
<div>ControlGroup=cpu:/system/vdsmd.service name=systemd:/system/vdsmd.service</div><div>NeedDaemonReload=no</div><div>JobTimeoutUSec=0</div><div>ConditionTimestampMonotonic=0</div><div>ConditionResult=no</div><div>Type=forking</div>
<div>Restart=no</div><div>NotifyAccess=none</div><div>RestartUSec=100ms</div><div>TimeoutUSec=1min 30s</div><div>TimeoutStartUSec=1min 30s</div><div>TimeoutStopUSec=1min 30s</div><div>WatchdogUSec=0</div><div>WatchdogTimestampMonotonic=0</div>
<div>StartLimitInterval=10000000</div><div>StartLimitBurst=5</div><div>StartLimitAction=none</div><div>ExecStart={ path=/lib/systemd/systemd-vdsmd ; argv[]=/lib/systemd/systemd-vdsmd start ; ignore_errors=no ; start_time=[n/a] ; st</div>
<div>ExecStop={ path=/lib/systemd/systemd-vdsmd ; argv[]=/lib/systemd/systemd-vdsmd stop ; ignore_errors=no ; start_time=[n/a] ; stop</div><div>PermissionsStartOnly=no</div><div>RootDirectoryStartOnly=no</div><div>RemainAfterExit=no</div>
<div>GuessMainPID=yes</div><div>MainPID=0</div></div><div><div>ControlPID=0</div><div>Result=success</div><div>EnvironmentFile=/etc/sysconfig/vdsm (ignore_errors=yes)</div><div>UMask=0022</div><div>LimitCPU=18446744073709551615</div>
<div>LimitFSIZE=18446744073709551615</div><div>LimitDATA=18446744073709551615</div><div>LimitSTACK=18446744073709551615</div><div>LimitCORE=18446744073709551615</div><div>LimitRSS=18446744073709551615</div><div>LimitNOFILE=4096</div>
<div>LimitAS=18446744073709551615</div><div>LimitNPROC=256714</div><div>LimitMEMLOCK=65536</div><div>LimitLOCKS=18446744073709551615</div><div>LimitSIGPENDING=256714</div><div>LimitMSGQUEUE=819200</div><div>LimitNICE=0</div>
<div>LimitRTPRIO=0</div><div>LimitRTTIME=18446744073709551615</div><div>OOMScoreAdjust=0</div><div>Nice=0</div><div>IOScheduling=0</div><div>CPUSchedulingPolicy=0</div><div>CPUSchedulingPriority=0</div><div>TimerSlackNSec=50000</div>
<div>CPUSchedulingResetOnFork=no</div></div><div><div>NonBlocking=no</div><div>StandardInput=null</div><div>StandardOutput=journal</div><div>StandardError=inherit</div><div>TTYReset=no</div><div>TTYVHangup=no</div><div>TTYVTDisallocate=no</div>
<div>SyslogPriority=30</div><div>SyslogLevelPrefix=yes</div><div>SecureBits=0</div><div>CapabilityBoundingSet=18446744073709551615</div><div>MountFlags=0</div><div>PrivateTmp=no</div><div>PrivateNetwork=no</div><div>SameProcessGroup=no</div>
<div>ControlGroupModify=no</div><div>ControlGroupPersistent=no</div><div>IgnoreSIGPIPE=yes</div><div>NoNewPrivileges=no</div><div>KillMode=control-group</div><div>KillSignal=15</div><div>SendSIGKILL=yes</div><div>ExecMainStartTimestampMonotonic=0</div>
<div>ExecMainExitTimestampMonotonic=0</div><div>ExecMainPID=0</div><div>ExecMainCode=0</div><div>ExecMainStatus=0</div></div><div><br></div></div></div>