Re: [ovirt-users] problem after rebooting the node

Based on what I can see, you used OVS as the switch type and it seems ovs (openvswitch) is not properly installed on your host. Make sure that you have ovs operational by issuing "ovs-vsctl show". You should note that OVS network support is not an official release feature, and you should use it on 4.1 and up versions. Fixes will be probably submitted to master (appearing in nightly builds). Next time please include the mailing-list in your replies and attach the log files, it is less spamming. Thanks, Edy. On Fri, Feb 3, 2017 at 5:07 AM, Shalabh Goel <shalabhgoel13(a)gmail.com&gt; wrote: > log from messages > > Feb 3 08:27:53 ovirtnode3 ovs-vsctl: ovs|00001|db_ctl_base|ERR|unix:/var/run/openvswitch/db.sock: > database connection failed (No such file or directory) > Feb 3 08:27:53 ovirtnode3 journal: vdsm vds ERROR Executing commands > failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database > connection failed (No su > ch file or directory)#012Traceback (most recent call last):#012 File > "/usr/share/vdsm/API.py", line 1531, in setupNetworks#012 > supervdsm.getProxy().setup > Networks(networks, bondings, options)#012 File > "/usr/lib/python2.7/site-packages/vdsm/supervdsm.py", line 53, in > __call__#012 return callMethod()#012 Fi > le "/usr/lib/python2.7/site-packages/vdsm/supervdsm.py", line 51, in > <lambda>#012 **kwargs)#012 File "<string>", line 2, in > setupNetworks#012 File "/usr > /lib64/python2.7/multiprocessing/managers.py", line 773, in > _callmethod#012 raise convert_to_error(kind, > result)#012ConfigNetworkError: (21, 'Executing co > mmands failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database > connection failed (No such file or directory)') > > Log from vdsm.log > > Reactor thread::INFO::2017-02-03 08:32:24,638::protocoldetector > ::72::ProtocolDetector.AcceptorImpl::(handle_accept) Accepted connection > from ::1:53082 > Reactor thread::DEBUG::2017-02-03 08:32:24,643::protocoldetector > ::91::ProtocolDetector.Detector::(__init__) Using required_size=11 > Reactor thread::INFO::2017-02-03 08:32:24,643::protocoldetector > ::127::ProtocolDetector.Detector::(handle_read) Detected protocol xml > from ::1:53082 > Reactor thread::DEBUG::2017-02-03 08:32:24,643::bindingxmlrpc::1 > 317::XmlDetector::(handle_socket) xml over http detected from ('::1', > 53082) > BindingXMLRPC::INFO::2017-02-03 08:32:24,643::xmlrpc::73::vds.XMLRPCServer::(handle_request) > Starting request handler for ::1:53082 > Thread-20::INFO::2017-02-03 08:32:24,644::xmlrpc::83::vds. > XMLRPCServer::(_process_requests) Request handler for ::1:53082 started > Thread-20::DEBUG::2017-02-03 08:32:24,644::bindingxmlrpc::1263::vds::(wrapper) > client [::1]::call getAllVmStats with () {} > Thread-20::DEBUG::2017-02-03 08:32:24,644::bindingxmlrpc::1270::vds::(wrapper) > return getAllVmStats with {'status': {'message': 'Done', 'code': 0}, > 'statsLis > t': (suppressed)} > Thread-20::INFO::2017-02-03 08:32:24,644::bindingxmlrpc::1297::vds::(wrapper) > RPC call getAllVmStats finished (code=0) in 0.00 seconds > Thread-20::INFO::2017-02-03 08:32:24,645::xmlrpc::91::vds. > XMLRPCServer::(_process_requests) Request handler for ::1:53082 stopped > periodic/0::DEBUG::2017-02-03 08:32:24,907::sampling::508::v > irt.sampling.VMBulkSampler::(__call__) sampled timestamp 4347942.15 > elapsed 0.010 acquired True d > omains all > periodic/2::DEBUG::2017-02-03 08:32:24,908::task::599::stora > ge.TaskManager.Task::(_updateState) (Task='bb07f89c-6165-42bc-902f-1b7701b813fa') > moving from sta > te init -> state preparing > periodic/2::INFO::2017-02-03 08:32:24,908::logUtils::49::dispatcher::(wrapper) > Run and protect: repoStats(options=None) > periodic/2::INFO::2017-02-03 08:32:24,908::logUtils::52::dispatcher::(wrapper) > Run and protect: repoStats, Return response: {} > periodic/2::DEBUG::2017-02-03 08:32:24,909::task::1195::stor > age.TaskManager.Task::(prepare) (Task='bb07f89c-6165-42bc-902f-1b7701b813fa') > finished: {} > periodic/2::DEBUG::2017-02-03 08:32:24,909::task::599::stora > ge.TaskManager.Task::(_updateState) (Task='bb07f89c-6165-42bc-902f-1b7701b813fa') > moving from sta > te preparing -> state finished > periodic/2::DEBUG::2017-02-03 08:32:24,909::resourceManager: > :910::storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll > requests {} resources {} > periodic/2::DEBUG::2017-02-03 08:32:24,909::resourceManager: > :947::storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll > requests {} > periodic/2::DEBUG::2017-02-03 08:32:24,909::task::997::storage.TaskManager.Task::(_decref) > (Task='bb07f89c-6165-42bc-902f-1b7701b813fa') ref 0 aborting False > jsonrpc/4::DEBUG::2017-02-03 08:32:26,653::__init__::532::j > sonrpc.JsonRpcServer::(_handle_request) Calling 'Host.getAllVmStats' in > bridge with {} > jsonrpc/4::DEBUG::2017-02-03 08:32:26,653::__init__::557::j > sonrpc.JsonRpcServer::(_handle_request) Return 'Host.getAllVmStats' in > bridge with (suppressed) > jsonrpc/4::INFO::2017-02-03 08:32:26,653::__init__::515::j > sonrpc.JsonRpcServer::(_serveRequest) RPC call Host.getAllVmStats > succeeded in 0.00 seconds > jsonrpc/6::DEBUG::2017-02-03 08:32:27,706::__init__::532::j > sonrpc.JsonRpcServer::(_handle_request) Calling 'Host.getStats' in > bridge with {} > jsonrpc/6::DEBUG::2017-02-03 08:32:27,706::__init__::532::j > sonrpc.JsonRpcServer::(_handle_request) Calling 'Host.getStats' in > bridge with {} > jsonrpc/6::DEBUG::2017-02-03 08:32:27,707::task::599::stora > ge.TaskManager.Task::(_updateState) (Task='9285329e-485b-4165-8bdc-4f411f394356') > moving from state init -> state preparing > jsonrpc/6::INFO::2017-02-03 08:32:27,707::logUtils::49::dispatcher::(wrapper) > Run and protect: repoStats(options=None) > jsonrpc/6::INFO::2017-02-03 08:32:27,707::logUtils::52::dispatcher::(wrapper) > Run and protect: repoStats, Return response: {} > jsonrpc/6::DEBUG::2017-02-03 08:32:27,707::task::1195::stor > age.TaskManager.Task::(prepare) (Task='9285329e-485b-4165-8bdc-4f411f394356') > finished: {} > jsonrpc/6::DEBUG::2017-02-03 08:32:27,707::task::599::stora > ge.TaskManager.Task::(_updateState) (Task='9285329e-485b-4165-8bdc-4f411f394356') > moving from state preparing -> state finished > jsonrpc/6::DEBUG::2017-02-03 08:32:27,708::resourceManager: > :910::storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll > requests {} resources {} > jsonrpc/6::DEBUG::2017-02-03 08:32:27,708::resourceManager: > :947::storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll > requests {} > jsonrpc/6::DEBUG::2017-02-03 08:32:27,708::task::997::storage.TaskManager.Task::(_decref) > (Task='9285329e-485b-4165-8bdc-4f411f394356') ref 0 aborting False > jsonrpc/6::DEBUG::2017-02-03 08:32:27,712::__init__::557::j > sonrpc.JsonRpcServer::(_handle_request) Return 'Host.getStats' in bridge > with {'cpuStatistics': {'28': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': > '0.00', 'cpuIdle': '99.87'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '24': {'cpuUser': '0.00', > 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '25': {'cpuUser': > '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, '26': > {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, > '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', > 'cpuIdle': '100.00'}, '21': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': > '0.00', 'cpuIdle': '100.00'}, '22': {'cpuUser': '0.00', 'nodeIndex': 1, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '23': {'cpuUser': '0.00', > 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '46': {'cpuUser': > '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '47': > {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, > '44': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}, '45': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', > 'cpuIdle': '100.00'}, '42': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': > '0.00', 'cpuIdle': '100.00'}, '43': {'cpuUser': '0.00', 'nodeIndex': 1, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '40': {'cpuUser': '0.00', > 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '41': {'cpuUser': > '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': > {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, > '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}, '3': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', > 'cpuIdle': '99.86'}, '2': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': > '0.00', 'cpuIdle': '99.93'}, '5': {'cpuUser': '0.00', 'nodeIndex': 0, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '4': {'cpuUser': '0.00', > 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '7': {'cpuUser': > '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': > {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.80'}, > '9': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', > 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': > '0.00', 'cpuIdle': '100.00'}, '38': {'cpuUser': '0.00', 'nodeIndex': 1, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '11': {'cpuUser': '0.00', > 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '10': {'cpuUser': > '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '13': > {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, > '12': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}, '15': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', > 'cpuIdle': '100.00'}, '14': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': > '0.00', 'cpuIdle': '100.00'}, '17': {'cpuUser': '0.00', 'nodeIndex': 1, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '16': {'cpuUser': '0.00', > 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '19': {'cpuUser': > '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '18': > {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, > '31': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}, '30': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', > 'cpuIdle': '100.00'}, '37': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': > '0.00', 'cpuIdle': '100.00'}, '36': {'cpuUser': '0.00', 'nodeIndex': 1, > 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '35': {'cpuUser': '0.00', > 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '34': {'cpuUser': > '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '33': > {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, > '32': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': > '100.00'}}, 'numaNodeMemFree': {'1': {'memPercent': 3, 'memFree': '63780'}, > '0': {'memPercent': 4, 'memFree': '63426'}}, 'memShared': 0, 'thpState': > 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 0, 'memUsed': '2', > 'storageDomains': {}, 'incomingVmMigrations': 0, 'network': {'ib0': > {'txErrors': '0', 'state': 'down', 'sampleTime': 1486090944.903051, 'name': > 'ib0', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': > '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', > 'sampleTime': 1486090944.903051, 'name': 'lo', 'tx': '56174388', > 'txDropped': '0', 'rx': '56174388', 'rxErrors': '0', 'speed': '1000', > 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': > 1486090944.903051, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', > 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno1': {'txErrors': > '0', 'state': 'up', 'sampleTime': 1486090944.903051, 'name': 'eno1', 'tx': > '26032823', 'txDropped': '0', 'rx': '174722400', 'rxErrors': '0', 'speed': > '1000', 'rxDropped': '5624'}, ';vdsmdummy;': {'txErrors': '0', 'state': > 'down', 'sampleTime': 1486090944.903051, 'name': ';vdsmdummy;', 'tx': '0', > 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': > '0'}}, 'txDropped': '0', 'anonHugePages': '34', 'ksmPages': 100, > 'elapsedTime': '287.81', 'cpuLoad': '0.07', 'cpuSys': '0.00', 'diskStats': > {'/var/log': {'free': '15072'}, '/var/log/core': {'free': '15072'}, > '/var/run/vdsm/': {'free': '64418'}, '/tmp': {'free': '914756'}}, > 'cpuUserVdsmd': '0.13', 'netConfigDirty': 'True', 'memCommitted': 0, > 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 127200, > 'bootTime': '1486037670', 'haStats': {'active': False, 'configured': False, > 'score': 0, 'localMaintenance': False, 'globalMaintenance': False}, > 'momStatus': 'active', 'rxDropped': '5624', 'outgoingVmMigrations': 0, > 'swapTotal': 4095, 'swapFree': 4095, 'dateTime': '2017-02-03T03:02:27 GMT', > 'cpuUser': '0.02', 'memFree': 127456, 'cpuIdle': '99.98', 'vmActive': 0, > 'v2vJobs': {}, 'cpuSysVdsmd': '0.07'} > jsonrpc/6::INFO::2017-02-03 08:32:27,713::__init__::515::j > sonrpc.JsonRpcServer::(_serveRequest) RPC call Host.getStats succeeded > in 0.00 seconds > Reactor thread::INFO::2017-02-03 08:32:39,661::protocoldetector > ::72::ProtocolDetector.AcceptorImpl::(handle_accept) Accepted connection > from ::1:53084 > > supervdsm.log > > > File "/usr/share/vdsm/supervdsmServer", line 95, in wrapper > res = func(*args, **kwargs) > File "/usr/share/vdsm/supervdsmServer", line 143, in umount > timeout=timeout) > File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line > 281, in _umount > _runcmd(cmd, timeout) > File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line > 297, in _runcmd > raise MountError(rc, ";".join((out, err))) > MountError: (32, ';umount: /rhev/data-center/mnt/10.1.235.6:_iso: > mountpoint not found\n') > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:26:59,495::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call hbaRescan with () {} > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:26:59,495::commands::69::storage.HBA::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /usr/libexec/vdsm/fc-scan (cwd N > one) > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:26:59,579::supervdsmServer: > :100::SuperVdsm.ServerCallback::(wrapper) return hbaRescan with None > MainThread::DEBUG::2017-02-03 08:27:26,367::supervdsmServer::311::SuperVdsm.Server::(main) > Terminated normally > MainThread::DEBUG::2017-02-03 08:27:36,148::__init__::47::blivet::(register_device_format) > registered device format class DeviceFormat as None > MainThread::DEBUG::2017-02-03 08:27:36,149::__init__::47::blivet::(register_device_format) > registered device format class BIOSBoot as biosboot > MainThread::DEBUG::2017-02-03 08:27:36,150::__init__::47::blivet::(register_device_format) > registered device format class DiskLabel as disklabel > MainThread::DEBUG::2017-02-03 08:27:36,150::__init__::47::blivet::(register_device_format) > registered device format class DMRaidMember as dmraidmember > MainThread::DEBUG::2017-02-03 08:27:36,151::__init__::47::blivet::(register_device_format) > registered device format class Ext2FS as ext2 > MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) > registered device format class Ext3FS as ext3 > MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) > registered device format class Ext4FS as ext4 > MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) > registered device format class FATFS as vfat > MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) > registered device format class EFIFS as efi > MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) > registered device format class BTRFS as btrfs > MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) > registered device format class GFS2 as gfs2 > MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) > registered device format class JFS as jfs > MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) > registered device format class ReiserFS as reiserfs > MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) > registered device format class XFS as xfs > MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) > registered device format class HFS as hfs > MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) > registered device format class AppleBootstrapFS as appleboot > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class HFSPlus as hfs+ > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class MacEFIFS as macefi > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class NTFS as ntfs > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class NFS as nfs > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class NFSv4 as nfs4 > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class Iso9660FS as iso9660 > MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) > registered device format class NoDevFS as nodev > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class DevPtsFS as devpts > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class ProcFS as proc > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class SysFS as sysfs > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class TmpFS as tmpfs > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class BindFS as bind > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class SELinuxFS as selinuxfs > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class USBFS as usbfs > MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) > registered device format class EFIVarFS as efivarfs > MainThread::DEBUG::2017-02-03 08:27:36,179::__init__::47::blivet::(register_device_format) > registered device format class LUKS as luks > MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) > registered device format class LVMPhysicalVolume as lvmpv > MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) > registered device format class MDRaidMember as mdmember > MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) > registered device format class MultipathMember as multipath_member > MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) > registered device format class PPCPRePBoot as prepboot > MainThread::DEBUG::2017-02-03 08:27:36,182::__init__::47::blivet::(register_device_format) > registered device format class SwapSpace as swap > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::69::blivet::(log_exception_info) > IGNORED: Caught exception, continuing. > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::72::blivet::(log_exception_info) > IGNORED: Problem description: failed to get initiator name from > iscsi firmware > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::73::blivet::(log_exception_info) > IGNORED: Begin exception details. > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) > IGNORED: Traceback (most recent call last): > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) > IGNORED: File "/usr/lib/python2.7/site-packages/blivet > /iscsi.py", line 146, in __init__ > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) > IGNORED: initiatorname = libiscsi.get_firmware_initi > ator_name() > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) > IGNORED: IOError: Unknown error > MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::77::blivet::(log_exception_info) > IGNORED: End exception details. > MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::271::SuperVdsm.Server::(main) > Making sure I'm root - SuperVdsm > MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::280::SuperVdsm.Server::(main) > Parsing cmd args > MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::283::SuperVdsm.Server::(main) > Cleaning old socket /var/run/vdsm/svdsm.sock > MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::287::SuperVdsm.Server::(main) > Setting up keep alive thread > MainThread::DEBUG::2017-02-03 08:27:36,228::supervdsmServer::293::SuperVdsm.Server::(main) > Creating remote object manager > MainThread::DEBUG::2017-02-03 08:27:36,228::fileUtils::246::storage.fileUtils::(chown) > Changing owner for /var/run/vdsm/svdsm.sock, to (36:36) > MainThread::DEBUG::2017-02-03 08:27:36,228::supervdsmServer::303::SuperVdsm.Server::(main) > Started serving super vdsm object > sourceRoute::DEBUG::2017-02-03 08:27:36,229::sourceroutethrea > d::79::root::(_subscribeToInotifyLoop) sourceRouteThread.subscribeToInotifyLoop > started > restore-net::INFO::2017-02-03 08:27:37,160::vdsm-restore-net-config::465::root::(restore) > networks already restored. doing nothing. > MainProcess|hsm/init::DEBUG::2017-02-03 08:27:39,601::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call hbaRescan with () {} > MainProcess|hsm/init::DEBUG::2017-02-03 08:27:39,602::commands::69::storage.HBA::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /usr/libexec/vdsm/fc-scan (cwd No > ne) > MainProcess|hsm/init::DEBUG::2017-02-03 08:27:39,691::supervdsmServer: > :100::SuperVdsm.ServerCallback::(wrapper) return hbaRescan with None > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,355::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call network_caps with () {} > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,360::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /sbin/ip route show to 0.0.0.0/0 table > main (cwd None) > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,364::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,408::libvirtconnection::160::root::(get) > trying to connect libvirt > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,450::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /usr/sbin/tc qdisc show (cwd None) > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,453::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,454::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /bin/systemctl --no-pager list-unit-fil > es (cwd None) > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,530::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,530::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /bin/systemctl status openvswitch.servi > ce (cwd None) > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,561::commands::93::root::(execCmd) > FAILED: <err> = ''; <rc> = 3 > MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,561::supervdsmServer: > :100::SuperVdsm.ServerCallback::(wrapper) return network_caps with > {'bridges': {}, 'bo > ndings': {}, 'nameservers': ['10.1.1.8'], 'nics': {'ib0': > {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', 'dhcpv6': False, > 'ipv6addrs': [], 'mtu': '4 > 092', 'dhcpv4': False, 'netmask': '', 'ipv4defaultroute': False, > 'ipv4addrs': [], 'hwaddr': '80:00:02:08:fe:80:00:00:00:00 > :00:00:0c:c4:7a:ff:ff:0f:d8:85', 's > peed': 0, 'gateway': ''}, 'eno1': {'ipv6autoconf': False, 'addr': > '10.1.235.5', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': > '1500', 'dhcpv4 > ': False, 'netmask': '255.255.0.0', 'ipv4defaultroute': True, > 'ipv4addrs': ['10.1.235.5/16'], 'hwaddr': '0c:c4:7a:0f:6b:2a', 'speed': > 1000, 'gateway': '10.1. > 0.1'}, 'eno2': {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', > 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, > 'netmask': '', 'ipv4 > defaultroute': False, 'ipv4addrs': [], 'hwaddr': '0c:c4:7a:0f:6b:2b', > 'speed': 0, 'gateway': ''}}, 'supportsIPv6': True, 'vlans': {}, 'networks': > {}} > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,690::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call setupNetworks with ({}, > {u'connectivityC > heck': u'true', u'connectivityTimeout': 120}) {} > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,691::api::247::root::(setupNetworks) > Setting up network according to configuration: networks:{u'ovirtmgmt': > {u'ipv6autoconf': False, u'nic': u'eno1', u'ipaddr': u'10.1.235.5', > u'netmask': u'255.255.0.0', u'mtu': 1500, u'switch': u'ovs', u'dhcpv6': > False, u'STP': u'no', u'bridged': u'true', u'gateway': u'10.1.0.1', > u'defaultRoute': True}}, bondings:{}, options:{u'connectivityCheck': > u'true', u'connectivityTimeout': 120} > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,691::api::252::root::(setupNetworks) > Validating configuration > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,694::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /sbin/ip route show to 0.0.0.0/0 table > main (cwd None) > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,698::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,771::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /usr/sbin/tc qdisc show (cwd None) > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,774::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,774::vsctl::57::root::(commit) > Executing commands: /usr/bin/ovs-vsctl --oneline --format=json -- list > Bridge -- list Port -- list Interface > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,774::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /usr/bin/ovs-vsctl --oneline --format=json > -- list Bridge -- list Port -- list Interface (cwd None) > MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,807::commands::93::root::(execCmd) > FAILED: <err> = 'ovs-vsctl: unix:/var/run/openvswitch/db.sock: database > connection failed (No such file or directory)\n'; <rc> = 1 > MainProcess|jsonrpc/5::ERROR::2017-02-03 08:27:53,808::supervdsmServer: > :97::SuperVdsm.ServerCallback::(wrapper) Error in setupNetworks > Traceback (most recent call last): > File "/usr/share/vdsm/supervdsmServer", line 95, in wrapper > res = func(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 254, > in setupNetworks > netswitch.validate(networks, bondings) > File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch.py", > line 121, in validate > ovs_switch.validate_network_setup(ovs_nets, ovs_bonds) > File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/switch.py", > line 40, in validate_network_setup > ovs_networks = info.create_netinfo(info.OvsInfo())['networks'] > File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/info.py", line > 73, in __init__ > ovs_db = OvsDB(driver.create()) > File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/info.py", line > 64, in __init__ > transaction.add(ifaces_command) > File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/driver/__init__.py", > line 54, in __exit__ > self.result = self.commit() > File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/driver/vsctl.py", > line 63, in commit > 'Executing commands failed: %s' % '\n'.join(err)) > ConfigNetworkError: (21, 'Executing commands failed: ovs-vsctl: > unix:/var/run/openvswitch/db.sock: database connection failed (No such > file or directory)') > MainProcess|Thread-2::DEBUG::2017-02-03 08:27:54,440::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call ksmTune with () {} > MainProcess|Thread-2::DEBUG::2017-02-03 08:27:54,440::supervdsmServer: > :100::SuperVdsm.ServerCallback::(wrapper) return ksmTune with None > MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:00,918::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call network_caps with () {} > MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:00,922::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /sbin/ip route show to 0.0.0.0/0 table > main (cwd None) > MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:00,927::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:01,013::commands::69::root::(execCmd) > /usr/bin/taskset --cpu-list 0-47 /usr/sbin/tc qdisc show (cwd None) > MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:01,016::commands::93::root::(execCmd) > SUCCESS: <err> = ''; <rc> = 0 > MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:01,017::supervdsmServer: > :100::SuperVdsm.ServerCallback::(wrapper) return network_caps with > {'bridges': {}, 'bondings': {}, 'nameservers': ['10.1.1.8'], 'nics': > {'ib0': {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', 'dhcpv6': > False, 'ipv6addrs': [], 'mtu': '4092', 'dhcpv4': False, 'netmask': '', > 'ipv4defaultroute': False, 'ipv4addrs': [], 'hwaddr': > '80:00:02:08:fe:80:00:00:00:00:00:00:0c:c4:7a:ff:ff:0f:d8:85', 'speed': > 0, 'gateway': ''}, 'eno1': {'ipv6autoconf': False, 'addr': '10.1.235.5', > 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', > 'dhcpv4': False, 'netmask': '255.255.0.0', 'ipv4defaultroute': True, > 'ipv4addrs': ['10.1.235.5/16'], 'hwaddr': '0c:c4:7a:0f:6b:2a', 'speed': > 1000, 'gateway': '10.1.0.1'}, 'eno2': {'ipv6autoconf': True, 'addr': '', > 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', > 'dhcpv4': False, 'netmask': '', 'ipv4defaultroute': False, 'ipv4addrs': [], > 'hwaddr': '0c:c4:7a:0f:6b:2b', 'speed': 0, 'gateway': ''}}, 'supportsIPv6': > True, 'vlans': {}, 'networks': {}} > MainProcess|jsonrpc/1::DEBUG::2017-02-03 08:30:01,036::supervdsmServer: > :93::SuperVdsm.ServerCallback::(wrapper) call getHardwareInfo with () {} > MainProcess|jsonrpc/1::DEBUG::2017-02-03 08:30:01,066::supervdsmServer: > :100::SuperVdsm.ServerCallback::(wrapper) return getHardwareInfo with > {'systemProductName': 'X9DRT', 'systemSerialNumber': '0123456789', > 'systemFamily': 'To be filled by O.E.M.', 'systemVersion': '0123456789', > 'systemUUID': '00000000-0000-0000-0000-0CC47A0F6B2A', > 'systemManufacturer': 'Supermicro'} > (END) > > > > On Fri, Feb 3, 2017 at 12:05 AM, Edward Haas <ehaas(a)redhat.com&gt; wrote: > >> Hello Shalabh, >> >> Please provide the logs from your node: >> - messages >> - vdsm/vdsm.log, vdsm/supervdsm.log >> >> It may be that you are missing openvswitch installed, although VDSM >> should not require it for its operation. >> >> Thanks, >> Edy. >> >> >> On Thu, Feb 2, 2017 at 2:10 PM, Shalabh Goel <shalabhgoel13(a)gmail.com&gt; >> wrote: >> >>> HI, >>> >>> I am getting the following error on my node after rebooting it. >>> >>> VDSM ovirtnode2 command HostSetupNetworksVDS failed: Executing commands >>> failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database >>> connection failed (No such file or directory) >>> >>> >>> To solve this, I am trying to restart ovsdb-server using the following >>> command, >>> >>> ovsdb-server --remote=punix:*/var/run/openvswitch/db.sock* >>> --remote=db:Open_vSwitch,Open_vSwitch,manager_options >>> --private-key=db:Open_vSwitch,SSL,private_key--certificate=db:Open_vSwitch,SSL,certificate >>> --bootstrap-ca-cert=db:Open_vSwitch,SSL,ca_cert --pidfile --detach >>> >>> But I am getting the following error. >>> >>> ovsdb-server: /var/run/openvswitch/ovsdb-server.pid.tmp: create failed >>> (No such file or directory) >>> >>> How to restart the ovsdb-server?? Also ovirtmgmt network is missing >>> from my node. It happened after I rebooted my node after it got upgraded to >>> Ovirt 4.1 >>> >>> -- >>> Shalabh Goel >>> >>> _______________________________________________ >>> Users mailing list >>> Users(a)ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> >>> >> > > > -- > Shalabh Goel >