Please package the logs (tar or zip) and send them.On Mon, Feb 6, 2017 at 12:05 PM, Shalabh Goel <shalabhgoel13@gmail.com> wrote:What should I do now?I am attaching OVS switch logs below:Yes, I am using OVS as the switch type and I did not know that it was not supported officially.The output of ovs-vsctl show is as follows:
f634d53e-4849-488b-8454-6b1fafa7c6ac
ovs_version: "2.6.90"
/var/log/openvswitch/ovsdb-server.log
2017-02-06T09:46:07.788Z|00001|vlog|INFO|opened log file /var/log/openvswitch/ovsdb-ser ver.log
2017-02-06T09:46:07.791Z|00002|ovsdb_server|INFO|ovsdb-serve r (Open vSwitch) 2.6.90
2017-02-06T09:46:17.802Z|00003|memory|INFO|2296 kB peak resident set size after 10.0 seconds
2017-02-06T09:46:17.802Z|00004|memory|INFO|cells:16 json-caches:1 monitors:1 sessions:1
ovs-vswitchd.log
2017-02-06T09:46:07.999Z|00001|vlog|INFO|opened log file /var/log/openvswitch/ovs-vswit chd.log
2017-02-06T09:46:08.036Z|00002|ovs_numa|INFO|Discovered 24 CPU cores on NUMA node 0
2017-02-06T09:46:08.036Z|00003|ovs_numa|INFO|Discovered 24 CPU cores on NUMA node 1
2017-02-06T09:46:08.036Z|00004|ovs_numa|INFO|Discovered 2 NUMA nodes and 48 CPU cores
2017-02-06T09:46:08.037Z|00005|reconnect|INFO|unix:/var/run/ openvswitch/db.sock: connecting...
2017-02-06T09:46:08.037Z|00006|reconnect|INFO|unix:/var/run/ openvswitch/db.sock: connected
2017-02-06T09:46:08.039Z|00007|bridge|INFO|ovs-vswitchd (Open vSwitch) 2.6.90
The engine says that "Host host2 does not comply with the cluster Default networks, the following networks are missing on host: 'ovirtmgmt'"What other logs should I attach?ThanksShalabh Goel--On Sun, Feb 5, 2017 at 1:10 PM, Edward Haas <ehaas@redhat.com> wrote:Edy.Based on what I can see, you used OVS as the switch type and it seems ovs (openvswitch) is not properly installed on your host.Thanks,
Make sure that you have ovs operational by issuing "ovs-vsctl show".
You should note that OVS network support is not an official release feature, and you should use it on 4.1 and up versions.
Fixes will be probably submitted to master (appearing in nightly builds).
Next time please include the mailing-list in your replies and attach the log files, it is less spamming.On Fri, Feb 3, 2017 at 5:07 AM, Shalabh Goel <shalabhgoel13@gmail.com> wrote:supervdsm.loglog from messagesLog from vdsm.log
Feb 3 08:27:53 ovirtnode3 ovs-vsctl: ovs|00001|db_ctl_base|ERR|unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)
Feb 3 08:27:53 ovirtnode3 journal: vdsm vds ERROR Executing commands failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No su
ch file or directory)#012Traceback (most recent call last):#012 File "/usr/share/vdsm/API.py", line 1531, in setupNetworks#012 supervdsm.getProxy().setup
Networks(networks, bondings, options)#012 File "/usr/lib/python2.7/site-packages/vdsm/supervdsm.py", line 53, in __call__#012 return callMethod()#012 Fi
le "/usr/lib/python2.7/site-packages/vdsm/supervdsm.py", line 51, in <lambda>#012 **kwargs)#012 File "<string>", line 2, in setupNetworks#012 File "/usr
/lib64/python2.7/multiprocessing/managers.py", line 773, in _callmethod#012 raise convert_to_error(kind, result)#012ConfigNetworkError: (21, 'Executing co
mmands failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)')
Reactor thread::INFO::2017-02-03 08:32:24,638::protocoldetector::72::ProtocolDetector.Accepto rImpl::(handle_accept) Accepted connection from ::1:53082
Reactor thread::DEBUG::2017-02-03 08:32:24,643::protocoldetector::91::ProtocolDetector.Detecto r::(__init__) Using required_size=11
Reactor thread::INFO::2017-02-03 08:32:24,643::protocoldetector::127::ProtocolDetector.Detect or::(handle_read) Detected protocol xml from ::1:53082
Reactor thread::DEBUG::2017-02-03 08:32:24,643::bindingxmlrpc::1317::XmlDetector::(handle_sock et) xml over http detected from ('::1', 53082)
BindingXMLRPC::INFO::2017-02-03 08:32:24,643::xmlrpc::73::vds. XMLRPCServer::(handle_request) Starting request handler for ::1:53082
Thread-20::INFO::2017-02-03 08:32:24,644::xmlrpc::83::vds.XMLRPCServer::(_process_reques ts) Request handler for ::1:53082 started
Thread-20::DEBUG::2017-02-03 08:32:24,644::bindingxmlrpc::1263::vds::(wrapper) client [::1]::call getAllVmStats with () {}
Thread-20::DEBUG::2017-02-03 08:32:24,644::bindingxmlrpc::1270::vds::(wrapper) return getAllVmStats with {'status': {'message': 'Done', 'code': 0}, 'statsLis
t': (suppressed)}
Thread-20::INFO::2017-02-03 08:32:24,644::bindingxmlrpc::1297::vds::(wrapper) RPC call getAllVmStats finished (code=0) in 0.00 seconds
Thread-20::INFO::2017-02-03 08:32:24,645::xmlrpc::91::vds.XMLRPCServer::(_process_reques ts) Request handler for ::1:53082 stopped
periodic/0::DEBUG::2017-02-03 08:32:24,907::sampling::508::virt.sampling.VMBulkSampler::(_ _call__) sampled timestamp 4347942.15 elapsed 0.010 acquired True d
omains all
periodic/2::DEBUG::2017-02-03 08:32:24,908::task::599::storage.TaskManager.Task::(_updateS tate) (Task='bb07f89c-6165-42bc-902f -1b7701b813fa') moving from sta
te init -> state preparing
periodic/2::INFO::2017-02-03 08:32:24,908::logUtils::49::dispatcher::(wrapper) Run and protect: repoStats(options=None)
periodic/2::INFO::2017-02-03 08:32:24,908::logUtils::52::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
periodic/2::DEBUG::2017-02-03 08:32:24,909::task::1195::storage.TaskManager.Task::(prepare ) (Task='bb07f89c-6165-42bc-902f -1b7701b813fa') finished: {}
periodic/2::DEBUG::2017-02-03 08:32:24,909::task::599::storage.TaskManager.Task::(_updateS tate) (Task='bb07f89c-6165-42bc-902f -1b7701b813fa') moving from sta
te preparing -> state finished
periodic/2::DEBUG::2017-02-03 08:32:24,909::resourceManager::910::storage.ResourceManager. Owner::(releaseAll) Owner.releaseAll requests {} resources {}
periodic/2::DEBUG::2017-02-03 08:32:24,909::resourceManager::947::storage.ResourceManager. Owner::(cancelAll) Owner.cancelAll requests {}
periodic/2::DEBUG::2017-02-03 08:32:24,909::task::997::storage.TaskManager.Task::(_decref) (Task='bb07f89c-6165-42bc-902f -1b7701b813fa') ref 0 aborting False
jsonrpc/4::DEBUG::2017-02-03 08:32:26,653::__init__::532::jsonrpc.JsonRpcServer::(_handle _request) Calling 'Host.getAllVmStats' in bridge with {}
jsonrpc/4::DEBUG::2017-02-03 08:32:26,653::__init__::557::jsonrpc.JsonRpcServer::(_handle _request) Return 'Host.getAllVmStats' in bridge with (suppressed)
jsonrpc/4::INFO::2017-02-03 08:32:26,653::__init__::515::jsonrpc.JsonRpcServer::(_serveR equest) RPC call Host.getAllVmStats succeeded in 0.00 seconds
jsonrpc/6::DEBUG::2017-02-03 08:32:27,706::__init__::532::jsonrpc.JsonRpcServer::(_handle _request) Calling 'Host.getStats' in bridge with {}
jsonrpc/6::DEBUG::2017-02-03 08:32:27,706::__init__::532::jsonrpc.JsonRpcServer::(_handle _request) Calling 'Host.getStats' in bridge with {}
jsonrpc/6::DEBUG::2017-02-03 08:32:27,707::task::599::storage.TaskManager.Task::(_updateS tate) (Task='9285329e-485b-4165-8bdc -4f411f394356') moving from state init -> state preparing
jsonrpc/6::INFO::2017-02-03 08:32:27,707::logUtils::49::dispatcher::(wrapper) Run and protect: repoStats(options=None)
jsonrpc/6::INFO::2017-02-03 08:32:27,707::logUtils::52::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
jsonrpc/6::DEBUG::2017-02-03 08:32:27,707::task::1195::storage.TaskManager.Task::(prepare ) (Task='9285329e-485b-4165-8bdc -4f411f394356') finished: {}
jsonrpc/6::DEBUG::2017-02-03 08:32:27,707::task::599::storage.TaskManager.Task::(_updateS tate) (Task='9285329e-485b-4165-8bdc -4f411f394356') moving from state preparing -> state finished
jsonrpc/6::DEBUG::2017-02-03 08:32:27,708::resourceManager::910::storage.ResourceManager. Owner::(releaseAll) Owner.releaseAll requests {} resources {}
jsonrpc/6::DEBUG::2017-02-03 08:32:27,708::resourceManager::947::storage.ResourceManager. Owner::(cancelAll) Owner.cancelAll requests {}
jsonrpc/6::DEBUG::2017-02-03 08:32:27,708::task::997::storage.TaskManager.Task::(_decref) (Task='9285329e-485b-4165-8bdc -4f411f394356') ref 0 aborting False
jsonrpc/6::DEBUG::2017-02-03 08:32:27,712::__init__::557::jsonrpc.JsonRpcServer::(_handle _request) Return 'Host.getStats' in bridge with {'cpuStatistics': {'28': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.87'}, '29': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '24': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '25': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, '26': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '27': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '20': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '21': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '22': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '23': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '46': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '47': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '44': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '45': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '42': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '43': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '40': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '41': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '1': {'cpuUser': '0.13', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.80'}, '0': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '3': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.86'}, '2': {'cpuUser': '0.07', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.93'}, '5': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '4': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.07', 'cpuIdle': '99.93'}, '7': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '6': {'cpuUser': '0.20', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '99.80'}, '9': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '8': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '39': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '38': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '11': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '10': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '13': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '12': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '15': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '14': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '17': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '16': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '19': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '18': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '31': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '30': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '37': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '36': {'cpuUser': '0.00', 'nodeIndex': 1, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '35': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '34': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '33': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}, '32': {'cpuUser': '0.00', 'nodeIndex': 0, 'cpuSys': '0.00', 'cpuIdle': '100.00'}}, 'numaNodeMemFree': {'1': {'memPercent': 3, 'memFree': '63780'}, '0': {'memPercent': 4, 'memFree': '63426'}}, 'memShared': 0, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 0, 'memUsed': '2', 'storageDomains': {}, 'incomingVmMigrations': 0, 'network': {'ib0': {'txErrors': '0', 'state': 'down', 'sampleTime': 1486090944.903051, 'name': 'ib0', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1486090944.903051, 'name': 'lo', 'tx': '56174388', 'txDropped': '0', 'rx': '56174388', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno2': {'txErrors': '0', 'state': 'down', 'sampleTime': 1486090944.903051, 'name': 'eno2', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'eno1': {'txErrors': '0', 'state': 'up', 'sampleTime': 1486090944.903051, 'name': 'eno1', 'tx': '26032823', 'txDropped': '0', 'rx': '174722400', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '5624'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1486090944.903051, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '34', 'ksmPages': 100, 'elapsedTime': '287.81', 'cpuLoad': '0.07', 'cpuSys': '0.00', 'diskStats': {'/var/log': {'free': '15072'}, '/var/log/core': {'free': '15072'}, '/var/run/vdsm/': {'free': '64418'}, '/tmp': {'free': '914756'}}, 'cpuUserVdsmd': '0.13', 'netConfigDirty': 'True', 'memCommitted': 0, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 127200, 'bootTime': '1486037670', 'haStats': {'active': False, 'configured': False, 'score': 0, 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': 'active', 'rxDropped': '5624', 'outgoingVmMigrations': 0, 'swapTotal': 4095, 'swapFree': 4095, 'dateTime': '2017-02-03T03:02:27 GMT', 'cpuUser': '0.02', 'memFree': 127456, 'cpuIdle': '99.98', 'vmActive': 0, 'v2vJobs': {}, 'cpuSysVdsmd': '0.07'}
jsonrpc/6::INFO::2017-02-03 08:32:27,713::__init__::515::jsonrpc.JsonRpcServer::(_serveR equest) RPC call Host.getStats succeeded in 0.00 seconds
Reactor thread::INFO::2017-02-03 08:32:39,661::protocoldetector::72::ProtocolDetector.Accepto rImpl::(handle_accept) Accepted connection from ::1:53084
File "/usr/share/vdsm/supervdsmServer", line 95, in wrapper
res = func(*args, **kwargs)
File "/usr/share/vdsm/supervdsmServer", line 143, in umount
timeout=timeout)
File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 281, in _umount
_runcmd(cmd, timeout)
File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 297, in _runcmd
raise MountError(rc, ";".join((out, err)))
MountError: (32, ';umount: /rhev/data-center/mnt/10.1.235.6:_iso: mountpoint not found\n')
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:26:59,495::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call hbaRescan with () {}
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:26:59,495::commands::69::st orage.HBA::(execCmd) /usr/bin/taskset --cpu-list 0-47 /usr/libexec/vdsm/fc-scan (cwd N
one)
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:26:59,579::supervdsmServer: :100::SuperVdsm.ServerCallback ::(wrapper) return hbaRescan with None
MainThread::DEBUG::2017-02-03 08:27:26,367::supervdsmServer::311::SuperVdsm.Server::(main) Terminated normally
MainThread::DEBUG::2017-02-03 08:27:36,148::__init__::47::blivet::(register_device_format) registered device format class DeviceFormat as None
MainThread::DEBUG::2017-02-03 08:27:36,149::__init__::47::blivet::(register_device_format) registered device format class BIOSBoot as biosboot
MainThread::DEBUG::2017-02-03 08:27:36,150::__init__::47::blivet::(register_device_format) registered device format class DiskLabel as disklabel
MainThread::DEBUG::2017-02-03 08:27:36,150::__init__::47::blivet::(register_device_format) registered device format class DMRaidMember as dmraidmember
MainThread::DEBUG::2017-02-03 08:27:36,151::__init__::47::blivet::(register_device_format) registered device format class Ext2FS as ext2
MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) registered device format class Ext3FS as ext3
MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) registered device format class Ext4FS as ext4
MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) registered device format class FATFS as vfat
MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) registered device format class EFIFS as efi
MainThread::DEBUG::2017-02-03 08:27:36,152::__init__::47::blivet::(register_device_format) registered device format class BTRFS as btrfs
MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) registered device format class GFS2 as gfs2
MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) registered device format class JFS as jfs
MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) registered device format class ReiserFS as reiserfs
MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) registered device format class XFS as xfs
MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) registered device format class HFS as hfs
MainThread::DEBUG::2017-02-03 08:27:36,153::__init__::47::blivet::(register_device_format) registered device format class AppleBootstrapFS as appleboot
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class HFSPlus as hfs+
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class MacEFIFS as macefi
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class NTFS as ntfs
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class NFS as nfs
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class NFSv4 as nfs4
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class Iso9660FS as iso9660
MainThread::DEBUG::2017-02-03 08:27:36,154::__init__::47::blivet::(register_device_format) registered device format class NoDevFS as nodev
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class DevPtsFS as devpts
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class ProcFS as proc
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class SysFS as sysfs
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class TmpFS as tmpfs
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class BindFS as bind
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class SELinuxFS as selinuxfs
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class USBFS as usbfs
MainThread::DEBUG::2017-02-03 08:27:36,155::__init__::47::blivet::(register_device_format) registered device format class EFIVarFS as efivarfs
MainThread::DEBUG::2017-02-03 08:27:36,179::__init__::47::blivet::(register_device_format) registered device format class LUKS as luks
MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) registered device format class LVMPhysicalVolume as lvmpv
MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) registered device format class MDRaidMember as mdmember
MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) registered device format class MultipathMember as multipath_member
MainThread::DEBUG::2017-02-03 08:27:36,181::__init__::47::blivet::(register_device_format) registered device format class PPCPRePBoot as prepboot
MainThread::DEBUG::2017-02-03 08:27:36,182::__init__::47::blivet::(register_device_format) registered device format class SwapSpace as swap
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::69::blivet::(log_exception_info) IGNORED: Caught exception, continuing.
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::72::blivet::(log_exception_info) IGNORED: Problem description: failed to get initiator name from iscsi firmware
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::73::blivet::(log_exception_info) IGNORED: Begin exception details.
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) IGNORED: Traceback (most recent call last):
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) IGNORED: File "/usr/lib/python2.7/site-packa ges/blivet
/iscsi.py", line 146, in __init__
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) IGNORED: initiatorname = libiscsi.get_firmware_initi
ator_name()
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::76::blivet::(log_exception_info) IGNORED: IOError: Unknown error
MainThread::DEBUG::2017-02-03 08:27:36,216::storage_log::77::blivet::(log_exception_info) IGNORED: End exception details.
MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::271::SuperVdsm.Server::(main) Making sure I'm root - SuperVdsm
MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::280::SuperVdsm.Server::(main) Parsing cmd args
MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::283::SuperVdsm.Server::(main) Cleaning old socket /var/run/vdsm/svdsm.sock
MainThread::DEBUG::2017-02-03 08:27:36,227::supervdsmServer::287::SuperVdsm.Server::(main) Setting up keep alive thread
MainThread::DEBUG::2017-02-03 08:27:36,228::supervdsmServer::293::SuperVdsm.Server::(main) Creating remote object manager
MainThread::DEBUG::2017-02-03 08:27:36,228::fileUtils::246::storage.fileUtils::(chown) Changing owner for /var/run/vdsm/svdsm.sock, to (36:36)
MainThread::DEBUG::2017-02-03 08:27:36,228::supervdsmServer::303::SuperVdsm.Server::(main) Started serving super vdsm object
sourceRoute::DEBUG::2017-02-03 08:27:36,229::sourceroutethread::79::root::(_subscribeToInot ifyLoop) sourceRouteThread.subscribeToI notifyLoop started
restore-net::INFO::2017-02-03 08:27:37,160::vdsm-restore-net-config::465::root::(restore) networks already restored. doing nothing.
MainProcess|hsm/init::DEBUG::2017-02-03 08:27:39,601::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call hbaRescan with () {}
MainProcess|hsm/init::DEBUG::2017-02-03 08:27:39,602::commands::69::st orage.HBA::(execCmd) /usr/bin/taskset --cpu-list 0-47 /usr/libexec/vdsm/fc-scan (cwd No
ne)
MainProcess|hsm/init::DEBUG::2017-02-03 08:27:39,691::supervdsmServer: :100::SuperVdsm.ServerCallback ::(wrapper) return hbaRescan with None
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,355::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call network_caps with () {}
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,360::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /sbin/ip route show to 0.0.0.0/0 table
main (cwd None)
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,364::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,408::libvirtconnectio n::160::root::(get) trying to connect libvirt
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,450::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /usr/sbin/tc qdisc show (cwd None)
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,453::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,454::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /bin/systemctl --no-pager list-unit-fil
es (cwd None)
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,530::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,530::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /bin/systemctl status openvswitch.servi
ce (cwd None)
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,561::commands::93::ro ot::(execCmd) FAILED: <err> = ''; <rc> = 3
MainProcess|jsonrpc/4::DEBUG::2017-02-03 08:27:48,561::supervdsmServer: :100::SuperVdsm.ServerCallback ::(wrapper) return network_caps with {'bridges': {}, 'bo
ndings': {}, 'nameservers': ['10.1.1.8'], 'nics': {'ib0': {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '4
092', 'dhcpv4': False, 'netmask': '', 'ipv4defaultroute': False, 'ipv4addrs': [], 'hwaddr': '80:00:02:08:fe:80:00:00:00:00:00:00:0c:c4:7a:ff:ff:0f:d8:85 ', 's
peed': 0, 'gateway': ''}, 'eno1': {'ipv6autoconf': False, 'addr': '10.1.235.5', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4
': False, 'netmask': '255.255.0.0', 'ipv4defaultroute': True, 'ipv4addrs': ['10.1.235.5/16'], 'hwaddr': '0c:c4:7a:0f:6b:2a', 'speed': 1000, 'gateway': '10.1.
0.1'}, 'eno2': {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'ipv4
defaultroute': False, 'ipv4addrs': [], 'hwaddr': '0c:c4:7a:0f:6b:2b', 'speed': 0, 'gateway': ''}}, 'supportsIPv6': True, 'vlans': {}, 'networks': {}}
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,690::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call setupNetworks with ({}, {u'connectivityC
heck': u'true', u'connectivityTimeout': 120}) {}
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,691::api::247::root:: (setupNetworks) Setting up network according to configuration: networks:{u'ovirtmgmt': {u'ipv6autoconf': False, u'nic': u'eno1', u'ipaddr': u'10.1.235.5', u'netmask': u'255.255.0.0', u'mtu': 1500, u'switch': u'ovs', u'dhcpv6': False, u'STP': u'no', u'bridged': u'true', u'gateway': u'10.1.0.1', u'defaultRoute': True}}, bondings:{}, options:{u'connectivityCheck': u'true', u'connectivityTimeout': 120}
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,691::api::252::root:: (setupNetworks) Validating configuration
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,694::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /sbin/ip route show to 0.0.0.0/0 table main (cwd None)
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,698::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,771::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /usr/sbin/tc qdisc show (cwd None)
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,774::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,774::vsctl::57::root: :(commit) Executing commands: /usr/bin/ovs-vsctl --oneline --format=json -- list Bridge -- list Port -- list Interface
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,774::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /usr/bin/ovs-vsctl --oneline --format=json -- list Bridge -- list Port -- list Interface (cwd None)
MainProcess|jsonrpc/5::DEBUG::2017-02-03 08:27:53,807::commands::93::ro ot::(execCmd) FAILED: <err> = 'ovs-vsctl: unix:/var/run/openvswitch/db.s ock: database connection failed (No such file or directory)\n'; <rc> = 1
MainProcess|jsonrpc/5::ERROR::2017-02-03 08:27:53,808::supervdsmServer: :97::SuperVdsm.ServerCallback: :(wrapper) Error in setupNetworks
Traceback (most recent call last):
File "/usr/share/vdsm/supervdsmServer", line 95, in wrapper
res = func(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 254, in setupNetworks
netswitch.validate(networks, bondings)
File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch.py" , line 121, in validate
ovs_switch.validate_network_setup(ovs_nets, ovs_bonds)
File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/switch.py ", line 40, in validate_network_setup
ovs_networks = info.create_netinfo(info.OvsInfo())['networks']
File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/info.py", line 73, in __init__
ovs_db = OvsDB(driver.create())
File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/info.py", line 64, in __init__
transaction.add(ifaces_command)
File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/driver/__ init__.py", line 54, in __exit__
self.result = self.commit()
File "/usr/lib/python2.7/site-packages/vdsm/network/ovs/driver/vs ctl.py", line 63, in commit
'Executing commands failed: %s' % '\n'.join(err))
ConfigNetworkError: (21, 'Executing commands failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)')
MainProcess|Thread-2::DEBUG::2017-02-03 08:27:54,440::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call ksmTune with () {}
MainProcess|Thread-2::DEBUG::2017-02-03 08:27:54,440::supervdsmServer: :100::SuperVdsm.ServerCallback ::(wrapper) return ksmTune with None
MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:00,918::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call network_caps with () {}
MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:00,922::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /sbin/ip route show to 0.0.0.0/0 table main (cwd None)
MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:00,927::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:01,013::commands::69::ro ot::(execCmd) /usr/bin/taskset --cpu-list 0-47 /usr/sbin/tc qdisc show (cwd None)
MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:01,016::commands::93::ro ot::(execCmd) SUCCESS: <err> = ''; <rc> = 0
MainProcess|jsonrpc/0::DEBUG::2017-02-03 08:30:01,017::supervdsmServer: :100::SuperVdsm.ServerCallback ::(wrapper) return network_caps with {'bridges': {}, 'bondings': {}, 'nameservers': ['10.1.1.8'], 'nics': {'ib0': {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '4092', 'dhcpv4': False, 'netmask': '', 'ipv4defaultroute': False, 'ipv4addrs': [], 'hwaddr': '80:00:02:08:fe:80:00:00:00:00 :00:00:0c:c4:7a:ff:ff:0f:d8:85 ', 'speed': 0, 'gateway': ''}, 'eno1': {'ipv6autoconf': False, 'addr': '10.1.235.5', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '255.255.0.0', 'ipv4defaultroute': True, 'ipv4addrs': ['10.1.235.5/16'], 'hwaddr': '0c:c4:7a:0f:6b:2a', 'speed': 1000, 'gateway': '10.1.0.1'}, 'eno2': {'ipv6autoconf': True, 'addr': '', 'ipv6gateway': '::', 'dhcpv6': False, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'ipv4defaultroute': False, 'ipv4addrs': [], 'hwaddr': '0c:c4:7a:0f:6b:2b', 'speed': 0, 'gateway': ''}}, 'supportsIPv6': True, 'vlans': {}, 'networks': {}}
MainProcess|jsonrpc/1::DEBUG::2017-02-03 08:30:01,036::supervdsmServer: :93::SuperVdsm.ServerCallback: :(wrapper) call getHardwareInfo with () {}
MainProcess|jsonrpc/1::DEBUG::2017-02-03 08:30:01,066::supervdsmServer: :100::SuperVdsm.ServerCallback ::(wrapper) return getHardwareInfo with {'systemProductName': 'X9DRT', 'systemSerialNumber': '0123456789', 'systemFamily': 'To be filled by O.E.M.', 'systemVersion': '0123456789', 'systemUUID': '00000000-0000-0000-0000-0CC47 A0F6B2A', 'systemManufacturer': 'Supermicro'}
(END)--On Fri, Feb 3, 2017 at 12:05 AM, Edward Haas <ehaas@redhat.com> wrote:It may be that you are missing openvswitch installed, although VDSM should not require it for its operation.- vdsm/vdsm.log, vdsm/supervdsm.log- messagesHello Shalabh,Please provide the logs from your node:Thanks,Edy.On Thu, Feb 2, 2017 at 2:10 PM, Shalabh Goel <shalabhgoel13@gmail.com> wrote:______________________________HI,I am getting the following error on my node after rebooting it.
VDSM ovirtnode2 command HostSetupNetworksVDS failed: Executing commands failed: ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory) To solve this, I am trying to restart ovsdb-server using the following command,
ovsdb-server --remote=punix:*/var/run/openvswitch/db.sock* --remote=db:Open_vSwitch,Open_ vSwitch,manager_options --private-key=db:Open_vSwitch, SSL,private_key--certificate=d b:Open_vSwitch,SSL,certificate --bootstrap-ca-cert=db:Open_vS witch,SSL,ca_cert --pidfile --detach But I am getting the following error.
ovsdb-server: /var/run/openvswitch/ovsdb-server.pid.tmp: create failed (No such file or directory) How to restart the ovsdb-server?? Also ovirtmgmt network is missing from my node. It happened after I rebooted my node after it got upgraded to Ovirt 4.1
--Shalabh Goel_________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
Shalabh GoelShalabh Goel