[Users] vdsm/engine do not like Infiniband

Thu Sep 13 23:49:15 UTC 2012

Yes you are right there is a known issue with the mac address length in IB cards. IIRC there was a hardware vendor who was working on a patch to extend the length and add the appropriate validation.

Dead Horse <deadhorseconsulting at gmail.com> wrote:

When attempting to activate/add a host with Infiniband cards present:

vdsm.log
Thread-14::DEBUG::2012-09-13
16:16:29,306::BindingXMLRPC::884::vds::(wrapper) return getCapabilities
with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory':
{'iSCSI': [{'InitiatorName': 'iqn.2012-09.net.azeroth:kezan'}], 'FC': []},
'packages2': {'kernel': {'release': '200.29.3.el6uek.x86_64', 'buildtime':
1346177011.0, 'version': '2.6.39'}, 'spice-server': {'release': '10.el6',
'buildtime': 1340343617L, 'version': '0.10.1'}, 'vdsm': {'release':
'435.el6', 'buildtime': 1347508928L, 'version': '4.10.0'}, 'qemu-kvm':
{'release': '2.295.el6_3.2', 'buildtime': 1346867328L, 'version':
'0.12.1.2'}, 'libvirt': {'release': '21.el6_3.4', 'buildtime': 1345740034L,
'version': '0.9.10'}, 'qemu-img': {'release': '2.295.el6_3.2', 'buildtime':
1346867328L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R)
CPU           E5540  @ 2.53GHz', 'hooks': {}, 'vmTypes': ['kvm'],
'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface':
'ovirtmgmt', 'addr': '3.57.111.31', 'cfg': {'IPV6INIT': 'no', 'IPADDR':
'3.57.111.31', 'DELAY': '0', 'PREFIX': '22', 'BOOTPROTO': 'none', 'STP':
'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'mtu':
'1500', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True,
'gateway': '0.0.0.0', 'ports': ['bond2']}, 'maelstrom': {'iface':
'maelstrom', 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DELAY': '0',
'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'maelstrom', 'TYPE': 'Bridge',
'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'stp': 'off', 'bridged':
True, 'gateway': '0.0.0.0', 'ports': ['bond0']}, 'twistingnether':
{'iface': 'twistingnether', 'addr': '3.70.204.31', 'cfg': {'IPV6INIT':
'no', 'IPADDR': '3.70.204.31', 'DELAY': '0', 'PREFIX': '22', 'BOOTPROTO':
'none', 'STP': 'off', 'DEVICE': 'twistingnether', 'TYPE': 'Bridge',
'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off',
'bridged': True, 'gateway': '3.70.204.254', 'ports': ['bond1']}},
'bridges': {'ovirtmgmt': {'addr': '3.57.111.31', 'cfg': {'IPV6INIT': 'no',
'IPADDR': '3.57.111.31', 'DELAY': '0', 'PREFIX': '22', 'BOOTPROTO': 'none',
'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'},
'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ports':
['bond2']}, 'maelstrom': {'addr': '', 'cfg': {'IPV6INIT': 'no', 'DELAY':
'0', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'maelstrom', 'TYPE':
'Bridge', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'stp': 'off',
'ports': ['bond0']}, 'twistingnether': {'addr': '3.70.204.31', 'cfg':
{'IPV6INIT': 'no', 'IPADDR': '3.70.204.31', 'DELAY': '0', 'PREFIX': '22',
'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'twistingnether', 'TYPE':
'Bridge', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '255.255.252.0',
'stp': 'off', 'ports': ['bond1']}}, 'uuid':
'FF200008-FFFF-FFFF-FFFF-00212883CE4C_00:15:17:00:10:0a',
'lastClientIface': 'twistingnether', 'nics': {'ib0': {'addr':
'192.168.1.1', 'cfg': {'IPV6INIT': 'no', 'IPADDR': '192.168.1.1', 'MTU':
'65520', 'PREFIX': '16', 'BOOTPROTO': 'none', 'CONNECTED_MODE': 'yes',
'DEVICE': 'ib0', 'TYPE': 'Infiniband', 'ONBOOT': 'yes'}, 'mtu': '65520',
'netmask': '255.255.0.0', 'hwaddr':
'80:00:04:04:fe:80:00:00:00:00:00:00:00:12:79:ff:ff:b5:b0:f1', 'speed': 0},
'ib1': {'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': '65520', 'BOOTPROTO':
'none', 'CONNECTED_MODE': 'yes', 'DEVICE': 'ib1', 'TYPE': 'Infiniband',
'ONBOOT': 'no'}, 'mtu': '2044', 'netmask': '', 'hwaddr':
'80:00:04:05:fe:80:00:00:00:00:00:00:00:12:79:ff:ff:b5:b0:f2', 'speed': 0},
'eth5': {'permhwaddr': '00:15:17:00:10:0B', 'addr': '', 'cfg': {'SLAVE':
'yes', 'IPV6INIT': 'no', 'HWADDR': '00:15:17:00:10:0B', 'BOOTPROTO':
'none', 'MASTER': 'bond2', 'DEVICE': 'eth5', 'ONBOOT': 'yes'}, 'mtu':
'1500', 'netmask': '', 'hwaddr': '00:15:17:00:10:0a', 'speed': 1000},
'eth4': {'permhwaddr': '00:15:17:00:10:0A', 'addr': '', 'cfg': {'SLAVE':
'yes', 'IPV6INIT': 'no', 'HWADDR': '00:15:17:00:10:0A', 'BOOTPROTO':
'none', 'MASTER': 'bond2', 'DEVICE': 'eth4', 'ONBOOT': 'yes'}, 'mtu':
'1500', 'netmask': '', 'hwaddr': '00:15:17:00:10:0a', 'speed': 1000},
'eth3': {'permhwaddr': '00:21:28:83:CE:4B', 'addr': '', 'cfg': {'SLAVE':
'yes', 'HWADDR': '00:21:28:83:CE:4B', 'BOOTPROTO': 'none', 'MASTER':
'bond1', 'DEVICE': 'eth3', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '',
'hwaddr': '00:21:28:83:ce:4a', 'speed': 1000}, 'eth2': {'permhwaddr':
'00:21:28:83:CE:4A', 'addr': '', 'cfg': {'SLAVE': 'yes', 'HWADDR':
'00:21:28:83:CE:4A', 'BOOTPROTO': 'none', 'MASTER': 'bond1', 'DEVICE':
'eth2', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr':
'00:21:28:83:ce:4a', 'speed': 1000}, 'eth1': {'permhwaddr':
'00:21:28:83:CE:49', 'addr': '', 'cfg': {'SLAVE': 'yes', 'IPV6INIT': 'no',
'HWADDR': '00:21:28:83:CE:49', 'BOOTPROTO': 'none', 'MASTER': 'bond0',
'DEVICE': 'eth1', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr':
'00:21:28:83:ce:48', 'speed': 1000}, 'eth0': {'permhwaddr':
'00:21:28:83:CE:48', 'addr': '', 'cfg': {'SLAVE': 'yes', 'IPV6INIT': 'no',
'HWADDR': '00:21:28:83:CE:48', 'BOOTPROTO': 'none', 'MASTER': 'bond0',
'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr':
'00:21:28:83:ce:48', 'speed': 1000}}, 'software_revision': '435',
'management_ip': '3.57.111.31', 'clusterLevels': ['3.0', '3.1', '3.2'],
'cpuFlags':
u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,sse4_2,popcnt,lahf_lm,ida,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_Penryn',
'ISCSIInitiatorName': 'iqn.2012-09.net.azeroth:kezan', 'netConfigDirty':
'False', 'memSize': '36272', 'reservedMem': '321', 'bondings': {'bond4':
{'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [],
'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {'BRIDGE':
'maelstrom', 'IPV6INIT': 'no', 'BOOTPROTO': 'none', 'BONDING_OPTS': 'mode=4
miimon=250 xmit_hash_policy=layer2+3', 'DEVICE': 'bond0', 'ONBOOT': 'yes'},
'mtu': '1500', 'netmask': '', 'slaves': ['eth0', 'eth1'], 'hwaddr':
'00:21:28:83:ce:48'}, 'bond1': {'addr': '', 'cfg': {'BRIDGE':
'twistingnether', 'IPV6INIT': 'no', 'BOOTPROTO': 'none', 'BONDING_OPTS':
'mode=4 miimon=250 xmit_hash_policy=layer2+3', 'DEVICE': 'bond1', 'ONBOOT':
'yes'}, 'mtu': '1500', 'netmask': '', 'slaves': ['eth2', 'eth3'], 'hwaddr':
'00:21:28:83:ce:4a'}, 'bond2': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt',
'IPV6INIT': 'no', 'BOOTPROTO': 'none', 'BONDING_OPTS': 'mode=4 miimon=250
xmit_hash_policy=layer2+3', 'DEVICE': 'bond2', 'ONBOOT': 'yes'}, 'mtu':
'1500', 'netmask': '', 'slaves': ['eth4', 'eth5'], 'hwaddr':
'00:15:17:00:10:0a'}}, 'software_version': '4.10', 'cpuSpeed': '2527.246',
'cpuSockets': '2', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true',
'guestOverhead': '65', 'supportedRHEVMs': ['3.0', '3.1'], 'version_name':
'Snow Man', 'emulatedMachines': [u'rhel6.3.0', u'pc', u'rhel6.2.0',
u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'],
'operatingSystem': {'release': '1', 'version': '6.3', 'name': 'RHEL'},
'lastClient': '0.0.0.0'}}

engine.log:
2012-09-13 16:16:28,559 INFO
[org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-50)
[21c70ebd] START, ActivateVdsVDSCommand(vdsId =
1a3d06a8-fde1-11e1-a02d-00151712f280), log id: 4483b716
2012-09-13 16:16:29,339 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager]
(pool-3-thread-50) [21c70ebd] ResourceManager::activateVds - failed to get
VDS = 1a3d06a8-fde1-11e1-a02d-00151712f280 capabilities with error:
CallableStatementCallback; SQL [{call insertvds_interface(?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}]; ERROR: value too long for type
character varying(20)
  Where: SQL statement "INSERT INTO vds_interface(addr, bond_name,
bond_type, gateway, id, is_bond, bond_opts, mac_addr, name, network_name,
speed, subnet, boot_protocol, type, VDS_ID, vlan_id, mtu, bridged)
    VALUES(v_addr, v_bond_name, v_bond_type, v_gateway, v_id, v_is_bond,
v_bond_opts, v_mac_addr, v_name, v_network_name, v_speed, v_subnet,
v_boot_protocol, v_type, v_vds_id, v_vlan_id, v_mtu, v_bridged)"
PL/pgSQL function "insertvds_interface" line 3 at SQL statement; nested
exception is org.postgresql.util.PSQLException: ERROR: value too long for
type character varying(20)
  Where: SQL statement "INSERT INTO vds_interface(addr, bond_name,
bond_type, gateway, id, is_bond, bond_opts, mac_addr, name, network_name,
speed, subnet, boot_protocol, type, VDS_ID, vlan_id, mtu, bridged)
    VALUES(v_addr, v_bond_name, v_bond_type, v_gateway, v_id, v_is_bond,
v_bond_opts, v_mac_addr, v_name, v_network_name, v_speed, v_subnet,
v_boot_protocol, v_type, v_vds_id, v_vlan_id, v_mtu, v_bridged)"
PL/pgSQL function "insertvds_interface" line 3 at SQL statement.
2012-09-13 16:16:29,342 INFO  [org.ovirt.engine.core.vdsbroker.VdsManager]
(pool-3-thread-50) [21c70ebd] ResourceManager::activateVds - failed to
activate VDS = 1a3d06a8-fde1-11e1-a02d-00151712f280
2012-09-13 16:16:29,344 ERROR
[org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-50)
[21c70ebd] Command ActivateVdsVDS execution failed. Exception:
UncategorizedSQLException: CallableStatementCallback; uncategorized
SQLException for SQL [{call updatevdsdynamic(?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?)}]; SQL state [25P02]; error code [0]; ERROR: current transaction is
aborted, commands ignored until end of transaction block; nested exception
is org.postgresql.util.PSQLException: ERROR: current transaction is
aborted, commands ignored until end of transaction block
2012-09-13 16:16:29,345 INFO
[org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-50)
[21c70ebd] FINISH, ActivateVdsVDSCommand, log id: 4483b716

NOTE the length of the Infiniband card "hwaddr" perhaps a clue to the above
engine DB insert barf? --> (ERROR: value too long for type character
varying(20))

- DHC