[Users] vdsm/engine do not like Infiniband
Dead Horse
deadhorseconsulting at gmail.com
Fri Sep 14 19:13:37 UTC 2012
This is a test setup so no worries about future breakage via upgrade.
I ended up stopping the engine service, dumping the database and altering
the the table vds_interface --> column "mac_addr" and increasing the char
varying length from 20 to 60.
I then restore the altered database and go about business as usual.
I had to make the edit offline because there are quite a few DB views and
rules dependent on that table.
- DHC
On Fri, Sep 14, 2012 at 2:51 AM, Itamar Heim <iheim at redhat.com> wrote:
> On 09/14/2012 06:59 AM, Dead Horse wrote:
>
>> Bug opened BZ857294 (https://bugzilla.redhat.com/**show_bug.cgi?id=857294<https://bugzilla.redhat.com/show_bug.cgi?id=857294>
>> )
>>
>> What would be a suggestion to work around this ATM and still be able to
>> use and keep the IB cards in the system?
>>
>
> a bit risky wrt future upgrade which you'll need to carefully test (and
> better if you get it first changed upstream...)
> change the field to be lengthier (i remember the discussion around this,
> but google'd a bit and couldn't find it)
>
>
>
>> - DHC
>>
>>
>> On Thu, Sep 13, 2012 at 6:49 PM, Andrew Cathrow <acathrow at redhat.com
>> <mailto:acathrow at redhat.com>> wrote:
>>
>> Yes you are right there is a known issue with the mac address length
>> in IB cards. IIRC there was a hardware vendor who was working on a
>> patch to extend the length and add the appropriate validation.
>>
>>
>> Dead Horse <deadhorseconsulting at gmail.com
>> <mailto:deadhorseconsulting@**gmail.com<deadhorseconsulting at gmail.com>>>
>> wrote:
>>
>> When attempting to activate/add a host with Infiniband cards present:
>>
>> vdsm.log
>> Thread-14::DEBUG::2012-09-13
>> 16:16:29,306::BindingXMLRPC::**884::vds::(wrapper) return
>> getCapabilities
>> with {'status': {'message': 'Done', 'code': 0}, 'info':
>> {'HBAInventory':
>> {'iSCSI': [{'InitiatorName': 'iqn.2012-09.net.azeroth:**kezan'}],
>> 'FC': []},
>> 'packages2': {'kernel': {'release': '200.29.3.el6uek.x86_64',
>> 'buildtime':
>> 1346177011.0, 'version': '2.6.39'}, 'spice-server': {'release':
>> '10.el6',
>> 'buildtime': 1340343617L, 'version': '0.10.1'}, 'vdsm': {'release':
>> '435.el6', 'buildtime': 1347508928L, 'version': '4.10.0'}, 'qemu-kvm':
>> {'release': '2.295.el6_3.2', 'buildtime': 1346867328L, 'version':
>> '0.12.1.2'}, 'libvirt': {'release': '21.el6_3.4', 'buildtime':
>> 1345740034L,
>> 'version': '0.9.10'}, 'qemu-img': {'release': '2.295.el6_3.2',
>> 'buildtime':
>> 1346867328L, 'version': '0.12.1.2'}}, 'cpuModel': 'Intel(R) Xeon(R)
>> CPU E5540 @ 2.53GHz', 'hooks': {}, 'vmTypes': ['kvm'],
>> 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt':
>> {'iface':
>> 'ovirtmgmt', 'addr': '3.57.111.31', 'cfg': {'IPV6INIT': 'no',
>> 'IPADDR':
>> '3.57.111.31', 'DELAY': '0', 'PREFIX': '22', 'BOOTPROTO': 'none',
>> 'STP':
>> 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'},
>> 'mtu':
>> '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True,
>> 'gateway': '0.0.0.0', 'ports': ['bond2']}, 'maelstrom': {'iface':
>> 'maelstrom', 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DELAY': '0',
>> 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'maelstrom', 'TYPE':
>> 'Bridge',
>> 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'stp': 'off',
>> 'bridged':
>> True, 'gateway': '0.0.0.0', 'ports': ['bond0']}, 'twistingnether':
>> {'iface': 'twistingnether', 'addr': '3.70.204.31', 'cfg': {'IPV6INIT':
>> 'no', 'IPADDR': '3.70.204.31', 'DELAY': '0', 'PREFIX': '22',
>> 'BOOTPROTO':
>> 'none', 'STP': 'off', 'DEVICE': 'twistingnether', 'TYPE': 'Bridge',
>> 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '255.255.252.0', 'stp':
>> 'off',
>> 'bridged': True, 'gateway': '3.70.204.254', 'ports': ['bond1']}},
>> 'bridges': {'ovirtmgmt': {'addr': '3.57.111.31', 'cfg': {'IPV6INIT':
>> 'no',
>> 'IPADDR': '3.57.111.31', 'DELAY': '0', 'PREFIX': '22', 'BOOTPROTO':
>> 'none',
>> 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT':
>> 'yes'},
>> 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ports':
>> ['bond2']}, 'maelstrom': {'addr': '', 'cfg': {'IPV6INIT': 'no',
>> 'DELAY':
>> '0', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'maelstrom', 'TYPE':
>> 'Bridge', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'stp':
>> 'off',
>> 'ports': ['bond0']}, 'twistingnether': {'addr': '3.70.204.31', 'cfg':
>> {'IPV6INIT': 'no', 'IPADDR': '3.70.204.31', 'DELAY': '0', 'PREFIX':
>> '22',
>> 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'twistingnether', 'TYPE':
>> 'Bridge', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '255.255.252.0',
>> 'stp': 'off', 'ports': ['bond1']}}, 'uuid':
>> 'FF200008-FFFF-FFFF-FFFF-**00212883CE4C_00:15:17:00:10:**0a',
>> 'lastClientIface': 'twistingnether', 'nics': {'ib0': {'addr':
>> '192.168.1.1', 'cfg': {'IPV6INIT': 'no', 'IPADDR': '192.168.1.1',
>> 'MTU':
>> '65520', 'PREFIX': '16', 'BOOTPROTO': 'none', 'CONNECTED_MODE': 'yes',
>> 'DEVICE': 'ib0', 'TYPE': 'Infiniband', 'ONBOOT': 'yes'}, 'mtu':
>> '65520',
>> 'netmask': '255.255.0.0', 'hwaddr':
>> '80:00:04:04:fe:80:00:00:00:**00:00:00:00:12:79:ff:ff:b5:b0:**f1',
>> 'speed': 0},
>> 'ib1': {'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': '65520',
>> 'BOOTPROTO':
>> 'none', 'CONNECTED_MODE': 'yes', 'DEVICE': 'ib1', 'TYPE':
>> 'Infiniband',
>> 'ONBOOT': 'no'}, 'mtu': '2044', 'netmask': '', 'hwaddr':
>> '80:00:04:05:fe:80:00:00:00:**00:00:00:00:12:79:ff:ff:b5:b0:**f2',
>> 'speed': 0},
>> 'eth5': {'permhwaddr': '00:15:17:00:10:0B', 'addr': '', 'cfg':
>> {'SLAVE':
>> 'yes', 'IPV6INIT': 'no', 'HWADDR': '00:15:17:00:10:0B', 'BOOTPROTO':
>> 'none', 'MASTER': 'bond2', 'DEVICE': 'eth5', 'ONBOOT': 'yes'}, 'mtu':
>> '1500', 'netmask': '', 'hwaddr': '00:15:17:00:10:0a', 'speed': 1000},
>> 'eth4': {'permhwaddr': '00:15:17:00:10:0A', 'addr': '', 'cfg':
>> {'SLAVE':
>> 'yes', 'IPV6INIT': 'no', 'HWADDR': '00:15:17:00:10:0A', 'BOOTPROTO':
>> 'none', 'MASTER': 'bond2', 'DEVICE': 'eth4', 'ONBOOT': 'yes'}, 'mtu':
>> '1500', 'netmask': '', 'hwaddr': '00:15:17:00:10:0a', 'speed': 1000},
>> 'eth3': {'permhwaddr': '00:21:28:83:CE:4B', 'addr': '', 'cfg':
>> {'SLAVE':
>> 'yes', 'HWADDR': '00:21:28:83:CE:4B', 'BOOTPROTO': 'none', 'MASTER':
>> 'bond1', 'DEVICE': 'eth3', 'ONBOOT': 'yes'}, 'mtu': '1500',
>> 'netmask': '',
>> 'hwaddr': '00:21:28:83:ce:4a', 'speed': 1000}, 'eth2': {'permhwaddr':
>> '00:21:28:83:CE:4A', 'addr': '', 'cfg': {'SLAVE': 'yes', 'HWADDR':
>> '00:21:28:83:CE:4A', 'BOOTPROTO': 'none', 'MASTER': 'bond1', 'DEVICE':
>> 'eth2', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '', 'hwaddr':
>> '00:21:28:83:ce:4a', 'speed': 1000}, 'eth1': {'permhwaddr':
>> '00:21:28:83:CE:49', 'addr': '', 'cfg': {'SLAVE': 'yes', 'IPV6INIT':
>> 'no',
>> 'HWADDR': '00:21:28:83:CE:49', 'BOOTPROTO': 'none', 'MASTER': 'bond0',
>> 'DEVICE': 'eth1', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '',
>> 'hwaddr':
>> '00:21:28:83:ce:48', 'speed': 1000}, 'eth0': {'permhwaddr':
>> '00:21:28:83:CE:48', 'addr': '', 'cfg': {'SLAVE': 'yes', 'IPV6INIT':
>> 'no',
>> 'HWADDR': '00:21:28:83:CE:48', 'BOOTPROTO': 'none', 'MASTER': 'bond0',
>> 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'mtu': '1500', 'netmask': '',
>> 'hwaddr':
>> '00:21:28:83:ce:48', 'speed': 1000}}, 'software_revision': '435',
>> 'management_ip': '3.57.111.31', 'clusterLevels': ['3.0', '3.1',
>> '3.2'],
>> 'cpuFlags':
>> u'fpu,vme,de,pse,tsc,msr,pae,**mce,cx8,apic,sep,mtrr,pge,mca,**
>> cmov,pat,pse36,clflush,dts,**acpi,mmx,fxsr,sse,sse2,ss,ht,**
>> tm,pbe,syscall,nx,rdtscp,lm,**constant_tsc,arch_perfmon,**
>> pebs,bts,rep_good,nopl,**xtopology,nonstop_tsc,**
>> aperfmperf,pni,dtes64,monitor,**ds_cpl,vmx,est,tm2,ssse3,cx16,**
>> xtpr,pdcm,dca,sse4_1,sse4_2,**popcnt,lahf_lm,ida,dts,tpr_**
>> shadow,vnmi,flexpriority,ept,**vpid,model_Nehalem,model_**
>> Conroe,model_Penryn',
>> 'ISCSIInitiatorName': 'iqn.2012-09.net.azeroth:**kezan',
>> 'netConfigDirty':
>> 'False', 'memSize': '36272', 'reservedMem': '321', 'bondings':
>> {'bond4':
>> {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [],
>> 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg':
>> {'BRIDGE':
>> 'maelstrom', 'IPV6INIT': 'no', 'BOOTPROTO': 'none', 'BONDING_OPTS':
>> 'mode=4
>> miimon=250 xmit_hash_policy=layer2+3', 'DEVICE': 'bond0', 'ONBOOT':
>> 'yes'},
>> 'mtu': '1500', 'netmask': '', 'slaves': ['eth0', 'eth1'], 'hwaddr':
>> '00:21:28:83:ce:48'}, 'bond1': {'addr': '', 'cfg': {'BRIDGE':
>> 'twistingnether', 'IPV6INIT': 'no', 'BOOTPROTO': 'none',
>> 'BONDING_OPTS':
>> 'mode=4 miimon=250 xmit_hash_policy=layer2+3', 'DEVICE': 'bond1',
>> 'ONBOOT':
>> 'yes'}, 'mtu': '1500', 'netmask': '', 'slaves': ['eth2', 'eth3'],
>> 'hwaddr':
>> '00:21:28:83:ce:4a'}, 'bond2': {'addr': '', 'cfg': {'BRIDGE':
>> 'ovirtmgmt',
>> 'IPV6INIT': 'no', 'BOOTPROTO': 'none', 'BONDING_OPTS': 'mode=4
>> miimon=250
>> xmit_hash_policy=layer2+3', 'DEVICE': 'bond2', 'ONBOOT': 'yes'},
>> 'mtu':
>> '1500', 'netmask': '', 'slaves': ['eth4', 'eth5'], 'hwaddr':
>> '00:15:17:00:10:0a'}}, 'software_version': '4.10', 'cpuSpeed':
>> '2527.246',
>> 'cpuSockets': '2', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true',
>> 'guestOverhead': '65', 'supportedRHEVMs': ['3.0', '3.1'],
>> 'version_name':
>> 'Snow Man', 'emulatedMachines': [u'rhel6.3.0', u'pc', u'rhel6.2.0',
>> u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'],
>> 'operatingSystem': {'release': '1', 'version': '6.3', 'name': 'RHEL'},
>> 'lastClient': '0.0.0.0'}}
>>
>>
>> engine.log:
>> 2012-09-13 16:16:28,559 INFO
>> [org.ovirt.engine.core.**vdsbroker.**ActivateVdsVDSCommand]
>> (pool-3-thread-50)
>> [21c70ebd] START, ActivateVdsVDSCommand(vdsId =
>> 1a3d06a8-fde1-11e1-a02d-**00151712f280), log id: 4483b716
>> 2012-09-13 16:16:29,339 INFO
>> [org.ovirt.engine.core.**vdsbroker.VdsManager]
>> (pool-3-thread-50) [21c70ebd] ResourceManager::activateVds - failed
>> to get
>> VDS = 1a3d06a8-fde1-11e1-a02d-**00151712f280 capabilities with error:
>> CallableStatementCallback; SQL [{call insertvds_interface(?, ?, ?,
>> ?, ?, ?,
>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}]; ERROR: value too long for type
>> character varying(20)
>> Where: SQL statement "INSERT INTO vds_interface(addr, bond_name,
>> bond_type, gateway, id, is_bond, bond_opts, mac_addr, name,
>> network_name,
>> speed, subnet, boot_protocol, type, VDS_ID, vlan_id, mtu, bridged)
>> VALUES(v_addr, v_bond_name, v_bond_type, v_gateway, v_id,
>> v_is_bond,
>> v_bond_opts, v_mac_addr, v_name, v_network_name, v_speed, v_subnet,
>> v_boot_protocol, v_type, v_vds_id, v_vlan_id, v_mtu, v_bridged)"
>> PL/pgSQL function "insertvds_interface" line 3 at SQL statement;
>> nested
>> exception is org.postgresql.util.**PSQLException: ERROR: value too
>> long for
>> type character varying(20)
>> Where: SQL statement "INSERT INTO vds_interface(addr, bond_name,
>> bond_type, gateway, id, is_bond, bond_opts, mac_addr, name,
>> network_name,
>> speed, subnet, boot_protocol, type, VDS_ID, vlan_id, mtu, bridged)
>> VALUES(v_addr, v_bond_name, v_bond_type, v_gateway, v_id,
>> v_is_bond,
>> v_bond_opts, v_mac_addr, v_name, v_network_name, v_speed, v_subnet,
>> v_boot_protocol, v_type, v_vds_id, v_vlan_id, v_mtu, v_bridged)"
>> PL/pgSQL function "insertvds_interface" line 3 at SQL statement.
>> 2012-09-13 16:16:29,342 INFO
>> [org.ovirt.engine.core.**vdsbroker.VdsManager]
>> (pool-3-thread-50) [21c70ebd] ResourceManager::activateVds - failed to
>> activate VDS = 1a3d06a8-fde1-11e1-a02d-**00151712f280
>> 2012-09-13 16:16:29,344 ERROR
>> [org.ovirt.engine.core.**vdsbroker.VDSCommandBase] (pool-3-thread-50)
>> [21c70ebd] Command ActivateVdsVDS execution failed. Exception:
>> UncategorizedSQLException: CallableStatementCallback; uncategorized
>> SQLException for SQL [{call updatevdsdynamic(?, ?, ?, ?, ?, ?, ?, ?,
>> ?, ?,
>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
>> ?, ?,
>> ?, ?)}]; SQL state [25P02]; error code [0]; ERROR: current
>> transaction is
>> aborted, commands ignored until end of transaction block; nested
>> exception
>> is org.postgresql.util.**PSQLException: ERROR: current transaction is
>> aborted, commands ignored until end of transaction block
>> 2012-09-13 16:16:29,345 INFO
>> [org.ovirt.engine.core.**vdsbroker.**ActivateVdsVDSCommand]
>> (pool-3-thread-50)
>> [21c70ebd] FINISH, ActivateVdsVDSCommand, log id: 4483b716
>>
>> NOTE the length of the Infiniband card "hwaddr" perhaps a clue to
>> the above
>> engine DB insert barf? --> (ERROR: value too long for type character
>> varying(20))
>>
>> - DHC
>>
>>
>>
>>
>> ______________________________**_________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/**mailman/listinfo/users<http://lists.ovirt.org/mailman/listinfo/users>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20120914/61f27866/attachment-0001.html>
More information about the Users
mailing list