Hello Marcin, hello all,
the provider failure was due to neutron services not behaving
correctly. Now when i try to start a VM attached to an external
network i get this in vdsm.log:
2017-03-21 12:51:38,893 INFO (vm/23ea52a8) [vds] prepared volume
path:
/rhev/data-center/00000001-0001-0001-0001-000000000311/3fb1af07-186b-4d2b-8a7a-26ff265f71fb/images/8933217f-47b0-4fe4-bb2f-7defcffb6bb8/4f996ad6-c06c-4527-be1f-45a9e718d01e
(clientIF:374)
2017-03-21 12:51:39,047 INFO (vm/23ea52a8) [root] (hooks:108)
2017-03-21 12:51:39,809 INFO (vm/23ea52a8) [root] Adding vNIC
0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3 for provider type
OPENSTACK_NETWORK and plugin OPEN_VSWITCHSetting up vNIC (portId
0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3) security groups
openstacknet hook: [unexpected error]: Traceback (most recent call last):
File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet",
line 194, in <module>
main()
File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet",
line 148, in main
addOpenstackVnic(domxml, pluginType, vNicId, hasSecurityGroups)
File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet",
line 121, in addOpenstackVnic
addOvsVnic(domxml, iface, portId, hasSecurityGroups)
File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet",
line 90, in addOvsVnic
addOvsHybridVnic(domxml, iface, portId)
File "/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet",
line 98, in addOvsHybridVnic
portId)
File "/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py",
line 99, in setUpSecurityGroupVnic
'external-ids:attached-mac=%s' % macAddr])
File "/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py",
line 47, in executeOrExit
(command, err))
RuntimeError: Failed to execute ['/usr/bin/ovs-vsctl', '--',
'--may-exist', 'add-port', 'br-int', 'qvo0eec5c68-49',
'--', 'set',
'Interface', 'qvo0eec5c68-49',
'external-ids:iface-id=0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3',
'external-ids:iface-status=active',
u'external-ids:attached-mac=00:1a:4a:16:01:51'], due to: ovs-vsctl: no
bridge named br-int
(hooks:108)
2017-03-21 12:51:39,810 ERROR (vm/23ea52a8) [virt.vm]
(vmId='23ea52a8-e499-41bb-8be4-8621b67869fd') The vm start process
failed (vm:616)
Traceback (most recent call last):
File "/usr/share/vdsm/virt/vm.py", line 552, in _startUnderlyingVm
self._run()
File "/usr/share/vdsm/virt/vm.py", line 1985, in _run
domxml = hooks.before_vm_start(self._buildDomainXML(),
File "/usr/share/vdsm/virt/vm.py", line 1667, in _buildDomainXML
self._appendDevices(domxml)
File "/usr/share/vdsm/virt/vm.py", line 1621, in _appendDevices
deviceXML, self.conf, dev.custom)
File "/usr/lib/python2.7/site-packages/vdsm/hooks.py", line 132, in
before_device_create
params=customProperties)
File "/usr/lib/python2.7/site-packages/vdsm/hooks.py", line 118, in
_runHooksDir
raise exception.HookError(err)
HookError: Hook Error: ('Adding vNIC
0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3 for provider type
OPENSTACK_NETWORK and plugin OPEN_VSWITCHSetting up vNIC (portId
0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3) security groups\nopenstacknet
hook: [unexpected error]: Traceback (most recent call last):\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
194, in <module>\n main()\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
148, in main\n addOpenstackVnic(domxml, pluginType, vNicId,
hasSecurityGroups)\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
121, in addOpenstackVnic\n addOvsVnic(domxml, iface, portId,
hasSecurityGroups)\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
90, in addOvsVnic\n addOvsHybridVnic(domxml, iface, portId)\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
98, in addOvsHybridVnic\n portId)\n File
"/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py",
line 99, in setUpSecurityGroupVnic\n
\'external-ids:attached-mac=%s\' % macAddr])\n File
"/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py",
line 47, in executeOrExit\n (command, err))\nRuntimeError: Failed
to execute [\'/usr/bin/ovs-vsctl\', \'--\', \'--may-exist\',
\'add-port\', \'br-int\', \'qvo0eec5c68-49\', \'--\',
\'set\',
\'Interface\', \'qvo0eec5c68-49\',
\'external-ids:iface-id=0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3\',
\'external-ids:iface-status=active\',
u\'external-ids:attached-mac=00:1a:4a:16:01:51\'], due to: ovs-vsctl:
no bridge named br-int\n\n\n\n',)
2017-03-21 12:51:39,812 INFO (vm/23ea52a8) [virt.vm]
(vmId='23ea52a8-e499-41bb-8be4-8621b67869fd') Changed state to Down:
Hook Error: ('Adding vNIC 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3 for
provider type OPENSTACK_NETWORK and plugin OPEN_VSWITCHSetting up vNIC
(portId 0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3) security
groups\nopenstacknet hook: [unexpected error]: Traceback (most recent
call last):\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
194, in <module>\n main()\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
148, in main\n addOpenstackVnic(domxml, pluginType, vNicId,
hasSecurityGroups)\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
121, in addOpenstackVnic\n addOvsVnic(domxml, iface, portId,
hasSecurityGroups)\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
90, in addOvsVnic\n addOvsHybridVnic(domxml, iface, portId)\n File
"/usr/libexec/vdsm/hooks/before_device_create/50_openstacknet", line
98, in addOvsHybridVnic\n portId)\n File
"/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py",
line 99, in setUpSecurityGroupVnic\n
\'external-ids:attached-mac=%s\' % macAddr])\n File
"/usr/libexec/vdsm/hooks/before_device_create/openstacknet_utils.py",
line 47, in executeOrExit\n (command, err))\nRuntimeError: Failed
to execute [\'/usr/bin/ovs-vsctl\', \'--\', \'--may-exist\',
\'add-port\', \'br-int\', \'qvo0eec5c68-49\', \'--\',
\'set\',
\'Interface\', \'qvo0eec5c68-49\',
\'external-ids:iface-id=0eec5c68-49c9-4d0f-8dc6-eeacb09aa2c3\',
\'external-ids:iface-status=active\',
u\'external-ids:attached-mac=00:1a:4a:16:01:51\'], due to: ovs-vsctl:
no bridge named br-int\n\n\n\n',) (code=1) (vm:1199)
And the error no bridge named br-int seems right, since there is no
br-int available:
# ovs-vsctl show
107a36d9-0b54-4324-8840-86cccfe2ed64
ovs_version: "2.6.90"
So maybe there is something wrong with my setup of the external
provider (or something wrong with openvswitch...)
Luca
On Mon, Mar 13, 2017 at 3:25 PM, Marcin Mirecki <mmirecki(a)redhat.com> wrote:
PROVIDER_FAILURE indicates a problem with the external network
provider.
The detailed cause of the error should be present in the vdsm logs.
On Mon, Mar 13, 2017 at 11:37 AM, Luca 'remix_tj' Lorenzetto
<lorenzetto.luca(a)gmail.com> wrote:
>
> About VM failing i can add this from engine.log:
>
> 2017-03-13 11:12:35,662+01 INFO
> [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand]
> (org.ovirt.thread.pool-6-thread-5)
> [462b7528-dce7-4b9e-98e4-f44ab9a551a5] START,
> UpdateVmDynamicDataVDSCommand(
> UpdateVmDynamicDataVDSCommandParameters:{runAsync='true', hostI
> d='null', vmId='23ea52a8-e499-41bb-8be4-8621b67869fd',
>
>
vmDynamic='org.ovirt.engine.core.common.businessentities.VmDynamic@da9f8b26'}),
> log id: 4d5a0bbe
> 2017-03-13 11:12:35,665+01 INFO
> [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand]
> (org.ovirt.thread.pool-6-thread-5)
> [462b7528-dce7-4b9e-98e4-f44ab9a551a5] FINISH,
> UpdateVmDynamicDataVDSCommand, log id: 4d5a0bbe
> 2017-03-13 11:14:35,698+01 ERROR
> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
> (org.ovirt.thread.pool-6-thread-5)
> [462b7528-dce7-4b9e-98e4-f44ab9a551a5] EVENT_ID:
> USER_FAILED_RUN_VM(54), Correlation ID:
> 462b7528-dce7-4b9e-98e4-f44ab9a551a5, Job ID
> : 86497f63-6bd0-46e5-b667-320f4ef30f30, Call Stack: null, Custom Event
> ID: -1, Message: Failed to run VM ovirt-node-test (User:
> admin@internal-authz).
> 2017-03-13 11:14:35,703+01 INFO
> [org.ovirt.engine.core.bll.RunVmCommand]
> (org.ovirt.thread.pool-6-thread-5)
> [462b7528-dce7-4b9e-98e4-f44ab9a551a5] Lock freed to object
> 'EngineLock:{exclusiveLocks='[23ea52a8-e499-41bb-8be4-8621b67869fd=<VM,
> ACTION_TYPE_FAILED_OBJECT_LOCKE
> D>]', sharedLocks='null'}'
> 2017-03-13 11:14:35,703+01 ERROR
> [org.ovirt.engine.core.bll.RunVmCommand]
> (org.ovirt.thread.pool-6-thread-5)
> [462b7528-dce7-4b9e-98e4-f44ab9a551a5] Command
> 'org.ovirt.engine.core.bll.RunVmCommand' failed: EngineException:
> (Failed with error PROVIDER_FAILURE and code 5050)
> 2017-03-13 11:14:35,713+01 INFO
> [org.ovirt.engine.core.bll.ProcessDownVmCommand]
> (org.ovirt.thread.pool-6-thread-36) [48f00a21] Running command:
> ProcessDownVmCommand internal: true.
>
> I see in particular a PROVIDER_FAILURE error, that's maybe related.
>
> 2017-03-13 11:17 GMT+01:00 Luca 'remix_tj' Lorenzetto
> <lorenzetto.luca(a)gmail.com>:
> > Hello,
> >
> > now, didn't understand why, the VM isn't starting. This is the VDSM
> > log when i try to poweron while attached to an external network. If i
> > attach to ovirtmgmt or other standard network, vm boots.
> >
> > Luca
> >
> > --
> > "E' assurdo impiegare gli uomini di intelligenza eccellente per fare
> > calcoli che potrebbero essere affidati a chiunque se si usassero delle
> > macchine"
> > Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716)
> >
> > "Internet è la più grande biblioteca del mondo.
> > Ma il problema è che i libri sono tutti sparsi sul pavimento"
> > John Allen Paulos, Matematico (1945-vivente)
> >
> > Luca 'remix_tj' Lorenzetto,
http://www.remixtj.net ,
> > <lorenzetto.luca(a)gmail.com>
>
>
>
> --
> "E' assurdo impiegare gli uomini di intelligenza eccellente per fare
> calcoli che potrebbero essere affidati a chiunque se si usassero delle
> macchine"
> Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716)
>
> "Internet è la più grande biblioteca del mondo.
> Ma il problema è che i libri sono tutti sparsi sul pavimento"
> John Allen Paulos, Matematico (1945-vivente)
>
> Luca 'remix_tj' Lorenzetto,
http://www.remixtj.net ,
> <lorenzetto.luca(a)gmail.com>
--
"E' assurdo impiegare gli uomini di intelligenza eccellente per fare
calcoli che potrebbero essere affidati a chiunque se si usassero delle
macchine"
Gottfried Wilhelm von Leibnitz, Filosofo e Matematico (1646-1716)
"Internet è la più grande biblioteca del mondo.
Ma il problema è che i libri sono tutti sparsi sul pavimento"
John Allen Paulos, Matematico (1945-vivente)
Luca 'remix_tj' Lorenzetto,
http://www.remixtj.net ,
<lorenzetto.luca(a)gmail.com>