Derek, I see 2 issues in the engine logs: 2016-11-02 09:53:13,767 WARN [org.ovirt.engine.core.bll.storage.disk.image.GetUnregisteredDiskQuery] (org.ovirt.thread.pool-8-thread-47) [1e5f014c] Exception while parsing JSON for disk. Exception: '{}': org.codehaus.jackson.JsonParseException: Unexpected character ('H' (code 72)): expected a valid value (number, String, array, object, 'true', 'false' or 'null') at [Source: java.io.StringReader@482fe2d8; line: 1, column: 2] at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433) [jackson-core-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521) [jackson-core-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:442) [jackson-core-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.impl.ReaderBasedParser._handleUnexpectedValue(ReaderBasedParser.java:1198) [jackson-core-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.impl.ReaderBasedParser.nextToken(ReaderBasedParser.java:485) [jackson-core-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.map.ObjectMapper._initForReading(ObjectMapper.java:2770) [jackson-mapper-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2718) [jackson-mapper-asl-1.9.13.jar:1.9.13] at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1877) [jackson-mapper-asl-1.9.13.jar:1.9.13] at org.ovirt.engine.core.utils.JsonHelper.jsonToMap(JsonHelper.java:41) [utils.jar:] at org.ovirt.engine.core.bll.storage.disk.image.MetadataDiskDescriptionHandler.enrichDiskByJsonDescription(MetadataDiskDescriptionHandler.java:247) [bll.jar:] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetOvaInfoVDS, error = [Errno 13] Permission denied: u'/ovirt/import/openafs-fc23-64.ihtfp.org.ova', code = -32603 (Failed with error unexpected and code 16) at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:114) [bll.jar:] at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.runVdsCommand(QueriesCommandBase.java:257) [bll.jar:] at org.ovirt.engine.core.bll.GetVmFromOvaQuery.getVmInfoFromOvaFile(GetVmFromOvaQuery.java:24) [bll.jar:] at org.ovirt.engine.core.bll.GetVmFromOvaQuery.executeQueryCommand(GetVmFromOvaQuery.java:20) [bll.jar:] both not related to reconnects. I see that from time to time there are connections reset by peer 2016-11-04 10:58:43,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler6) [77387d45] Command 'GetStatsVDSCommand(HostName = ovirt-0, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='62b75bb9-fbd9-405f-b479-b6ad8cffd5b1', vds='Host[ovirt-0,62b75bb9-fbd9-405f-b479-b6ad8cffd5b1]'})' execution failed: VDSGenericException: VDSNetworkException: Connection reset by peer which means that vdsm or the host was stopped. Vdsm log you provided do not cover this time so I am not able to say what is the cause of it. There are more 'unexpected eof' in the logs but they seems not to be triggered by the engine. It looks like those connection are triggered from local host. This seems to be related to https://bugzilla.redhat.com/1349829 Thanks, Piotr On Tue, Nov 8, 2016 at 4:29 PM, Derek Atkins <derek@ihtfp.com> wrote:
Hi,
I'm not sure if you want my logs here or on the bug report (you didn't specify). But here you go. I had to gzip them to get them down to size -- the VDSM log is 18MB just from today (man is it chatty!)
-derek
Piotr Kliczewski <piotr.kliczewski@gmail.com> writes:
Derek,
This error may occur from time to time due to [1] but in your listing it is much to often. Please share engine and vdsm logs so we could see why.
Thanks, Piotr
-- Derek Atkins 617-623-3745 derek@ihtfp.com www.ihtfp.com Computer and Internet Security Consultant