Re: [ovirt-users] Cannot login after upgrade from 3.5 to 3.6

On 01/28/2016 09:10 AM, Eli Mesika wrote: > > > ----- Original Message ----- >> >> From: "Martin Perina" <mperina(a)redhat.com&gt; >> To: "Eli Mesika" <emesika(a)redhat.com&gt; >> Cc: "Moti Asayag" <masayag(a)redhat.com&gt;, "Allon Mureinik" >> <amureini(a)redhat.com&gt;, "users" <users(a)ovirt.org&gt;, "Amador >> Pahim" <apahim(a)redhat.com&gt;, "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >> Sent: Thursday, January 28, 2016 12:59:02 PM >> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 to 3.6 >> >> >> >> ----- Original Message ----- >>> >>> From: "Eli Mesika" <emesika(a)redhat.com&gt; >>> To: "Martin Perina" <mperina(a)redhat.com&gt; >>> Cc: "Moti Asayag" <masayag(a)redhat.com&gt;, "Allon Mureinik" >>> <amureini(a)redhat.com&gt;, "users" <users(a)ovirt.org&gt;, "Amador >>> Pahim" <apahim(a)redhat.com&gt;, "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>> Sent: Thursday, January 28, 2016 11:55:56 AM >>> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 to 3.6 >>> >>> >>> >>> ----- Original Message ----- >>>> >>>> From: "Martin Perina" <mperina(a)redhat.com&gt; >>>> To: "Moti Asayag" <masayag(a)redhat.com&gt;, "Allon Mureinik" >>>> <amureini(a)redhat.com&gt; >>>> Cc: "Eli Mesika" <emesika(a)redhat.com&gt;, "users" <users(a)ovirt.org&gt;, >>>> "Amador >>>> Pahim" <apahim(a)redhat.com&gt;, "Marcelo >>>> Leandro" <marceloltmm(a)gmail.com&gt; >>>> Sent: Wednesday, January 27, 2016 2:31:20 PM >>>> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 to 3.6 >>>> >>>> So now I finally understand the issue: >>>> >>>> When you try to login, CommandBase tries to execute LoginCommand, but >>>> before the command execution it loads content of commands cache and >>>> here comes the issue: there's stored AddVmFromSnapshotCommand which >>>> contains DiskImage as a parameter and DiskImage implementation has >>>> changed between 3.5 and 3.6. >>>> >>>> Moti, is there some way how to clean up commands cache so it doesn't >>>> contain those 3.5 commands? >>>> >>>> Also should those situation be covered during engine upgrades? >>> >>> Martin, is this a left over in the command_entities table that caused >>> the >>> failure while the entity is deserialized ? >> >> Probably, because this DiskImage.Id serialization exception started to >> appear >> after upgrade from 3.5. Is there any way how to verify and clean up? > > I suggest having a bug on the taskcleaner code which is called upon > upgrade, then I will try to reproduce > Amador, Is there a chance we can get a backup of that 3.5 DB in order to > reproduce ? Yes, I was talking to Marcelo off-list and he has the dump taken by engine-setup. Marcelo, could you send the tar.gz'ed 3.5 dump download link off-list to Eli? Thank you. > >>>> Thanks >>>> >>>> Martin >>>> >>>> >>>> ----- Original Message ----- >>>>> >>>>> From: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>>>> To: "Martin Perina" <mperina(a)redhat.com&gt; >>>>> Cc: "Eli Mesika" <emesika(a)redhat.com&gt;, "users" <users(a)ovirt.org&gt;, >>>>> "Amador >>>>> Pahim" <apahim(a)redhat.com&gt; >>>>> Sent: Wednesday, January 27, 2016 1:08:19 PM >>>>> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 to 3.6 >>>>> >>>>> The server just in time isolate from the network,is it a problem? >>>>> thats ok? >>>>> >>>>> follows the logs: >>>>> >>>>> server.log: >>>>> https://copy.com/Eni9adZSCjyMZNFN >>>>> >>>>> engine.log: >>>>> https://copy.com/ayczW9ipHdW4BWni >>>>> >>>>> 2016-01-27 5:32 GMT-03:00 Martin Perina <mperina(a)redhat.com&gt;: >>>>>> >>>>>> Hi, >>>>>> >>>>>> according to the test of login by ovirt-engine-extensions-tool you >>>>>> were >>>>>> logged in >>>>>> successfully, so there shouldn't be any issues logging into engine >>>>>> using >>>>>> admin@internal ... >>>>>> >>>>>> Unfortunately both engine.log and server.log ends on Jan 22th and I'd >>>>>> really >>>>>> like to see up-to-date logs. >>>>>> >>>>>> So if you still cannot login into webadmin please do following: >>>>>> >>>>>> 1. Stop engine service >>>>>> >>>>>> systemctl stop ovirt-engine >>>>>> >>>>>> or >>>>>> >>>>>> service ovirt-engine stop >>>>>> >>>>>> >>>>>> 2. Rotate logs >>>>>> >>>>>> cd /var/log/ovirt-engine >>>>>> mv engine.log engine-20160127.log >>>>>> mv server.log server-20160127.log >>>>>> >>>>>> >>>>>> 3. Start engine >>>>>> >>>>>> systemctl start ovirt-engine >>>>>> >>>>>> or >>>>>> >>>>>> service ovirt-engine start >>>>>> >>>>>> >>>>>> 4. Try to login as admin with domain internal using webadmin >>>>>> >>>>>> >>>>>> 5. Try to login as admin@internal using REST API by >>>>>> accessing >>>>>> >>>>>> http://SERVER/ovirt-engine/api/datacenters >>>>>> >>>>>> Into user please enter full username: admin@internal >>>>>> >>>>>> >>>>>> When done please attach latest server.log and engine.log >>>>>> >>>>>> >>>>>> Thanks a lot >>>>>> >>>>>> Martin Perina >>>>>> >>>>>> >>>>>> ----- Original Message ----- >>>>>>> >>>>>>> From: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>>>>>> To: "Martin Perina" <mperina(a)redhat.com&gt; >>>>>>> Cc: "Eli Mesika" <emesika(a)redhat.com&gt;, "users" <users(a)ovirt.org&gt;, >>>>>>> "Amador >>>>>>> Pahim" <apahim(a)redhat.com&gt; >>>>>>> Sent: Tuesday, January 26, 2016 8:46:12 PM >>>>>>> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 to >>>>>>> 3.6 >>>>>>> >>>>>>> hello, >>>>>>> >>>>>>> setup.log: >>>>>>> https://copy.com/lIYzccOnwCiW7e9q >>>>>>> >>>>>>> and output the command : >>>>>>> https://copy.com/7psvpyUzUq0FKW31 >>>>>>> >>>>>>> error screen when i try to login on webadmin: >>>>>>> https://copy.com/CfKZePnGFmIwF7B8 >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> 2016-01-26 12:24 GMT-03:00 Martin Perina <mperina(a)redhat.com&gt;: >>>>>>>> >>>>>>>> And also could you try to login using extension test tool: >>>>>>>> >>>>>>>> ovirt-engine-extensions-tool aaa login-user --profile=internal >>>>>>>> --user-name=admin --password=interactive: >>>>>>>> >>>>>>>> and post the output of the command. >>>>>>>> >>>>>>>> Thanks a lot >>>>>>>> >>>>>>>> Martin Perina >>>>>>>> >>>>>>>> ----- Original Message ----- >>>>>>>>> >>>>>>>>> From: "Martin Perina" <mperina(a)redhat.com&gt; >>>>>>>>> To: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>>>>>>>> Cc: "Eli Mesika" <emesika(a)redhat.com&gt;, "users" <users(a)ovirt.org&gt;, >>>>>>>>> "Amador >>>>>>>>> Pahim" <apahim(a)redhat.com&gt; >>>>>>>>> Sent: Tuesday, January 26, 2016 4:12:21 PM >>>>>>>>> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 to >>>>>>>>> 3.6 >>>>>>>>> >>>>>>>>> Could you please share also your server.log? >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> >>>>>>>>> Martin Perina >>>>>>>>> >>>>>>>>> ----- Original Message ----- >>>>>>>>>> >>>>>>>>>> From: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>>>>>>>>> To: "Martin Perina" <mperina(a)redhat.com&gt; >>>>>>>>>> Cc: "Eli Mesika" <emesika(a)redhat.com&gt;, "users" >>>>>>>>>> <users(a)ovirt.org&gt;, >>>>>>>>>> "Amador >>>>>>>>>> Pahim" <apahim(a)redhat.com&gt; >>>>>>>>>> Sent: Tuesday, January 26, 2016 4:03:16 PM >>>>>>>>>> Subject: Re: [ovirt-users] Cannot login after upgrade from 3.5 >>>>>>>>>> to >>>>>>>>>> 3.6 >>>>>>>>>> >>>>>>>>>> And here the engine.log: >>>>>>>>>> https://copy.com/TWjgIu7KwSkcmRZ8 >>>>>>>>>> >>>>>>>>>> the log started 2016-01-19. >>>>>>>>>> >>>>>>>>>> 2016-01-26 11:57 GMT-03:00 Marcelo Leandro >>>>>>>>>> <marceloltmm(a)gmail.com&gt;: >>>>>>>>>>> >>>>>>>>>>> I didn't change nothing on jan 20th and it happened on 22th. >>>>>>>>>>> I can't login into the web admin. >>>>>>>>>>> >>>>>>>>>>> Thanks >>>>>>>>>>> >>>>>>>>>>> 2016-01-26 9:55 GMT-03:00 Martin Perina <mperina(a)redhat.com&gt;: >>>>>>>>>>>> >>>>>>>>>>>> Hi Marcelo, >>>>>>>>>>>> >>>>>>>>>>>> sorry for late response, too many tasks on me at the moment >>>>>>>>>>>> :-( >>>>>>>>>>>> >>>>>>>>>>>> As Eli said important issues started at 2016-01-20, but >>>>>>>>>>>> engine-setup >>>>>>>>>>>> log you posted is dated at 2016-01-22. So, did you perform >>>>>>>>>>>> any >>>>>>>>>>>> upgrade on important configuration changed on Jan 20th? If >>>>>>>>>>>> so >>>>>>>>>>>> could >>>>>>>>>>>> you please share also this setup log? >>>>>>>>>>>> >>>>>>>>>>>> Regarding login: I haven't found any issue logging, I see >>>>>>>>>>>> many >>>>>>>>>>>> successful >>>>>>>>>>>> logins of admin@internal in the log. So are you able to >>>>>>>>>>>> login >>>>>>>>>>>> into >>>>>>>>>>>> webadmin >>>>>>>>>>>> or not? >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> >>>>>>>>>>>> Martin Perina >>>>>>>>>>>> >>>>>>>>>>>> ----- Original Message ----- >>>>>>>>>>>>> >>>>>>>>>>>>> From: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>>>>>>>>>>>> To: "Eli Mesika" <emesika(a)redhat.com&gt; >>>>>>>>>>>>> Cc: "Martin Perina" <mperina(a)redhat.com&gt;, "users" >>>>>>>>>>>>> <users(a)ovirt.org&gt;, >>>>>>>>>>>>> "Amador Pahim" <apahim(a)redhat.com&gt; >>>>>>>>>>>>> Sent: Tuesday, January 26, 2016 12:27:55 PM >>>>>>>>>>>>> Subject: Re: [ovirt-users] Cannot login after upgrade from >>>>>>>>>>>>> 3.5 >>>>>>>>>>>>> to >>>>>>>>>>>>> 3.6 >>>>>>>>>>>>> >>>>>>>>>>>>> Martins, can you help me ? I can't administer my >>>>>>>>>>>>> environment. >>>>>>>>>>>>> >>>>>>>>>>>>> 2016-01-25 8:30 GMT-03:00 Eli Mesika <emesika(a)redhat.com&gt;: >>>>>>>>>>>>>> >>>>>>>>>>>>>> Adding Martin >>>>>>>>>>>>>> >>>>>>>>>>>>>> There are some aaa errors before that, but first >>>>>>>>>>>>>> significant >>>>>>>>>>>>>> error >>>>>>>>>>>>>> is >>>>>>>>>>>>>> in >>>>>>>>>>>>>> 2016-01-20 00:14:55,002 >>>>>>>>>>>>>> Can you take a look ? >>>>>>>>>>>>>> >>>>>>>>>>>>>> ----- Original Message ----- >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> From: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt; >>>>>>>>>>>>>>> To: "Eli Mesika" <emesika(a)redhat.com&gt; >>>>>>>>>>>>>>> Cc: users(a)ovirt.org, "Amador Pahim" <apahim(a)redhat.com&gt; >>>>>>>>>>>>>>> Sent: Sunday, January 24, 2016 1:48:04 PM >>>>>>>>>>>>>>> Subject: Re: [ovirt-users] Cannot login after upgrade >>>>>>>>>>>>>>> from >>>>>>>>>>>>>>> 3.5 >>>>>>>>>>>>>>> to >>>>>>>>>>>>>>> 3.6 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> It's here : https://copy.com/TWjgIu7KwSkcmRZ8 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> ----- Original Message ----- >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> From: "Amador Pahim" <apahim(a)redhat.com&gt; >>>>>>>>>>>>>>>> To: "Marcelo Leandro" <marceloltmm(a)gmail.com&gt;, >>>>>>>>>>>>>>>> users(a)ovirt.org >>>>>>>>>>>>>>>> Cc: emesika(a)redhat.com >>>>>>>>>>>>>>>> Sent: Friday, January 22, 2016 7:08:20 PM >>>>>>>>>>>>>>>> Subject: Re: [ovirt-users] Cannot login after upgrade >>>>>>>>>>>>>>>> from >>>>>>>>>>>>>>>> 3.5 >>>>>>>>>>>>>>>> to >>>>>>>>>>>>>>>> 3.6 >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On 01/22/2016 03:03 PM, Marcelo Leandro wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> After engine-setup from >>>>>>>>>>>>>>>>> ovirt-engine-3.5.6.2-1.el7.centos >>>>>>>>>>>>>>>>> to >>>>>>>>>>>>>>>>> ovirt-engine-3.6.1.3-1.el7.centos, I'm not able to >>>>>>>>>>>>>>>>> login >>>>>>>>>>>>>>>>> anymore. >>>>>>>>>>>>>>>>> The >>>>>>>>>>>>>>>>> engine.log say >>>>>>>>>>>>>>>>> Caused by: >>>>>>>>>>>>>>>>> org.codehaus.jackson.map.JsonMappingException: >>>>>>>>>>>>>>>>> Invalid >>>>>>>>>>>>>>>>> type >>>>>>>>>>>>>>>>> id >>>>>>>>>>>>>>>>> 'org.ovirt.engine.core.common.businessentities.DiskImage' >>>>>>>>>>>>>>>>> (for >>>>>>>>>>>>>>>>> id >>>>>>>>>>>>>>>>> type 'Id.class'): no such class found (through >>>>>>>>>>>>>>>>> reference >>>>>>>>>>>>>>>>> chain: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> org.ovirt.engine.core.common.action.AddVmFromSnapshotParameters["vm"]->org.ovirt.engine.core.common.businessentities.VM["diskList"]) >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> hmm, I see a similar msg here: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> http://lists.ovirt.org/pipermail/devel/2015-July/010976.html >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Not sure if related. Eli? Any thoughts here? >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I don't think it is related ... >>>>>>>>>>>>>>> Amador, can you please attach a full engine log ? >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Here the setup log: >>>>>>>>>>>>>>>>> https://copy.com/YBddV8bg3tnjHnwp >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> And here the engine.log: >>>>>>>>>>>>>>>>> https://copy.com/TWjgIu7KwSkcmRZ8 >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Need urgent assistance. Thank you in advance. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Best Regards, >>>>>>>>>>>>>>>>> Marcelo Leandro >>>>>>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>>>>>> Users mailing list >>>>>>>>>>>>>>>>> Users(a)ovirt.org >>>>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>