[ovirt-devel] Re: [ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [22-05-2018 ] [ 004_basic_sanity.update_template_version]

ok. thank you for the update Martin. On Wed, May 23, 2018 at 4:16 PM, Martin Perina <mperina(a)redhat.com&gt; wrote: > > > On Wed, May 23, 2018 at 5:11 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: > >> Arik - any update? >> >> Thanks, >> Dafna >> > > ​We have confirmed that the fix doesn't work. If we haven't found a fix > till tomorrow noon, we will revert the patch. > ​ > >> >> >> On Wed, May 23, 2018 at 1:23 PM, Martin Perina <mperina(a)redhat.com&gt; >> wrote: >> >>> >>> >>> On Wed, May 23, 2018 at 2:08 PM, Martin Perina <mperina(a)redhat.com&gt; >>> wrote: >>> >>>> >>>> >>>> On Wed, May 23, 2018 at 12:23 PM, Martin Perina <mperina(a)redhat.com&gt; >>>> wrote: >>>> >>>>> >>>>> >>>>> On Wed, May 23, 2018 at 11:55 AM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>>>> >>>>>> Eli, Martin - can you please take a look? >>>>>> >>>>> >>>>> ​We have discussed a few minutes ago, Eli is looking at it. >>>>> >>>> >>>> ​Here's possible fix: https://gerrit.ovirt.org/91534​ >>>> We want to verify it by OST run, but looks like manual engine RPM >>>> builds are either not working or it takes REALLY long time to start ... >>>> >>> >>> ​Adding Arik to the thread, it looks like the above fix doesn't help, >>> we are continuing with investigations ... >>> ​ >>> >>>> >>>> >>>>> Thanks >>>>> >>>>> Martin >>>>> >>>>> ​ >>>>> >>>>>> >>>>>> Thanks, >>>>>> Dafna >>>>>> >>>>>> >>>>>> On Tue, May 22, 2018 at 7:09 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> This failure seems to be related to the regression we found earlier >>>>>>> today which was causing failure in initialize engine: >>>>>>> https://gerrit.ovirt.org/#/c/89293/ - core:make search string >>>>>>> fields not null and empty >>>>>>> >>>>>>> The fix for the above change was reported as failed on the update >>>>>>> template test with an error which I think is related to the same >>>>>>> regression. >>>>>>> >>>>>>> https://gerrit.ovirt.org/#/c/91476/ - db: resolve duplicate db >>>>>>> scripts >>>>>>> >>>>>>> Can you please have a look? >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> *Link to >>>>>>> Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/ >>>>>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/>Link >>>>>>> to all >>>>>>> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/a... >>>>>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/artifa... >>>>>>> error snippet from the log: <error>2018-05-22 12:40:21,015-04 DEBUG >>>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runQuery, >>>>>>> params: [GetSoundDevices, IdQueryParameters:{refresh='false', >>>>>>> filtered='false'}], timeElapsed: 3ms2018-05-22 12:40:21,021-04 DEBUG >>>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>>>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 1ms2018-05-22 >>>>>>> 12:40:21,045-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Lock Acquired to >>>>>>> object >>>>>>> 'EngineLock:{exclusiveLocks='[2f43ef56-db61-4d93-99ee-00e84c741a29=DISK, >>>>>>> bb954b00-d22c-4421-aba2-35335f9c441f=TEMPLATE, >>>>>>> 9d749a87-45c9-4251-8e69-e55da5d3deed=DISK]', >>>>>>> sharedLocks='[5cf93146-a5f1-4330-affe-672eaf39cc0d=VM, >>>>>>> 4c68925d-569d-4987-8f54-29859763391a=TEMPLATE]'}'2018-05-22 12:40:21,097-04 >>>>>>> DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>>>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 2ms2018-05-22 >>>>>>> 12:40:21,111-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Running command: >>>>>>> AddVmTemplateCommand internal: false. Entities affected : ID: >>>>>>> 79448f95-c26c-45b6-b396-ecd8fe98c2d9 Type: StoragePoolAction group >>>>>>> CREATE_TEMPLATE with role type USER2018-05-22 12:40:21,115-04 INFO >>>>>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>>>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] START, SetVmStatusVDSCommand( >>>>>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>>>>> status='ImageLocked', exitStatus='Normal'}), log id: 4897bb3a2018-05-22 >>>>>>> 12:40:21,117-04 INFO >>>>>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>>>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] FINISH, SetVmStatusVDSCommand, >>>>>>> return: , log id: 4897bb3a2018-05-22 12:40:21,117-04 DEBUG >>>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: >>>>>>> runVdsCommand, params: [SetVmStatus, >>>>>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>>>>> status='ImageLocked', exitStatus='Normal'}], timeElapsed: 4ms2018-05-22 >>>>>>> 12:40:21,125-04 DEBUG >>>>>>> [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] >>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Translating >>>>>>> SQLException with SQL state '23502', error code '0', message [ERROR: null >>>>>>> value in column "description" violates not-null constraint Detail: Failing >>>>>>> row contains (bb954b00-d22c-4421-aba2-35335f9c441f, >>>>>>> CirrOS_0.4.0_for_x86_64_glance_template, 512, >>>>>>> 4c68925d-569d-4987-8f54-29859763391a, 0, null, >>>>>>> 5e28a528-59ad-4054-9397-a9174ec356a7, 2018-05-22 12:40:21.119-04, 1, null, >>>>>>> f, 1, 1, 1, Etc/GMT, t, f, 2018-05-22 12:40:21.120272-04, null, null, f, 1, >>>>>>> 0, 0, 1, 0, , 3, null, null, null, 0, , , 256, TEMPLATE, 0, 1, >>>>>>> 7d498f3a-b16d-4574-9e47-9c87cd1c866b, f, null, f, f, 1, f, f, f, >>>>>>> bd48ab26-5ddb-11e8-b3bb-5452c0a8c904, null, , f, 0, null, null, null, >>>>>>> guest_agent, null, null, null, 2, null, 2, 12345678, f, interleave, t, t, >>>>>>> 20fa3adb-29f2-4938-b07a-751d63a65447, null, null, null, 0, null, >>>>>>> 3463183e-b5ce-076d-2a26-0e3e9d93dafb, d2f75033-25ec-e3b3-3c27-351115d4aa2b, >>>>>>> null, 0, LOCK_SCREEN, 2, null, null, 2048, null, AUTO_RESUME). Where: SQL >>>>>>> statement "INSERT INTO vm_static( child_count, >>>>>>> creation_date, description, free_text_comment, >>>>>>> mem_size_mb, max_memory_size_mb, num_of_io_threads, >>>>>>> vm_name, num_of_sockets, cpu_per_socket, >>>>>>> threads_per_cpu, os, vm_guid, cluster_id, >>>>>>> num_of_monitors, single_qxl_pci, >>>>>>> allow_console_reconnect, template_status, usb_policy, >>>>>>> time_zone, fail_back, vm_type, nice_level, >>>>>>> cpu_shares, default_boot_sequence, >>>>>>> default_display_type, priority, auto_startup, >>>>>>> is_stateless, iso_path, origin, initrd_url, >>>>>>> kernel_url, kernel_params, entity_type, >>>>>>> quota_id, migration_support, >>>>>>> is_disabled,dedicated_vm_for_vds, is_smartcard_enabled, >>>>>>> is_delete_protected, sso_method, tunnel_migration, >>>>>>> vnc_keyboard_layout, min_allocated_mem, >>>>>>> is_run_and_pause, created_by_user_id, >>>>>>> migration_downtime, template_version_number, vmt_guid, >>>>>>> template_version_name, serial_number_policy, >>>>>>> custom_serial_number, is_boot_menu_enabled, >>>>>>> is_spice_file_transfer_enabled, is_spice_copy_paste_enabled, >>>>>>> cpu_profile_id, numatune_mode, is_auto_converge, >>>>>>> is_migrate_compressed, predefined_properties, >>>>>>> userdefined_properties, custom_emulated_machine, >>>>>>> bios_type, custom_cpu_name, small_icon_id, >>>>>>> large_icon_id, console_disconnect_action, >>>>>>> resume_behavior, custom_compatibility_version, >>>>>>> migration_policy_id, lease_sd_id) VALUES( >>>>>>> v_child_count, v_creation_date, v_description, >>>>>>> v_free_text_comment, v_mem_size_mb, >>>>>>> v_max_memory_size_mb, v_num_of_io_threads, v_name, >>>>>>> v_num_of_sockets, v_cpu_per_socket, >>>>>>> v_threads_per_cpu, v_os, v_vmt_guid, v_cluster_id, >>>>>>> v_num_of_monitors, v_single_qxl_pci, >>>>>>> v_allow_console_reconnect, v_status, v_usb_policy, >>>>>>> v_time_zone, v_fail_back, v_vm_type, >>>>>>> v_nice_level, v_cpu_shares, v_default_boot_sequence, >>>>>>> v_default_display_type, v_priority, v_auto_startup, >>>>>>> v_is_stateless, v_iso_path, v_origin, >>>>>>> v_initrd_url, v_kernel_url, v_kernel_params, >>>>>>> v_template_type, v_quota_id, v_migration_support, >>>>>>> v_is_disabled, v_dedicated_vm_for_vds, >>>>>>> v_is_smartcard_enabled, v_is_delete_protected, >>>>>>> v_sso_method, v_tunnel_migration, >>>>>>> v_vnc_keyboard_layout, v_min_allocated_mem, >>>>>>> v_is_run_and_pause, v_created_by_user_id, >>>>>>> v_migration_downtime, v_template_version_number, >>>>>>> v_base_template_id, v_template_version_name, >>>>>>> v_serial_number_policy, v_custom_serial_number, >>>>>>> v_is_boot_menu_enabled, v_is_spice_file_transfer_enabled, >>>>>>> v_is_spice_copy_paste_enabled, v_cpu_profile_id, >>>>>>> v_numatune_mode, v_is_auto_converge, >>>>>>> v_is_migrate_compressed, v_predefined_properties, >>>>>>> v_userdefined_properties, v_custom_emulated_machine, >>>>>>> v_bios_type, v_custom_cpu_name, v_small_icon_id, >>>>>>> v_large_icon_id, v_console_disconnect_action, >>>>>>> v_resume_behavior, v_custom_compatibility_version, >>>>>>> v_migration_policy_id, v_lease_sd_id)"PL/pgSQL function >>>>>>> insertvmtemplate(integer,timestamp with time zone,character >>>>>>> varying,text,integer,integer,integer,character >>>>>>> varying,integer,integer,integer,integer,uuid,uuid,integer,boolean,boolean,integer,integer,character >>>>>>> varying,boolean,integer,integer,integer,integer,integer,integer,boolean,boolean,boolean,boolean,character >>>>>>> varying,boolean,character varying,integer,character varying,character >>>>>>> varying,character varying,uuid,integer,text,boolean,character >>>>>>> varying,integer,boolean,uuid,character varying,integer,uuid,character >>>>>>> varying,smallint,character varying,boolean,boolean,boolean,uuid,character >>>>>>> varying,boolean,boolean,character varying,character varying,character >>>>>>> varying,integer,character varying,uuid,uuid,character varying,character >>>>>>> varying,character varying,uuid,uuid) line 16 at SQL statement]; SQL was >>>>>>> [{call insertvmtemplate(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>>> ?, ?, ?, ?)}] for task [CallableStatementCallback]</error>* >>>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Martin Perina >>>>> Associate Manager, Software Engineering >>>>> Red Hat Czech s.r.o. >>>>> >>>> >>>> >>>> >>>> -- >>>> Martin Perina >>>> Associate Manager, Software Engineering >>>> Red Hat Czech s.r.o. >>>> >>> >>> >>> >>> -- >>> Martin Perina >>> Associate Manager, Software Engineering >>> Red Hat Czech s.r.o. >>> >> >> > > > -- > Martin Perina > Associate Manager, Software Engineering > Red Hat Czech s.r.o. >