Hi, This failure seems to be related to the regression we found earlier today which was causing failure in initialize engine: https://gerrit.ovirt.org/#/c/89293/ - core:make search string fields not null and empty The fix for the above change was reported as failed on the update template test with an error which I think is related to the same regression. https://gerrit.ovirt.org/#/c/91476/ - db: resolve duplicate db scripts Can you please have a look? *Link to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/a... <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/artifa... error snippet from the log: <error>2018-05-22 12:40:21,015-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runQuery, params: [GetSoundDevices, IdQueryParameters:{refresh='false', filtered='false'}], timeElapsed: 3ms2018-05-22 12:40:21,021-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 1ms2018-05-22 12:40:21,045-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Lock Acquired to object 'EngineLock:{exclusiveLocks='[2f43ef56-db61-4d93-99ee-00e84c741a29=DISK, bb954b00-d22c-4421-aba2-35335f9c441f=TEMPLATE, 9d749a87-45c9-4251-8e69-e55da5d3deed=DISK]', sharedLocks='[5cf93146-a5f1-4330-affe-672eaf39cc0d=VM, 4c68925d-569d-4987-8f54-29859763391a=TEMPLATE]'}'2018-05-22 12:40:21,097-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 2ms2018-05-22 12:40:21,111-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Running command: AddVmTemplateCommand internal: false. Entities affected : ID: 79448f95-c26c-45b6-b396-ecd8fe98c2d9 Type: StoragePoolAction group CREATE_TEMPLATE with role type USER2018-05-22 12:40:21,115-04 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', status='ImageLocked', exitStatus='Normal'}), log id: 4897bb3a2018-05-22 12:40:21,117-04 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] FINISH, SetVmStatusVDSCommand, return: , log id: 4897bb3a2018-05-22 12:40:21,117-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runVdsCommand, params: [SetVmStatus, SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', status='ImageLocked', exitStatus='Normal'}], timeElapsed: 4ms2018-05-22 12:40:21,125-04 DEBUG [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Translating SQLException with SQL state '23502', error code '0', message [ERROR: null value in column "description" violates not-null constraint Detail: Failing row contains (bb954b00-d22c-4421-aba2-35335f9c441f, CirrOS_0.4.0_for_x86_64_glance_template, 512, 4c68925d-569d-4987-8f54-29859763391a, 0, null, 5e28a528-59ad-4054-9397-a9174ec356a7, 2018-05-22 12:40:21.119-04, 1, null, f, 1, 1, 1, Etc/GMT, t, f, 2018-05-22 12:40:21.120272-04, null, null, f, 1, 0, 0, 1, 0, , 3, null, null, null, 0, , , 256, TEMPLATE, 0, 1, 7d498f3a-b16d-4574-9e47-9c87cd1c866b, f, null, f, f, 1, f, f, f, bd48ab26-5ddb-11e8-b3bb-5452c0a8c904, null, , f, 0, null, null, null, guest_agent, null, null, null, 2, null, 2, 12345678, f, interleave, t, t, 20fa3adb-29f2-4938-b07a-751d63a65447, null, null, null, 0, null, 3463183e-b5ce-076d-2a26-0e3e9d93dafb, d2f75033-25ec-e3b3-3c27-351115d4aa2b, null, 0, LOCK_SCREEN, 2, null, null, 2048, null, AUTO_RESUME). Where: SQL statement "INSERT INTO vm_static( child_count, creation_date, description, free_text_comment, mem_size_mb, max_memory_size_mb, num_of_io_threads, vm_name, num_of_sockets, cpu_per_socket, threads_per_cpu, os, vm_guid, cluster_id, num_of_monitors, single_qxl_pci, allow_console_reconnect, template_status, usb_policy, time_zone, fail_back, vm_type, nice_level, cpu_shares, default_boot_sequence, default_display_type, priority, auto_startup, is_stateless, iso_path, origin, initrd_url, kernel_url, kernel_params, entity_type, quota_id, migration_support, is_disabled,dedicated_vm_for_vds, is_smartcard_enabled, is_delete_protected, sso_method, tunnel_migration, vnc_keyboard_layout, min_allocated_mem, is_run_and_pause, created_by_user_id, migration_downtime, template_version_number, vmt_guid, template_version_name, serial_number_policy, custom_serial_number, is_boot_menu_enabled, is_spice_file_transfer_enabled, is_spice_copy_paste_enabled, cpu_profile_id, numatune_mode, is_auto_converge, is_migrate_compressed, predefined_properties, userdefined_properties, custom_emulated_machine, bios_type, custom_cpu_name, small_icon_id, large_icon_id, console_disconnect_action, resume_behavior, custom_compatibility_version, migration_policy_id, lease_sd_id) VALUES( v_child_count, v_creation_date, v_description, v_free_text_comment, v_mem_size_mb, v_max_memory_size_mb, v_num_of_io_threads, v_name, v_num_of_sockets, v_cpu_per_socket, v_threads_per_cpu, v_os, v_vmt_guid, v_cluster_id, v_num_of_monitors, v_single_qxl_pci, v_allow_console_reconnect, v_status, v_usb_policy, v_time_zone, v_fail_back, v_vm_type, v_nice_level, v_cpu_shares, v_default_boot_sequence, v_default_display_type, v_priority, v_auto_startup, v_is_stateless, v_iso_path, v_origin, v_initrd_url, v_kernel_url, v_kernel_params, v_template_type, v_quota_id, v_migration_support, v_is_disabled, v_dedicated_vm_for_vds, v_is_smartcard_enabled, v_is_delete_protected, v_sso_method, v_tunnel_migration, v_vnc_keyboard_layout, v_min_allocated_mem, v_is_run_and_pause, v_created_by_user_id, v_migration_downtime, v_template_version_number, v_base_template_id, v_template_version_name, v_serial_number_policy, v_custom_serial_number, v_is_boot_menu_enabled, v_is_spice_file_transfer_enabled, v_is_spice_copy_paste_enabled, v_cpu_profile_id, v_numatune_mode, v_is_auto_converge, v_is_migrate_compressed, v_predefined_properties, v_userdefined_properties, v_custom_emulated_machine, v_bios_type, v_custom_cpu_name, v_small_icon_id, v_large_icon_id, v_console_disconnect_action, v_resume_behavior, v_custom_compatibility_version, v_migration_policy_id, v_lease_sd_id)"PL/pgSQL function insertvmtemplate(integer,timestamp with time zone,character varying,text,integer,integer,integer,character varying,integer,integer,integer,integer,uuid,uuid,integer,boolean,boolean,integer,integer,character varying,boolean,integer,integer,integer,integer,integer,integer,boolean,boolean,boolean,boolean,character varying,boolean,character varying,integer,character varying,character varying,character varying,uuid,integer,text,boolean,character varying,integer,boolean,uuid,character varying,integer,uuid,character varying,smallint,character varying,boolean,boolean,boolean,uuid,character varying,boolean,boolean,character varying,character varying,character varying,integer,character varying,uuid,uuid,character varying,character varying,character varying,uuid,uuid) line 16 at SQL statement]; SQL was [{call insertvmtemplate(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}] for task [CallableStatementCallback]</error>*

On Wed, May 23, 2018 at 11:55 AM, Dafna Ron <dron(a)redhat.com&gt; wrote: > Eli, Martin - can you please take a look? > ​We have discussed a few minutes ago, Eli is looking at it.

Thanks Martin ​ > > Thanks, > Dafna > > > On Tue, May 22, 2018 at 7:09 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: > >> Hi, >> >> This failure seems to be related to the regression we found earlier >> today which was causing failure in initialize engine: >> https://gerrit.ovirt.org/#/c/89293/ - core:make search string fields >> not null and empty >> >> The fix for the above change was reported as failed on the update >> template test with an error which I think is related to the same >> regression. >> >> https://gerrit.ovirt.org/#/c/91476/ - db: resolve duplicate db scripts >> >> Can you please have a look? >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> *Link to >> Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/ >> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/>Link >> to all >> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/a... >> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/artifa... >> error snippet from the log: <error>2018-05-22 12:40:21,015-04 DEBUG >> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runQuery, >> params: [GetSoundDevices, IdQueryParameters:{refresh='false', >> filtered='false'}], timeElapsed: 3ms2018-05-22 12:40:21,021-04 DEBUG >> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 1ms2018-05-22 >> 12:40:21,045-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Lock Acquired to >> object >> 'EngineLock:{exclusiveLocks='[2f43ef56-db61-4d93-99ee-00e84c741a29=DISK, >> bb954b00-d22c-4421-aba2-35335f9c441f=TEMPLATE, >> 9d749a87-45c9-4251-8e69-e55da5d3deed=DISK]', >> sharedLocks='[5cf93146-a5f1-4330-affe-672eaf39cc0d=VM, >> 4c68925d-569d-4987-8f54-29859763391a=TEMPLATE]'}'2018-05-22 12:40:21,097-04 >> DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 2ms2018-05-22 >> 12:40:21,111-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Running command: >> AddVmTemplateCommand internal: false. Entities affected : ID: >> 79448f95-c26c-45b6-b396-ecd8fe98c2d9 Type: StoragePoolAction group >> CREATE_TEMPLATE with role type USER2018-05-22 12:40:21,115-04 INFO >> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >> [aa79ad89-02ea-4474-ad41-78cf52243b41] START, SetVmStatusVDSCommand( >> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >> status='ImageLocked', exitStatus='Normal'}), log id: 4897bb3a2018-05-22 >> 12:40:21,117-04 INFO >> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >> [aa79ad89-02ea-4474-ad41-78cf52243b41] FINISH, SetVmStatusVDSCommand, >> return: , log id: 4897bb3a2018-05-22 12:40:21,117-04 DEBUG >> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: >> runVdsCommand, params: [SetVmStatus, >> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >> status='ImageLocked', exitStatus='Normal'}], timeElapsed: 4ms2018-05-22 >> 12:40:21,125-04 DEBUG >> [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] >> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Translating >> SQLException with SQL state '23502', error code '0', message [ERROR: null >> value in column "description" violates not-null constraint Detail: Failing >> row contains (bb954b00-d22c-4421-aba2-35335f9c441f, >> CirrOS_0.4.0_for_x86_64_glance_template, 512, >> 4c68925d-569d-4987-8f54-29859763391a, 0, null, >> 5e28a528-59ad-4054-9397-a9174ec356a7, 2018-05-22 12:40:21.119-04, 1, null, >> f, 1, 1, 1, Etc/GMT, t, f, 2018-05-22 12:40:21.120272-04, null, null, f, 1, >> 0, 0, 1, 0, , 3, null, null, null, 0, , , 256, TEMPLATE, 0, 1, >> 7d498f3a-b16d-4574-9e47-9c87cd1c866b, f, null, f, f, 1, f, f, f, >> bd48ab26-5ddb-11e8-b3bb-5452c0a8c904, null, , f, 0, null, null, null, >> guest_agent, null, null, null, 2, null, 2, 12345678, f, interleave, t, t, >> 20fa3adb-29f2-4938-b07a-751d63a65447, null, null, null, 0, null, >> 3463183e-b5ce-076d-2a26-0e3e9d93dafb, d2f75033-25ec-e3b3-3c27-351115d4aa2b, >> null, 0, LOCK_SCREEN, 2, null, null, 2048, null, AUTO_RESUME). Where: SQL >> statement "INSERT INTO vm_static( child_count, >> creation_date, description, free_text_comment, >> mem_size_mb, max_memory_size_mb, num_of_io_threads, >> vm_name, num_of_sockets, cpu_per_socket, >> threads_per_cpu, os, vm_guid, cluster_id, >> num_of_monitors, single_qxl_pci, >> allow_console_reconnect, template_status, usb_policy, >> time_zone, fail_back, vm_type, nice_level, >> cpu_shares, default_boot_sequence, >> default_display_type, priority, auto_startup, >> is_stateless, iso_path, origin, initrd_url, >> kernel_url, kernel_params, entity_type, >> quota_id, migration_support, >> is_disabled,dedicated_vm_for_vds, is_smartcard_enabled, >> is_delete_protected, sso_method, tunnel_migration, >> vnc_keyboard_layout, min_allocated_mem, >> is_run_and_pause, created_by_user_id, >> migration_downtime, template_version_number, vmt_guid, >> template_version_name, serial_number_policy, >> custom_serial_number, is_boot_menu_enabled, >> is_spice_file_transfer_enabled, is_spice_copy_paste_enabled, >> cpu_profile_id, numatune_mode, is_auto_converge, >> is_migrate_compressed, predefined_properties, >> userdefined_properties, custom_emulated_machine, >> bios_type, custom_cpu_name, small_icon_id, >> large_icon_id, console_disconnect_action, >> resume_behavior, custom_compatibility_version, >> migration_policy_id, lease_sd_id) VALUES( >> v_child_count, v_creation_date, v_description, >> v_free_text_comment, v_mem_size_mb, >> v_max_memory_size_mb, v_num_of_io_threads, v_name, >> v_num_of_sockets, v_cpu_per_socket, >> v_threads_per_cpu, v_os, v_vmt_guid, v_cluster_id, >> v_num_of_monitors, v_single_qxl_pci, >> v_allow_console_reconnect, v_status, v_usb_policy, >> v_time_zone, v_fail_back, v_vm_type, >> v_nice_level, v_cpu_shares, v_default_boot_sequence, >> v_default_display_type, v_priority, v_auto_startup, >> v_is_stateless, v_iso_path, v_origin, >> v_initrd_url, v_kernel_url, v_kernel_params, >> v_template_type, v_quota_id, v_migration_support, >> v_is_disabled, v_dedicated_vm_for_vds, >> v_is_smartcard_enabled, v_is_delete_protected, >> v_sso_method, v_tunnel_migration, >> v_vnc_keyboard_layout, v_min_allocated_mem, >> v_is_run_and_pause, v_created_by_user_id, >> v_migration_downtime, v_template_version_number, >> v_base_template_id, v_template_version_name, >> v_serial_number_policy, v_custom_serial_number, >> v_is_boot_menu_enabled, v_is_spice_file_transfer_enabled, >> v_is_spice_copy_paste_enabled, v_cpu_profile_id, >> v_numatune_mode, v_is_auto_converge, >> v_is_migrate_compressed, v_predefined_properties, >> v_userdefined_properties, v_custom_emulated_machine, >> v_bios_type, v_custom_cpu_name, v_small_icon_id, >> v_large_icon_id, v_console_disconnect_action, >> v_resume_behavior, v_custom_compatibility_version, >> v_migration_policy_id, v_lease_sd_id)"PL/pgSQL function >> insertvmtemplate(integer,timestamp with time zone,character >> varying,text,integer,integer,integer,character >> varying,integer,integer,integer,integer,uuid,uuid,integer,boolean,boolean,integer,integer,character >> varying,boolean,integer,integer,integer,integer,integer,integer,boolean,boolean,boolean,boolean,character >> varying,boolean,character varying,integer,character varying,character >> varying,character varying,uuid,integer,text,boolean,character >> varying,integer,boolean,uuid,character varying,integer,uuid,character >> varying,smallint,character varying,boolean,boolean,boolean,uuid,character >> varying,boolean,boolean,character varying,character varying,character >> varying,integer,character varying,uuid,uuid,character varying,character >> varying,character varying,uuid,uuid) line 16 at SQL statement]; SQL was >> [{call insertvmtemplate(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >> ?, ?, ?, ?)}] for task [CallableStatementCallback]</error>* >> > > -- Martin Perina Associate Manager, Software Engineering Red Hat Czech s.r.o.

On Wed, May 23, 2018 at 2:08 PM, Martin Perina <mperina(a)redhat.com&gt; wrote: > > > On Wed, May 23, 2018 at 12:23 PM, Martin Perina <mperina(a)redhat.com&gt; > wrote: > >> >> >> On Wed, May 23, 2018 at 11:55 AM, Dafna Ron <dron(a)redhat.com&gt; wrote: >> >>> Eli, Martin - can you please take a look? >>> >> >> ​We have discussed a few minutes ago, Eli is looking at it. >> > > ​Here's possible fix: https://gerrit.ovirt.org/91534​ > We want to verify it by OST run, but looks like manual engine RPM builds > are either not working or it takes REALLY long time to start ... > ​Adding Arik to the thread, it looks like the above fix doesn't help, we are continuing with investigations ... ​ > > >> Thanks >> >> Martin >> >> ​ >> >>> >>> Thanks, >>> Dafna >>> >>> >>> On Tue, May 22, 2018 at 7:09 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>> >>>> Hi, >>>> >>>> This failure seems to be related to the regression we found earlier >>>> today which was causing failure in initialize engine: >>>> https://gerrit.ovirt.org/#/c/89293/ - core:make search string fields >>>> not null and empty >>>> >>>> The fix for the above change was reported as failed on the update >>>> template test with an error which I think is related to the same >>>> regression. >>>> >>>> https://gerrit.ovirt.org/#/c/91476/ - db: resolve duplicate db scripts >>>> >>>> Can you please have a look? >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> *Link to >>>> Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/ >>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/>Link >>>> to all >>>> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/a... >>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/artifa... >>>> error snippet from the log: <error>2018-05-22 12:40:21,015-04 DEBUG >>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runQuery, >>>> params: [GetSoundDevices, IdQueryParameters:{refresh='false', >>>> filtered='false'}], timeElapsed: 3ms2018-05-22 12:40:21,021-04 DEBUG >>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 1ms2018-05-22 >>>> 12:40:21,045-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Lock Acquired to >>>> object >>>> 'EngineLock:{exclusiveLocks='[2f43ef56-db61-4d93-99ee-00e84c741a29=DISK, >>>> bb954b00-d22c-4421-aba2-35335f9c441f=TEMPLATE, >>>> 9d749a87-45c9-4251-8e69-e55da5d3deed=DISK]', >>>> sharedLocks='[5cf93146-a5f1-4330-affe-672eaf39cc0d=VM, >>>> 4c68925d-569d-4987-8f54-29859763391a=TEMPLATE]'}'2018-05-22 12:40:21,097-04 >>>> DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 2ms2018-05-22 >>>> 12:40:21,111-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Running command: >>>> AddVmTemplateCommand internal: false. Entities affected : ID: >>>> 79448f95-c26c-45b6-b396-ecd8fe98c2d9 Type: StoragePoolAction group >>>> CREATE_TEMPLATE with role type USER2018-05-22 12:40:21,115-04 INFO >>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] START, SetVmStatusVDSCommand( >>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>> status='ImageLocked', exitStatus='Normal'}), log id: 4897bb3a2018-05-22 >>>> 12:40:21,117-04 INFO >>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] FINISH, SetVmStatusVDSCommand, >>>> return: , log id: 4897bb3a2018-05-22 12:40:21,117-04 DEBUG >>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: >>>> runVdsCommand, params: [SetVmStatus, >>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>> status='ImageLocked', exitStatus='Normal'}], timeElapsed: 4ms2018-05-22 >>>> 12:40:21,125-04 DEBUG >>>> [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] >>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Translating >>>> SQLException with SQL state '23502', error code '0', message [ERROR: null >>>> value in column "description" violates not-null constraint Detail: Failing >>>> row contains (bb954b00-d22c-4421-aba2-35335f9c441f, >>>> CirrOS_0.4.0_for_x86_64_glance_template, 512, >>>> 4c68925d-569d-4987-8f54-29859763391a, 0, null, >>>> 5e28a528-59ad-4054-9397-a9174ec356a7, 2018-05-22 12:40:21.119-04, 1, null, >>>> f, 1, 1, 1, Etc/GMT, t, f, 2018-05-22 12:40:21.120272-04, null, null, f, 1, >>>> 0, 0, 1, 0, , 3, null, null, null, 0, , , 256, TEMPLATE, 0, 1, >>>> 7d498f3a-b16d-4574-9e47-9c87cd1c866b, f, null, f, f, 1, f, f, f, >>>> bd48ab26-5ddb-11e8-b3bb-5452c0a8c904, null, , f, 0, null, null, null, >>>> guest_agent, null, null, null, 2, null, 2, 12345678, f, interleave, t, t, >>>> 20fa3adb-29f2-4938-b07a-751d63a65447, null, null, null, 0, null, >>>> 3463183e-b5ce-076d-2a26-0e3e9d93dafb, d2f75033-25ec-e3b3-3c27-351115d4aa2b, >>>> null, 0, LOCK_SCREEN, 2, null, null, 2048, null, AUTO_RESUME). Where: SQL >>>> statement "INSERT INTO vm_static( child_count, >>>> creation_date, description, free_text_comment, >>>> mem_size_mb, max_memory_size_mb, num_of_io_threads, >>>> vm_name, num_of_sockets, cpu_per_socket, >>>> threads_per_cpu, os, vm_guid, cluster_id, >>>> num_of_monitors, single_qxl_pci, >>>> allow_console_reconnect, template_status, usb_policy, >>>> time_zone, fail_back, vm_type, nice_level, >>>> cpu_shares, default_boot_sequence, >>>> default_display_type, priority, auto_startup, >>>> is_stateless, iso_path, origin, initrd_url, >>>> kernel_url, kernel_params, entity_type, >>>> quota_id, migration_support, >>>> is_disabled,dedicated_vm_for_vds, is_smartcard_enabled, >>>> is_delete_protected, sso_method, tunnel_migration, >>>> vnc_keyboard_layout, min_allocated_mem, >>>> is_run_and_pause, created_by_user_id, >>>> migration_downtime, template_version_number, vmt_guid, >>>> template_version_name, serial_number_policy, >>>> custom_serial_number, is_boot_menu_enabled, >>>> is_spice_file_transfer_enabled, is_spice_copy_paste_enabled, >>>> cpu_profile_id, numatune_mode, is_auto_converge, >>>> is_migrate_compressed, predefined_properties, >>>> userdefined_properties, custom_emulated_machine, >>>> bios_type, custom_cpu_name, small_icon_id, >>>> large_icon_id, console_disconnect_action, >>>> resume_behavior, custom_compatibility_version, >>>> migration_policy_id, lease_sd_id) VALUES( >>>> v_child_count, v_creation_date, v_description, >>>> v_free_text_comment, v_mem_size_mb, >>>> v_max_memory_size_mb, v_num_of_io_threads, v_name, >>>> v_num_of_sockets, v_cpu_per_socket, >>>> v_threads_per_cpu, v_os, v_vmt_guid, v_cluster_id, >>>> v_num_of_monitors, v_single_qxl_pci, >>>> v_allow_console_reconnect, v_status, v_usb_policy, >>>> v_time_zone, v_fail_back, v_vm_type, >>>> v_nice_level, v_cpu_shares, v_default_boot_sequence, >>>> v_default_display_type, v_priority, v_auto_startup, >>>> v_is_stateless, v_iso_path, v_origin, >>>> v_initrd_url, v_kernel_url, v_kernel_params, >>>> v_template_type, v_quota_id, v_migration_support, >>>> v_is_disabled, v_dedicated_vm_for_vds, >>>> v_is_smartcard_enabled, v_is_delete_protected, >>>> v_sso_method, v_tunnel_migration, >>>> v_vnc_keyboard_layout, v_min_allocated_mem, >>>> v_is_run_and_pause, v_created_by_user_id, >>>> v_migration_downtime, v_template_version_number, >>>> v_base_template_id, v_template_version_name, >>>> v_serial_number_policy, v_custom_serial_number, >>>> v_is_boot_menu_enabled, v_is_spice_file_transfer_enabled, >>>> v_is_spice_copy_paste_enabled, v_cpu_profile_id, >>>> v_numatune_mode, v_is_auto_converge, >>>> v_is_migrate_compressed, v_predefined_properties, >>>> v_userdefined_properties, v_custom_emulated_machine, >>>> v_bios_type, v_custom_cpu_name, v_small_icon_id, >>>> v_large_icon_id, v_console_disconnect_action, >>>> v_resume_behavior, v_custom_compatibility_version, >>>> v_migration_policy_id, v_lease_sd_id)"PL/pgSQL function >>>> insertvmtemplate(integer,timestamp with time zone,character >>>> varying,text,integer,integer,integer,character >>>> varying,integer,integer,integer,integer,uuid,uuid,integer,boolean,boolean,integer,integer,character >>>> varying,boolean,integer,integer,integer,integer,integer,integer,boolean,boolean,boolean,boolean,character >>>> varying,boolean,character varying,integer,character varying,character >>>> varying,character varying,uuid,integer,text,boolean,character >>>> varying,integer,boolean,uuid,character varying,integer,uuid,character >>>> varying,smallint,character varying,boolean,boolean,boolean,uuid,character >>>> varying,boolean,boolean,character varying,character varying,character >>>> varying,integer,character varying,uuid,uuid,character varying,character >>>> varying,character varying,uuid,uuid) line 16 at SQL statement]; SQL was >>>> [{call insertvmtemplate(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>> ?, ?, ?, ?)}] for task [CallableStatementCallback]</error>* >>>> >>> >>> >> >> >> -- >> Martin Perina >> Associate Manager, Software Engineering >> Red Hat Czech s.r.o. >> > > > > -- > Martin Perina > Associate Manager, Software Engineering > Red Hat Czech s.r.o. > -- Martin Perina Associate Manager, Software Engineering Red Hat Czech s.r.o.

On Wed, May 23, 2018 at 5:11 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: > Arik - any update? > > Thanks, > Dafna > ​We have confirmed that the fix doesn't work. If we haven't found a fix till tomorrow noon, we will revert the patch. ​ > > > On Wed, May 23, 2018 at 1:23 PM, Martin Perina <mperina(a)redhat.com&gt; > wrote: > >> >> >> On Wed, May 23, 2018 at 2:08 PM, Martin Perina <mperina(a)redhat.com&gt; >> wrote: >> >>> >>> >>> On Wed, May 23, 2018 at 12:23 PM, Martin Perina <mperina(a)redhat.com&gt; >>> wrote: >>> >>>> >>>> >>>> On Wed, May 23, 2018 at 11:55 AM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>>> >>>>> Eli, Martin - can you please take a look? >>>>> >>>> >>>> ​We have discussed a few minutes ago, Eli is looking at it. >>>> >>> >>> ​Here's possible fix: https://gerrit.ovirt.org/91534​ >>> We want to verify it by OST run, but looks like manual engine RPM >>> builds are either not working or it takes REALLY long time to start ... >>> >> >> ​Adding Arik to the thread, it looks like the above fix doesn't help, we >> are continuing with investigations ... >> ​ >> >>> >>> >>>> Thanks >>>> >>>> Martin >>>> >>>> ​ >>>> >>>>> >>>>> Thanks, >>>>> Dafna >>>>> >>>>> >>>>> On Tue, May 22, 2018 at 7:09 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> This failure seems to be related to the regression we found earlier >>>>>> today which was causing failure in initialize engine: >>>>>> https://gerrit.ovirt.org/#/c/89293/ - core:make search string >>>>>> fields not null and empty >>>>>> >>>>>> The fix for the above change was reported as failed on the update >>>>>> template test with an error which I think is related to the same >>>>>> regression. >>>>>> >>>>>> https://gerrit.ovirt.org/#/c/91476/ - db: resolve duplicate db >>>>>> scripts >>>>>> >>>>>> Can you please have a look? >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> *Link to >>>>>> Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/ >>>>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/>Link >>>>>> to all >>>>>> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/a... >>>>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/artifa... >>>>>> error snippet from the log: <error>2018-05-22 12:40:21,015-04 DEBUG >>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runQuery, >>>>>> params: [GetSoundDevices, IdQueryParameters:{refresh='false', >>>>>> filtered='false'}], timeElapsed: 3ms2018-05-22 12:40:21,021-04 DEBUG >>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 1ms2018-05-22 >>>>>> 12:40:21,045-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Lock Acquired to >>>>>> object >>>>>> 'EngineLock:{exclusiveLocks='[2f43ef56-db61-4d93-99ee-00e84c741a29=DISK, >>>>>> bb954b00-d22c-4421-aba2-35335f9c441f=TEMPLATE, >>>>>> 9d749a87-45c9-4251-8e69-e55da5d3deed=DISK]', >>>>>> sharedLocks='[5cf93146-a5f1-4330-affe-672eaf39cc0d=VM, >>>>>> 4c68925d-569d-4987-8f54-29859763391a=TEMPLATE]'}'2018-05-22 12:40:21,097-04 >>>>>> DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 2ms2018-05-22 >>>>>> 12:40:21,111-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Running command: >>>>>> AddVmTemplateCommand internal: false. Entities affected : ID: >>>>>> 79448f95-c26c-45b6-b396-ecd8fe98c2d9 Type: StoragePoolAction group >>>>>> CREATE_TEMPLATE with role type USER2018-05-22 12:40:21,115-04 INFO >>>>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] START, SetVmStatusVDSCommand( >>>>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>>>> status='ImageLocked', exitStatus='Normal'}), log id: 4897bb3a2018-05-22 >>>>>> 12:40:21,117-04 INFO >>>>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] FINISH, SetVmStatusVDSCommand, >>>>>> return: , log id: 4897bb3a2018-05-22 12:40:21,117-04 DEBUG >>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: >>>>>> runVdsCommand, params: [SetVmStatus, >>>>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>>>> status='ImageLocked', exitStatus='Normal'}], timeElapsed: 4ms2018-05-22 >>>>>> 12:40:21,125-04 DEBUG >>>>>> [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] >>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Translating >>>>>> SQLException with SQL state '23502', error code '0', message [ERROR: null >>>>>> value in column "description" violates not-null constraint Detail: Failing >>>>>> row contains (bb954b00-d22c-4421-aba2-35335f9c441f, >>>>>> CirrOS_0.4.0_for_x86_64_glance_template, 512, >>>>>> 4c68925d-569d-4987-8f54-29859763391a, 0, null, >>>>>> 5e28a528-59ad-4054-9397-a9174ec356a7, 2018-05-22 12:40:21.119-04, 1, null, >>>>>> f, 1, 1, 1, Etc/GMT, t, f, 2018-05-22 12:40:21.120272-04, null, null, f, 1, >>>>>> 0, 0, 1, 0, , 3, null, null, null, 0, , , 256, TEMPLATE, 0, 1, >>>>>> 7d498f3a-b16d-4574-9e47-9c87cd1c866b, f, null, f, f, 1, f, f, f, >>>>>> bd48ab26-5ddb-11e8-b3bb-5452c0a8c904, null, , f, 0, null, null, null, >>>>>> guest_agent, null, null, null, 2, null, 2, 12345678, f, interleave, t, t, >>>>>> 20fa3adb-29f2-4938-b07a-751d63a65447, null, null, null, 0, null, >>>>>> 3463183e-b5ce-076d-2a26-0e3e9d93dafb, d2f75033-25ec-e3b3-3c27-351115d4aa2b, >>>>>> null, 0, LOCK_SCREEN, 2, null, null, 2048, null, AUTO_RESUME). Where: SQL >>>>>> statement "INSERT INTO vm_static( child_count, >>>>>> creation_date, description, free_text_comment, >>>>>> mem_size_mb, max_memory_size_mb, num_of_io_threads, >>>>>> vm_name, num_of_sockets, cpu_per_socket, >>>>>> threads_per_cpu, os, vm_guid, cluster_id, >>>>>> num_of_monitors, single_qxl_pci, >>>>>> allow_console_reconnect, template_status, usb_policy, >>>>>> time_zone, fail_back, vm_type, nice_level, >>>>>> cpu_shares, default_boot_sequence, >>>>>> default_display_type, priority, auto_startup, >>>>>> is_stateless, iso_path, origin, initrd_url, >>>>>> kernel_url, kernel_params, entity_type, >>>>>> quota_id, migration_support, >>>>>> is_disabled,dedicated_vm_for_vds, is_smartcard_enabled, >>>>>> is_delete_protected, sso_method, tunnel_migration, >>>>>> vnc_keyboard_layout, min_allocated_mem, >>>>>> is_run_and_pause, created_by_user_id, >>>>>> migration_downtime, template_version_number, vmt_guid, >>>>>> template_version_name, serial_number_policy, >>>>>> custom_serial_number, is_boot_menu_enabled, >>>>>> is_spice_file_transfer_enabled, is_spice_copy_paste_enabled, >>>>>> cpu_profile_id, numatune_mode, is_auto_converge, >>>>>> is_migrate_compressed, predefined_properties, >>>>>> userdefined_properties, custom_emulated_machine, >>>>>> bios_type, custom_cpu_name, small_icon_id, >>>>>> large_icon_id, console_disconnect_action, >>>>>> resume_behavior, custom_compatibility_version, >>>>>> migration_policy_id, lease_sd_id) VALUES( >>>>>> v_child_count, v_creation_date, v_description, >>>>>> v_free_text_comment, v_mem_size_mb, >>>>>> v_max_memory_size_mb, v_num_of_io_threads, v_name, >>>>>> v_num_of_sockets, v_cpu_per_socket, >>>>>> v_threads_per_cpu, v_os, v_vmt_guid, v_cluster_id, >>>>>> v_num_of_monitors, v_single_qxl_pci, >>>>>> v_allow_console_reconnect, v_status, v_usb_policy, >>>>>> v_time_zone, v_fail_back, v_vm_type, >>>>>> v_nice_level, v_cpu_shares, v_default_boot_sequence, >>>>>> v_default_display_type, v_priority, v_auto_startup, >>>>>> v_is_stateless, v_iso_path, v_origin, >>>>>> v_initrd_url, v_kernel_url, v_kernel_params, >>>>>> v_template_type, v_quota_id, v_migration_support, >>>>>> v_is_disabled, v_dedicated_vm_for_vds, >>>>>> v_is_smartcard_enabled, v_is_delete_protected, >>>>>> v_sso_method, v_tunnel_migration, >>>>>> v_vnc_keyboard_layout, v_min_allocated_mem, >>>>>> v_is_run_and_pause, v_created_by_user_id, >>>>>> v_migration_downtime, v_template_version_number, >>>>>> v_base_template_id, v_template_version_name, >>>>>> v_serial_number_policy, v_custom_serial_number, >>>>>> v_is_boot_menu_enabled, v_is_spice_file_transfer_enabled, >>>>>> v_is_spice_copy_paste_enabled, v_cpu_profile_id, >>>>>> v_numatune_mode, v_is_auto_converge, >>>>>> v_is_migrate_compressed, v_predefined_properties, >>>>>> v_userdefined_properties, v_custom_emulated_machine, >>>>>> v_bios_type, v_custom_cpu_name, v_small_icon_id, >>>>>> v_large_icon_id, v_console_disconnect_action, >>>>>> v_resume_behavior, v_custom_compatibility_version, >>>>>> v_migration_policy_id, v_lease_sd_id)"PL/pgSQL function >>>>>> insertvmtemplate(integer,timestamp with time zone,character >>>>>> varying,text,integer,integer,integer,character >>>>>> varying,integer,integer,integer,integer,uuid,uuid,integer,boolean,boolean,integer,integer,character >>>>>> varying,boolean,integer,integer,integer,integer,integer,integer,boolean,boolean,boolean,boolean,character >>>>>> varying,boolean,character varying,integer,character varying,character >>>>>> varying,character varying,uuid,integer,text,boolean,character >>>>>> varying,integer,boolean,uuid,character varying,integer,uuid,character >>>>>> varying,smallint,character varying,boolean,boolean,boolean,uuid,character >>>>>> varying,boolean,boolean,character varying,character varying,character >>>>>> varying,integer,character varying,uuid,uuid,character varying,character >>>>>> varying,character varying,uuid,uuid) line 16 at SQL statement]; SQL was >>>>>> [{call insertvmtemplate(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>> ?, ?, ?, ?)}] for task [CallableStatementCallback]</error>* >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Martin Perina >>>> Associate Manager, Software Engineering >>>> Red Hat Czech s.r.o. >>>> >>> >>> >>> >>> -- >>> Martin Perina >>> Associate Manager, Software Engineering >>> Red Hat Czech s.r.o. >>> >> >> >> >> -- >> Martin Perina >> Associate Manager, Software Engineering >> Red Hat Czech s.r.o. >> > > -- Martin Perina Associate Manager, Software Engineering Red Hat Czech s.r.o.

Seems as [1] solves the issue [1] https://gerrit.ovirt.org/#/c/91586/ On Wed, May 23, 2018 at 6:19 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: > ok. thank you for the update Martin. > > On Wed, May 23, 2018 at 4:16 PM, Martin Perina <mperina(a)redhat.com&gt; > wrote: > >> >> >> On Wed, May 23, 2018 at 5:11 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: >> >>> Arik - any update? >>> >>> Thanks, >>> Dafna >>> >> >> ​We have confirmed that the fix doesn't work. If we haven't found a fix >> till tomorrow noon, we will revert the patch. >> ​ >> >>> >>> >>> On Wed, May 23, 2018 at 1:23 PM, Martin Perina <mperina(a)redhat.com&gt; >>> wrote: >>> >>>> >>>> >>>> On Wed, May 23, 2018 at 2:08 PM, Martin Perina <mperina(a)redhat.com&gt; >>>> wrote: >>>> >>>>> >>>>> >>>>> On Wed, May 23, 2018 at 12:23 PM, Martin Perina <mperina(a)redhat.com&gt; >>>>> wrote: >>>>> >>>>>> >>>>>> >>>>>> On Wed, May 23, 2018 at 11:55 AM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>>>>> >>>>>>> Eli, Martin - can you please take a look? >>>>>>> >>>>>> >>>>>> ​We have discussed a few minutes ago, Eli is looking at it. >>>>>> >>>>> >>>>> ​Here's possible fix: https://gerrit.ovirt.org/91534​ >>>>> We want to verify it by OST run, but looks like manual engine RPM >>>>> builds are either not working or it takes REALLY long time to start ... >>>>> >>>> >>>> ​Adding Arik to the thread, it looks like the above fix doesn't help, >>>> we are continuing with investigations ... >>>> ​ >>>> >>>>> >>>>> >>>>>> Thanks >>>>>> >>>>>> Martin >>>>>> >>>>>> ​ >>>>>> >>>>>>> >>>>>>> Thanks, >>>>>>> Dafna >>>>>>> >>>>>>> >>>>>>> On Tue, May 22, 2018 at 7:09 PM, Dafna Ron <dron(a)redhat.com&gt; wrote: >>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> This failure seems to be related to the regression we found >>>>>>>> earlier today which was causing failure in initialize engine: >>>>>>>> https://gerrit.ovirt.org/#/c/89293/ - core:make search string >>>>>>>> fields not null and empty >>>>>>>> >>>>>>>> The fix for the above change was reported as failed on the update >>>>>>>> template test with an error which I think is related to the same >>>>>>>> regression. >>>>>>>> >>>>>>>> https://gerrit.ovirt.org/#/c/91476/ - db: resolve duplicate db >>>>>>>> scripts >>>>>>>> >>>>>>>> Can you please have a look? >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> *Link to >>>>>>>> Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/ >>>>>>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/>Link >>>>>>>> to all >>>>>>>> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/a... >>>>>>>> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7675/artifa... >>>>>>>> error snippet from the log: <error>2018-05-22 12:40:21,015-04 DEBUG >>>>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: runQuery, >>>>>>>> params: [GetSoundDevices, IdQueryParameters:{refresh='false', >>>>>>>> filtered='false'}], timeElapsed: 3ms2018-05-22 12:40:21,021-04 DEBUG >>>>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>>>>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 1ms2018-05-22 >>>>>>>> 12:40:21,045-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Lock Acquired to >>>>>>>> object >>>>>>>> 'EngineLock:{exclusiveLocks='[2f43ef56-db61-4d93-99ee-00e84c741a29=DISK, >>>>>>>> bb954b00-d22c-4421-aba2-35335f9c441f=TEMPLATE, >>>>>>>> 9d749a87-45c9-4251-8e69-e55da5d3deed=DISK]', >>>>>>>> sharedLocks='[5cf93146-a5f1-4330-affe-672eaf39cc0d=VM, >>>>>>>> 4c68925d-569d-4987-8f54-29859763391a=TEMPLATE]'}'2018-05-22 12:40:21,097-04 >>>>>>>> DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: get, >>>>>>>> params: [5cf93146-a5f1-4330-affe-672eaf39cc0d], timeElapsed: 2ms2018-05-22 >>>>>>>> 12:40:21,111-04 INFO [org.ovirt.engine.core.bll.AddVmTemplateCommand] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Running command: >>>>>>>> AddVmTemplateCommand internal: false. Entities affected : ID: >>>>>>>> 79448f95-c26c-45b6-b396-ecd8fe98c2d9 Type: StoragePoolAction group >>>>>>>> CREATE_TEMPLATE with role type USER2018-05-22 12:40:21,115-04 INFO >>>>>>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>>>>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] START, SetVmStatusVDSCommand( >>>>>>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>>>>>> status='ImageLocked', exitStatus='Normal'}), log id: 4897bb3a2018-05-22 >>>>>>>> 12:40:21,117-04 INFO >>>>>>>> [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-10) >>>>>>>> [aa79ad89-02ea-4474-ad41-78cf52243b41] FINISH, SetVmStatusVDSCommand, >>>>>>>> return: , log id: 4897bb3a2018-05-22 12:40:21,117-04 DEBUG >>>>>>>> [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] method: >>>>>>>> runVdsCommand, params: [SetVmStatus, >>>>>>>> SetVmStatusVDSCommandParameters:{vmId='5cf93146-a5f1-4330-affe-672eaf39cc0d', >>>>>>>> status='ImageLocked', exitStatus='Normal'}], timeElapsed: 4ms2018-05-22 >>>>>>>> 12:40:21,125-04 DEBUG >>>>>>>> [org.ovirt.engine.core.dal.dbbroker.CustomSQLErrorCodeSQLExceptionTranslator] >>>>>>>> (default task-10) [aa79ad89-02ea-4474-ad41-78cf52243b41] Translating >>>>>>>> SQLException with SQL state '23502', error code '0', message [ERROR: null >>>>>>>> value in column "description" violates not-null constraint Detail: Failing >>>>>>>> row contains (bb954b00-d22c-4421-aba2-35335f9c441f, >>>>>>>> CirrOS_0.4.0_for_x86_64_glance_template, 512, >>>>>>>> 4c68925d-569d-4987-8f54-29859763391a, 0, null, >>>>>>>> 5e28a528-59ad-4054-9397-a9174ec356a7, 2018-05-22 12:40:21.119-04, 1, null, >>>>>>>> f, 1, 1, 1, Etc/GMT, t, f, 2018-05-22 12:40:21.120272-04, null, null, f, 1, >>>>>>>> 0, 0, 1, 0, , 3, null, null, null, 0, , , 256, TEMPLATE, 0, 1, >>>>>>>> 7d498f3a-b16d-4574-9e47-9c87cd1c866b, f, null, f, f, 1, f, f, f, >>>>>>>> bd48ab26-5ddb-11e8-b3bb-5452c0a8c904, null, , f, 0, null, null, null, >>>>>>>> guest_agent, null, null, null, 2, null, 2, 12345678, f, interleave, t, t, >>>>>>>> 20fa3adb-29f2-4938-b07a-751d63a65447, null, null, null, 0, null, >>>>>>>> 3463183e-b5ce-076d-2a26-0e3e9d93dafb, d2f75033-25ec-e3b3-3c27-351115d4aa2b, >>>>>>>> null, 0, LOCK_SCREEN, 2, null, null, 2048, null, AUTO_RESUME). Where: SQL >>>>>>>> statement "INSERT INTO vm_static( child_count, >>>>>>>> creation_date, description, free_text_comment, >>>>>>>> mem_size_mb, max_memory_size_mb, num_of_io_threads, >>>>>>>> vm_name, num_of_sockets, cpu_per_socket, >>>>>>>> threads_per_cpu, os, vm_guid, cluster_id, >>>>>>>> num_of_monitors, single_qxl_pci, >>>>>>>> allow_console_reconnect, template_status, usb_policy, >>>>>>>> time_zone, fail_back, vm_type, nice_level, >>>>>>>> cpu_shares, default_boot_sequence, >>>>>>>> default_display_type, priority, auto_startup, >>>>>>>> is_stateless, iso_path, origin, initrd_url, >>>>>>>> kernel_url, kernel_params, entity_type, >>>>>>>> quota_id, migration_support, >>>>>>>> is_disabled,dedicated_vm_for_vds, is_smartcard_enabled, >>>>>>>> is_delete_protected, sso_method, tunnel_migration, >>>>>>>> vnc_keyboard_layout, min_allocated_mem, >>>>>>>> is_run_and_pause, created_by_user_id, >>>>>>>> migration_downtime, template_version_number, vmt_guid, >>>>>>>> template_version_name, serial_number_policy, >>>>>>>> custom_serial_number, is_boot_menu_enabled, >>>>>>>> is_spice_file_transfer_enabled, is_spice_copy_paste_enabled, >>>>>>>> cpu_profile_id, numatune_mode, is_auto_converge, >>>>>>>> is_migrate_compressed, predefined_properties, >>>>>>>> userdefined_properties, custom_emulated_machine, >>>>>>>> bios_type, custom_cpu_name, small_icon_id, >>>>>>>> large_icon_id, console_disconnect_action, >>>>>>>> resume_behavior, custom_compatibility_version, >>>>>>>> migration_policy_id, lease_sd_id) VALUES( >>>>>>>> v_child_count, v_creation_date, v_description, >>>>>>>> v_free_text_comment, v_mem_size_mb, >>>>>>>> v_max_memory_size_mb, v_num_of_io_threads, v_name, >>>>>>>> v_num_of_sockets, v_cpu_per_socket, >>>>>>>> v_threads_per_cpu, v_os, v_vmt_guid, v_cluster_id, >>>>>>>> v_num_of_monitors, v_single_qxl_pci, >>>>>>>> v_allow_console_reconnect, v_status, v_usb_policy, >>>>>>>> v_time_zone, v_fail_back, v_vm_type, >>>>>>>> v_nice_level, v_cpu_shares, v_default_boot_sequence, >>>>>>>> v_default_display_type, v_priority, v_auto_startup, >>>>>>>> v_is_stateless, v_iso_path, v_origin, >>>>>>>> v_initrd_url, v_kernel_url, v_kernel_params, >>>>>>>> v_template_type, v_quota_id, v_migration_support, >>>>>>>> v_is_disabled, v_dedicated_vm_for_vds, >>>>>>>> v_is_smartcard_enabled, v_is_delete_protected, >>>>>>>> v_sso_method, v_tunnel_migration, >>>>>>>> v_vnc_keyboard_layout, v_min_allocated_mem, >>>>>>>> v_is_run_and_pause, v_created_by_user_id, >>>>>>>> v_migration_downtime, v_template_version_number, >>>>>>>> v_base_template_id, v_template_version_name, >>>>>>>> v_serial_number_policy, v_custom_serial_number, >>>>>>>> v_is_boot_menu_enabled, v_is_spice_file_transfer_enabled, >>>>>>>> v_is_spice_copy_paste_enabled, v_cpu_profile_id, >>>>>>>> v_numatune_mode, v_is_auto_converge, >>>>>>>> v_is_migrate_compressed, v_predefined_properties, >>>>>>>> v_userdefined_properties, v_custom_emulated_machine, >>>>>>>> v_bios_type, v_custom_cpu_name, v_small_icon_id, >>>>>>>> v_large_icon_id, v_console_disconnect_action, >>>>>>>> v_resume_behavior, v_custom_compatibility_version, >>>>>>>> v_migration_policy_id, v_lease_sd_id)"PL/pgSQL function >>>>>>>> insertvmtemplate(integer,timestamp with time zone,character >>>>>>>> varying,text,integer,integer,integer,character >>>>>>>> varying,integer,integer,integer,integer,uuid,uuid,integer,boolean,boolean,integer,integer,character >>>>>>>> varying,boolean,integer,integer,integer,integer,integer,integer,boolean,boolean,boolean,boolean,character >>>>>>>> varying,boolean,character varying,integer,character varying,character >>>>>>>> varying,character varying,uuid,integer,text,boolean,character >>>>>>>> varying,integer,boolean,uuid,character varying,integer,uuid,character >>>>>>>> varying,smallint,character varying,boolean,boolean,boolean,uuid,character >>>>>>>> varying,boolean,boolean,character varying,character varying,character >>>>>>>> varying,integer,character varying,uuid,uuid,character varying,character >>>>>>>> varying,character varying,uuid,uuid) line 16 at SQL statement]; SQL was >>>>>>>> [{call insertvmtemplate(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>>>> ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, >>>>>>>> ?, ?, ?, ?)}] for task [CallableStatementCallback]</error>* >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Martin Perina >>>>>> Associate Manager, Software Engineering >>>>>> Red Hat Czech s.r.o. >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Martin Perina >>>>> Associate Manager, Software Engineering >>>>> Red Hat Czech s.r.o. >>>>> >>>> >>>> >>>> >>>> -- >>>> Martin Perina >>>> Associate Manager, Software Engineering >>>> Red Hat Czech s.r.o. >>>> >>> >>> >> >> >> -- >> Martin Perina >> Associate Manager, Software Engineering >> Red Hat Czech s.r.o. >> > >