Kernel soft lockup on vm0085.workers-phx.ovirt.org while building ovirt-node ---------------------------------------------------------------------------- Key: OVIRT-2711 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2711 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: Evgheni Dereveanchin *https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64/151/console <https://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc2... *07:51:38* 06:51:37,952 EMERG kernel:watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [scsi_eh_1:85]*07:51:38* 06:51:37,952 WARNING kernel:Modules linked in: xfs fcoe libfcoe libfc scsi_transport_fc zram scsi_dh_rdac scsi_dh_emc scsi_dh_alua parport_pc i2c_piix4 parport joydev loop nls_utf8 isofs 8021q garp mrp stp llc virtio_console serio_raw qemu_fw_cfg virtio_pci e1000 bochs_drm drm_kms_helper ttm drm ata_generic pata_acpi sunrpc mcryptd sha256_ssse3 dm_crypt dm_round_robin dm_multipath linear raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 iscsi_ibft iscsi_boot_sysfs floppy iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi squashfs zstd_decompress xxhash cramfs edd virtio_rng virtio_ring virtio*07:51:38* 06:51:37,953 WARNING kernel:CPU: 0 PID: 85 Comm: scsi_eh_1 Not tainted 4.16.3-301.fc28.x86_64 #1*07:51:38* 06:51:37,954 WARNING kernel:Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS ?-20180531_142017-buildhw-08.phx2.fedoraproject.org-1.fc28 04/01/2014*07:51:38* 06:51:37,954 WARNING kernel:RIP: 0010:_raw_spin_unlock_irqrestore+0xd/0x20*07:51:38* 06:51:37,954 WARNING kernel:RSP: 0018:ffffa53b8048bdf0 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff12*07:51:38* 06:51:37,954 WARNING kernel:RAX: 0000000000000000 RBX: ffff9898e8c58000 RCX: 0000000000000000*07:51:38* 06:51:37,955 WARNING kernel:RDX: 0000000000000000 RSI: 0000000000000202 RDI: 0000000000000202*07:51:38* 06:51:37,955 WARNING kernel:RBP: ffffffff9860bd20 R08: 0000000000000038 R09: 000000000000029e*07:51:38* 06:51:37,956 WARNING kernel:R10: 0000000000000000 R11: 0000000000000001 R12: ffffffff9860b050*07:51:38* 06:51:37,956 WARNING kernel:R13: ffff9898e8c58130 R14: 0000000000000202 R15: 0000000000000000*07:51:38* 06:51:37,957 WARNING kernel:FS: 0000000000000000(0000) GS:ffff9898fbc00000(0000) knlGS:0000000000000000*07:51:38* 06:51:37,957 WARNING kernel:CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033*07:51:38* 06:51:37,957 WARNING kernel:CR2: 00007f544a48d6d7 CR3: 0000000068dfc000 CR4: 00000000000006f0*07:51:38* 06:51:37,957 WARNING kernel:Call Trace:*07:51:38* 06:51:37,958 WARNING kernel: ata_sff_error_handler+0x83/0xe0*07:51:38* 06:51:37,958 WARNING kernel: ata_scsi_port_error_handler+0x354/0x770*07:51:38* 06:51:37,958 WARNING kernel: ? scsi_try_target_reset+0x90/0x90*07:51:38* 06:51:37,959 WARNING kernel: ? scsi_eh_get_sense+0x220/0x220*07:51:38* 06:51:37,959 WARNING kernel: ata_scsi_error+0x91/0xc0*07:51:38* 06:51:37,959 WARNING kernel: scsi_error_handler+0xd0/0x5b0*07:51:38* 06:51:37,959 WARNING kernel: ? __schedule+0x23f/0x850*07:51:38* 06:51:37,960 WARNING kernel: ? scsi_eh_get_sense+0x220/0x220*07:51:38* 06:51:37,960 WARNING kernel: kthread+0x112/0x130*07:51:38* 06:51:37,960 WARNING kernel: ? kthread_create_worker_on_cpu+0x70/0x70*07:51:38* 06:51:37,960 WARNING kernel: ? kthread_create_worker_on_cpu+0x70/0x70*07:51:38* 06:51:37,960 WARNING kernel: ret_from_fork+0x35/0x40*07:51:38* 06:51:37,961 WARNING kernel:Code: a8 08 74 0b 65 81 25 6f 2c 76 67 ff ff ff 7f 89 d0 c3 90 90 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 0f 1f 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f Running yum check-update on the slave shows several updates available including kernel. I would recommend to upgrade slaves. -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>