-- Logs begin at Wed 2019-11-20 07:01:56 UTC, end at Wed 2019-11-20 07:25:55 UTC. -- Nov 20 07:01:56 localhost kernel: Linux version 4.18.0-147.el8.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.3.1 20190507 (Red Hat 8.3.1-4) (GCC)) #1 SMP Thu Sep 26 15:52:44 UTC 2019 Nov 20 07:01:56 localhost kernel: Command line: BOOT_IMAGE=(hd0,gpt1)/ostree/rhcos-080bd939511d1dbcd14e6096ea93f587363a58d6565f8ba2b10c4c84de791a62/vmlinuz-4.18.0-147.el8.x86_64 root=/dev/disk/by-label/root rootflags=defaults,prjquota rw ignition.firstboot rd.neednet=1 ip=dhcp console=tty0 console=ttyS0,115200n8 ostree=/ostree/boot.1/rhcos/080bd939511d1dbcd14e6096ea93f587363a58d6565f8ba2b10c4c84de791a62/0 ignition.platform.id=openstack Nov 20 07:01:56 localhost kernel: x86/fpu: x87 FPU will use FXSAVE Nov 20 07:01:56 localhost kernel: BIOS-provided physical RAM map: Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009f7ff] usable Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x000000000009f800-0x000000000009ffff] reserved Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffdbfff] usable Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x00000000bffdc000-0x00000000bfffffff] reserved Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Nov 20 07:01:56 localhost kernel: BIOS-e820: [mem 0x0000000100000000-0x000000023fffffff] usable Nov 20 07:01:56 localhost kernel: NX (Execute Disable) protection: active Nov 20 07:01:56 localhost kernel: SMBIOS 2.8 present. Nov 20 07:01:56 localhost kernel: DMI: oVirt oVirt Node, BIOS 1.11.0-2.el7 04/01/2014 Nov 20 07:01:56 localhost kernel: Hypervisor detected: KVM Nov 20 07:01:56 localhost kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Nov 20 07:01:56 localhost kernel: kvm-clock: cpu 0, msr 1b4201001, primary cpu clock Nov 20 07:01:56 localhost kernel: kvm-clock: using sched offset of 9282384315 cycles Nov 20 07:01:56 localhost kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Nov 20 07:01:56 localhost kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Nov 20 07:01:56 localhost kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Nov 20 07:01:56 localhost kernel: last_pfn = 0x240000 max_arch_pfn = 0x400000000 Nov 20 07:01:56 localhost kernel: MTRR default type: write-back Nov 20 07:01:56 localhost kernel: MTRR fixed ranges enabled: Nov 20 07:01:56 localhost kernel: 00000-9FFFF write-back Nov 20 07:01:56 localhost kernel: A0000-BFFFF uncachable Nov 20 07:01:56 localhost kernel: C0000-FFFFF write-protect Nov 20 07:01:56 localhost kernel: MTRR variable ranges enabled: Nov 20 07:01:56 localhost kernel: 0 base 00C0000000 mask FFC0000000 uncachable Nov 20 07:01:56 localhost kernel: 1 disabled Nov 20 07:01:56 localhost kernel: 2 disabled Nov 20 07:01:56 localhost kernel: 3 disabled Nov 20 07:01:56 localhost kernel: 4 disabled Nov 20 07:01:56 localhost kernel: 5 disabled Nov 20 07:01:56 localhost kernel: 6 disabled Nov 20 07:01:56 localhost kernel: 7 disabled Nov 20 07:01:56 localhost kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Nov 20 07:01:56 localhost kernel: last_pfn = 0xbffdc max_arch_pfn = 0x400000000 Nov 20 07:01:56 localhost kernel: found SMP MP-table at [mem 0x000f6260-0x000f626f] mapped at [(____ptrval____)] Nov 20 07:01:56 localhost kernel: Base memory trampoline at [(____ptrval____)] 99000 size 24576 Nov 20 07:01:56 localhost kernel: BRK [0x1b4401000, 0x1b4401fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4402000, 0x1b4402fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4403000, 0x1b4403fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4404000, 0x1b4404fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4405000, 0x1b4405fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4406000, 0x1b4406fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4407000, 0x1b4407fff] PGTABLE Nov 20 07:01:56 localhost kernel: BRK [0x1b4408000, 0x1b4408fff] PGTABLE Nov 20 07:01:56 localhost kernel: RAMDISK: [mem 0x3035b000-0x341a5fff] Nov 20 07:01:56 localhost kernel: ACPI: Early table checksum verification disabled Nov 20 07:01:56 localhost kernel: ACPI: RSDP 0x00000000000F6010 000014 (v00 BOCHS ) Nov 20 07:01:56 localhost kernel: ACPI: RSDT 0x00000000BFFE3E12 000030 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) Nov 20 07:01:56 localhost kernel: ACPI: FACP 0x00000000BFFE365E 000074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) Nov 20 07:01:56 localhost kernel: ACPI: DSDT 0x00000000BFFE0040 00361E (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001) Nov 20 07:01:56 localhost kernel: ACPI: FACS 0x00000000BFFE0000 000040 Nov 20 07:01:56 localhost kernel: ACPI: APIC 0x00000000BFFE36D2 000270 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) Nov 20 07:01:56 localhost kernel: ACPI: SRAT 0x00000000BFFE3942 0004D0 (v01 BOCHS BXPCSRAT 00000001 BXPC 00000001) Nov 20 07:01:56 localhost kernel: ACPI: Local APIC address 0xfee00000 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x00 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x01 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x02 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x03 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x04 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x05 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x06 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x07 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x08 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x09 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x0a -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x0b -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x0c -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x0d -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x0e -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x0f -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x10 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x11 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x12 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x13 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x14 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x15 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x16 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x17 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x18 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x19 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x1a -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x1b -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x1c -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x1d -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x1e -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x1f -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x20 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x21 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x22 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x23 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x24 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x25 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x26 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x27 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x28 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x29 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x2a -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x2b -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x2c -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x2d -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x2e -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x2f -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x30 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x31 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x32 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x33 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x34 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x35 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x36 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x37 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x38 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x39 -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x3a -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x3b -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x3c -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x3d -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x3e -> Node 0 Nov 20 07:01:56 localhost kernel: SRAT: PXM 0 -> APIC 0x3f -> Node 0 Nov 20 07:01:56 localhost kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff] Nov 20 07:01:56 localhost kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x00100000-0xbfffffff] Nov 20 07:01:56 localhost kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x23fffffff] Nov 20 07:01:56 localhost kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x240000000-0xc3fffffff] hotplug Nov 20 07:01:56 localhost kernel: NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0xbfffffff] -> [mem 0x00000000-0xbfffffff] Nov 20 07:01:56 localhost kernel: NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x23fffffff] -> [mem 0x00000000-0x23fffffff] Nov 20 07:01:56 localhost kernel: NODE_DATA(0) allocated [mem 0x23ffd2000-0x23fffbfff] Nov 20 07:01:56 localhost kernel: Zone ranges: Nov 20 07:01:56 localhost kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Nov 20 07:01:56 localhost kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Nov 20 07:01:56 localhost kernel: Normal [mem 0x0000000100000000-0x000000023fffffff] Nov 20 07:01:56 localhost kernel: Device empty Nov 20 07:01:56 localhost kernel: Movable zone start for each node Nov 20 07:01:56 localhost kernel: Early memory node ranges Nov 20 07:01:56 localhost kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Nov 20 07:01:56 localhost kernel: node 0: [mem 0x0000000000100000-0x00000000bffdbfff] Nov 20 07:01:56 localhost kernel: node 0: [mem 0x0000000100000000-0x000000023fffffff] Nov 20 07:01:56 localhost kernel: Zeroed struct page in unavailable ranges: 134 pages Nov 20 07:01:56 localhost kernel: Initmem setup node 0 [mem 0x0000000000001000-0x000000023fffffff] Nov 20 07:01:56 localhost kernel: On node 0 totalpages: 2097018 Nov 20 07:01:56 localhost kernel: DMA zone: 64 pages used for memmap Nov 20 07:01:56 localhost kernel: DMA zone: 21 pages reserved Nov 20 07:01:56 localhost kernel: DMA zone: 3998 pages, LIFO batch:0 Nov 20 07:01:56 localhost kernel: DMA32 zone: 12224 pages used for memmap Nov 20 07:01:56 localhost kernel: DMA32 zone: 782300 pages, LIFO batch:31 Nov 20 07:01:56 localhost kernel: Normal zone: 20480 pages used for memmap Nov 20 07:01:56 localhost kernel: Normal zone: 1310720 pages, LIFO batch:31 Nov 20 07:01:56 localhost kernel: ACPI: PM-Timer IO Port: 0x608 Nov 20 07:01:56 localhost kernel: ACPI: Local APIC address 0xfee00000 Nov 20 07:01:56 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Nov 20 07:01:56 localhost kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Nov 20 07:01:56 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Nov 20 07:01:56 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Nov 20 07:01:56 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Nov 20 07:01:56 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Nov 20 07:01:56 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Nov 20 07:01:56 localhost kernel: ACPI: IRQ0 used by override. Nov 20 07:01:56 localhost kernel: ACPI: IRQ5 used by override. Nov 20 07:01:56 localhost kernel: ACPI: IRQ9 used by override. Nov 20 07:01:56 localhost kernel: ACPI: IRQ10 used by override. Nov 20 07:01:56 localhost kernel: ACPI: IRQ11 used by override. Nov 20 07:01:56 localhost kernel: Using ACPI (MADT) for SMP configuration information Nov 20 07:01:56 localhost kernel: smpboot: Allowing 64 CPUs, 60 hotplug CPUs Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0x00000000-0x00000fff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000effff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0xbffdc000-0xbfffffff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] Nov 20 07:01:56 localhost kernel: PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Nov 20 07:01:56 localhost kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices Nov 20 07:01:56 localhost kernel: Booting paravirtualized kernel on KVM Nov 20 07:01:56 localhost kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Nov 20 07:01:56 localhost kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:64 nr_cpu_ids:64 nr_node_ids:1 Nov 20 07:01:56 localhost kernel: percpu: Embedded 47 pages/cpu s155648 r8192 d28672 u262144 Nov 20 07:01:56 localhost kernel: pcpu-alloc: s155648 r8192 d28672 u262144 alloc=1*2097152 Nov 20 07:01:56 localhost kernel: pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 Nov 20 07:01:56 localhost kernel: pcpu-alloc: [0] 16 17 18 19 20 21 22 23 [0] 24 25 26 27 28 29 30 31 Nov 20 07:01:56 localhost kernel: pcpu-alloc: [0] 32 33 34 35 36 37 38 39 [0] 40 41 42 43 44 45 46 47 Nov 20 07:01:56 localhost kernel: pcpu-alloc: [0] 48 49 50 51 52 53 54 55 [0] 56 57 58 59 60 61 62 63 Nov 20 07:01:56 localhost kernel: KVM setup async PF for cpu 0 Nov 20 07:01:56 localhost kernel: kvm-stealtime: cpu 0, msr 236c25040 Nov 20 07:01:56 localhost kernel: PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) Nov 20 07:01:56 localhost kernel: Built 1 zonelists, mobility grouping on. Total pages: 2064229 Nov 20 07:01:56 localhost kernel: Policy zone: Normal Nov 20 07:01:56 localhost kernel: Kernel command line: BOOT_IMAGE=(hd0,gpt1)/ostree/rhcos-080bd939511d1dbcd14e6096ea93f587363a58d6565f8ba2b10c4c84de791a62/vmlinuz-4.18.0-147.el8.x86_64 root=/dev/disk/by-label/root rootflags=defaults,prjquota rw ignition.firstboot rd.neednet=1 ip=dhcp console=tty0 console=ttyS0,115200n8 ostree=/ostree/boot.1/rhcos/080bd939511d1dbcd14e6096ea93f587363a58d6565f8ba2b10c4c84de791a62/0 ignition.platform.id=openstack Nov 20 07:01:56 localhost kernel: Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://access.redhat.com/ecosystem. Nov 20 07:01:56 localhost kernel: Memory: 3146856K/8388072K available (12292K kernel code, 2117K rwdata, 3780K rodata, 2368K init, 6348K bss, 306188K reserved, 0K cma-reserved) Nov 20 07:01:56 localhost kernel: random: get_random_u64 called from cache_random_seq_create+0x7c/0x140 with crng_init=0 Nov 20 07:01:56 localhost kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=64, Nodes=1 Nov 20 07:01:56 localhost kernel: Kernel/User page tables isolation: enabled Nov 20 07:01:56 localhost kernel: ftrace: allocating 35709 entries in 140 pages Nov 20 07:01:56 localhost kernel: rcu: Hierarchical RCU implementation. Nov 20 07:01:56 localhost kernel: rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=64. Nov 20 07:01:56 localhost kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Nov 20 07:01:56 localhost kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=64 Nov 20 07:01:56 localhost kernel: NR_IRQS: 524544, nr_irqs: 936, preallocated irqs: 16 Nov 20 07:01:56 localhost kernel: Console: colour VGA+ 80x25 Nov 20 07:01:56 localhost kernel: console [tty0] enabled Nov 20 07:01:56 localhost kernel: console [ttyS0] enabled Nov 20 07:01:56 localhost kernel: ACPI: Core revision 20180531 Nov 20 07:01:56 localhost kernel: APIC: Switch to symmetric I/O mode setup Nov 20 07:01:56 localhost kernel: x2apic enabled Nov 20 07:01:56 localhost kernel: Switched APIC routing to physical x2apic. Nov 20 07:01:56 localhost kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Nov 20 07:01:56 localhost kernel: tsc: Detected 2527.000 MHz processor Nov 20 07:01:56 localhost kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x246cdbae981, max_idle_ns: 440795219599 ns Nov 20 07:01:56 localhost kernel: Calibrating delay loop (skipped) preset value.. 5054.00 BogoMIPS (lpj=2527000) Nov 20 07:01:56 localhost kernel: pid_max: default: 65536 minimum: 512 Nov 20 07:01:56 localhost kernel: Security Framework initialized Nov 20 07:01:56 localhost kernel: Yama: becoming mindful. Nov 20 07:01:56 localhost kernel: SELinux: Initializing. Nov 20 07:01:56 localhost kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes) Nov 20 07:01:56 localhost kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes) Nov 20 07:01:56 localhost kernel: Mount-cache hash table entries: 16384 (order: 5, 131072 bytes) Nov 20 07:01:56 localhost kernel: Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes) Nov 20 07:01:56 localhost kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Nov 20 07:01:56 localhost kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 Nov 20 07:01:56 localhost kernel: FEATURE SPEC_CTRL Present Nov 20 07:01:56 localhost kernel: FEATURE IBPB_SUPPORT Present Nov 20 07:01:56 localhost kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Nov 20 07:01:56 localhost kernel: Spectre V2 : Mitigation: Full generic retpoline Nov 20 07:01:56 localhost kernel: Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Nov 20 07:01:56 localhost kernel: Spectre V2 : Enabling Restricted Speculation for firmware calls Nov 20 07:01:56 localhost kernel: Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Nov 20 07:01:56 localhost kernel: Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp Nov 20 07:01:56 localhost kernel: MDS: Vulnerable: Clear CPU buffers attempted, no microcode Nov 20 07:01:56 localhost kernel: Freeing SMP alternatives memory: 32K Nov 20 07:01:56 localhost kernel: smpboot: CPU0: Intel Core i7 9xx (Nehalem Class Core i7) (family: 0x6, model: 0x1a, stepping: 0x3) Nov 20 07:01:56 localhost kernel: Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only. Nov 20 07:01:56 localhost kernel: rcu: Hierarchical SRCU implementation. Nov 20 07:01:56 localhost kernel: NMI watchdog: Perf event create on CPU 0 failed with -2 Nov 20 07:01:56 localhost kernel: NMI watchdog: Perf NMI watchdog permanently disabled Nov 20 07:01:56 localhost kernel: smp: Bringing up secondary CPUs ... Nov 20 07:01:56 localhost kernel: x86: Booting SMP configuration: Nov 20 07:01:56 localhost kernel: .... node #0, CPUs: #1 Nov 20 07:01:56 localhost kernel: kvm-clock: cpu 1, msr 1b4201041, secondary cpu clock Nov 20 07:01:56 localhost kernel: KVM setup async PF for cpu 1 Nov 20 07:01:56 localhost kernel: kvm-stealtime: cpu 1, msr 236c65040 Nov 20 07:01:56 localhost kernel: #2 Nov 20 07:01:56 localhost kernel: kvm-clock: cpu 2, msr 1b4201081, secondary cpu clock Nov 20 07:01:56 localhost kernel: KVM setup async PF for cpu 2 Nov 20 07:01:56 localhost kernel: kvm-stealtime: cpu 2, msr 236ca5040 Nov 20 07:01:56 localhost kernel: #3 Nov 20 07:01:56 localhost kernel: kvm-clock: cpu 3, msr 1b42010c1, secondary cpu clock Nov 20 07:01:56 localhost kernel: KVM setup async PF for cpu 3 Nov 20 07:01:56 localhost kernel: kvm-stealtime: cpu 3, msr 236ce5040 Nov 20 07:01:56 localhost kernel: smp: Brought up 1 node, 4 CPUs Nov 20 07:01:56 localhost kernel: smpboot: Max logical packages: 16 Nov 20 07:01:56 localhost kernel: smpboot: Total of 4 processors activated (20216.00 BogoMIPS) Nov 20 07:01:56 localhost kernel: node 0 initialised, 1233757 pages in 159ms Nov 20 07:01:56 localhost kernel: devtmpfs: initialized Nov 20 07:01:56 localhost kernel: x86/mm: Memory block size: 128MB Nov 20 07:01:56 localhost kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Nov 20 07:01:56 localhost kernel: futex hash table entries: 16384 (order: 8, 1048576 bytes) Nov 20 07:01:56 localhost kernel: pinctrl core: initialized pinctrl subsystem Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 16 Nov 20 07:01:56 localhost kernel: audit: initializing netlink subsys (disabled) Nov 20 07:01:56 localhost kernel: audit: type=2000 audit(1574233314.204:1): state=initialized audit_enabled=0 res=1 Nov 20 07:01:56 localhost kernel: cpuidle: using governor menu Nov 20 07:01:56 localhost kernel: ACPI: bus type PCI registered Nov 20 07:01:56 localhost kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Nov 20 07:01:56 localhost kernel: PCI: Using configuration type 1 for base access Nov 20 07:01:56 localhost kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Nov 20 07:01:56 localhost kernel: cryptd: max_cpu_qlen set to 1000 Nov 20 07:01:56 localhost kernel: ACPI: Added _OSI(Module Device) Nov 20 07:01:56 localhost kernel: ACPI: Added _OSI(Processor Device) Nov 20 07:01:56 localhost kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Nov 20 07:01:56 localhost kernel: ACPI: Added _OSI(Processor Aggregator Device) Nov 20 07:01:56 localhost kernel: ACPI: Added _OSI(Linux-Dell-Video) Nov 20 07:01:56 localhost kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Nov 20 07:01:56 localhost kernel: ACPI: Interpreter enabled Nov 20 07:01:56 localhost kernel: ACPI: (supports S0 S5) Nov 20 07:01:56 localhost kernel: ACPI: Using IOAPIC for interrupt routing Nov 20 07:01:56 localhost kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Nov 20 07:01:56 localhost kernel: ACPI: Enabled 3 GPEs in block 00 to 0F Nov 20 07:01:56 localhost kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Nov 20 07:01:56 localhost kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] Nov 20 07:01:56 localhost kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. Nov 20 07:01:56 localhost kernel: acpiphp: Slot [3] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [4] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [5] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [6] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [7] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [8] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [9] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [10] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [11] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [12] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [13] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [14] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [15] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [16] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [17] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [18] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [19] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [20] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [21] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [22] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [23] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [24] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [25] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [26] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [27] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [28] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [29] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [30] registered Nov 20 07:01:56 localhost kernel: acpiphp: Slot [31] registered Nov 20 07:01:56 localhost kernel: PCI host bridge to bus 0000:00 Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: root bus resource [mem 0xc40000000-0xcbfffffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Nov 20 07:01:56 localhost kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Nov 20 07:01:56 localhost kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Nov 20 07:01:56 localhost kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Nov 20 07:01:56 localhost kernel: pci 0000:00:01.1: reg 0x20: [io 0xc140-0xc14f] Nov 20 07:01:56 localhost kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Nov 20 07:01:56 localhost kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Nov 20 07:01:56 localhost kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Nov 20 07:01:56 localhost kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Nov 20 07:01:56 localhost kernel: pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 Nov 20 07:01:56 localhost kernel: pci 0000:00:01.2: reg 0x20: [io 0xc0c0-0xc0df] Nov 20 07:01:56 localhost kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Nov 20 07:01:56 localhost kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Nov 20 07:01:56 localhost kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: [1b36:0100] type 00 class 0x030000 Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: reg 0x10: [mem 0xf8000000-0xfbffffff] Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: reg 0x14: [mem 0xfc000000-0xfdffffff] Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: reg 0x18: [mem 0xfe050000-0xfe051fff] Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: reg 0x1c: [io 0xc0e0-0xc0ff] Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfe040000-0xfe04ffff pref] Nov 20 07:01:56 localhost kernel: pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 Nov 20 07:01:56 localhost kernel: pci 0000:00:03.0: reg 0x10: [io 0xc000-0xc03f] Nov 20 07:01:56 localhost kernel: pci 0000:00:03.0: reg 0x14: [mem 0xfe052000-0xfe052fff] Nov 20 07:01:56 localhost kernel: pci 0000:00:03.0: reg 0x20: [mem 0xfebec000-0xfebeffff 64bit pref] Nov 20 07:01:56 localhost kernel: pci 0000:00:03.0: reg 0x30: [mem 0xfe000000-0xfe03ffff pref] Nov 20 07:01:56 localhost kernel: pci 0000:00:04.0: [1af4:1003] type 00 class 0x078000 Nov 20 07:01:56 localhost kernel: pci 0000:00:04.0: reg 0x10: [io 0xc040-0xc07f] Nov 20 07:01:56 localhost kernel: pci 0000:00:04.0: reg 0x14: [mem 0xfe053000-0xfe053fff] Nov 20 07:01:56 localhost kernel: pci 0000:00:04.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref] Nov 20 07:01:56 localhost kernel: pci 0000:00:05.0: [1af4:1004] type 00 class 0x010000 Nov 20 07:01:56 localhost kernel: pci 0000:00:05.0: reg 0x10: [io 0xc080-0xc0bf] Nov 20 07:01:56 localhost kernel: pci 0000:00:05.0: reg 0x14: [mem 0xfe054000-0xfe054fff] Nov 20 07:01:56 localhost kernel: pci 0000:00:05.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] Nov 20 07:01:56 localhost kernel: pci 0000:00:06.0: [1af4:1002] type 00 class 0x00ff00 Nov 20 07:01:56 localhost kernel: pci 0000:00:06.0: reg 0x10: [io 0xc100-0xc11f] Nov 20 07:01:56 localhost kernel: pci 0000:00:06.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] Nov 20 07:01:56 localhost kernel: pci 0000:00:07.0: [1af4:1005] type 00 class 0x00ff00 Nov 20 07:01:56 localhost kernel: pci 0000:00:07.0: reg 0x10: [io 0xc120-0xc13f] Nov 20 07:01:56 localhost kernel: pci 0000:00:07.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] Nov 20 07:01:56 localhost kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) Nov 20 07:01:56 localhost kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) Nov 20 07:01:56 localhost kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) Nov 20 07:01:56 localhost kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) Nov 20 07:01:56 localhost kernel: ACPI: PCI Interrupt Link [LNKS] (IRQs *9) Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: vgaarb: setting as boot VGA device Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: vgaarb: bridge control possible Nov 20 07:01:56 localhost kernel: vgaarb: loaded Nov 20 07:01:56 localhost kernel: SCSI subsystem initialized Nov 20 07:01:56 localhost kernel: ACPI: bus type USB registered Nov 20 07:01:56 localhost kernel: usbcore: registered new interface driver usbfs Nov 20 07:01:56 localhost kernel: usbcore: registered new interface driver hub Nov 20 07:01:56 localhost kernel: usbcore: registered new device driver usb Nov 20 07:01:56 localhost kernel: pps_core: LinuxPPS API ver. 1 registered Nov 20 07:01:56 localhost kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Nov 20 07:01:56 localhost kernel: PTP clock support registered Nov 20 07:01:56 localhost kernel: EDAC MC: Ver: 3.0.0 Nov 20 07:01:56 localhost kernel: PCI: Using ACPI for IRQ routing Nov 20 07:01:56 localhost kernel: PCI: pci_cache_line_size set to 64 bytes Nov 20 07:01:56 localhost kernel: e820: reserve RAM buffer [mem 0x0009f800-0x0009ffff] Nov 20 07:01:56 localhost kernel: e820: reserve RAM buffer [mem 0xbffdc000-0xbfffffff] Nov 20 07:01:56 localhost kernel: NetLabel: Initializing Nov 20 07:01:56 localhost kernel: NetLabel: domain hash size = 128 Nov 20 07:01:56 localhost kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Nov 20 07:01:56 localhost kernel: NetLabel: unlabeled traffic allowed by default Nov 20 07:01:56 localhost kernel: clocksource: Switched to clocksource kvm-clock Nov 20 07:01:56 localhost kernel: VFS: Disk quotas dquot_6.6.0 Nov 20 07:01:56 localhost kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Nov 20 07:01:56 localhost kernel: pnp: PnP ACPI init Nov 20 07:01:56 localhost kernel: pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active) Nov 20 07:01:56 localhost kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active) Nov 20 07:01:56 localhost kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active) Nov 20 07:01:56 localhost kernel: pnp 00:03: [dma 2] Nov 20 07:01:56 localhost kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0700 (active) Nov 20 07:01:56 localhost kernel: pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) Nov 20 07:01:56 localhost kernel: pnp: PnP ACPI: found 5 devices Nov 20 07:01:56 localhost kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Nov 20 07:01:56 localhost kernel: pci_bus 0000:00: resource 8 [mem 0xc40000000-0xcbfffffff window] Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 2 Nov 20 07:01:56 localhost kernel: tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes) Nov 20 07:01:56 localhost kernel: TCP established hash table entries: 65536 (order: 7, 524288 bytes) Nov 20 07:01:56 localhost kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Nov 20 07:01:56 localhost kernel: TCP: Hash tables configured (established 65536 bind 65536) Nov 20 07:01:56 localhost kernel: UDP hash table entries: 4096 (order: 5, 131072 bytes) Nov 20 07:01:56 localhost kernel: UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes) Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 1 Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 44 Nov 20 07:01:56 localhost kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers Nov 20 07:01:56 localhost kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release Nov 20 07:01:56 localhost kernel: pci 0000:00:01.0: Activating ISA DMA hang workarounds Nov 20 07:01:56 localhost kernel: PCI Interrupt Link [LNKD] enabled at IRQ 11 Nov 20 07:01:56 localhost kernel: pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x6c5 took 46040 usecs Nov 20 07:01:56 localhost kernel: pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Nov 20 07:01:56 localhost kernel: PCI: CLS 0 bytes, default 64 Nov 20 07:01:56 localhost kernel: Unpacking initramfs... Nov 20 07:01:56 localhost kernel: Freeing initrd memory: 63788K Nov 20 07:01:56 localhost kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Nov 20 07:01:56 localhost kernel: software IO TLB: mapped [mem 0xbbfdc000-0xbffdc000] (64MB) Nov 20 07:01:56 localhost kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x246cdbae981, max_idle_ns: 440795219599 ns Nov 20 07:01:56 localhost kernel: Initialise system trusted keyrings Nov 20 07:01:56 localhost kernel: Key type blacklist registered Nov 20 07:01:56 localhost kernel: workingset: timestamp_bits=36 max_order=21 bucket_order=0 Nov 20 07:01:56 localhost kernel: zbud: loaded Nov 20 07:01:56 localhost kernel: pstore: using deflate compression Nov 20 07:01:56 localhost kernel: Platform Keyring initialized Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 38 Nov 20 07:01:56 localhost kernel: Key type asymmetric registered Nov 20 07:01:56 localhost kernel: Asymmetric key parser 'x509' registered Nov 20 07:01:56 localhost kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245) Nov 20 07:01:56 localhost kernel: io scheduler mq-deadline registered Nov 20 07:01:56 localhost kernel: io scheduler kyber registered Nov 20 07:01:56 localhost kernel: io scheduler bfq registered Nov 20 07:01:56 localhost kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE Nov 20 07:01:56 localhost kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Nov 20 07:01:56 localhost kernel: intel_idle: Please enable MWAIT in BIOS SETUP Nov 20 07:01:56 localhost kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Nov 20 07:01:56 localhost kernel: ACPI: Power Button [PWRF] Nov 20 07:01:56 localhost kernel: PCI Interrupt Link [LNKC] enabled at IRQ 10 Nov 20 07:01:56 localhost kernel: PCI Interrupt Link [LNKA] enabled at IRQ 10 Nov 20 07:01:56 localhost kernel: PCI Interrupt Link [LNKB] enabled at IRQ 11 Nov 20 07:01:56 localhost kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Nov 20 07:01:56 localhost kernel: 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Nov 20 07:01:56 localhost kernel: Non-volatile memory driver v1.3 Nov 20 07:01:56 localhost kernel: random: fast init done Nov 20 07:01:56 localhost kernel: rdac: device handler registered Nov 20 07:01:56 localhost kernel: random: crng init done Nov 20 07:01:56 localhost kernel: hp_sw: device handler registered Nov 20 07:01:56 localhost kernel: emc: device handler registered Nov 20 07:01:56 localhost kernel: alua: device handler registered Nov 20 07:01:56 localhost kernel: libphy: Fixed MDIO Bus: probed Nov 20 07:01:56 localhost kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Nov 20 07:01:56 localhost kernel: ehci-pci: EHCI PCI platform driver Nov 20 07:01:56 localhost kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Nov 20 07:01:56 localhost kernel: ohci-pci: OHCI PCI platform driver Nov 20 07:01:56 localhost kernel: uhci_hcd: USB Universal Host Controller Interface driver Nov 20 07:01:56 localhost kernel: uhci_hcd 0000:00:01.2: UHCI Host Controller Nov 20 07:01:56 localhost kernel: uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 Nov 20 07:01:56 localhost kernel: uhci_hcd 0000:00:01.2: detected 2 ports Nov 20 07:01:56 localhost kernel: uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c0c0 Nov 20 07:01:56 localhost kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 4.18 Nov 20 07:01:56 localhost kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Nov 20 07:01:56 localhost kernel: usb usb1: Product: UHCI Host Controller Nov 20 07:01:56 localhost kernel: usb usb1: Manufacturer: Linux 4.18.0-147.el8.x86_64 uhci_hcd Nov 20 07:01:56 localhost kernel: usb usb1: SerialNumber: 0000:00:01.2 Nov 20 07:01:56 localhost kernel: hub 1-0:1.0: USB hub found Nov 20 07:01:56 localhost kernel: hub 1-0:1.0: 2 ports detected Nov 20 07:01:56 localhost kernel: usbcore: registered new interface driver usbserial_generic Nov 20 07:01:56 localhost kernel: usbserial: USB Serial support registered for generic Nov 20 07:01:56 localhost kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Nov 20 07:01:56 localhost kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Nov 20 07:01:56 localhost kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Nov 20 07:01:56 localhost kernel: mousedev: PS/2 mouse device common for all mice Nov 20 07:01:56 localhost kernel: rtc_cmos 00:00: RTC can wake from S4 Nov 20 07:01:56 localhost kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Nov 20 07:01:56 localhost kernel: rtc_cmos 00:00: registered as rtc0 Nov 20 07:01:56 localhost kernel: rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram Nov 20 07:01:56 localhost kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Nov 20 07:01:56 localhost kernel: hidraw: raw HID events driver (C) Jiri Kosina Nov 20 07:01:56 localhost kernel: usbcore: registered new interface driver usbhid Nov 20 07:01:56 localhost kernel: usbhid: USB HID core driver Nov 20 07:01:56 localhost kernel: drop_monitor: Initializing network drop monitor service Nov 20 07:01:56 localhost kernel: input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Nov 20 07:01:56 localhost kernel: Initializing XFRM netlink socket Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 10 Nov 20 07:01:56 localhost kernel: Segment Routing with IPv6 Nov 20 07:01:56 localhost kernel: NET: Registered protocol family 17 Nov 20 07:01:56 localhost kernel: mpls_gso: MPLS GSO support Nov 20 07:01:56 localhost kernel: core: Using 10 MCE banks Nov 20 07:01:56 localhost kernel: sched_clock: Marking stable (2635240871, 0)->(3774982900, -1139742029) Nov 20 07:01:56 localhost kernel: registered taskstats version 1 Nov 20 07:01:56 localhost kernel: Loading compiled-in X.509 certificates Nov 20 07:01:56 localhost kernel: Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 2a5479ea3203c06a3ee15b5d83b77c78b66f3461' Nov 20 07:01:56 localhost kernel: Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' Nov 20 07:01:56 localhost kernel: Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' Nov 20 07:01:56 localhost kernel: zswap: loaded using pool lzo/zbud Nov 20 07:01:56 localhost kernel: Key type big_key registered Nov 20 07:01:56 localhost kernel: Key type encrypted registered Nov 20 07:01:56 localhost kernel: ima: No TPM chip found, activating TPM-bypass! Nov 20 07:01:56 localhost kernel: ima: Allocated hash algorithm: sha1 Nov 20 07:01:56 localhost kernel: evm: Initialising EVM extended attributes: Nov 20 07:01:56 localhost kernel: evm: security.selinux Nov 20 07:01:56 localhost kernel: evm: security.ima Nov 20 07:01:56 localhost kernel: evm: security.capability Nov 20 07:01:56 localhost kernel: evm: HMAC attrs: 0x1 Nov 20 07:01:56 localhost kernel: rtc_cmos 00:00: setting system clock to 2019-11-20 07:01:55 UTC (1574233315) Nov 20 07:01:56 localhost kernel: Freeing unused decrypted memory: 2040K Nov 20 07:01:56 localhost kernel: Freeing unused kernel memory: 2368K Nov 20 07:01:56 localhost kernel: Write protecting the kernel read-only data: 18432k Nov 20 07:01:56 localhost kernel: Freeing unused kernel memory: 2020K Nov 20 07:01:56 localhost kernel: Freeing unused kernel memory: 316K Nov 20 07:01:56 localhost systemd-journald[193]: Missed 7 kernel messages Nov 20 07:01:56 localhost kernel: usb 1-1: new full-speed USB device number 2 using uhci_hcd Nov 20 07:01:56 localhost systemd-journald[193]: Missed 3 kernel messages Nov 20 07:01:56 localhost kernel: Loading iSCSI transport class v2.0-870. Nov 20 07:01:56 localhost kernel: usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 Nov 20 07:01:56 localhost kernel: usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=5 Nov 20 07:01:56 localhost kernel: usb 1-1: Product: QEMU USB Tablet Nov 20 07:01:56 localhost kernel: usb 1-1: Manufacturer: QEMU Nov 20 07:01:56 localhost kernel: usb 1-1: SerialNumber: 42 Nov 20 07:01:56 localhost kernel: input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input5 Nov 20 07:01:56 localhost kernel: hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 Nov 20 07:01:56 localhost systemd-journald[193]: Journal started Nov 20 07:01:56 localhost systemd-journald[193]: Runtime journal (/run/log/journal/fb73d2b2ff5f4c90893005c8a553c7c2) is 8.0M, max 398.0M, 390.0M free. Nov 20 07:01:56 localhost dracut-cmdline[209]: dracut-43.81.201911011153.0 dracut-049-27.git20190906.el8 Nov 20 07:01:56 localhost dracut-cmdline[209]: Using kernel command line parameters: rd.driver.pre=dm_multipath rd.neednet=1 BOOT_IMAGE=(hd0,gpt1)/ostree/rhcos-080bd939511d1dbcd14e6096ea93f587363a58d6565f8ba2b10c4c84de791a62/vmlinuz-4.18.0-147.el8.x86_64 root=/dev/disk/by-label/root rootflags=defaults,prjquota rw ignition.firstboot rd.neednet=1 ip=dhcp console=tty0 console=ttyS0,115200n8 ostree=/ostree/boot.1/rhcos/080bd939511d1dbcd14e6096ea93f587363a58d6565f8ba2b10c4c84de791a62/0 ignition.platform.id=openstack Nov 20 07:01:56 localhost systemd-journald[193]: Missed 16 kernel messages Nov 20 07:01:56 localhost kernel: iscsi: registered transport (tcp) Nov 20 07:01:56 localhost kernel: iscsi: registered transport (qla4xxx) Nov 20 07:01:56 localhost kernel: QLogic iSCSI HBA Driver Nov 20 07:01:56 localhost kernel: libcxgbi:libcxgbi_init_module: Chelsio iSCSI driver library libcxgbi v0.9.1-ko (Apr. 2015) Nov 20 07:01:56 localhost kernel: Chelsio T4-T6 iSCSI Driver cxgb4i v0.9.5-ko (Apr. 2015) Nov 20 07:01:56 localhost kernel: iscsi: registered transport (cxgb4i) Nov 20 07:01:56 localhost kernel: cnic: QLogic cnicDriver v2.5.22 (July 20, 2015) Nov 20 07:01:56 localhost kernel: QLogic NetXtreme II iSCSI Driver bnx2i v2.7.10.1 (Jul 16, 2014) Nov 20 07:01:56 localhost kernel: iscsi: registered transport (bnx2i) Nov 20 07:01:56 localhost kernel: iscsi: registered transport (be2iscsi) Nov 20 07:01:56 localhost kernel: In beiscsi_module_init, tt=0000000082d41a14 Nov 20 07:01:56 localhost systemd[1]: Started dracut cmdline hook. Nov 20 07:01:56 localhost systemd[1]: Starting dracut pre-udev hook... Nov 20 07:01:56 localhost systemd-journald[193]: Missed 2 kernel messages Nov 20 07:01:56 localhost kernel: device-mapper: uevent: version 1.0.3 Nov 20 07:01:56 localhost kernel: device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com Nov 20 07:01:56 localhost systemd[1]: Started dracut pre-udev hook. Nov 20 07:01:56 localhost systemd[1]: Starting udev Kernel Device Manager... Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'tty' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'kmem' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'input' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'video' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'render' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'audio' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'lp' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'disk' unknown Nov 20 07:01:56 localhost systemd-udevd[444]: Specified group 'kvm' unknown Nov 20 07:01:56 localhost systemd[1]: Started udev Kernel Device Manager. Nov 20 07:01:56 localhost systemd[1]: Starting dracut pre-trigger hook... Nov 20 07:01:56 localhost dracut-pre-trigger[451]: rd.md=0: removing MD RAID activation Nov 20 07:01:57 localhost systemd[1]: Started dracut pre-trigger hook. Nov 20 07:01:57 localhost systemd[1]: Starting udev Coldplug all Devices... Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'tty' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'kmem' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'input' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'video' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'render' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'audio' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'lp' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'disk' unknown Nov 20 07:01:57 localhost systemd-udevd[444]: Specified group 'kvm' unknown Nov 20 07:01:57 localhost systemd[1]: Mounting Kernel Configuration File System... Nov 20 07:01:57 localhost systemd[1]: Mounted Kernel Configuration File System. Nov 20 07:01:57 localhost systemd[1]: Started udev Coldplug all Devices. Nov 20 07:01:57 localhost systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 20 07:01:57 localhost systemd-journald[193]: Missed 29 kernel messages Nov 20 07:01:57 localhost kernel: libata version 3.00 loaded. Nov 20 07:01:57 localhost kernel: scsi host0: Virtio SCSI HBA Nov 20 07:01:57 localhost kernel: scsi 0:0:0:0: Direct-Access QEMU QEMU HARDDISK 2.5+ PQ: 0 ANSI: 5 Nov 20 07:01:57 localhost kernel: ata_piix 0000:00:01.1: version 2.13 Nov 20 07:01:57 localhost kernel: scsi host1: ata_piix Nov 20 07:01:57 localhost kernel: scsi host2: ata_piix Nov 20 07:01:57 localhost kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc140 irq 14 Nov 20 07:01:57 localhost kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc148 irq 15 Nov 20 07:01:57 localhost kernel: ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 Nov 20 07:01:57 localhost kernel: ata2.01: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 Nov 20 07:01:57 localhost kernel: scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 Nov 20 07:01:57 localhost kernel: scsi 2:0:1:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 Nov 20 07:01:57 localhost systemd-udevd[521]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 20 07:01:57 localhost systemd-udevd[511]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 20 07:01:57 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:01:57 localhost kernel: virtio_net virtio0 ens3: renamed from eth0 Nov 20 07:01:57 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:01:57 localhost kernel: scsi 0:0:0:0: Attached scsi generic sg0 type 0 Nov 20 07:01:57 localhost kernel: scsi 2:0:0:0: Attached scsi generic sg1 type 5 Nov 20 07:01:57 localhost kernel: scsi 2:0:1:0: Attached scsi generic sg2 type 5 Nov 20 07:01:57 localhost kernel: sd 0:0:0:0: Power-on or device reset occurred Nov 20 07:01:57 localhost kernel: sd 0:0:0:0: [sda] 33554432 512-byte logical blocks: (17.2 GB/16.0 GiB) Nov 20 07:01:57 localhost kernel: sd 0:0:0:0: [sda] Write Protect is off Nov 20 07:01:57 localhost kernel: sd 0:0:0:0: [sda] Mode Sense: 63 00 00 08 Nov 20 07:01:57 localhost kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Nov 20 07:01:57 localhost kernel: sda: sda1 sda2 sda3 sda4 Nov 20 07:01:57 localhost kernel: sd 0:0:0:0: [sda] Attached SCSI disk Nov 20 07:01:57 localhost systemd[1]: Found device QEMU_HARDDISK boot. Nov 20 07:01:57 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:01:57 localhost kernel: sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray Nov 20 07:01:57 localhost kernel: cdrom: Uniform CD-ROM driver Revision: 3.20 Nov 20 07:01:57 localhost kernel: sr 2:0:0:0: Attached scsi CD-ROM sr0 Nov 20 07:01:57 localhost kernel: sr 2:0:1:0: [sr1] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray Nov 20 07:01:57 localhost kernel: sr 2:0:1:0: Attached scsi CD-ROM sr1 Nov 20 07:01:57 localhost systemd[1]: Found device QEMU_HARDDISK root. Nov 20 07:01:57 localhost systemd[1]: Reached target Initrd Root Device. Nov 20 07:01:57 localhost systemd[1]: Starting Ignition (setup)... Nov 20 07:01:57 localhost ignition-setup[757]: File /usr/lib/ignition/platform/openstack/base.ign does not exist.. Skipping copy Nov 20 07:01:57 localhost systemd-journald[193]: Missed 4 kernel messages Nov 20 07:01:57 localhost kernel: EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) Nov 20 07:01:57 localhost ignition-setup[757]: File /mnt/boot_partition/ignition/config.ign does not exist.. Skipping copy Nov 20 07:01:57 localhost systemd[1]: Started Ignition (setup). Nov 20 07:01:58 localhost systemd[1]: Started udev Wait for Complete Device Initialization. Nov 20 07:01:58 localhost systemd[1]: Starting Device-Mapper Multipath Device Controller... Nov 20 07:01:58 localhost systemd[1]: Started Device-Mapper Multipath Device Controller. Nov 20 07:01:58 localhost multipathd[776]: --------start up-------- Nov 20 07:01:58 localhost multipathd[776]: read /etc/multipath.conf Nov 20 07:01:58 localhost multipathd[776]: /etc/multipath.conf does not exist, blacklisting all devices. Nov 20 07:01:58 localhost multipathd[776]: You can run "/sbin/mpathconf --enable" to create Nov 20 07:01:58 localhost multipathd[776]: /etc/multipath.conf. See man mpathconf(8) for more details Nov 20 07:01:58 localhost multipathd[776]: path checkers start up Nov 20 07:01:58 localhost multipathd[776]: /etc/multipath.conf does not exist, blacklisting all devices. Nov 20 07:01:58 localhost multipathd[776]: You can run "/sbin/mpathconf --enable" to create Nov 20 07:01:58 localhost multipathd[776]: /etc/multipath.conf. See man mpathconf(8) for more details Nov 20 07:01:58 localhost systemd[1]: Starting Open-iSCSI... Nov 20 07:01:58 localhost iscsid[782]: iscsid: can't open InitiatorName configuration file /etc/iscsi/initiatorname.iscsi Nov 20 07:01:58 localhost iscsid[782]: iscsid: Warning: InitiatorName file /etc/iscsi/initiatorname.iscsi does not exist or does not contain a properly formatted InitiatorName. If using software iscsi (iscsi_tcp or ib_iser) or partial offload (bnx2i or cxgbi iscsi), you may not be able to log into or discover targets. Please create a file /etc/iscsi/initiatorname.iscsi that contains a sting with the format: InitiatorName=iqn.yyyy-mm.[:identifier]. Nov 20 07:01:58 localhost iscsid[782]: Example: InitiatorName=iqn.2001-04.com.redhat:fc6. Nov 20 07:01:58 localhost iscsid[782]: If using hardware iscsi like qla4xxx this message can be ignored. Nov 20 07:01:58 localhost iscsid[782]: iscsid: can't open InitiatorAlias configuration file /etc/iscsi/initiatorname.iscsi Nov 20 07:01:58 localhost systemd[1]: Reached target Local File Systems (Pre). Nov 20 07:01:58 localhost ignition[788]: Ignition 0.33.0 Nov 20 07:01:58 localhost systemd[1]: Reached target Local File Systems. Nov 20 07:01:58 localhost ignition[788]: Stage: fetch Nov 20 07:01:58 localhost systemd[1]: Starting Create Volatile Files and Directories... Nov 20 07:01:58 localhost ignition[788]: reading system config file "/usr/lib/ignition/base.ign" Nov 20 07:01:58 localhost systemd[1]: Started Open-iSCSI. Nov 20 07:01:58 localhost ignition[788]: parsing config with SHA512: d16f2b139dd8152b12568f119876a90612e9149a14e0e27bfbec5486e458c2954193b818361ea24ea076ddbcd9d66a67e9b696ae8998562346bdb86925040973 Nov 20 07:01:58 localhost systemd-tmpfiles[784]: [/usr/lib/tmpfiles.d/systemd.conf:11] Unknown group 'utmp'. Nov 20 07:01:58 localhost systemd[1]: Started Create Volatile Files and Directories. Nov 20 07:01:58 localhost systemd[1]: Reached target System Initialization. Nov 20 07:01:58 localhost ignition[788]: parsed url from cmdline: "" Nov 20 07:01:58 localhost systemd[1]: Reached target Basic System. Nov 20 07:01:58 localhost ignition[788]: no config URL provided Nov 20 07:01:58 localhost systemd[1]: Starting Ask OSTree to mount /var in initramfs... Nov 20 07:01:58 localhost ignition[788]: reading system config file "/usr/lib/ignition/user.ign" Nov 20 07:01:58 localhost systemd[1]: Starting Ignition (fetch)... Nov 20 07:01:58 localhost ignition[788]: no config at "/usr/lib/ignition/user.ign" Nov 20 07:01:58 localhost systemd[1]: Starting dracut initqueue hook... Nov 20 07:01:58 localhost ignition[788]: GET http://169.254.169.254/openstack/latest/user_data: attempt #1 Nov 20 07:01:58 localhost systemd[1]: Started Ask OSTree to mount /var in initramfs. Nov 20 07:01:58 localhost ignition[788]: GET error: Get http://169.254.169.254/openstack/latest/user_data: dial tcp 169.254.169.254:80: connect: network is unreachable Nov 20 07:01:58 localhost ignition[788]: config drive ("/dev/disk/by-label/CONFIG-2") not found. Waiting... Nov 20 07:01:58 localhost ignition[788]: creating temporary mount point Nov 20 07:01:58 localhost ignition[788]: op(1): [started] mounting config drive Nov 20 07:01:58 localhost ignition[788]: op(1): executing: "/usr/bin/mount" "-o" "ro" "-t" "auto" "/dev/disk/by-label/config-2" "/tmp/ignition-configdrive416111715" Nov 20 07:01:58 localhost systemd-journald[193]: Missed 41 kernel messages Nov 20 07:01:58 localhost kernel: ISO 9660 Extensions: Microsoft Joliet Level 3 Nov 20 07:01:58 localhost ignition[788]: op(1): [finished] mounting config drive Nov 20 07:01:58 localhost kernel: ISO 9660 Extensions: RRIP_1991A Nov 20 07:01:58 localhost dracut-initqueue[789]: Starting dhcp for interface ens3 Nov 20 07:01:58 localhost ignition[788]: op(2): [started] unmounting "/dev/disk/by-label/config-2" at "/tmp/ignition-configdrive416111715" Nov 20 07:01:58 localhost ignition[788]: op(2): [finished] unmounting "/dev/disk/by-label/config-2" at "/tmp/ignition-configdrive416111715" Nov 20 07:01:58 localhost dracut-initqueue[789]: dhcp: PREINIT ens3 up Nov 20 07:01:58 localhost ignition[788]: GET http://169.254.169.254/openstack/latest/user_data: attempt #2 Nov 20 07:01:58 localhost ignition[788]: GET error: Get http://169.254.169.254/openstack/latest/user_data: dial tcp 169.254.169.254:80: connect: network is unreachable Nov 20 07:01:58 localhost dhclient[849]: Created duid "\000\004\373s\322\262\377_L\220\2110\005\310\245S\307\302". Nov 20 07:01:58 localhost dhclient[849]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 3 (xid=0xfb0a1c7b) Nov 20 07:01:58 localhost ignition[788]: GET http://169.254.169.254/openstack/latest/user_data: attempt #3 Nov 20 07:01:58 localhost ignition[788]: GET error: Get http://169.254.169.254/openstack/latest/user_data: dial tcp 169.254.169.254:80: connect: network is unreachable Nov 20 07:01:59 localhost dhclient[849]: DHCPREQUEST on ens3 to 255.255.255.255 port 67 (xid=0xfb0a1c7b) Nov 20 07:01:59 localhost dhclient[849]: DHCPOFFER from 10.34.212.199 Nov 20 07:01:59 localhost dhclient[849]: DHCPACK from 10.34.212.199 (xid=0xfb0a1c7b) Nov 20 07:01:59 localhost dracut-initqueue[789]: dhcp: BOND setting ens3 Nov 20 07:01:59 localhost ignition[788]: GET http://169.254.169.254/openstack/latest/user_data: attempt #4 Nov 20 07:01:59 localhost ignition[788]: GET error: Get http://169.254.169.254/openstack/latest/user_data: dial tcp 169.254.169.254:80: connect: network is unreachable Nov 20 07:02:01 localhost ignition[788]: GET http://169.254.169.254/openstack/latest/user_data: attempt #5 Nov 20 07:02:01 localhost ignition[788]: GET error: Get http://169.254.169.254/openstack/latest/user_data: dial tcp 169.254.169.254:80: connect: network is unreachable Nov 20 07:02:01 localhost dhclient[849]: bound to 10.34.212.212 -- renewal in 492127 seconds. Nov 20 07:02:01 localhost dracut-initqueue[789]: RTNETLINK answers: File exists Nov 20 07:02:02 localhost systemd[1]: Started dracut initqueue hook. Nov 20 07:02:02 localhost systemd[1]: Reached target Remote File Systems (Pre). Nov 20 07:02:02 localhost systemd[1]: Reached target Remote File Systems. Nov 20 07:02:02 localhost systemd[1]: Starting dracut pre-mount hook... Nov 20 07:02:02 localhost systemd[1]: Started dracut pre-mount hook. Nov 20 07:02:02 localhost systemd[1]: Starting File System Check on /dev/disk/by-label/root... Nov 20 07:02:02 localhost systemd-fsck[940]: /usr/sbin/fsck.xfs: XFS file system. Nov 20 07:02:02 localhost systemd[1]: Started File System Check on /dev/disk/by-label/root. Nov 20 07:02:04 localhost ignition[788]: GET http://169.254.169.254/openstack/latest/user_data: attempt #6 Nov 20 07:02:05 localhost ignition[788]: fetch: fetch complete Nov 20 07:02:05 localhost ignition[788]: fetch: fetch passed Nov 20 07:02:05 localhost systemd[1]: Started Ignition (fetch). Nov 20 07:02:05 localhost ignition[788]: Ignition finished successfully Nov 20 07:02:05 localhost systemd[1]: Starting Ignition (disks)... Nov 20 07:02:06 localhost ignition[946]: Ignition 0.33.0 Nov 20 07:02:06 localhost ignition[946]: Stage: disks Nov 20 07:02:06 localhost ignition[946]: reading system config file "/usr/lib/ignition/base.ign" Nov 20 07:02:06 localhost ignition[946]: parsing config with SHA512: d16f2b139dd8152b12568f119876a90612e9149a14e0e27bfbec5486e458c2954193b818361ea24ea076ddbcd9d66a67e9b696ae8998562346bdb86925040973 Nov 20 07:02:06 localhost ignition[946]: disks: disks passed Nov 20 07:02:06 localhost systemd[1]: Started Ignition (disks). Nov 20 07:02:06 localhost ignition[946]: Ignition finished successfully Nov 20 07:02:06 localhost systemd[1]: Mounting /sysroot... Nov 20 07:02:06 localhost systemd-journald[193]: Missed 42 kernel messages Nov 20 07:02:06 localhost kernel: SGI XFS with ACLs, security attributes, no debug enabled Nov 20 07:02:06 localhost kernel: XFS (sda4): Mounting V5 Filesystem Nov 20 07:02:06 localhost kernel: XFS (sda4): Ending clean mount Nov 20 07:02:06 localhost systemd[1]: Mounted /sysroot. Nov 20 07:02:06 localhost systemd[1]: Starting OSTree Prepare OS/... Nov 20 07:02:06 localhost ostree-prepare-root[973]: Resolved OSTree target to: /sysroot/ostree/deploy/rhcos/deploy/f323fee503fd47afa77de27ebb3bb8509f1772518149a5c5c3b6b9c3c771fd4e.0 Nov 20 07:02:06 localhost systemd[1]: Started OSTree Prepare OS/. Nov 20 07:02:06 localhost systemd[1]: Reached target Initrd Root File System. Nov 20 07:02:06 localhost systemd[1]: Starting Ignition (files)... Nov 20 07:02:06 localhost ignition[975]: INFO : Ignition 0.33.0 Nov 20 07:02:06 localhost ignition[975]: INFO : Stage: files Nov 20 07:02:06 localhost ignition[975]: INFO : reading system config file "/usr/lib/ignition/base.ign" Nov 20 07:02:06 localhost ignition[975]: DEBUG : parsing config with SHA512: d16f2b139dd8152b12568f119876a90612e9149a14e0e27bfbec5486e458c2954193b818361ea24ea076ddbcd9d66a67e9b696ae8998562346bdb86925040973 Nov 20 07:02:06 localhost ignition[975]: INFO : files: createUsers: op(1): [started] creating or modifying user "core" Nov 20 07:02:06 localhost ignition[975]: DEBUG : files: createUsers: op(1): executing: "/usr/sbin/usermod" "--root" "/sysroot" "--comment" "CoreOS Admin" "--groups" "adm,sudo,systemd-journal,wheel" "core" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createUsers: op(1): [finished] creating or modifying user "core" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createUsers: op(2): [started] creating or modifying user "core" Nov 20 07:02:07 localhost ignition[975]: DEBUG : files: createUsers: op(2): executing: "/usr/sbin/usermod" "--root" "/sysroot" "core" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createUsers: op(2): [finished] creating or modifying user "core" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createUsers: op(3): [started] adding ssh keys to user "core" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createUsers: op(3): [finished] adding ssh keys to user "core" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4): [started] writing file "/etc/containers/registries.conf" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4): [finished] writing file "/etc/containers/registries.conf" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5): [started] appending to file "/etc/motd" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5): [finished] appending to file "/etc/motd" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6): [started] writing file "/etc/pki/ca-trust/source/anchors/ca.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6): [finished] writing file "/etc/pki/ca-trust/source/anchors/ca.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(7): [started] writing file "/etc/profile.d/proxy.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(7): [finished] writing file "/etc/profile.d/proxy.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(8): [started] writing file "/etc/systemd/system.conf.d/10-default-env.conf" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(8): [finished] writing file "/etc/systemd/system.conf.d/10-default-env.conf" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(9): [started] writing file "/root/.docker/config.json" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(9): [finished] writing file "/root/.docker/config.json" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(a): [started] writing file "/usr/local/bin/approve-csr.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(a): [finished] writing file "/usr/local/bin/approve-csr.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(b): [started] writing file "/usr/local/bin/bootkube.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(b): [finished] writing file "/usr/local/bin/bootkube.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(c): [started] writing file "/usr/local/bin/crio-configure.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(c): [finished] writing file "/usr/local/bin/crio-configure.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(d): [started] writing file "/usr/local/bin/installer-gather.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(d): [finished] writing file "/usr/local/bin/installer-gather.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(e): [started] writing file "/usr/local/bin/installer-masters-gather.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(e): [finished] writing file "/usr/local/bin/installer-masters-gather.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(f): [started] writing file "/usr/local/bin/release-image-download.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(f): [finished] writing file "/usr/local/bin/release-image-download.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(10): [started] writing file "/usr/local/bin/release-image.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(10): [finished] writing file "/usr/local/bin/release-image.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(11): [started] writing file "/usr/local/bin/report-progress.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(11): [finished] writing file "/usr/local/bin/report-progress.sh" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(12): [started] writing file "/etc/dhcp/dhclient.conf" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(12): [finished] writing file "/etc/dhcp/dhclient.conf" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(13): [started] writing file "/opt/openshift/manifests/04-openshift-machine-config-operator.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(13): [finished] writing file "/opt/openshift/manifests/04-openshift-machine-config-operator.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(14): [started] writing file "/opt/openshift/manifests/cloud-provider-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(14): [finished] writing file "/opt/openshift/manifests/cloud-provider-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(15): [started] writing file "/opt/openshift/manifests/cluster-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(15): [finished] writing file "/opt/openshift/manifests/cluster-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(16): [started] writing file "/opt/openshift/manifests/cluster-dns-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(16): [finished] writing file "/opt/openshift/manifests/cluster-dns-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(17): [started] writing file "/opt/openshift/manifests/cluster-infrastructure-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(17): [finished] writing file "/opt/openshift/manifests/cluster-infrastructure-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(18): [started] writing file "/opt/openshift/manifests/cluster-ingress-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(18): [finished] writing file "/opt/openshift/manifests/cluster-ingress-02-config.yml" Nov 20 07:02:07 localhost systemd[1]: Started Ignition (files). Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(19): [started] writing file "/opt/openshift/manifests/cluster-network-01-crd.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(19): [finished] writing file "/opt/openshift/manifests/cluster-network-01-crd.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1a): [started] writing file "/opt/openshift/manifests/cluster-network-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1a): [finished] writing file "/opt/openshift/manifests/cluster-network-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1b): [started] writing file "/opt/openshift/manifests/cluster-proxy-01-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1b): [finished] writing file "/opt/openshift/manifests/cluster-proxy-01-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1c): [started] writing file "/opt/openshift/manifests/cluster-scheduler-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1c): [finished] writing file "/opt/openshift/manifests/cluster-scheduler-02-config.yml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1d): [started] writing file "/opt/openshift/manifests/cvo-overrides.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1d): [finished] writing file "/opt/openshift/manifests/cvo-overrides.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1e): [started] writing file "/opt/openshift/manifests/etcd-ca-bundle-configmap.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1e): [finished] writing file "/opt/openshift/manifests/etcd-ca-bundle-configmap.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1f): [started] writing file "/opt/openshift/manifests/etcd-client-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(1f): [finished] writing file "/opt/openshift/manifests/etcd-client-secret.yaml" Nov 20 07:02:07 localhost systemd[1]: Started Tear down initramfs networking. Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(20): [started] writing file "/opt/openshift/manifests/etcd-host-service-endpoints.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(20): [finished] writing file "/opt/openshift/manifests/etcd-host-service-endpoints.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(21): [started] writing file "/opt/openshift/manifests/etcd-host-service.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(21): [finished] writing file "/opt/openshift/manifests/etcd-host-service.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(22): [started] writing file "/opt/openshift/manifests/etcd-metric-client-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(22): [finished] writing file "/opt/openshift/manifests/etcd-metric-client-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(23): [started] writing file "/opt/openshift/manifests/etcd-metric-serving-ca-configmap.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(23): [finished] writing file "/opt/openshift/manifests/etcd-metric-serving-ca-configmap.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(24): [started] writing file "/opt/openshift/manifests/etcd-metric-signer-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(24): [finished] writing file "/opt/openshift/manifests/etcd-metric-signer-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(25): [started] writing file "/opt/openshift/manifests/etcd-namespace.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(25): [finished] writing file "/opt/openshift/manifests/etcd-namespace.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(26): [started] writing file "/opt/openshift/manifests/etcd-service.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(26): [finished] writing file "/opt/openshift/manifests/etcd-service.yaml" Nov 20 07:02:07 localhost systemd[1]: Starting Reload Configuration from the Real Root... Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(27): [started] writing file "/opt/openshift/manifests/etcd-serving-ca-configmap.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(27): [finished] writing file "/opt/openshift/manifests/etcd-serving-ca-configmap.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(28): [started] writing file "/opt/openshift/manifests/etcd-signer-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(28): [finished] writing file "/opt/openshift/manifests/etcd-signer-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(29): [started] writing file "/opt/openshift/manifests/kube-cloud-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(29): [finished] writing file "/opt/openshift/manifests/kube-cloud-config.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2a): [started] writing file "/opt/openshift/manifests/kube-system-configmap-root-ca.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2a): [finished] writing file "/opt/openshift/manifests/kube-system-configmap-root-ca.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2b): [started] writing file "/opt/openshift/manifests/machine-config-server-tls-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2b): [finished] writing file "/opt/openshift/manifests/machine-config-server-tls-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2c): [started] writing file "/opt/openshift/manifests/openshift-config-secret-pull-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2c): [finished] writing file "/opt/openshift/manifests/openshift-config-secret-pull-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2d): [started] writing file "/opt/openshift/openshift/99_kubeadmin-password-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2d): [finished] writing file "/opt/openshift/openshift/99_kubeadmin-password-secret.yaml" Nov 20 07:02:07 localhost systemd[1]: Reloading. Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2e): [started] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-user-data-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2e): [finished] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-user-data-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2f): [started] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-machines-0.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(2f): [finished] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-machines-0.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(30): [started] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-machines-1.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(30): [finished] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-machines-1.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(31): [started] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-machines-2.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(31): [finished] writing file "/opt/openshift/openshift/99_openshift-cluster-api_master-machines-2.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(32): [started] writing file "/opt/openshift/openshift/99_openshift-cluster-api_worker-user-data-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(32): [finished] writing file "/opt/openshift/openshift/99_openshift-cluster-api_worker-user-data-secret.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(33): [started] writing file "/opt/openshift/openshift/99_openshift-cluster-api_worker-machineset-0.yaml" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(33): [finished] writing file "/opt/openshift/openshift/99_openshift-cluster-api_worker-machineset-0.yaml" Nov 20 07:02:07 localhost systemd[1]: Started Reload Configuration from the Real Root. Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(34): [started] writing file "/opt/openshift/auth/kubeconfig" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(34): [finished] writing file "/opt/openshift/auth/kubeconfig" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(35): [started] writing file "/opt/openshift/auth/kubeconfig-kubelet" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(35): [finished] writing file "/opt/openshift/auth/kubeconfig-kubelet" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(36): [started] writing file "/opt/openshift/auth/kubeconfig-loopback" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(36): [finished] writing file "/opt/openshift/auth/kubeconfig-loopback" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(37): [started] writing file "/opt/openshift/tls/admin-kubeconfig-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(37): [finished] writing file "/opt/openshift/tls/admin-kubeconfig-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(38): [started] writing file "/opt/openshift/tls/aggregator-ca.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(38): [finished] writing file "/opt/openshift/tls/aggregator-ca.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(39): [started] writing file "/opt/openshift/tls/aggregator-ca.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(39): [finished] writing file "/opt/openshift/tls/aggregator-ca.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3a): [started] writing file "/opt/openshift/tls/aggregator-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3a): [finished] writing file "/opt/openshift/tls/aggregator-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3b): [started] writing file "/opt/openshift/tls/aggregator-client.key" Nov 20 07:02:07 localhost systemd[1]: Reached target Initrd File Systems. Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3b): [finished] writing file "/opt/openshift/tls/aggregator-client.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3c): [started] writing file "/opt/openshift/tls/aggregator-client.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3c): [finished] writing file "/opt/openshift/tls/aggregator-client.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3d): [started] writing file "/opt/openshift/tls/aggregator-signer.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3d): [finished] writing file "/opt/openshift/tls/aggregator-signer.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3e): [started] writing file "/opt/openshift/tls/aggregator-signer.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3e): [finished] writing file "/opt/openshift/tls/aggregator-signer.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3f): [started] writing file "/opt/openshift/tls/apiserver-proxy.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(3f): [finished] writing file "/opt/openshift/tls/apiserver-proxy.key" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(40): [started] writing file "/opt/openshift/tls/apiserver-proxy.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(40): [finished] writing file "/opt/openshift/tls/apiserver-proxy.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(41): [started] writing file "/opt/openshift/tls/etcd-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(41): [finished] writing file "/opt/openshift/tls/etcd-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(42): [started] writing file "/opt/openshift/tls/etcd-metric-ca-bundle.crt" Nov 20 07:02:07 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(42): [finished] writing file "/opt/openshift/tls/etcd-metric-ca-bundle.crt" Nov 20 07:02:07 localhost systemd[1]: Reached target Initrd Default Target. Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(43): [started] writing file "/opt/openshift/tls/etcd-metric-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(43): [finished] writing file "/opt/openshift/tls/etcd-metric-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(44): [started] writing file "/opt/openshift/tls/etcd-metric-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(44): [finished] writing file "/opt/openshift/tls/etcd-metric-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(45): [started] writing file "/opt/openshift/tls/etcd-metric-signer-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(45): [finished] writing file "/opt/openshift/tls/etcd-metric-signer-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(46): [started] writing file "/opt/openshift/tls/etcd-metric-signer-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(46): [finished] writing file "/opt/openshift/tls/etcd-metric-signer-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(47): [started] writing file "/opt/openshift/tls/etcd-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(47): [finished] writing file "/opt/openshift/tls/etcd-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(48): [started] writing file "/opt/openshift/tls/etcd-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(48): [finished] writing file "/opt/openshift/tls/etcd-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(49): [started] writing file "/opt/openshift/tls/etcd-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(49): [finished] writing file "/opt/openshift/tls/etcd-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4a): [started] writing file "/opt/openshift/tls/etcd-client.crt" Nov 20 07:02:07 localhost systemd[1]: Starting dracut pre-pivot and cleanup hook... Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4a): [finished] writing file "/opt/openshift/tls/etcd-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4b): [started] writing file "/opt/openshift/tls/kube-apiserver-lb-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4b): [finished] writing file "/opt/openshift/tls/kube-apiserver-lb-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4c): [started] writing file "/opt/openshift/tls/kube-apiserver-lb-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4c): [finished] writing file "/opt/openshift/tls/kube-apiserver-lb-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4d): [started] writing file "/opt/openshift/tls/kube-apiserver-lb-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4d): [finished] writing file "/opt/openshift/tls/kube-apiserver-lb-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4e): [started] writing file "/opt/openshift/tls/kube-apiserver-internal-lb-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4e): [finished] writing file "/opt/openshift/tls/kube-apiserver-internal-lb-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4f): [started] writing file "/opt/openshift/tls/kube-apiserver-internal-lb-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(4f): [finished] writing file "/opt/openshift/tls/kube-apiserver-internal-lb-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(50): [started] writing file "/opt/openshift/tls/kube-apiserver-lb-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(50): [finished] writing file "/opt/openshift/tls/kube-apiserver-lb-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(51): [started] writing file "/opt/openshift/tls/kube-apiserver-lb-signer.crt" Nov 20 07:02:08 localhost iscsid[782]: iscsid: iscsid shutting down. Nov 20 07:02:08 localhost multipathd[776]: --------shut down------- Nov 20 07:02:07 localhost systemd[1]: Started dracut pre-pivot and cleanup hook. Nov 20 07:02:08 localhost dracut-pre-pivot[1173]: Nov 20 07:02:07 | /etc/multipath.conf does not exist, blacklisting all devices. Nov 20 07:02:08 localhost dracut-pre-pivot[1173]: Nov 20 07:02:07 | You can run "/sbin/mpathconf --enable" to create Nov 20 07:02:08 localhost dracut-pre-pivot[1173]: Nov 20 07:02:07 | /etc/multipath.conf. See man mpathconf(8) for more details Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(51): [finished] writing file "/opt/openshift/tls/kube-apiserver-lb-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(52): [started] writing file "/opt/openshift/tls/kube-apiserver-localhost-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(52): [finished] writing file "/opt/openshift/tls/kube-apiserver-localhost-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(53): [started] writing file "/opt/openshift/tls/kube-apiserver-localhost-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(53): [finished] writing file "/opt/openshift/tls/kube-apiserver-localhost-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(54): [started] writing file "/opt/openshift/tls/kube-apiserver-localhost-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(54): [finished] writing file "/opt/openshift/tls/kube-apiserver-localhost-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(55): [started] writing file "/opt/openshift/tls/kube-apiserver-localhost-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(55): [finished] writing file "/opt/openshift/tls/kube-apiserver-localhost-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(56): [started] writing file "/opt/openshift/tls/kube-apiserver-localhost-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(56): [finished] writing file "/opt/openshift/tls/kube-apiserver-localhost-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(57): [started] writing file "/opt/openshift/tls/kube-apiserver-service-network-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(57): [finished] writing file "/opt/openshift/tls/kube-apiserver-service-network-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(58): [started] writing file "/opt/openshift/tls/kube-apiserver-service-network-server.key" Nov 20 07:02:07 localhost systemd[1]: Starting Cleaning Up and Shutting Down Daemons... Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(58): [finished] writing file "/opt/openshift/tls/kube-apiserver-service-network-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(59): [started] writing file "/opt/openshift/tls/kube-apiserver-service-network-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(59): [finished] writing file "/opt/openshift/tls/kube-apiserver-service-network-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5a): [started] writing file "/opt/openshift/tls/kube-apiserver-service-network-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5a): [finished] writing file "/opt/openshift/tls/kube-apiserver-service-network-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5b): [started] writing file "/opt/openshift/tls/kube-apiserver-service-network-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5b): [finished] writing file "/opt/openshift/tls/kube-apiserver-service-network-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5c): [started] writing file "/opt/openshift/tls/kube-apiserver-complete-server-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5c): [finished] writing file "/opt/openshift/tls/kube-apiserver-complete-server-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5d): [started] writing file "/opt/openshift/tls/kube-apiserver-complete-client-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5d): [finished] writing file "/opt/openshift/tls/kube-apiserver-complete-client-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5e): [started] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5e): [finished] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-ca-bundle.crt" Nov 20 07:02:08 localhost systemd-journald[193]: Missed 203 kernel messages Nov 20 07:02:08 localhost kernel: systemd: 11 output lines suppressed due to ratelimiting Nov 20 07:02:07 localhost systemd[1]: Stopping Tear down initramfs networking... Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5f): [started] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(5f): [finished] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(60): [started] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(60): [finished] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(61): [started] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(61): [finished] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(62): [started] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(62): [finished] writing file "/opt/openshift/tls/kube-apiserver-to-kubelet-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(63): [started] writing file "/opt/openshift/tls/kube-control-plane-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(63): [finished] writing file "/opt/openshift/tls/kube-control-plane-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(64): [started] writing file "/opt/openshift/tls/kube-control-plane-kube-controller-manager-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(64): [finished] writing file "/opt/openshift/tls/kube-control-plane-kube-controller-manager-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(65): [started] writing file "/opt/openshift/tls/kube-control-plane-kube-controller-manager-client.crt" Nov 20 07:02:07 localhost systemd[1]: Stopped target Timers. Nov 20 07:02:08 localhost multipathd[1233]: Nov 20 07:02:08 | /etc/multipath.conf does not exist, blacklisting all devices. Nov 20 07:02:08 localhost multipathd[1233]: Nov 20 07:02:08 | You can run "/sbin/mpathconf --enable" to create Nov 20 07:02:08 localhost multipathd[1233]: Nov 20 07:02:08 | /etc/multipath.conf. See man mpathconf(8) for more details Nov 20 07:02:08 localhost multipathd[1233]: ok Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(65): [finished] writing file "/opt/openshift/tls/kube-control-plane-kube-controller-manager-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(66): [started] writing file "/opt/openshift/tls/kube-control-plane-kube-scheduler-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(66): [finished] writing file "/opt/openshift/tls/kube-control-plane-kube-scheduler-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(67): [started] writing file "/opt/openshift/tls/kube-control-plane-kube-scheduler-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(67): [finished] writing file "/opt/openshift/tls/kube-control-plane-kube-scheduler-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(68): [started] writing file "/opt/openshift/tls/kube-control-plane-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(68): [finished] writing file "/opt/openshift/tls/kube-control-plane-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(69): [started] writing file "/opt/openshift/tls/kube-control-plane-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(69): [finished] writing file "/opt/openshift/tls/kube-control-plane-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6a): [started] writing file "/opt/openshift/tls/kubelet-bootstrap-kubeconfig-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6a): [finished] writing file "/opt/openshift/tls/kubelet-bootstrap-kubeconfig-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6b): [started] writing file "/opt/openshift/tls/kubelet-client-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6b): [finished] writing file "/opt/openshift/tls/kubelet-client-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6c): [started] writing file "/opt/openshift/tls/kubelet-client.key" Nov 20 07:02:07 localhost systemd[1]: Stopped Ignition (fetch). Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6c): [finished] writing file "/opt/openshift/tls/kubelet-client.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6d): [started] writing file "/opt/openshift/tls/kubelet-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6d): [finished] writing file "/opt/openshift/tls/kubelet-client.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6e): [started] writing file "/opt/openshift/tls/kubelet-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6e): [finished] writing file "/opt/openshift/tls/kubelet-signer.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6f): [started] writing file "/opt/openshift/tls/kubelet-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(6f): [finished] writing file "/opt/openshift/tls/kubelet-signer.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(70): [started] writing file "/opt/openshift/tls/kubelet-serving-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(70): [finished] writing file "/opt/openshift/tls/kubelet-serving-ca-bundle.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(71): [started] writing file "/opt/openshift/tls/machine-config-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(71): [finished] writing file "/opt/openshift/tls/machine-config-server.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(72): [started] writing file "/opt/openshift/tls/machine-config-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(72): [finished] writing file "/opt/openshift/tls/machine-config-server.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(73): [started] writing file "/opt/openshift/tls/service-account.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(73): [finished] writing file "/opt/openshift/tls/service-account.key" Nov 20 07:02:07 localhost systemd[1]: Stopped dracut pre-pivot and cleanup hook. Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(74): [started] writing file "/opt/openshift/tls/service-account.pub" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(74): [finished] writing file "/opt/openshift/tls/service-account.pub" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(75): [started] writing file "/opt/openshift/tls/journal-gatewayd.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(75): [finished] writing file "/opt/openshift/tls/journal-gatewayd.key" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(76): [started] writing file "/opt/openshift/tls/journal-gatewayd.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(76): [finished] writing file "/opt/openshift/tls/journal-gatewayd.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(77): [started] writing file "/opt/openshift/tls/root-ca.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(77): [finished] writing file "/opt/openshift/tls/root-ca.crt" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(78): [started] writing file "/opt/openshift/manifests/openshift-install.yml" Nov 20 07:02:08 localhost ignition[975]: INFO : files: createFilesystemsFiles: createFiles: op(78): [finished] writing file "/opt/openshift/manifests/openshift-install.yml" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(79): [started] processing unit "approve-csr.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(79): op(7a): [started] writing unit "approve-csr.service" at "etc/systemd/system/approve-csr.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(79): op(7a): [finished] writing unit "approve-csr.service" at "etc/systemd/system/approve-csr.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(79): [finished] processing unit "approve-csr.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(7b): [started] enabling unit "approve-csr.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(7b): [finished] enabling unit "approve-csr.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(7c): [started] processing unit "bootkube.service" Nov 20 07:02:08 localhost ignition[975]: INFO : files: op(7c): op(7d): [started] writing unit "bootkube.service" at "etc/systemd/system/bootkube.service" Nov 20 07:02:07 localhost systemd[1]: Stopped target Initrd Default Target. Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(7c): op(7d): [finished] writing unit "bootkube.service" at "etc/systemd/system/bootkube.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(7c): [finished] processing unit "bootkube.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(7e): [started] processing unit "chown-gatewayd-key.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(7e): op(7f): [started] writing unit "chown-gatewayd-key.service" at "etc/systemd/system/chown-gatewayd-key.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(7e): op(7f): [finished] writing unit "chown-gatewayd-key.service" at "etc/systemd/system/chown-gatewayd-key.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(7e): [finished] processing unit "chown-gatewayd-key.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(80): [started] enabling unit "chown-gatewayd-key.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(80): [finished] enabling unit "chown-gatewayd-key.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(81): [started] processing unit "crio-configure.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(81): op(82): [started] writing unit "crio-configure.service" at "etc/systemd/system/crio-configure.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(81): op(82): [finished] writing unit "crio-configure.service" at "etc/systemd/system/crio-configure.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(81): [finished] processing unit "crio-configure.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(83): [started] processing unit "kubelet.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(83): op(84): [started] writing unit "kubelet.service" at "etc/systemd/system/kubelet.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(83): op(84): [finished] writing unit "kubelet.service" at "etc/systemd/system/kubelet.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(83): [finished] processing unit "kubelet.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(85): [started] enabling unit "kubelet.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(85): [finished] enabling unit "kubelet.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(86): [started] processing unit "progress.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(86): op(87): [started] writing unit "progress.service" at "etc/systemd/system/progress.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(86): op(87): [finished] writing unit "progress.service" at "etc/systemd/system/progress.service" Nov 20 07:02:07 localhost systemd[1]: Stopped target Initrd Root Device. Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(86): [finished] processing unit "progress.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(88): [started] enabling unit "progress.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(88): [finished] enabling unit "progress.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(89): [started] processing unit "release-image.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(89): op(8a): [started] writing unit "release-image.service" at "etc/systemd/system/release-image.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(89): op(8a): [finished] writing unit "release-image.service" at "etc/systemd/system/release-image.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(89): [finished] processing unit "release-image.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8b): [started] processing unit "systemd-journal-gatewayd.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8b): op(8c): [started] writing systemd drop-in "certs.conf" at "etc/systemd/system/systemd-journal-gatewayd.service.d/certs.conf" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8b): op(8c): [finished] writing systemd drop-in "certs.conf" at "etc/systemd/system/systemd-journal-gatewayd.service.d/certs.conf" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8b): [finished] processing unit "systemd-journal-gatewayd.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8d): [started] processing unit "systemd-journal-gatewayd.socket" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8d): [finished] processing unit "systemd-journal-gatewayd.socket" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8e): [started] enabling unit "systemd-journal-gatewayd.socket" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8e): [finished] enabling unit "systemd-journal-gatewayd.socket" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8f): [started] processing unit "ignition-relabel.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8f): op(90): [started] writing unit "ignition-relabel.service" at "run/systemd/system/ignition-relabel.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8f): op(90): [finished] writing unit "ignition-relabel.service" at "run/systemd/system/ignition-relabel.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: op(8f): [finished] processing unit "ignition-relabel.service" Nov 20 07:02:09 localhost ignition[975]: INFO : files: files passed Nov 20 07:02:09 localhost ignition[975]: INFO : Ignition finished successfully Nov 20 07:02:09 localhost systemd-journald[193]: Missed 114 kernel messages Nov 20 07:02:09 localhost kernel: SELinux: policy capability network_peer_controls=1 Nov 20 07:02:09 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:02:09 localhost kernel: SELinux: policy capability open_perms=1 Nov 20 07:02:09 localhost kernel: SELinux: policy capability extended_socket_class=1 Nov 20 07:02:09 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:02:09 localhost kernel: SELinux: policy capability always_check_network=0 Nov 20 07:02:09 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:02:09 localhost kernel: SELinux: policy capability cgroup_seclabel=1 Nov 20 07:02:09 localhost systemd-journald[193]: Missed 1 kernel messages Nov 20 07:02:09 localhost kernel: SELinux: policy capability nnp_nosuid_transition=1 Nov 20 07:02:07 localhost systemd[1]: Stopped Ask OSTree to mount /var in initramfs. Nov 20 07:02:07 localhost systemd[1]: Stopped target Basic System. Nov 20 07:02:07 localhost systemd[1]: Stopped target Sockets. Nov 20 07:02:07 localhost systemd[1]: Stopped target System Initialization. Nov 20 07:02:07 localhost systemd[1]: Stopped Apply Kernel Variables. Nov 20 07:02:07 localhost systemd[1]: Stopped Create Volatile Files and Directories. Nov 20 07:02:08 localhost systemd[1]: Stopped target Swap. Nov 20 07:02:08 localhost systemd[1]: Stopped target Local File Systems. Nov 20 07:02:08 localhost systemd[1]: Stopped target Local File Systems (Pre). Nov 20 07:02:08 localhost systemd[1]: Stopped Ignition (setup). Nov 20 07:02:08 localhost systemd[1]: Stopped target Slices. Nov 20 07:02:08 localhost systemd[1]: Stopped target Paths. Nov 20 07:02:08 localhost systemd[1]: Stopped dracut pre-mount hook. Nov 20 07:02:08 localhost systemd[1]: Stopped target Local Encrypted Volumes. Nov 20 07:02:08 localhost systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. Nov 20 07:02:08 localhost systemd[1]: Stopped target Remote File Systems. Nov 20 07:02:08 localhost systemd[1]: Stopped target Remote File Systems (Pre). Nov 20 07:02:08 localhost systemd[1]: Stopped dracut initqueue hook. Nov 20 07:02:08 localhost systemd[1]: Stopping Open-iSCSI... Nov 20 07:02:09 localhost systemd-journald[193]: Missed 24 kernel messages Nov 20 07:02:09 localhost kernel: audit: type=1403 audit(1574233329.381:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Nov 20 07:02:08 localhost systemd[1]: Stopped Tear down initramfs networking. Nov 20 07:02:08 localhost systemd[1]: Stopped Open-iSCSI. Nov 20 07:02:08 localhost systemd[1]: Stopping Device-Mapper Multipath Device Controller... Nov 20 07:02:08 localhost systemd[1]: Stopping iSCSI UserSpace I/O driver... Nov 20 07:02:08 localhost systemd[1]: Closed Open-iSCSI iscsid Socket. Nov 20 07:02:08 localhost systemd[1]: Stopped iSCSI UserSpace I/O driver. Nov 20 07:02:08 localhost systemd[1]: Started Cleaning Up and Shutting Down Daemons. Nov 20 07:02:08 localhost systemd[1]: Stopped Device-Mapper Multipath Device Controller. Nov 20 07:02:08 localhost systemd[1]: Stopped udev Wait for Complete Device Initialization. Nov 20 07:02:08 localhost systemd[1]: Stopped udev Coldplug all Devices. Nov 20 07:02:08 localhost systemd[1]: Stopped dracut pre-trigger hook. Nov 20 07:02:08 localhost systemd[1]: Stopping udev Kernel Device Manager... Nov 20 07:02:08 localhost systemd[1]: Closed Open-iSCSI iscsiuio Socket. Nov 20 07:02:08 localhost systemd[1]: Stopped udev Kernel Device Manager. Nov 20 07:02:08 localhost systemd[1]: Stopped Create Static Device Nodes in /dev. Nov 20 07:02:08 localhost systemd[1]: Stopped Create list of required static device nodes for the current kernel. Nov 20 07:02:08 localhost systemd[1]: Stopped dracut pre-udev hook. Nov 20 07:02:08 localhost systemd[1]: Stopped dracut cmdline hook. Nov 20 07:02:08 localhost systemd[1]: Stopped dracut ask for additional cmdline parameters. Nov 20 07:02:08 localhost systemd[1]: Closed udev Control Socket. Nov 20 07:02:08 localhost systemd[1]: Closed udev Kernel Socket. Nov 20 07:02:08 localhost systemd[1]: Starting Cleanup udevd DB... Nov 20 07:02:08 localhost systemd[1]: Started Cleanup udevd DB. Nov 20 07:02:08 localhost systemd[1]: Reached target Switch Root. Nov 20 07:02:08 localhost systemd[1]: Starting Switch Root... Nov 20 07:02:08 localhost systemd[1]: Switching root. Nov 20 07:02:09 localhost systemd-journald[193]: Journal stopped Nov 20 07:02:10 localhost systemd[1]: Stopping Open-iSCSI... Nov 20 07:02:10 localhost systemd[1]: Successfully loaded SELinux policy in 662.231ms. Nov 20 07:02:10 localhost systemd[1]: Stopped Tear down initramfs networking. Nov 20 07:02:10 localhost systemd[1]: Stopped Open-iSCSI. Nov 20 07:02:10 localhost systemd[1]: Stopping Device-Mapper Multipath Device Controller... Nov 20 07:02:10 localhost systemd[1]: Stopping iSCSI UserSpace I/O driver... Nov 20 07:02:10 localhost systemd[1]: Closed Open-iSCSI iscsid Socket. Nov 20 07:02:10 localhost systemd[1]: Stopped iSCSI UserSpace I/O driver. Nov 20 07:02:10 localhost systemd[1]: Started Cleaning Up and Shutting Down Daemons. Nov 20 07:02:10 localhost systemd[1]: Stopped Device-Mapper Multipath Device Controller. Nov 20 07:02:10 localhost systemd[1]: Stopped udev Wait for Complete Device Initialization. Nov 20 07:02:10 localhost systemd[1]: Stopped udev Coldplug all Devices. Nov 20 07:02:10 localhost systemd[1]: Stopped dracut pre-trigger hook. Nov 20 07:02:10 localhost systemd[1]: Stopping udev Kernel Device Manager... Nov 20 07:02:10 localhost systemd[1]: Closed Open-iSCSI iscsiuio Socket. Nov 20 07:02:10 localhost systemd[1]: Stopped udev Kernel Device Manager. Nov 20 07:02:10 localhost systemd[1]: Stopped Create Static Device Nodes in /dev. Nov 20 07:02:10 localhost systemd[1]: Stopped Create list of required static device nodes for the current kernel. Nov 20 07:02:10 localhost systemd[1]: Stopped dracut pre-udev hook. Nov 20 07:02:10 localhost systemd[1]: Stopped dracut cmdline hook. Nov 20 07:02:10 localhost systemd[1]: Stopped dracut ask for additional cmdline parameters. Nov 20 07:02:10 localhost systemd[1]: Closed udev Control Socket. Nov 20 07:02:10 localhost systemd[1]: Closed udev Kernel Socket. Nov 20 07:02:10 localhost systemd[1]: Starting Cleanup udevd DB... Nov 20 07:02:10 localhost systemd[1]: Started Cleanup udevd DB. Nov 20 07:02:10 localhost systemd[1]: Reached target Switch Root. Nov 20 07:02:10 localhost systemd[1]: Starting Switch Root... Nov 20 07:02:10 localhost systemd[1]: Switching root. Nov 20 07:02:10 localhost systemd-journald[193]: Received SIGTERM from PID 1 (n/a). Nov 20 07:02:10 localhost systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 75.794ms. Nov 20 07:02:10 localhost systemd[1]: Configuration file /etc/systemd/system.conf.d/10-default-env.conf is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway. Nov 20 07:02:10 localhost systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 20 07:02:10 localhost systemd[1]: Detected virtualization kvm. Nov 20 07:02:10 localhost systemd[1]: Detected architecture x86-64. Nov 20 07:02:10 localhost systemd[1]: Running with unpopulated /etc. Nov 20 07:02:10 localhost systemd[1]: Initializing machine ID from KVM UUID. Nov 20 07:02:10 localhost systemd[1]: Populated /etc with preset unit settings. Nov 20 07:02:10 localhost systemd[1]: Stopped Switch Root. Nov 20 07:02:10 localhost systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. Nov 20 07:02:10 localhost systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Nov 20 07:02:10 localhost systemd[1]: Stopped Journal Service. Nov 20 07:02:10 localhost systemd[1]: Starting Journal Service... Nov 20 07:02:10 localhost systemd[1]: Listening on RPCbind Server Activation Socket. Nov 20 07:02:10 localhost systemd[1]: Created slice system-systemd\x2dfsck.slice. Nov 20 07:02:10 localhost systemd[1]: Listening on Process Core Dump Socket. Nov 20 07:02:10 localhost systemd[1]: Created slice system-sshd\x2dkeygen.slice. Nov 20 07:02:10 localhost systemd[1]: Stopped File System Check on Root Device. Nov 20 07:02:10 localhost systemd[1]: Reached target Host and Network Name Lookups. Nov 20 07:02:10 localhost systemd[1]: Listening on udev Kernel Socket. Nov 20 07:02:10 localhost systemd[1]: Reached target Remote Encrypted Volumes. Nov 20 07:02:10 localhost systemd[1]: Listening on initctl Compatibility Named Pipe. Nov 20 07:02:10 localhost systemd[1]: Listening on Device-mapper event daemon FIFOs. Nov 20 07:02:10 localhost systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Nov 20 07:02:10 localhost systemd[1]: Listening on LVM2 poll daemon socket. Nov 20 07:02:10 localhost systemd[1]: Listening on multipathd control socket. Nov 20 07:02:10 localhost systemd[1]: Created slice system-getty.slice. Nov 20 07:02:10 localhost systemd[1]: Reached target Swap. Nov 20 07:02:10 localhost systemd[1]: Reached target RPC Port Mapper. Nov 20 07:02:10 localhost systemd[1]: Created slice User and Session Slice. Nov 20 07:02:10 localhost systemd[1]: Reached target Slices. Nov 20 07:02:10 localhost systemd[1]: Started Forward Password Requests to Wall Directory Watch. Nov 20 07:02:10 localhost systemd[1]: Mounting POSIX Message Queue File System... Nov 20 07:02:10 localhost systemd[1]: Stopped target Switch Root. Nov 20 07:02:10 localhost systemd[1]: Stopped target Initrd Root File System. Nov 20 07:02:10 localhost systemd[1]: Mounting Kernel Debug File System... Nov 20 07:02:10 localhost systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 20 07:02:10 localhost systemd[1]: Starting Create list of required static device nodes for the current kernel... Nov 20 07:02:10 localhost systemd[1]: Stopped target Initrd File Systems. Nov 20 07:02:10 localhost systemd[1]: Listening on udev Control Socket. Nov 20 07:02:10 localhost systemd[1]: Starting udev Coldplug all Devices... Nov 20 07:02:10 localhost systemd[1]: Starting OSTree Remount OS/ Bind Mounts... Nov 20 07:02:10 localhost systemd[1]: Created slice system-afterburn\x2dsshkeys.slice. Nov 20 07:02:10 localhost systemd[1]: Created slice system-serial\x2dgetty.slice. Nov 20 07:02:10 localhost systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Nov 20 07:02:10 localhost systemd[1]: Reached target Local Encrypted Volumes. Nov 20 07:02:10 localhost systemd[1]: Reached target Remote File Systems. Nov 20 07:02:10 localhost systemd[1]: Mounting Huge Pages File System... Nov 20 07:02:10 localhost systemd[1]: Stopped OSTree Prepare OS/. Nov 20 07:02:10 localhost systemd[1]: Starting Run update-ca-trust... Nov 20 07:02:10 localhost systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 20 07:02:10 localhost systemd[1]: Mounted POSIX Message Queue File System. Nov 20 07:02:10 localhost systemd[1]: Mounted Kernel Debug File System. Nov 20 07:02:10 localhost systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 20 07:02:10 localhost systemd-journald[1270]: Journal started Nov 20 07:02:10 localhost systemd-journald[1270]: Runtime journal (/run/log/journal/fb73d2b2ff5f4c90893005c8a553c7c2) is 8.0M, max 398.0M, 390.0M free. Nov 20 07:02:10 localhost systemd[1]: Started OSTree Remount OS/ Bind Mounts. Nov 20 07:02:10 localhost systemd[1]: Started Journal Service. Nov 20 07:02:10 localhost systemd[1]: Mounted Huge Pages File System. Nov 20 07:02:10 localhost systemd[1]: Starting Flush Journal to Persistent Storage... Nov 20 07:02:10 localhost systemd[1]: Starting Load/Save Random Seed... Nov 20 07:02:10 localhost systemd[1]: Starting Create Static Device Nodes in /dev... Nov 20 07:02:10 localhost systemd-journald[1270]: Time spent on flushing to /var is 26.040ms for 1190 entries. Nov 20 07:02:10 localhost systemd-journald[1270]: System journal (/var/log/journal/fb73d2b2ff5f4c90893005c8a553c7c2) is 8.0M, max 1.5G, 1.5G free. Nov 20 07:02:10 localhost systemd[1]: Started Load/Save Random Seed. Nov 20 07:02:10 localhost systemd-tmpfiles[1290]: [/usr/lib/tmpfiles.d/mdadm.conf:1] Line references path below legacy directory /var/run/, updating /var/run/mdadm → /run/mdadm; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:10 localhost systemd[1]: Started Flush Journal to Persistent Storage. Nov 20 07:02:10 localhost systemd-tmpfiles[1290]: [/usr/lib/tmpfiles.d/pkg-mdadm.conf:1] Line references path below legacy directory /var/run/, updating /var/run/mdadm → /run/mdadm; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:10 localhost systemd-tmpfiles[1290]: [/usr/lib/tmpfiles.d/pkg-pam.conf:1] Line references path below legacy directory /var/run/, updating /var/run/console → /run/console; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:10 localhost systemd-tmpfiles[1290]: [/usr/lib/tmpfiles.d/pkg-pam.conf:2] Line references path below legacy directory /var/run/, updating /var/run/faillock → /run/faillock; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:10 localhost systemd-tmpfiles[1290]: [/usr/lib/tmpfiles.d/pkg-pam.conf:3] Line references path below legacy directory /var/run/, updating /var/run/sepermit → /run/sepermit; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:10 localhost systemd[1]: Started udev Coldplug all Devices. Nov 20 07:02:10 localhost systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 20 07:02:10 localhost systemd[1]: Started Create Static Device Nodes in /dev. Nov 20 07:02:10 localhost systemd[1]: Starting udev Kernel Device Manager... Nov 20 07:02:11 localhost systemd[1]: Started udev Kernel Device Manager. Nov 20 07:02:11 localhost systemd[1]: Starting Initialize the iWARP/InfiniBand/RDMA stack in the kernel... Nov 20 07:02:11 localhost kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Nov 20 07:02:11 localhost systemd-udevd[1314]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 20 07:02:11 localhost kernel: input: PC Speaker as /devices/platform/pcspkr/input/input6 Nov 20 07:02:11 localhost systemd[1]: Started Run update-ca-trust. Nov 20 07:02:11 localhost kernel: kvm: VM_EXIT_LOAD_IA32_PERF_GLOBAL_CTRL does not work properly. Using workaround Nov 20 07:02:11 localhost kernel: qxl 0000:00:02.0: vgaarb: deactivate vga console Nov 20 07:02:11 localhost kernel: Console: switching to colour dummy device 80x25 Nov 20 07:02:11 localhost kernel: [drm] Device Version 0.0 Nov 20 07:02:11 localhost kernel: [drm] Compression level 0 log level 0 Nov 20 07:02:11 localhost kernel: [drm] 12286 io pages at offset 0x1000000 Nov 20 07:02:11 localhost kernel: [drm] 16777216 byte draw area at offset 0x0 Nov 20 07:02:11 localhost kernel: [drm] RAM header offset: 0x3ffe000 Nov 20 07:02:11 localhost kernel: [TTM] Zone kernel: Available graphics memory: 4076224 kiB Nov 20 07:02:11 localhost kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB Nov 20 07:02:11 localhost kernel: [TTM] Initializing pool allocator Nov 20 07:02:11 localhost kernel: [TTM] Initializing DMA pool allocator Nov 20 07:02:11 localhost kernel: [drm] qxl: 16M of VRAM memory size Nov 20 07:02:11 localhost kernel: [drm] qxl: 63M of IO pages memory ready (VRAM domain) Nov 20 07:02:11 localhost kernel: [drm] qxl: 32M of Surface memory size Nov 20 07:02:11 localhost kernel: [drm] slot 0 (main): base 0xf8000000, size 0x03ffe000, gpu_offset 0x20000000000 Nov 20 07:02:11 localhost kernel: [drm] slot 1 (surfaces): base 0xfc000000, size 0x02000000, gpu_offset 0x30000000000 Nov 20 07:02:11 localhost kernel: [drm] Initialized qxl 0.1.0 20120117 for 0000:00:02.0 on minor 0 Nov 20 07:02:11 localhost kernel: fbcon: DRM emulated (fb0) is primary device Nov 20 07:02:11 localhost systemd-udevd[1316]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 20 07:02:11 localhost kernel: Console: switching to colour frame buffer device 128x48 Nov 20 07:02:11 localhost kernel: qxl 0000:00:02.0: fb0: DRM emulated frame buffer device Nov 20 07:02:11 localhost systemd[1]: Started udev Wait for Complete Device Initialization. Nov 20 07:02:11 localhost systemd[1]: Reached target Local File Systems (Pre). Nov 20 07:02:11 localhost systemd[1]: Starting File System Check on /dev/disk/by-label/EFI-SYSTEM... Nov 20 07:02:11 localhost systemd[1]: Starting File System Check on /dev/disk/by-label/boot... Nov 20 07:02:11 localhost systemd-fsck[1547]: boot: clean, 306/98304 files, 99573/393216 blocks Nov 20 07:02:11 localhost systemd[1]: Started File System Check on /dev/disk/by-label/boot. Nov 20 07:02:11 localhost systemd[1]: Mounting Boot partition... Nov 20 07:02:11 localhost systemd-fsck[1546]: fsck.fat 4.1 (2017-01-24) Nov 20 07:02:11 localhost systemd-fsck[1546]: /dev/sda2: 7 files, 1446/64887 clusters Nov 20 07:02:11 localhost systemd[1]: Started File System Check on /dev/disk/by-label/EFI-SYSTEM. Nov 20 07:02:12 localhost kernel: EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) Nov 20 07:02:12 localhost systemd[1]: Mounted Boot partition. Nov 20 07:02:12 localhost systemd[1]: Mounting EFI System Partition... Nov 20 07:02:12 localhost systemd[1]: Mounted EFI System Partition. Nov 20 07:02:12 localhost systemd[1]: Reached target Local File Systems. Nov 20 07:02:12 localhost systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 20 07:02:12 localhost systemd[1]: Starting Relabel files created by Ignition... Nov 20 07:02:12 localhost systemd[1]: Starting Create Volatile Files and Directories... Nov 20 07:02:12 localhost systemd[1]: Started Restore /run/initramfs on shutdown. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/mdadm.conf:1] Line references path below legacy directory /var/run/, updating /var/run/mdadm → /run/mdadm; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/pkg-dbus-daemon.conf:1] Duplicate line for path "/var/lib/dbus", ignoring. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/pkg-mdadm.conf:1] Line references path below legacy directory /var/run/, updating /var/run/mdadm → /run/mdadm; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/pkg-pam.conf:1] Line references path below legacy directory /var/run/, updating /var/run/console → /run/console; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/pkg-pam.conf:2] Line references path below legacy directory /var/run/, updating /var/run/faillock → /run/faillock; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/pkg-pam.conf:3] Line references path below legacy directory /var/run/, updating /var/run/sepermit → /run/sepermit; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/rpm-ostree-1-autovar.conf:1] Duplicate line for path "/var/lib/alternatives", ignoring. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/tmp.conf:12] Duplicate line for path "/var/tmp", ignoring. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/var.conf:19] Duplicate line for path "/var/cache", ignoring. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/var.conf:21] Duplicate line for path "/var/lib", ignoring. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: [/usr/lib/tmpfiles.d/var.conf:23] Duplicate line for path "/var/spool", ignoring. Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/home/core/.authorized_keys.d.lock from system_u:object_r:unlabeled_t:s0 to system_u:object_r:user_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/home/core/.ssh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:ssh_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/home/core/.ssh/authorized_keys.d from system_u:object_r:unlabeled_t:s0 to system_u:object_r:ssh_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/home/core/.ssh/authorized_keys.d/coreos-ignition from system_u:object_r:unlabeled_t:s0 to system_u:object_r:ssh_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/home/core/.ssh/authorized_keys from system_u:object_r:unlabeled_t:s0 to system_u:object_r:ssh_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/roothome/.docker from system_u:object_r:unlabeled_t:s0 to system_u:object_r:container_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/roothome/.docker/config.json from system_u:object_r:unlabeled_t:s0 to system_u:object_r:admin_home_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/containers/registries.conf from system_u:object_r:unlabeled_t:s0 to system_u:object_r:etc_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/pki/ca-trust/source/anchors/ca.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:cert_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/profile.d/proxy.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system.conf.d from system_u:object_r:unlabeled_t:s0 to system_u:object_r:etc_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system.conf.d/10-default-env.conf from system_u:object_r:unlabeled_t:s0 to system_u:object_r:etc_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/approve-csr.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/bootkube.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/crio-configure.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/installer-gather.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/installer-masters-gather.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/release-image-download.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/release-image.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/usrlocal/bin/report-progress.sh from system_u:object_r:unlabeled_t:s0 to system_u:object_r:bin_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/dhcp/dhclient.conf from system_u:object_r:unlabeled_t:s0 to system_u:object_r:dhcp_etc_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/04-openshift-machine-config-operator.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cloud-provider-config.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-config.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-dns-02-config.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-infrastructure-02-config.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-ingress-02-config.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-network-01-crd.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-network-02-config.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-proxy-01-config.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cluster-scheduler-02-config.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/cvo-overrides.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-ca-bundle-configmap.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-client-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-host-service-endpoints.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-host-service.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-metric-client-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-metric-serving-ca-configmap.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-metric-signer-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-namespace.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-service.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-serving-ca-configmap.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/etcd-signer-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/kube-cloud-config.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/kube-system-configmap-root-ca.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/machine-config-server-tls-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/openshift-config-secret-pull-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/manifests/openshift-install.yml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_kubeadmin-password-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_openshift-cluster-api_master-user-data-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_openshift-cluster-api_master-machines-0.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_openshift-cluster-api_master-machines-1.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_openshift-cluster-api_master-machines-2.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_openshift-cluster-api_worker-user-data-secret.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/openshift/99_openshift-cluster-api_worker-machineset-0.yaml from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/auth from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/auth/kubeconfig from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/auth/kubeconfig-kubelet from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/auth/kubeconfig-loopback from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/root-ca.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: "/home" already exists and is not a directory. Nov 20 07:02:12 localhost systemd-tmpfiles[1602]: "/srv" already exists and is not a directory. Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/admin-kubeconfig-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-ca.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-ca.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/aggregator-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/apiserver-proxy.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/apiserver-proxy.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-metric-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-metric-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-metric-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-metric-signer-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-metric-signer-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/etcd-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-lb-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-lb-server.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-lb-server.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-internal-lb-server.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-internal-lb-server.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-lb-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-lb-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-localhost-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-localhost-server.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-localhost-server.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-localhost-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-localhost-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-service-network-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-service-network-server.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-service-network-server.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-service-network-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-service-network-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-complete-server-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-complete-client-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-to-kubelet-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-to-kubelet-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-to-kubelet-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-to-kubelet-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-apiserver-to-kubelet-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-kube-controller-manager-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-kube-controller-manager-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-kube-scheduler-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-kube-scheduler-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kube-control-plane-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-bootstrap-kubeconfig-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-client-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-client.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-client.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-signer.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-signer.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/kubelet-serving-ca-bundle.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/machine-config-server.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/machine-config-server.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/service-account.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/service-account.pub from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/journal-gatewayd.key from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /var/opt/openshift/tls/journal-gatewayd.crt from system_u:object_r:unlabeled_t:s0 to system_u:object_r:var_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/approve-csr.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/bootkube.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/chown-gatewayd-key.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/crio-configure.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/kubelet.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/progress.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/release-image.service from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/systemd-journal-gatewayd.service.d from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system/systemd-journal-gatewayd.service.d/certs.conf from system_u:object_r:unlabeled_t:s0 to system_u:object_r:systemd_unit_file_t:s0 Nov 20 07:02:12 localhost restorecon[1600]: Relabeled /etc/systemd/system-preset/20-ignition.preset from system_u:object_r:unlabeled_t:s0 to system_u:object_r:etc_t:s0 Nov 20 07:02:12 localhost systemd[1]: Started Relabel files created by Ignition. Nov 20 07:02:12 localhost systemd[1]: Starting Apply Kernel Variables... Nov 20 07:02:12 localhost systemd[1]: Started Apply Kernel Variables. Nov 20 07:02:12 localhost kernel: Rounding down aligned max_sectors from 4294967295 to 4294967288 Nov 20 07:02:12 localhost kernel: db_root: cannot open: /etc/target Nov 20 07:02:12 localhost systemd[1]: Started Create Volatile Files and Directories. Nov 20 07:02:12 localhost systemd[1]: Starting Security Auditing Service... Nov 20 07:02:12 localhost kernel: iscsi: registered transport (iser) Nov 20 07:02:12 localhost auditd[1673]: No plugins found, not dispatching events Nov 20 07:02:12 localhost auditd[1673]: Init complete, auditd 3.0 listening for events (startup state enable) Nov 20 07:02:12 localhost augenrules[1679]: /sbin/augenrules: No change Nov 20 07:02:12 localhost systemd[1]: Started Security Auditing Service. Nov 20 07:02:12 localhost systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 20 07:02:12 localhost systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 20 07:02:12 localhost systemd[1]: Reached target System Initialization. Nov 20 07:02:12 localhost systemd[1]: Started OSTree Monitor Staged Deployment. Nov 20 07:02:12 localhost systemd[1]: Reached target Paths. Nov 20 07:02:12 localhost systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 20 07:02:12 localhost systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 20 07:02:12 localhost systemd[1]: Reached target Timers. Nov 20 07:02:12 localhost systemd[1]: Listening on Journal Gateway Service Socket. Nov 20 07:02:12 localhost systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 20 07:02:12 localhost kernel: RPC: Registered named UNIX socket transport module. Nov 20 07:02:12 localhost kernel: RPC: Registered udp transport module. Nov 20 07:02:12 localhost kernel: RPC: Registered tcp transport module. Nov 20 07:02:12 localhost kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Nov 20 07:02:12 localhost systemd[1]: Reached target Sockets. Nov 20 07:02:12 localhost systemd[1]: Reached target Basic System. Nov 20 07:02:12 localhost systemd[1]: Started irqbalance daemon. Nov 20 07:02:12 localhost systemd[1]: Starting Change ownership of journal-gatewayd.key... Nov 20 07:02:12 localhost systemd[1]: Starting Mark boot complete... Nov 20 07:02:12 localhost systemd[1]: Starting CRI-O Auto Update Script... Nov 20 07:02:12 localhost kernel: RPC: Registered rdma transport module. Nov 20 07:02:12 localhost kernel: RPC: Registered rdma backchannel transport module. Nov 20 07:02:12 localhost systemd[1]: Reached target sshd-keygen.target. Nov 20 07:02:12 localhost systemd[1]: Starting NTP client/server... Nov 20 07:02:12 localhost kernel: EXT4-fs (sda1): re-mounted. Opts: Nov 20 07:02:12 localhost systemd[1]: Starting coreos-regenerate-iscsi-initiatorname.service... Nov 20 07:02:12 localhost systemd[1]: Started D-Bus System Message Bus. Nov 20 07:02:12 localhost systemd[1]: Starting Network Manager... Nov 20 07:02:12 localhost systemd[1]: Starting Login Service... Nov 20 07:02:12 localhost systemd[1]: Started Mark boot complete. Nov 20 07:02:12 localhost systemd[1]: Started coreos-regenerate-iscsi-initiatorname.service. Nov 20 07:02:12 localhost chronyd[1728]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 20 07:02:12 localhost systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 20 07:02:12 localhost chronyd[1728]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 20 07:02:12 localhost chronyd[1728]: Using right/UTC timezone to obtain leap second data Nov 20 07:02:12 localhost dbus-daemon[1716]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 20 07:02:12 localhost systemd[1]: Started Initialize the iWARP/InfiniBand/RDMA stack in the kernel. Nov 20 07:02:12 localhost systemd[1]: Started NTP client/server. Nov 20 07:02:12 localhost useradd[1736]: new group: name=systemd-journal-gateway, GID=995 Nov 20 07:02:12 localhost useradd[1736]: new user: name=systemd-journal-gateway, UID=993, GID=995, home=/var/home/systemd-journal-gateway, shell=/bin/bash Nov 20 07:02:12 localhost NetworkManager[1723]: [1574233332.7265] NetworkManager (version 1.20.0-3.el8) is starting... (for the first time) Nov 20 07:02:12 localhost NetworkManager[1723]: [1574233332.7278] Read config: /etc/NetworkManager/NetworkManager.conf (lib: 20-client-id-from-mac.conf) (run: 10-dracut-dhclient.conf) Nov 20 07:02:12 localhost systemd[1]: Started Network Manager. Nov 20 07:02:12 localhost NetworkManager[1723]: [1574233332.7350] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" Nov 20 07:02:12 localhost systemd[1]: Starting Network Manager Wait Online... Nov 20 07:02:12 localhost systemd[1]: Reached target Network. Nov 20 07:02:12 localhost NetworkManager[1723]: [1574233332.7450] manager[0x5579e3a3c140]: monitoring kernel firmware directory '/lib/firmware'. Nov 20 07:02:12 localhost dbus-daemon[1716]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.5' (uid=0 pid=1723 comm="/usr/sbin/NetworkManager --no-daemon " label="system_u:system_r:NetworkManager_t:s0") Nov 20 07:02:12 localhost systemd[1]: Starting OpenSSH server daemon... Nov 20 07:02:12 localhost systemd[1]: Starting Hostname Service... Nov 20 07:02:12 localhost sshd[1746]: Server listening on 0.0.0.0 port 22. Nov 20 07:02:12 localhost sshd[1746]: Server listening on :: port 22. Nov 20 07:02:12 localhost systemd[1]: Started OpenSSH server daemon. Nov 20 07:02:12 localhost systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 20 07:02:12 localhost systemd[1]: Started Change ownership of journal-gatewayd.key. Nov 20 07:02:12 localhost systemd-logind[1725]: New seat seat0. Nov 20 07:02:12 localhost systemd-logind[1725]: Watching system buttons on /dev/input/event0 (Power Button) Nov 20 07:02:12 localhost systemd-logind[1725]: Watching system buttons on /dev/input/event1 (AT Translated Set 2 keyboard) Nov 20 07:02:12 localhost systemd[1]: Started Login Service. Nov 20 07:02:12 localhost systemd[1]: Created slice system-user\x2druntime\x2ddir.slice. Nov 20 07:02:12 localhost systemd[1]: Started /run/user/1001 mount wrapper. Nov 20 07:02:13 localhost dbus-daemon[1716]: [system] Successfully activated service 'org.freedesktop.hostname1' Nov 20 07:02:13 localhost systemd[1]: Started Hostname Service. Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1449] hostname: hostname: using hostnamed Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1459] dns-mgr[0x5579e3a20250]: init: dns=default,systemd-resolved rc-manager=symlink Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1594] Loaded device plugin: NMOvsFactory (/usr/lib64/NetworkManager/1.20.0-3.el8/libnm-device-plugin-ovs.so) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1596] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1598] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1600] manager: Networking is enabled by state file Nov 20 07:02:13 localhost dbus-daemon[1716]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.5' (uid=0 pid=1723 comm="/usr/sbin/NetworkManager --no-daemon " label="system_u:system_r:NetworkManager_t:s0") Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1616] dhcp-init: Using DHCP client 'dhclient' Nov 20 07:02:13 localhost systemd[1]: Starting Network Manager Script Dispatcher Service... Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1703] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.20.0-3.el8/libnm-settings-plugin-ifcfg-rh.so") Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1704] settings: Loaded settings plugin: keyfile (internal) Nov 20 07:02:13 localhost dbus-daemon[1716]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher' Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1883] device (lo): carrier: link connected Nov 20 07:02:13 localhost systemd[1]: Started Network Manager Script Dispatcher Service. Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1909] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1933] manager: (ens3): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.1958] device (ens3): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Nov 20 07:02:13 localhost kernel: IPv6: ADDRCONF(NETDEV_UP): ens3: link is not ready Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2013] device (ens3): carrier: link connected Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2082] ovsdb: Could not connect: No such file or directory Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2117] device (ens3): state change: unavailable -> disconnected (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2143] policy: auto-activating connection 'ens3' (04202341-27c3-456a-b44b-e6b916b17ba9) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2160] device (ens3): Activation: starting connection 'ens3' (04202341-27c3-456a-b44b-e6b916b17ba9) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2163] device (ens3): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2171] manager: NetworkManager state is now CONNECTING Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2179] device (ens3): state change: prepare -> config (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2207] device (ens3): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2225] dhcp4 (ens3): activation: beginning transaction (timeout in 45 seconds) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.2300] dhcp4 (ens3): dhclient started with pid 1783 Nov 20 07:02:13 localhost dhclient[1783]: DHCPREQUEST on ens3 to 255.255.255.255 port 67 (xid=0x1e862777) Nov 20 07:02:13 localhost dhclient[1783]: DHCPNAK from 10.34.212.199 (xid=0x1e862777) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3348] dhcp4 (ens3): state changed unknown -> expire Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3510] dhcp4 (ens3): state changed expire -> unknown Nov 20 07:02:13 localhost dhclient[1783]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 8 (xid=0x899a6d02) Nov 20 07:02:13 localhost dhclient[1783]: DHCPREQUEST on ens3 to 255.255.255.255 port 67 (xid=0x899a6d02) Nov 20 07:02:13 localhost dhclient[1783]: DHCPOFFER from 10.34.212.199 Nov 20 07:02:13 localhost dhclient[1783]: DHCPACK from 10.34.212.199 (xid=0x899a6d02) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3681] dhcp4 (ens3): address 10.34.212.212 Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3682] dhcp4 (ens3): plen 23 (255.255.254.0) Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3682] dhcp4 (ens3): gateway 10.34.212.65 Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3683] dhcp4 (ens3): lease time 1296000 Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3683] dhcp4 (ens3): nameserver '127.0.0.1' Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3683] dhcp4 (ens3): nameserver '10.34.212.100' Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3683] dhcp4 (ens3): nameserver '10.34.106.100' Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3684] dhcp4 (ens3): nameserver '10.34.107.40' Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3684] dhcp4 (ens3): domain name 'v212.abes.fr' Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3684] dhcp4 (ens3): state changed unknown -> bound Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3698] device (ens3): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3769] device (ens3): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3777] device (ens3): state change: secondaries -> activated (reason 'none', sys-iface-state: 'managed') Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3801] manager: NetworkManager state is now CONNECTED_LOCAL Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3828] manager: NetworkManager state is now CONNECTED_SITE Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3831] policy: set 'ens3' (ens3) as default for IPv4 routing and DNS Nov 20 07:02:13 localhost dhclient[1783]: bound to 10.34.212.212 -- renewal in 602503 seconds. Nov 20 07:02:13 localhost dbus-daemon[1716]: [system] Activating via systemd: service name='org.freedesktop.resolve1' unit='dbus-org.freedesktop.resolve1.service' requested by ':1.5' (uid=0 pid=1723 comm="/usr/sbin/NetworkManager --no-daemon " label="system_u:system_r:NetworkManager_t:s0") Nov 20 07:02:13 localhost dbus-daemon[1716]: [system] Activation via systemd failed for unit 'dbus-org.freedesktop.resolve1.service': Unit dbus-org.freedesktop.resolve1.service not found. Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3925] device (ens3): Activation: successful, device activated. Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3948] manager: NetworkManager state is now CONNECTED_GLOBAL Nov 20 07:02:13 localhost NetworkManager[1723]: [1574233333.3963] manager: startup complete Nov 20 07:02:13 localhost systemd[1]: Started Network Manager Wait Online. Nov 20 07:02:13 localhost systemd[1]: Reached target Network is Online. Nov 20 07:02:13 localhost systemd[1]: Starting Download the OpenShift Release Image... Nov 20 07:02:13 localhost systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 20 07:02:13 localhost systemd[1]: Starting Generate /run/issue.d/console-login-helper-messages.issue... Nov 20 07:02:13 localhost release-image-download.sh[1808]: Pulling registry.svc.ci.openshift.org/origin/release:4.3... Nov 20 07:02:13 localhost systemd[1]: iscsi.service: Unit cannot be reloaded because it is inactive. Nov 20 07:02:13 localhost systemd[1]: Starting RPC Bind... Nov 20 07:02:13 localhost systemd[1]: Started Generate /run/issue.d/console-login-helper-messages.issue. Nov 20 07:02:13 localhost systemd[1]: Starting Permit User Sessions... Nov 20 07:02:13 localhost systemd[1]: Started RPC Bind. Nov 20 07:02:13 localhost rpc.statd[1847]: Version 2.3.3 starting Nov 20 07:02:13 localhost rpc.statd[1847]: Flags: TI-RPC Nov 20 07:02:13 localhost systemd[1]: Started Permit User Sessions. Nov 20 07:02:13 localhost rpc.statd[1847]: Initializing NSM state Nov 20 07:02:13 localhost systemd[1]: Started Getty on tty1. Nov 20 07:02:13 localhost systemd[1]: Created slice User Slice of UID 1001. Nov 20 07:02:13 localhost systemd[1]: Starting User Manager for UID 1001... Nov 20 07:02:13 localhost systemd[1]: Started Serial Getty on ttyS0. Nov 20 07:02:13 localhost systemd[1]: Reached target Login Prompts. Nov 20 07:02:13 localhost systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 20 07:02:13 localhost systemd[1851]: pam_unix(systemd-user:session): session opened for user user1 by (uid=0) Nov 20 07:02:13 localhost crio[1706]: version file /var/lib/crio/version not found: open /var/lib/crio/version: no such file or directory. Triggering wipe Nov 20 07:02:13 localhost systemd[1]: Started CRI-O Auto Update Script. Nov 20 07:02:13 localhost systemd[1]: Starting Open Container Initiative Daemon... Nov 20 07:02:13 localhost systemd[1851]: Starting Create User's Volatile Files and Directories... Nov 20 07:02:13 localhost systemd[1851]: Reached target Paths. Nov 20 07:02:13 localhost systemd[1851]: Starting D-Bus User Message Bus Socket. Nov 20 07:02:13 localhost systemd[1851]: Listening on Podman Remote API Socket. Nov 20 07:02:13 localhost systemd[1851]: Started Daily Cleanup of User's Temporary Directories. Nov 20 07:02:13 localhost systemd[1851]: Reached target Timers. Nov 20 07:02:13 localhost systemd[1851]: Listening on D-Bus User Message Bus Socket. Nov 20 07:02:13 localhost systemd[1851]: Reached target Sockets. Nov 20 07:02:13 localhost systemd[1851]: Started Create User's Volatile Files and Directories. Nov 20 07:02:13 localhost systemd[1851]: Reached target Basic System. Nov 20 07:02:13 localhost systemd[1]: Started User Manager for UID 1001. Nov 20 07:02:13 localhost systemd[1851]: Started Podman Remote API Service. Nov 20 07:02:13 localhost systemd[1851]: Reached target Default. Nov 20 07:02:13 localhost systemd[1851]: Startup finished in 109ms. Nov 20 07:02:13 localhost systemd[1]: Started Open Container Initiative Daemon. Nov 20 07:02:13 localhost systemd[1]: Starting Kubernetes Kubelet... Nov 20 07:02:14 localhost podman[1816]: 2019-11-20 07:02:14.190541864 +0000 UTC m=+0.386779485 system refresh Nov 20 07:02:14 localhost podman[1912]: 2019-11-20 07:02:14.40068218 +0000 UTC m=+0.130303288 system refresh Nov 20 07:02:16 localhost hyperkube[1909]: Flag --runtime-request-timeout has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 20 07:02:16 localhost hyperkube[1909]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 20 07:02:16 localhost hyperkube[1909]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 20 07:02:16 localhost hyperkube[1909]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 20 07:02:16 localhost hyperkube[1909]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 20 07:02:16 localhost hyperkube[1909]: Flag --serialize-image-pulls has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.131841 1909 flags.go:33] FLAG: --add-dir-header="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132184 1909 flags.go:33] FLAG: --address="0.0.0.0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132202 1909 flags.go:33] FLAG: --allowed-unsafe-sysctls="[]" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132222 1909 flags.go:33] FLAG: --alsologtostderr="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132234 1909 flags.go:33] FLAG: --anonymous-auth="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132247 1909 flags.go:33] FLAG: --application-metrics-count-limit="100" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132259 1909 flags.go:33] FLAG: --authentication-token-webhook="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132270 1909 flags.go:33] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132284 1909 flags.go:33] FLAG: --authorization-mode="AlwaysAllow" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132297 1909 flags.go:33] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132308 1909 flags.go:33] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132321 1909 flags.go:33] FLAG: --azure-container-registry-config="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132332 1909 flags.go:33] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132344 1909 flags.go:33] FLAG: --bootstrap-checkpoint-path="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132354 1909 flags.go:33] FLAG: --bootstrap-kubeconfig="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132365 1909 flags.go:33] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132376 1909 flags.go:33] FLAG: --cgroup-driver="systemd" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132387 1909 flags.go:33] FLAG: --cgroup-root="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132397 1909 flags.go:33] FLAG: --cgroups-per-qos="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132408 1909 flags.go:33] FLAG: --chaos-chance="0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132423 1909 flags.go:33] FLAG: --client-ca-file="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132433 1909 flags.go:33] FLAG: --cloud-config="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132444 1909 flags.go:33] FLAG: --cloud-provider="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132454 1909 flags.go:33] FLAG: --cluster-dns="[]" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132467 1909 flags.go:33] FLAG: --cluster-domain="cluster.local" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132478 1909 flags.go:33] FLAG: --cni-bin-dir="/opt/cni/bin" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132489 1909 flags.go:33] FLAG: --cni-cache-dir="/var/lib/cni/cache" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132500 1909 flags.go:33] FLAG: --cni-conf-dir="/etc/cni/net.d" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132512 1909 flags.go:33] FLAG: --config="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132522 1909 flags.go:33] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132534 1909 flags.go:33] FLAG: --container-log-max-files="5" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132547 1909 flags.go:33] FLAG: --container-log-max-size="10Mi" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132558 1909 flags.go:33] FLAG: --container-runtime="remote" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132720 1909 flags.go:33] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132735 1909 flags.go:33] FLAG: --containerd="/run/containerd/containerd.sock" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132747 1909 flags.go:33] FLAG: --contention-profiling="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132759 1909 flags.go:33] FLAG: --cpu-cfs-quota="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132770 1909 flags.go:33] FLAG: --cpu-cfs-quota-period="100ms" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132782 1909 flags.go:33] FLAG: --cpu-manager-policy="none" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132794 1909 flags.go:33] FLAG: --cpu-manager-reconcile-period="10s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132805 1909 flags.go:33] FLAG: --docker="unix:///var/run/docker.sock" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132818 1909 flags.go:33] FLAG: --docker-endpoint="unix:///var/run/docker.sock" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132829 1909 flags.go:33] FLAG: --docker-env-metadata-whitelist="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132844 1909 flags.go:33] FLAG: --docker-only="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132856 1909 flags.go:33] FLAG: --docker-root="/var/lib/docker" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132867 1909 flags.go:33] FLAG: --docker-tls="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132878 1909 flags.go:33] FLAG: --docker-tls-ca="ca.pem" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132889 1909 flags.go:33] FLAG: --docker-tls-cert="cert.pem" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132900 1909 flags.go:33] FLAG: --docker-tls-key="key.pem" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132911 1909 flags.go:33] FLAG: --dynamic-config-dir="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132937 1909 flags.go:33] FLAG: --enable-cadvisor-json-endpoints="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132948 1909 flags.go:33] FLAG: --enable-controller-attach-detach="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.132960 1909 flags.go:33] FLAG: --enable-debugging-handlers="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133088 1909 flags.go:33] FLAG: --enable-load-reader="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133105 1909 flags.go:33] FLAG: --enable-server="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133116 1909 flags.go:33] FLAG: --enforce-node-allocatable="[pods]" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133135 1909 flags.go:33] FLAG: --event-burst="10" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133147 1909 flags.go:33] FLAG: --event-qps="5" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133158 1909 flags.go:33] FLAG: --event-storage-age-limit="default=0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133173 1909 flags.go:33] FLAG: --event-storage-event-limit="default=0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133185 1909 flags.go:33] FLAG: --eviction-hard="imagefs.available<15%,memory.available<100Mi,nodefs.available<10%,nodefs.inodesFree<5%" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133208 1909 flags.go:33] FLAG: --eviction-max-pod-grace-period="0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133219 1909 flags.go:33] FLAG: --eviction-minimum-reclaim="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133233 1909 flags.go:33] FLAG: --eviction-pressure-transition-period="5m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133244 1909 flags.go:33] FLAG: --eviction-soft="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133267 1909 flags.go:33] FLAG: --eviction-soft-grace-period="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133279 1909 flags.go:33] FLAG: --exit-on-lock-contention="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133290 1909 flags.go:33] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133300 1909 flags.go:33] FLAG: --experimental-bootstrap-kubeconfig="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133311 1909 flags.go:33] FLAG: --experimental-check-node-capabilities-before-mount="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133323 1909 flags.go:33] FLAG: --experimental-dockershim="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133334 1909 flags.go:33] FLAG: --experimental-dockershim-root-directory="/var/lib/dockershim" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133345 1909 flags.go:33] FLAG: --experimental-kernel-memcg-notification="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133356 1909 flags.go:33] FLAG: --experimental-mounter-path="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133366 1909 flags.go:33] FLAG: --fail-swap-on="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133377 1909 flags.go:33] FLAG: --feature-gates="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133391 1909 flags.go:33] FLAG: --file-check-frequency="20s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133403 1909 flags.go:33] FLAG: --global-housekeeping-interval="1m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133414 1909 flags.go:33] FLAG: --hairpin-mode="promiscuous-bridge" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133426 1909 flags.go:33] FLAG: --healthz-bind-address="127.0.0.1" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133437 1909 flags.go:33] FLAG: --healthz-port="10248" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133448 1909 flags.go:33] FLAG: --help="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133459 1909 flags.go:33] FLAG: --hostname-override="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133469 1909 flags.go:33] FLAG: --housekeeping-interval="10s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133480 1909 flags.go:33] FLAG: --http-check-frequency="20s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133491 1909 flags.go:33] FLAG: --image-gc-high-threshold="85" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133502 1909 flags.go:33] FLAG: --image-gc-low-threshold="80" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133513 1909 flags.go:33] FLAG: --image-pull-progress-deadline="1m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133524 1909 flags.go:33] FLAG: --image-service-endpoint="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133535 1909 flags.go:33] FLAG: --iptables-drop-bit="15" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133545 1909 flags.go:33] FLAG: --iptables-masquerade-bit="14" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133556 1909 flags.go:33] FLAG: --keep-terminated-pod-volumes="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133570 1909 flags.go:33] FLAG: --kube-api-burst="10" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133582 1909 flags.go:33] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133593 1909 flags.go:33] FLAG: --kube-api-qps="5" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133604 1909 flags.go:33] FLAG: --kube-reserved="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133616 1909 flags.go:33] FLAG: --kube-reserved-cgroup="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133638 1909 flags.go:33] FLAG: --kubeconfig="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133649 1909 flags.go:33] FLAG: --kubelet-cgroups="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133659 1909 flags.go:33] FLAG: --lock-file="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133670 1909 flags.go:33] FLAG: --log-backtrace-at=":0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133683 1909 flags.go:33] FLAG: --log-cadvisor-usage="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133694 1909 flags.go:33] FLAG: --log-dir="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133705 1909 flags.go:33] FLAG: --log-file="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133834 1909 flags.go:33] FLAG: --log-file-max-size="1800" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133860 1909 flags.go:33] FLAG: --log-flush-frequency="5s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133873 1909 flags.go:33] FLAG: --logtostderr="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133892 1909 flags.go:33] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133905 1909 flags.go:33] FLAG: --make-iptables-util-chains="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133916 1909 flags.go:33] FLAG: --manifest-url="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133928 1909 flags.go:33] FLAG: --manifest-url-header="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133943 1909 flags.go:33] FLAG: --master-service-namespace="default" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133954 1909 flags.go:33] FLAG: --max-open-files="1000000" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.133987 1909 flags.go:33] FLAG: --max-pods="110" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134002 1909 flags.go:33] FLAG: --maximum-dead-containers="-1" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134036 1909 flags.go:33] FLAG: --maximum-dead-containers-per-container="1" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134047 1909 flags.go:33] FLAG: --minimum-container-ttl-duration="6m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134058 1909 flags.go:33] FLAG: --minimum-image-ttl-duration="2m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134069 1909 flags.go:33] FLAG: --network-plugin="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134080 1909 flags.go:33] FLAG: --network-plugin-mtu="0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134091 1909 flags.go:33] FLAG: --node-ip="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134101 1909 flags.go:33] FLAG: --node-labels="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134115 1909 flags.go:33] FLAG: --node-status-max-images="50" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134126 1909 flags.go:33] FLAG: --node-status-update-frequency="10s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134137 1909 flags.go:33] FLAG: --non-masquerade-cidr="10.0.0.0/8" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134148 1909 flags.go:33] FLAG: --oom-score-adj="-999" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134159 1909 flags.go:33] FLAG: --pod-cidr="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134170 1909 flags.go:33] FLAG: --pod-infra-container-image="k8s.gcr.io/pause:3.1" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134181 1909 flags.go:33] FLAG: --pod-manifest-path="/etc/kubernetes/manifests" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134204 1909 flags.go:33] FLAG: --pod-max-pids="-1" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134215 1909 flags.go:33] FLAG: --pods-per-core="0" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134226 1909 flags.go:33] FLAG: --port="10250" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134238 1909 flags.go:33] FLAG: --protect-kernel-defaults="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134248 1909 flags.go:33] FLAG: --provider-id="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134259 1909 flags.go:33] FLAG: --qos-reserved="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134271 1909 flags.go:33] FLAG: --read-only-port="10255" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134282 1909 flags.go:33] FLAG: --really-crash-for-testing="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134293 1909 flags.go:33] FLAG: --redirect-container-streaming="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134307 1909 flags.go:33] FLAG: --register-node="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134319 1909 flags.go:33] FLAG: --register-schedulable="true" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134329 1909 flags.go:33] FLAG: --register-with-taints="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134343 1909 flags.go:33] FLAG: --registry-burst="10" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134354 1909 flags.go:33] FLAG: --registry-qps="5" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134365 1909 flags.go:33] FLAG: --resolv-conf="/etc/resolv.conf" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134376 1909 flags.go:33] FLAG: --root-dir="/var/lib/kubelet" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134387 1909 flags.go:33] FLAG: --rotate-certificates="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134398 1909 flags.go:33] FLAG: --rotate-server-certificates="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134409 1909 flags.go:33] FLAG: --runonce="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134419 1909 flags.go:33] FLAG: --runtime-cgroups="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134430 1909 flags.go:33] FLAG: --runtime-request-timeout="10m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134441 1909 flags.go:33] FLAG: --seccomp-profile-root="/var/lib/kubelet/seccomp" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134452 1909 flags.go:33] FLAG: --serialize-image-pulls="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134463 1909 flags.go:33] FLAG: --skip-headers="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134474 1909 flags.go:33] FLAG: --skip-log-headers="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134485 1909 flags.go:33] FLAG: --stderrthreshold="2" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134496 1909 flags.go:33] FLAG: --storage-driver-buffer-duration="1m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134507 1909 flags.go:33] FLAG: --storage-driver-db="cadvisor" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134519 1909 flags.go:33] FLAG: --storage-driver-host="localhost:8086" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134530 1909 flags.go:33] FLAG: --storage-driver-password="root" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134541 1909 flags.go:33] FLAG: --storage-driver-secure="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134552 1909 flags.go:33] FLAG: --storage-driver-table="stats" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134572 1909 flags.go:33] FLAG: --storage-driver-user="root" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134584 1909 flags.go:33] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134595 1909 flags.go:33] FLAG: --sync-frequency="1m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134606 1909 flags.go:33] FLAG: --system-cgroups="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134617 1909 flags.go:33] FLAG: --system-reserved="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134629 1909 flags.go:33] FLAG: --system-reserved-cgroup="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134639 1909 flags.go:33] FLAG: --tls-cert-file="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134650 1909 flags.go:33] FLAG: --tls-cipher-suites="[]" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134663 1909 flags.go:33] FLAG: --tls-min-version="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134675 1909 flags.go:33] FLAG: --tls-private-key-file="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134686 1909 flags.go:33] FLAG: --topology-manager-policy="none" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134697 1909 flags.go:33] FLAG: --v="2" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134708 1909 flags.go:33] FLAG: --version="false" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134730 1909 flags.go:33] FLAG: --vmodule="" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134742 1909 flags.go:33] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134754 1909 flags.go:33] FLAG: --volume-stats-agg-period="1m0s" Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.134836 1909 feature_gate.go:217] feature gates: &{map[]} Nov 20 07:02:16 localhost hyperkube[1909]: I1120 07:02:16.135054 1909 feature_gate.go:217] feature gates: &{map[]} Nov 20 07:02:17 localhost systemd[1]: Started Kubernetes systemd probe. Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.456482 1909 mount_linux.go:168] Detected OS with systemd Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.458416 1909 server.go:417] Version: v1.16.2 Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.458550 1909 feature_gate.go:217] feature gates: &{map[]} Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.458631 1909 feature_gate.go:217] feature gates: &{map[]} Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.458797 1909 plugins.go:100] No cloud provider specified. Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.460349 1909 server.go:533] No cloud provider specified: "" from the config file: "" Nov 20 07:02:17 localhost hyperkube[1909]: W1120 07:02:17.460423 1909 server.go:556] standalone mode, no API client Nov 20 07:02:17 localhost hyperkube[1909]: W1120 07:02:17.461284 1909 server.go:612] failed to get the kubelet's cgroup: cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service. Kubelet system container metrics may be missing. Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.461730 1909 manager.go:146] cAdvisor running in container: "/sys/fs/cgroup/cpu,cpuacct" Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.481347 1909 fs.go:127] Filesystem UUIDs: map[2019-11-20-08-01-38-00:/dev/sr1 574c389e-c1ac-4478-a1be-b9e045cd1d67:/dev/sda1 E1F8-6C77:/dev/sda2 ef8bb9ba-7cca-4774-a47b-55b80b2ddeb3:/dev/sda4] Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.481433 1909 fs.go:128] Filesystem partitions: map[/dev/sda1:{mountpoint:/boot major:8 minor:1 fsType:ext4 blockSize:0} /dev/sda4:{mountpoint:/var major:8 minor:4 fsType:xfs blockSize:0} tmpfs:{mountpoint:/dev/shm major:0 minor:21 fsType:tmpfs blockSize:0}] Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.487055 1909 manager.go:193] Machine: {NumCores:4 CpuFrequency:2527000 MemoryCapacity:8348106752 HugePages:[{PageSize:2048 NumPages:0}] MachineID:fb73d2b2ff5f4c90893005c8a553c7c2 SystemUUID:fb73d2b2-ff5f-4c90-8930-05c8a553c7c2 BootID:f49153a5-8973-403b-9fcd-c557e536b088 Filesystems:[{Device:tmpfs DeviceMajor:0 DeviceMinor:21 Capacity:4174053376 Type:vfs Inodes:1019056 HasInodes:true} {Device:/dev/sda4 DeviceMajor:8 DeviceMinor:4 Capacity:16631443456 Type:vfs Inodes:8125888 HasInodes:true} {Device:/dev/sda1 DeviceMajor:8 DeviceMinor:1 Capacity:381549568 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:17179869184 Scheduler:mq-deadline}] NetworkDevices:[{Name:ens3 MacAddress:56:6f:75:c1:00:45 Speed:-1 Mtu:1500}] Topology:[{Id:0 Memory:8348106752 Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2}]} {Id:1 Threads:[1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2}]} {Id:2 Threads:[2] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2}]} {Id:3 Threads:[3] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2}]}] Caches:[{Size:16777216 Type:Unified Level:3}]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.488714 1909 manager.go:199] Version: {KernelVersion:4.18.0-147.el8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 43.81.201911011153.0 (Ootpa) DockerVersion:Unknown DockerAPIVersion:Unknown CadvisorVersion: CadvisorRevision:} Nov 20 07:02:17 localhost hyperkube[1909]: W1120 07:02:17.492334 1909 server.go:474] No api server defined - no events will be sent to API server. Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.492381 1909 server.go:643] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to / Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.497977 1909 container_manager_linux.go:265] container manager verified user specified cgroup-root exists: [] Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.498080 1909 container_manager_linux.go:270] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:systemd KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:} {Signal:nodefs.available Operator:LessThan Value:{Quantity: Percentage:0.1} GracePeriod:0s MinReclaim:} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity: Percentage:0.05} GracePeriod:0s MinReclaim:} {Signal:imagefs.available Operator:LessThan Value:{Quantity: Percentage:0.15} GracePeriod:0s MinReclaim:}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none} Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.498306 1909 fake_topology_manager.go:29] [fake topologymanager] NewFakeManager Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.498324 1909 container_manager_linux.go:305] Creating device plugin manager: true Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.499803 1909 manager.go:125] Creating Device Plugin manager at /var/lib/kubelet/device-plugins/kubelet.sock Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.502794 1909 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider: &{kubelet.sock /var/lib/kubelet/device-plugins/ map[] {0 0} {{} [0 0 0]} 0x44b3790 0xdb05930 0x44b4190 map[] map[] map[] map[] map[] 0xc000e22330 [0] 0xdb05930} Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.503095 1909 state_mem.go:36] [cpumanager] initializing new in-memory state store Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.506095 1909 fake_topology_manager.go:39] [fake topologymanager] AddHintProvider HintProvider: &{{0 0} 0xdb05930 10000000000 0xc0003e7f20 map[memory:{{104857600 0} {} BinarySI}]} Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.506253 1909 server.go:1014] Using root directory: /var/lib/kubelet Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.508620 1909 kubelet.go:287] Adding pod path: /etc/kubernetes/manifests Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.511210 1909 file.go:68] Watching path "/etc/kubernetes/manifests" Nov 20 07:02:17 localhost hyperkube[1909]: W1120 07:02:17.515108 1909 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock". Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.523665 1909 remote_runtime.go:59] parsed scheme: "" Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.523738 1909 remote_runtime.go:59] scheme "" not registered, fallback to default scheme Nov 20 07:02:17 localhost hyperkube[1909]: W1120 07:02:17.523819 1909 util_unix.go:103] Using "/var/run/crio/crio.sock" as endpoint is deprecated, please consider using full url format "unix:///var/run/crio/crio.sock". Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.523856 1909 remote_image.go:50] parsed scheme: "" Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.523875 1909 remote_image.go:50] scheme "" not registered, fallback to default scheme Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.524035 1909 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{/var/run/crio/crio.sock 0 }] Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.524115 1909 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{/var/run/crio/crio.sock 0 }] Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.525320 1909 clientconn.go:796] ClientConn switching balancer to "pick_first" Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.525323 1909 clientconn.go:796] ClientConn switching balancer to "pick_first" Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.527219 1909 balancer_conn_wrappers.go:131] pickfirstBalancer: HandleSubConnStateChange: 0xc0000a49d0, CONNECTING Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.527237 1909 balancer_conn_wrappers.go:131] pickfirstBalancer: HandleSubConnStateChange: 0xc0008b20b0, CONNECTING Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.530917 1909 balancer_conn_wrappers.go:131] pickfirstBalancer: HandleSubConnStateChange: 0xc0008b20b0, READY Nov 20 07:02:17 localhost hyperkube[1909]: I1120 07:02:17.531066 1909 balancer_conn_wrappers.go:131] pickfirstBalancer: HandleSubConnStateChange: 0xc0000a49d0, READY Nov 20 07:02:32 localhost podman[1816]: 2019-11-20 07:02:32.606837341 +0000 UTC m=+18.803074955 image pull Nov 20 07:02:32 localhost release-image-download.sh[1808]: 849984d06b95c47993b97f06dc3b68766fef7ad582c95e8fa8398bec5e59cfc5 Nov 20 07:02:32 localhost systemd[1]: Started Download the OpenShift Release Image. Nov 20 07:02:32 localhost systemd[1]: Starting Configure CRI-O to use the pause image... Nov 20 07:02:32 localhost podman[2024]: 2019-11-20 07:02:32.991069115 +0000 UTC m=+0.184831800 container create 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=eager_cannon) Nov 20 07:02:33 localhost systemd[1]: Created slice machine.slice. Nov 20 07:02:33 localhost systemd[1]: Started libpod-conmon-446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603.scope. Nov 20 07:02:33 localhost systemd[1]: Created slice libcontainer_2038_systemd_test_default.slice. Nov 20 07:02:33 localhost systemd[1]: Removed slice libcontainer_2038_systemd_test_default.slice. Nov 20 07:02:33 localhost systemd[1]: Started libcontainer container 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603. Nov 20 07:02:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:33 localhost podman[2024]: 2019-11-20 07:02:33.60107571 +0000 UTC m=+0.794838407 container init 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=eager_cannon) Nov 20 07:02:33 localhost podman[2024]: 2019-11-20 07:02:33.623197173 +0000 UTC m=+0.816959853 container start 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=eager_cannon) Nov 20 07:02:33 localhost podman[2024]: 2019-11-20 07:02:33.623814258 +0000 UTC m=+0.817576965 container attach 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=eager_cannon) Nov 20 07:02:34 localhost systemd[1]: libpod-446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603.scope: Consumed 814ms CPU time Nov 20 07:02:34 localhost podman[2024]: 2019-11-20 07:02:34.100569998 +0000 UTC m=+1.294332779 container died 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=eager_cannon) Nov 20 07:02:35 localhost podman[2024]: 2019-11-20 07:02:35.138523102 +0000 UTC m=+2.332285844 container remove 446dc9b7a04ff3ff4bbcfa6750e3946c084741b39707eb088c9d7ae648e35603 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=eager_cannon) Nov 20 07:02:35 localhost systemd[1]: Started Configure CRI-O to use the pause image. Nov 20 07:02:37 localhost hyperkube[1909]: E1120 07:02:37.914616 1909 aws_credentials.go:77] while getting AWS credentials NoCredentialProviders: no valid providers in chain. Deprecated. Nov 20 07:02:37 localhost hyperkube[1909]: For verbose messaging see aws.Config.CredentialsChainVerboseErrors Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.975997 1909 kuberuntime_manager.go:207] Container runtime cri-o initialized, version: 1.16.0-0.4.dev.rhaos4.3.giteed6aa1.el8-rc2, apiVersion: v1alpha1 Nov 20 07:02:37 localhost hyperkube[1909]: W1120 07:02:37.977796 1909 volume_host.go:79] kubeClient is nil. Skip initialization of CSIDriverLister Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979033 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/aws-ebs" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979107 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/azure-disk" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979154 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/azure-file" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979199 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/cinder" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979245 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/gce-pd" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979291 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/vsphere-volume" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979328 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/empty-dir" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979364 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/git-repo" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979415 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/host-path" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979463 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/nfs" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979509 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/secret" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979571 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/iscsi" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979608 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/glusterfs" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979667 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/rbd" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979714 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/quobyte" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979749 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/cephfs" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979783 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/downward-api" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979838 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/fc" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979873 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/flocker" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979907 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/configmap" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.979942 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/projected" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.980055 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/portworx-volume" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.980110 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/scaleio" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.980157 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/local-volume" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.980192 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/storageos" Nov 20 07:02:37 localhost hyperkube[1909]: W1120 07:02:37.982486 1909 csi_plugin.go:198] kubernetes.io/csi: kubeclient not set, assuming standalone kubelet Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.982548 1909 plugins.go:630] Loaded volume plugin "kubernetes.io/csi" Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.983297 1909 server.go:1072] Started kubelet Nov 20 07:02:37 localhost hyperkube[1909]: W1120 07:02:37.983399 1909 kubelet.go:1410] No api server defined - no node status update will be sent. Nov 20 07:02:37 localhost hyperkube[1909]: I1120 07:02:37.984736 1909 server.go:145] Starting to listen on 0.0.0.0:10250 Nov 20 07:02:37 localhost systemd[1]: Started Kubernetes Kubelet. Nov 20 07:02:37 localhost systemd[1]: Started Bootstrap a Kubernetes cluster. Nov 20 07:02:37 localhost systemd[1]: Started Approve CSRs during bootstrap phase. Nov 20 07:02:37 localhost systemd[1]: Started Report the completion of the cluster bootstrap process. Nov 20 07:02:37 localhost systemd[1]: Reached target Multi-User System. Nov 20 07:02:38 localhost systemd[1]: Reached target Graphical Interface. Nov 20 07:02:38 localhost systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.011780 1909 server.go:167] Starting to listen read-only on 0.0.0.0:10255 Nov 20 07:02:38 localhost report-progress.sh[2097]: Waiting for bootstrap to complete... Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.018772 1909 server.go:358] Adding debug handlers to kubelet server. Nov 20 07:02:38 localhost hyperkube[1909]: E1120 07:02:38.023728 1909 kubelet.go:1302] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data in memory cache Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.024691 1909 fs_resource_analyzer.go:64] Starting FS ResourceAnalyzer Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.024896 1909 status_manager.go:152] Kubernetes client is nil, not starting status manager. Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.024986 1909 kubelet.go:1829] Starting kubelet main sync loop. Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.025210 1909 kubelet.go:1846] skipping pod synchronization - [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful] Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.028900 1909 volume_manager.go:247] The desired_state_of_world populator starts Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.028945 1909 volume_manager.go:249] Starting Kubelet Volume Manager Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.033542 1909 desired_state_of_world_populator.go:131] Desired state populator starts to run Nov 20 07:02:38 localhost approve-csr.sh[2096]: Approving all CSR requests until bootstrapping is complete... Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.048962 1909 factory.go:157] Registering CRI-O factory Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.049570 1909 factory.go:54] Registering systemd factory Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.050764 1909 factory.go:100] Registering Raw factory Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.051293 1909 manager.go:1159] Started watching for new ooms in manager Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.054984 1909 manager.go:272] Starting recovery of all containers Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.061192 1909 manager.go:277] Recovery completed Nov 20 07:02:38 localhost systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 20 07:02:38 localhost systemd[1]: Startup finished in 2.796s (kernel) + 13.162s (initrd) + 29.373s (userspace) = 45.332s. Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.125497 1909 kubelet.go:1846] skipping pod synchronization - container runtime status check may not have completed yet Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.129546 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.133372 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.133431 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.133454 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.133566 1909 cpu_manager.go:161] [cpumanager] starting with none policy Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.133585 1909 cpu_manager.go:162] [cpumanager] reconciling every 10s Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.133607 1909 policy_none.go:42] [cpumanager] none policy: Start Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.134643 1909 container_manager_linux.go:413] Updating kernel flag: vm/overcommit_memory, expected value: 1, actual value: 0 Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.135041 1909 container_manager_linux.go:413] Updating kernel flag: kernel/panic, expected value: 10, actual value: 0 Nov 20 07:02:38 localhost systemd[1]: Created slice libcontainer container kubepods.slice. Nov 20 07:02:38 localhost systemd[1]: Created slice libcontainer container kubepods-burstable.slice. Nov 20 07:02:38 localhost systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.210941 1909 manager.go:222] Starting Device Plugin manager Nov 20 07:02:38 localhost hyperkube[1909]: W1120 07:02:38.211134 1909 manager.go:569] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.211593 1909 manager.go:262] Serving device plugin registration server on "/var/lib/kubelet/device-plugins/kubelet.sock" Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.211886 1909 plugin_watcher.go:59] Plugin Watcher Start at /var/lib/kubelet/plugins_registry Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.212238 1909 plugin_manager.go:114] The desired_state_of_world populator (plugin watcher) starts Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.212286 1909 plugin_manager.go:116] Starting Kubelet Plugin Manager Nov 20 07:02:38 localhost hyperkube[1909]: E1120 07:02:38.213315 1909 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.214924 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.221343 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.221403 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.221426 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.329330 1909 kubelet.go:1908] SyncLoop (ADD, "file"): "" Nov 20 07:02:38 localhost hyperkube[1909]: I1120 07:02:38.334082 1909 reconciler.go:154] Reconciler: start to sync state Nov 20 07:02:38 localhost podman[2154]: 2019-11-20 07:02:38.402092247 +0000 UTC m=+0.146778912 container create c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_wing) Nov 20 07:02:38 localhost systemd[1]: Started libpod-conmon-c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160.scope. Nov 20 07:02:38 localhost systemd[1]: Created slice libcontainer_2171_systemd_test_default.slice. Nov 20 07:02:38 localhost systemd[1]: Removed slice libcontainer_2171_systemd_test_default.slice. Nov 20 07:02:38 localhost systemd[1]: Started libcontainer container c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160. Nov 20 07:02:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:38 localhost podman[2154]: 2019-11-20 07:02:38.824727549 +0000 UTC m=+0.569414198 container init c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_wing) Nov 20 07:02:38 localhost podman[2154]: 2019-11-20 07:02:38.850078047 +0000 UTC m=+0.594764688 container start c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_wing) Nov 20 07:02:38 localhost podman[2154]: 2019-11-20 07:02:38.850511836 +0000 UTC m=+0.595198514 container attach c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_wing) Nov 20 07:02:39 localhost systemd[1]: libpod-c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160.scope: Consumed 792ms CPU time Nov 20 07:02:39 localhost podman[2154]: 2019-11-20 07:02:39.333472049 +0000 UTC m=+1.078158756 container died c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_wing) Nov 20 07:02:39 localhost podman[2154]: 2019-11-20 07:02:39.423953268 +0000 UTC m=+1.168639891 container remove c695ecb81eed81d32857b31965ae3e350a6a9f6f790981acaa3921a71fe4e160 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_wing) Nov 20 07:02:39 localhost approve-csr.sh[2096]: The connection to the server localhost:6443 was refused - did you specify the right host or port? Nov 20 07:02:39 localhost podman[2230]: 2019-11-20 07:02:39.627776702 +0000 UTC m=+0.148543080 container create 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_herschel) Nov 20 07:02:39 localhost systemd[1]: Started libpod-conmon-68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8.scope. Nov 20 07:02:39 localhost systemd[1]: Created slice libcontainer_2249_systemd_test_default.slice. Nov 20 07:02:39 localhost systemd[1]: Removed slice libcontainer_2249_systemd_test_default.slice. Nov 20 07:02:39 localhost systemd[1]: Started libcontainer container 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8. Nov 20 07:02:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:40 localhost podman[2230]: 2019-11-20 07:02:40.036925525 +0000 UTC m=+0.557691872 container init 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_herschel) Nov 20 07:02:40 localhost podman[2230]: 2019-11-20 07:02:40.058483709 +0000 UTC m=+0.579250064 container start 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_herschel) Nov 20 07:02:40 localhost podman[2230]: 2019-11-20 07:02:40.058643838 +0000 UTC m=+0.579410198 container attach 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_herschel) Nov 20 07:02:40 localhost systemd[1]: libpod-68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8.scope: Consumed 760ms CPU time Nov 20 07:02:40 localhost podman[2230]: 2019-11-20 07:02:40.491240242 +0000 UTC m=+1.012006648 container died 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_herschel) Nov 20 07:02:40 localhost podman[2230]: 2019-11-20 07:02:40.551149997 +0000 UTC m=+1.071916403 container remove 68bd61b4930b6fcdaaeb2661b640259c7a837c036ff627129d2122a4b142b0b8 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_herschel) Nov 20 07:02:40 localhost podman[2302]: 2019-11-20 07:02:40.737177089 +0000 UTC m=+0.135741610 container create ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=relaxed_ganguly) Nov 20 07:02:40 localhost systemd[1]: Started libpod-conmon-ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625.scope. Nov 20 07:02:40 localhost systemd[1]: Created slice libcontainer_2319_systemd_test_default.slice. Nov 20 07:02:40 localhost systemd[1]: Removed slice libcontainer_2319_systemd_test_default.slice. Nov 20 07:02:40 localhost systemd[1]: Started libcontainer container ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625. Nov 20 07:02:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:41 localhost podman[2302]: 2019-11-20 07:02:41.152905811 +0000 UTC m=+0.551470344 container init ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=relaxed_ganguly) Nov 20 07:02:41 localhost podman[2302]: 2019-11-20 07:02:41.173602182 +0000 UTC m=+0.572166715 container start ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=relaxed_ganguly) Nov 20 07:02:41 localhost podman[2302]: 2019-11-20 07:02:41.173749366 +0000 UTC m=+0.572313902 container attach ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=relaxed_ganguly) Nov 20 07:02:41 localhost systemd[1]: libpod-ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625.scope: Consumed 791ms CPU time Nov 20 07:02:41 localhost podman[2302]: 2019-11-20 07:02:41.616693214 +0000 UTC m=+1.015257785 container died ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=relaxed_ganguly) Nov 20 07:02:41 localhost podman[2302]: 2019-11-20 07:02:41.683628045 +0000 UTC m=+1.082192641 container remove ab5955dffac568a76189d83576f61f51f60b56d02fce1e4ed188070b17de9625 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=relaxed_ganguly) Nov 20 07:02:41 localhost podman[2375]: 2019-11-20 07:02:41.84800113 +0000 UTC m=+0.123172010 container create 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=pensive_driscoll) Nov 20 07:02:41 localhost systemd[1]: Started libpod-conmon-20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e.scope. Nov 20 07:02:41 localhost systemd[1]: Created slice libcontainer_2392_systemd_test_default.slice. Nov 20 07:02:41 localhost systemd[1]: Removed slice libcontainer_2392_systemd_test_default.slice. Nov 20 07:02:41 localhost systemd[1]: Started libcontainer container 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e. Nov 20 07:02:41 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:42 localhost podman[2375]: 2019-11-20 07:02:42.270252135 +0000 UTC m=+0.545422925 container init 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=pensive_driscoll) Nov 20 07:02:42 localhost podman[2375]: 2019-11-20 07:02:42.292305529 +0000 UTC m=+0.567476398 container start 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=pensive_driscoll) Nov 20 07:02:42 localhost podman[2375]: 2019-11-20 07:02:42.292490344 +0000 UTC m=+0.567661181 container attach 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=pensive_driscoll) Nov 20 07:02:42 localhost systemd[1]: libpod-20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e.scope: Consumed 756ms CPU time Nov 20 07:02:42 localhost podman[2375]: 2019-11-20 07:02:42.721600687 +0000 UTC m=+0.996771527 container died 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=pensive_driscoll) Nov 20 07:02:42 localhost podman[2375]: 2019-11-20 07:02:42.781649492 +0000 UTC m=+1.056820354 container remove 20af7997367c87644b3a9ca27330c1ff4e84d54f616b9a25886993dcaa4cd24e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=pensive_driscoll) Nov 20 07:02:42 localhost podman[2446]: 2019-11-20 07:02:42.98647627 +0000 UTC m=+0.156962039 container create a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=cool_galileo) Nov 20 07:02:43 localhost systemd[1]: Started libpod-conmon-a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224.scope. Nov 20 07:02:43 localhost systemd[1]: Created slice libcontainer_2462_systemd_test_default.slice. Nov 20 07:02:43 localhost systemd[1]: Removed slice libcontainer_2462_systemd_test_default.slice. Nov 20 07:02:43 localhost systemd[1]: Started libcontainer container a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224. Nov 20 07:02:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:43 localhost podman[2446]: 2019-11-20 07:02:43.391634214 +0000 UTC m=+0.562119970 container init a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=cool_galileo) Nov 20 07:02:43 localhost podman[2446]: 2019-11-20 07:02:43.410753913 +0000 UTC m=+0.581239682 container start a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=cool_galileo) Nov 20 07:02:43 localhost podman[2446]: 2019-11-20 07:02:43.410882611 +0000 UTC m=+0.581368362 container attach a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=cool_galileo) Nov 20 07:02:43 localhost systemd[1]: libpod-a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224.scope: Consumed 770ms CPU time Nov 20 07:02:43 localhost podman[2446]: 2019-11-20 07:02:43.864785686 +0000 UTC m=+1.035271480 container died a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=cool_galileo) Nov 20 07:02:43 localhost podman[2446]: 2019-11-20 07:02:43.915676788 +0000 UTC m=+1.086162599 container remove a7a81260e3c65c528aa735bdac89aee4b756e2381e54ee1c707079dd0f99c224 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=cool_galileo) Nov 20 07:02:44 localhost podman[2518]: 2019-11-20 07:02:44.095986699 +0000 UTC m=+0.139275421 container create 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_thompson) Nov 20 07:02:44 localhost systemd[1]: Started libpod-conmon-23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86.scope. Nov 20 07:02:44 localhost systemd[1]: Created slice libcontainer_2536_systemd_test_default.slice. Nov 20 07:02:44 localhost systemd[1]: Removed slice libcontainer_2536_systemd_test_default.slice. Nov 20 07:02:44 localhost systemd[1]: Started libcontainer container 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86. Nov 20 07:02:44 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:44 localhost podman[2518]: 2019-11-20 07:02:44.50989921 +0000 UTC m=+0.553187969 container init 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_thompson) Nov 20 07:02:44 localhost podman[2518]: 2019-11-20 07:02:44.529206771 +0000 UTC m=+0.572495510 container start 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_thompson) Nov 20 07:02:44 localhost podman[2518]: 2019-11-20 07:02:44.529333319 +0000 UTC m=+0.572622041 container attach 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_thompson) Nov 20 07:02:44 localhost systemd[1]: libpod-23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86.scope: Consumed 784ms CPU time Nov 20 07:02:44 localhost podman[2518]: 2019-11-20 07:02:44.964727666 +0000 UTC m=+1.008016475 container died 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_thompson) Nov 20 07:02:45 localhost podman[2518]: 2019-11-20 07:02:45.01714448 +0000 UTC m=+1.060433264 container remove 23c08091848ae106fd61734bece8769067d0c04df8066ae7b29e0a7010653f86 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_thompson) Nov 20 07:02:45 localhost podman[2587]: 2019-11-20 07:02:45.194637769 +0000 UTC m=+0.135161098 container create 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_stallman) Nov 20 07:02:45 localhost systemd[1]: Started libpod-conmon-1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10.scope. Nov 20 07:02:45 localhost systemd[1]: Created slice libcontainer_2604_systemd_test_default.slice. Nov 20 07:02:45 localhost systemd[1]: Removed slice libcontainer_2604_systemd_test_default.slice. Nov 20 07:02:45 localhost systemd[1]: Started libcontainer container 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10. Nov 20 07:02:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:45 localhost podman[2587]: 2019-11-20 07:02:45.626457011 +0000 UTC m=+0.566980429 container init 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_stallman) Nov 20 07:02:45 localhost podman[2587]: 2019-11-20 07:02:45.647857419 +0000 UTC m=+0.588380772 container start 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_stallman) Nov 20 07:02:45 localhost podman[2587]: 2019-11-20 07:02:45.648366766 +0000 UTC m=+0.588890140 container attach 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_stallman) Nov 20 07:02:46 localhost systemd[1]: libpod-1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10.scope: Consumed 815ms CPU time Nov 20 07:02:46 localhost podman[2587]: 2019-11-20 07:02:46.092680478 +0000 UTC m=+1.033203857 container died 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_stallman) Nov 20 07:02:46 localhost podman[2587]: 2019-11-20 07:02:46.157089133 +0000 UTC m=+1.097612504 container remove 1f8011f682240bcb2e9a15af2f827a868b99cf10e866af5a850cc15eee7d7e10 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_stallman) Nov 20 07:02:46 localhost podman[2656]: 2019-11-20 07:02:46.381588616 +0000 UTC m=+0.168305678 container create 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=naughty_antonelli) Nov 20 07:02:46 localhost systemd[1]: Started libpod-conmon-7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92.scope. Nov 20 07:02:46 localhost systemd[1]: Created slice libcontainer_2672_systemd_test_default.slice. Nov 20 07:02:46 localhost systemd[1]: Removed slice libcontainer_2672_systemd_test_default.slice. Nov 20 07:02:46 localhost systemd[1]: Started libcontainer container 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92. Nov 20 07:02:46 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:46 localhost podman[2656]: 2019-11-20 07:02:46.789693435 +0000 UTC m=+0.576410460 container init 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=naughty_antonelli) Nov 20 07:02:46 localhost podman[2656]: 2019-11-20 07:02:46.808765515 +0000 UTC m=+0.595482584 container start 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=naughty_antonelli) Nov 20 07:02:46 localhost podman[2656]: 2019-11-20 07:02:46.809056236 +0000 UTC m=+0.595773245 container attach 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=naughty_antonelli) Nov 20 07:02:47 localhost systemd[1]: libpod-7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92.scope: Consumed 788ms CPU time Nov 20 07:02:47 localhost podman[2656]: 2019-11-20 07:02:47.252048773 +0000 UTC m=+1.038765852 container died 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=naughty_antonelli) Nov 20 07:02:47 localhost podman[2656]: 2019-11-20 07:02:47.315698418 +0000 UTC m=+1.102415551 container remove 7b0ab86e61e2259858d9d588ceb64dd94126eb44df2804755c3f2d2f70e0ca92 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=naughty_antonelli) Nov 20 07:02:47 localhost podman[2726]: 2019-11-20 07:02:47.494258289 +0000 UTC m=+0.130385037 container create f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=silly_heyrovsky) Nov 20 07:02:47 localhost systemd[1]: Started libpod-conmon-f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606.scope. Nov 20 07:02:47 localhost systemd[1]: Created slice libcontainer_2742_systemd_test_default.slice. Nov 20 07:02:47 localhost systemd[1]: Removed slice libcontainer_2742_systemd_test_default.slice. Nov 20 07:02:47 localhost systemd[1]: Started libcontainer container f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606. Nov 20 07:02:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:47 localhost podman[2726]: 2019-11-20 07:02:47.888141784 +0000 UTC m=+0.524268549 container init f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=silly_heyrovsky) Nov 20 07:02:47 localhost podman[2726]: 2019-11-20 07:02:47.907779965 +0000 UTC m=+0.543906721 container start f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=silly_heyrovsky) Nov 20 07:02:47 localhost podman[2726]: 2019-11-20 07:02:47.907890064 +0000 UTC m=+0.544016819 container attach f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=silly_heyrovsky) Nov 20 07:02:48 localhost hyperkube[1909]: I1120 07:02:48.231155 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:02:48 localhost hyperkube[1909]: I1120 07:02:48.234484 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:02:48 localhost hyperkube[1909]: I1120 07:02:48.234531 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:02:48 localhost hyperkube[1909]: I1120 07:02:48.234553 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:02:48 localhost systemd[1]: libpod-f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606.scope: Consumed 766ms CPU time Nov 20 07:02:48 localhost podman[2726]: 2019-11-20 07:02:48.357319014 +0000 UTC m=+0.993445821 container died f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=silly_heyrovsky) Nov 20 07:02:48 localhost podman[2726]: 2019-11-20 07:02:48.427085305 +0000 UTC m=+1.063212151 container remove f5187232408df81086c295c4cc0935580be4cf246845e189db39da2116479606 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=silly_heyrovsky) Nov 20 07:02:48 localhost podman[2796]: 2019-11-20 07:02:48.611698877 +0000 UTC m=+0.136940222 container create 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=angry_khorana) Nov 20 07:02:48 localhost systemd[1]: Started libpod-conmon-8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017.scope. Nov 20 07:02:48 localhost systemd[1]: Created slice libcontainer_2813_systemd_test_default.slice. Nov 20 07:02:48 localhost systemd[1]: Removed slice libcontainer_2813_systemd_test_default.slice. Nov 20 07:02:48 localhost systemd[1]: Started libcontainer container 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017. Nov 20 07:02:48 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:49 localhost podman[2796]: 2019-11-20 07:02:49.012474779 +0000 UTC m=+0.537716122 container init 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=angry_khorana) Nov 20 07:02:49 localhost podman[2796]: 2019-11-20 07:02:49.031621623 +0000 UTC m=+0.556863013 container start 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=angry_khorana) Nov 20 07:02:49 localhost podman[2796]: 2019-11-20 07:02:49.031975964 +0000 UTC m=+0.557217314 container attach 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=angry_khorana) Nov 20 07:02:49 localhost systemd[1]: libpod-8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017.scope: Consumed 811ms CPU time Nov 20 07:02:49 localhost podman[2796]: 2019-11-20 07:02:49.506607172 +0000 UTC m=+1.031848562 container died 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=angry_khorana) Nov 20 07:02:49 localhost podman[2796]: 2019-11-20 07:02:49.572419666 +0000 UTC m=+1.097661073 container remove 8465455960e5c3ae908d85b220fbeeac61b4828e3e1248b696d8ff34eecfa017 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=angry_khorana) Nov 20 07:02:49 localhost podman[2863]: 2019-11-20 07:02:49.752417773 +0000 UTC m=+0.131584574 container create 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_kare) Nov 20 07:02:49 localhost systemd[1]: Started libpod-conmon-3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226.scope. Nov 20 07:02:49 localhost systemd[1]: Created slice libcontainer_2882_systemd_test_default.slice. Nov 20 07:02:49 localhost systemd[1]: Removed slice libcontainer_2882_systemd_test_default.slice. Nov 20 07:02:49 localhost systemd[1]: Started libcontainer container 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226. Nov 20 07:02:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:50 localhost podman[2863]: 2019-11-20 07:02:50.140129911 +0000 UTC m=+0.519296723 container init 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_kare) Nov 20 07:02:50 localhost podman[2863]: 2019-11-20 07:02:50.160163853 +0000 UTC m=+0.539330683 container start 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_kare) Nov 20 07:02:50 localhost podman[2863]: 2019-11-20 07:02:50.160610924 +0000 UTC m=+0.539777723 container attach 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_kare) Nov 20 07:02:50 localhost systemd[1]: libpod-3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226.scope: Consumed 759ms CPU time Nov 20 07:02:50 localhost podman[2863]: 2019-11-20 07:02:50.600507205 +0000 UTC m=+0.979674048 container died 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_kare) Nov 20 07:02:50 localhost podman[2863]: 2019-11-20 07:02:50.660757704 +0000 UTC m=+1.039924588 container remove 3f398e606a007900f17089759d013dd92990a018db103552f8260624e345a226 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=elegant_kare) Nov 20 07:02:50 localhost podman[2930]: 2019-11-20 07:02:50.844723013 +0000 UTC m=+0.128263574 container create 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec (image=registry.svc.ci.openshift.org/origin/release:4.3, name=wonderful_lalande) Nov 20 07:02:50 localhost systemd[1]: Started libpod-conmon-3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec.scope. Nov 20 07:02:50 localhost systemd[1]: Created slice libcontainer_2948_systemd_test_default.slice. Nov 20 07:02:50 localhost systemd[1]: Removed slice libcontainer_2948_systemd_test_default.slice. Nov 20 07:02:50 localhost systemd[1]: Started libcontainer container 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec. Nov 20 07:02:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:51 localhost podman[2930]: 2019-11-20 07:02:51.275899876 +0000 UTC m=+0.559440465 container init 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec (image=registry.svc.ci.openshift.org/origin/release:4.3, name=wonderful_lalande) Nov 20 07:02:51 localhost podman[2930]: 2019-11-20 07:02:51.296689543 +0000 UTC m=+0.580230111 container start 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec (image=registry.svc.ci.openshift.org/origin/release:4.3, name=wonderful_lalande) Nov 20 07:02:51 localhost podman[2930]: 2019-11-20 07:02:51.296832989 +0000 UTC m=+0.580373582 container attach 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec (image=registry.svc.ci.openshift.org/origin/release:4.3, name=wonderful_lalande) Nov 20 07:02:51 localhost systemd[1]: libpod-3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec.scope: Consumed 802ms CPU time Nov 20 07:02:51 localhost podman[2930]: 2019-11-20 07:02:51.737992622 +0000 UTC m=+1.021533234 container died 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec (image=registry.svc.ci.openshift.org/origin/release:4.3, name=wonderful_lalande) Nov 20 07:02:51 localhost podman[2930]: 2019-11-20 07:02:51.797916753 +0000 UTC m=+1.081457370 container remove 3c912a0e2b0b75ab54a3b727d61ffa9e1ff524cec48803eadf93eaa5523557ec (image=registry.svc.ci.openshift.org/origin/release:4.3, name=wonderful_lalande) Nov 20 07:02:52 localhost podman[3001]: 2019-11-20 07:02:52.012036974 +0000 UTC m=+0.164793441 container create 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=determined_edison) Nov 20 07:02:52 localhost systemd[1]: Started libpod-conmon-9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7.scope. Nov 20 07:02:52 localhost systemd[1]: Created slice libcontainer_3017_systemd_test_default.slice. Nov 20 07:02:52 localhost systemd[1]: Removed slice libcontainer_3017_systemd_test_default.slice. Nov 20 07:02:52 localhost systemd[1]: Started libcontainer container 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7. Nov 20 07:02:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:52 localhost podman[3001]: 2019-11-20 07:02:52.423326051 +0000 UTC m=+0.576082541 container init 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=determined_edison) Nov 20 07:02:52 localhost podman[3001]: 2019-11-20 07:02:52.443482194 +0000 UTC m=+0.596238720 container start 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=determined_edison) Nov 20 07:02:52 localhost podman[3001]: 2019-11-20 07:02:52.443645084 +0000 UTC m=+0.596401535 container attach 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=determined_edison) Nov 20 07:02:52 localhost podman[3001]: 2019-11-20 07:02:52.872599915 +0000 UTC m=+1.025356432 container died 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=determined_edison) Nov 20 07:02:52 localhost systemd[1]: libpod-9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7.scope: Consumed 780ms CPU time Nov 20 07:02:52 localhost podman[3001]: 2019-11-20 07:02:52.942179784 +0000 UTC m=+1.094936332 container remove 9d16d2de843721e0bbff37b71e7b9916efa04111ac27b35f7b8e7d075adbd5e7 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=determined_edison) Nov 20 07:02:53 localhost podman[3068]: 2019-11-20 07:02:53.129698267 +0000 UTC m=+0.144411436 container create 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_bohr) Nov 20 07:02:53 localhost systemd[1]: Started libpod-conmon-83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e.scope. Nov 20 07:02:53 localhost systemd[1]: Created slice libcontainer_3086_systemd_test_default.slice. Nov 20 07:02:53 localhost systemd[1]: Removed slice libcontainer_3086_systemd_test_default.slice. Nov 20 07:02:53 localhost systemd[1]: Started libcontainer container 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e. Nov 20 07:02:53 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:53 localhost podman[3068]: 2019-11-20 07:02:53.55008004 +0000 UTC m=+0.564793213 container init 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_bohr) Nov 20 07:02:53 localhost podman[3068]: 2019-11-20 07:02:53.571442678 +0000 UTC m=+0.586155817 container start 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_bohr) Nov 20 07:02:53 localhost podman[3068]: 2019-11-20 07:02:53.571883455 +0000 UTC m=+0.586596655 container attach 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_bohr) Nov 20 07:02:53 localhost systemd[1]: libpod-83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e.scope: Consumed 760ms CPU time Nov 20 07:02:53 localhost podman[3068]: 2019-11-20 07:02:53.997139431 +0000 UTC m=+1.011852624 container died 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_bohr) Nov 20 07:02:54 localhost podman[3068]: 2019-11-20 07:02:54.060235137 +0000 UTC m=+1.074948313 container remove 83841d5909bb42a223b722a1f57c20f42f68bc7e18bf0df4afcca0d928f44e0e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=ecstatic_bohr) Nov 20 07:02:54 localhost podman[3138]: 2019-11-20 07:02:54.250430002 +0000 UTC m=+0.134343442 container create d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d (image=registry.svc.ci.openshift.org/origin/release:4.3, name=recursing_moser) Nov 20 07:02:54 localhost systemd[1]: Started libpod-conmon-d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d.scope. Nov 20 07:02:54 localhost systemd[1]: Created slice libcontainer_3154_systemd_test_default.slice. Nov 20 07:02:54 localhost systemd[1]: Removed slice libcontainer_3154_systemd_test_default.slice. Nov 20 07:02:54 localhost systemd[1]: Started libcontainer container d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d. Nov 20 07:02:54 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:54 localhost podman[3138]: 2019-11-20 07:02:54.675625988 +0000 UTC m=+0.559539414 container init d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d (image=registry.svc.ci.openshift.org/origin/release:4.3, name=recursing_moser) Nov 20 07:02:54 localhost podman[3138]: 2019-11-20 07:02:54.696477479 +0000 UTC m=+0.580390918 container start d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d (image=registry.svc.ci.openshift.org/origin/release:4.3, name=recursing_moser) Nov 20 07:02:54 localhost podman[3138]: 2019-11-20 07:02:54.696611021 +0000 UTC m=+0.580524418 container attach d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d (image=registry.svc.ci.openshift.org/origin/release:4.3, name=recursing_moser) Nov 20 07:02:55 localhost systemd[1]: libpod-d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d.scope: Consumed 773ms CPU time Nov 20 07:02:55 localhost podman[3138]: 2019-11-20 07:02:55.13370965 +0000 UTC m=+1.017623099 container died d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d (image=registry.svc.ci.openshift.org/origin/release:4.3, name=recursing_moser) Nov 20 07:02:55 localhost podman[3138]: 2019-11-20 07:02:55.195234487 +0000 UTC m=+1.079147939 container remove d40c05cbbde70903e088942f77478ba1fae467d1193409322d427ab3d013e83d (image=registry.svc.ci.openshift.org/origin/release:4.3, name=recursing_moser) Nov 20 07:02:55 localhost podman[3208]: 2019-11-20 07:02:55.383994582 +0000 UTC m=+0.126210566 container create 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_neumann) Nov 20 07:02:55 localhost systemd[1]: Started libpod-conmon-718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea.scope. Nov 20 07:02:55 localhost systemd[1]: Created slice libcontainer_3226_systemd_test_default.slice. Nov 20 07:02:55 localhost systemd[1]: Removed slice libcontainer_3226_systemd_test_default.slice. Nov 20 07:02:55 localhost systemd[1]: Started libcontainer container 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea. Nov 20 07:02:55 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:55 localhost podman[3208]: 2019-11-20 07:02:55.776290027 +0000 UTC m=+0.518506061 container init 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_neumann) Nov 20 07:02:55 localhost podman[3208]: 2019-11-20 07:02:55.800385392 +0000 UTC m=+0.542601410 container start 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_neumann) Nov 20 07:02:55 localhost podman[3208]: 2019-11-20 07:02:55.800547412 +0000 UTC m=+0.542763408 container attach 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_neumann) Nov 20 07:02:56 localhost systemd[1]: libpod-718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea.scope: Consumed 768ms CPU time Nov 20 07:02:56 localhost podman[3208]: 2019-11-20 07:02:56.239549055 +0000 UTC m=+0.981765128 container died 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_neumann) Nov 20 07:02:56 localhost podman[3208]: 2019-11-20 07:02:56.295915651 +0000 UTC m=+1.038131728 container remove 718b7bd96457568856bdcf3271fe76961605648b2ff48a41d121faf527eddbea (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_neumann) Nov 20 07:02:56 localhost podman[3280]: 2019-11-20 07:02:56.473542671 +0000 UTC m=+0.133993904 container create b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_feynman) Nov 20 07:02:56 localhost systemd[1]: Started libpod-conmon-b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3.scope. Nov 20 07:02:56 localhost systemd[1]: Created slice libcontainer_3296_systemd_test_default.slice. Nov 20 07:02:56 localhost systemd[1]: Removed slice libcontainer_3296_systemd_test_default.slice. Nov 20 07:02:56 localhost systemd[1]: Started libcontainer container b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3. Nov 20 07:02:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:56 localhost podman[3280]: 2019-11-20 07:02:56.884679581 +0000 UTC m=+0.545130746 container init b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_feynman) Nov 20 07:02:56 localhost podman[3280]: 2019-11-20 07:02:56.908316472 +0000 UTC m=+0.568767638 container start b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_feynman) Nov 20 07:02:56 localhost podman[3280]: 2019-11-20 07:02:56.908459951 +0000 UTC m=+0.568911112 container attach b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_feynman) Nov 20 07:02:57 localhost systemd[1]: libpod-b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3.scope: Consumed 749ms CPU time Nov 20 07:02:57 localhost podman[3280]: 2019-11-20 07:02:57.335476829 +0000 UTC m=+0.995928020 container died b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_feynman) Nov 20 07:02:57 localhost podman[3280]: 2019-11-20 07:02:57.391318697 +0000 UTC m=+1.051769902 container remove b1dc6be78edb4313901f09eee3c0744c41faab78cc57833c18c8e9d63d8588e3 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=clever_feynman) Nov 20 07:02:57 localhost podman[3348]: 2019-11-20 07:02:57.579056081 +0000 UTC m=+0.142899532 container create 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_bardeen) Nov 20 07:02:57 localhost systemd[1]: Started libpod-conmon-51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef.scope. Nov 20 07:02:57 localhost systemd[1]: Created slice libcontainer_3366_systemd_test_default.slice. Nov 20 07:02:57 localhost systemd[1]: Removed slice libcontainer_3366_systemd_test_default.slice. Nov 20 07:02:57 localhost systemd[1]: Started libcontainer container 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef. Nov 20 07:02:57 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:58 localhost podman[3348]: 2019-11-20 07:02:58.007987057 +0000 UTC m=+0.571830521 container init 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_bardeen) Nov 20 07:02:58 localhost podman[3348]: 2019-11-20 07:02:58.032657284 +0000 UTC m=+0.596500705 container start 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_bardeen) Nov 20 07:02:58 localhost podman[3348]: 2019-11-20 07:02:58.033151304 +0000 UTC m=+0.596994831 container attach 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_bardeen) Nov 20 07:02:58 localhost hyperkube[1909]: I1120 07:02:58.244140 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:02:58 localhost hyperkube[1909]: I1120 07:02:58.247676 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:02:58 localhost hyperkube[1909]: I1120 07:02:58.247740 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:02:58 localhost hyperkube[1909]: I1120 07:02:58.247764 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:02:58 localhost systemd[1]: libpod-51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef.scope: Consumed 790ms CPU time Nov 20 07:02:58 localhost podman[3348]: 2019-11-20 07:02:58.475970073 +0000 UTC m=+1.039813557 container died 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_bardeen) Nov 20 07:02:58 localhost podman[3348]: 2019-11-20 07:02:58.535463617 +0000 UTC m=+1.099307130 container remove 51b4291d8db354232351baf5d46a44d96915284c3b812d110b391fefb17101ef (image=registry.svc.ci.openshift.org/origin/release:4.3, name=xenodochial_bardeen) Nov 20 07:02:58 localhost podman[3421]: 2019-11-20 07:02:58.718962877 +0000 UTC m=+0.133915427 container create 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=boring_kapitsa) Nov 20 07:02:58 localhost systemd[1]: Started libpod-conmon-634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4.scope. Nov 20 07:02:58 localhost systemd[1]: Created slice libcontainer_3438_systemd_test_default.slice. Nov 20 07:02:58 localhost systemd[1]: Removed slice libcontainer_3438_systemd_test_default.slice. Nov 20 07:02:58 localhost systemd[1]: Started libcontainer container 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4. Nov 20 07:02:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:02:59 localhost podman[3421]: 2019-11-20 07:02:59.153649332 +0000 UTC m=+0.568601909 container init 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=boring_kapitsa) Nov 20 07:02:59 localhost podman[3421]: 2019-11-20 07:02:59.174665424 +0000 UTC m=+0.589618069 container start 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=boring_kapitsa) Nov 20 07:02:59 localhost podman[3421]: 2019-11-20 07:02:59.174873468 +0000 UTC m=+0.589826031 container attach 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=boring_kapitsa) Nov 20 07:02:59 localhost podman[3421]: 2019-11-20 07:02:59.634934843 +0000 UTC m=+1.049887438 container died 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=boring_kapitsa) Nov 20 07:02:59 localhost systemd[1]: libpod-634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4.scope: Consumed 864ms CPU time Nov 20 07:02:59 localhost podman[3421]: 2019-11-20 07:02:59.722784117 +0000 UTC m=+1.137736707 container remove 634edd18d8ae9a80c00e4d7b91f416cbce48d121de47096fbb5ab8d11a29d5f4 (image=registry.svc.ci.openshift.org/origin/release:4.3, name=boring_kapitsa) Nov 20 07:02:59 localhost bootkube.sh[2095]: Moving OpenShift manifests in with the rest of them Nov 20 07:02:59 localhost bootkube.sh[2095]: Rendering Cluster Version Operator Manifests... Nov 20 07:02:59 localhost approve-csr.sh[2096]: The connection to the server localhost:6443 was refused - did you specify the right host or port? Nov 20 07:02:59 localhost podman[3504]: 2019-11-20 07:02:59.946732197 +0000 UTC m=+0.135105022 container create 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_chaplygin) Nov 20 07:02:59 localhost systemd[1]: Started libpod-conmon-549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e.scope. Nov 20 07:03:00 localhost systemd[1]: Created slice libcontainer_3523_systemd_test_default.slice. Nov 20 07:03:00 localhost systemd[1]: Removed slice libcontainer_3523_systemd_test_default.slice. Nov 20 07:03:00 localhost systemd[1]: Started libcontainer container 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e. Nov 20 07:03:00 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:00 localhost podman[3504]: 2019-11-20 07:03:00.352196186 +0000 UTC m=+0.540568994 container init 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_chaplygin) Nov 20 07:03:00 localhost podman[3504]: 2019-11-20 07:03:00.37220866 +0000 UTC m=+0.560581454 container start 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_chaplygin) Nov 20 07:03:00 localhost podman[3504]: 2019-11-20 07:03:00.372341081 +0000 UTC m=+0.560713872 container attach 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_chaplygin) Nov 20 07:03:00 localhost systemd[1]: libpod-549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e.scope: Consumed 312ms CPU time Nov 20 07:03:00 localhost podman[3504]: 2019-11-20 07:03:00.446254686 +0000 UTC m=+0.634627565 container died 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_chaplygin) Nov 20 07:03:00 localhost bootkube.sh[2095]: Rendering cluster config manifests... Nov 20 07:03:00 localhost podman[3558]: 2019-11-20 07:03:00.588739846 +0000 UTC m=+0.143478394 container cleanup 549b1eb7ac39abefbb300f7337a5d5ea7d3e7ae122fcc35007f421b9fcda823e (image=registry.svc.ci.openshift.org/origin/release:4.3, name=beautiful_chaplygin) Nov 20 07:03:07 localhost podman[3572]: 2019-11-20 07:03:07.445330746 +0000 UTC m=+6.949734760 image pull Nov 20 07:03:07 localhost podman[3572]: 2019-11-20 07:03:07.496147529 +0000 UTC m=+7.000551489 container create 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:8527fbe39c874033ee3f22aadd3249b0deab20fab6055b5ca29d3e1209329b8c, name=ecstatic_maxwell) Nov 20 07:03:07 localhost systemd[1]: Started libpod-conmon-683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6.scope. Nov 20 07:03:07 localhost systemd[1]: Created slice libcontainer_3610_systemd_test_default.slice. Nov 20 07:03:07 localhost systemd[1]: Removed slice libcontainer_3610_systemd_test_default.slice. Nov 20 07:03:07 localhost systemd[1]: Started libcontainer container 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6. Nov 20 07:03:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:07 localhost podman[3572]: 2019-11-20 07:03:07.938067447 +0000 UTC m=+7.442471410 container init 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:8527fbe39c874033ee3f22aadd3249b0deab20fab6055b5ca29d3e1209329b8c, name=ecstatic_maxwell) Nov 20 07:03:07 localhost podman[3572]: 2019-11-20 07:03:07.963565611 +0000 UTC m=+7.467969602 container start 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:8527fbe39c874033ee3f22aadd3249b0deab20fab6055b5ca29d3e1209329b8c, name=ecstatic_maxwell) Nov 20 07:03:07 localhost podman[3572]: 2019-11-20 07:03:07.963731155 +0000 UTC m=+7.468135151 container attach 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:8527fbe39c874033ee3f22aadd3249b0deab20fab6055b5ca29d3e1209329b8c, name=ecstatic_maxwell) Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_03_authorization-openshift_01_rolebindingrestriction.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_project.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_scheduler.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_03_config-operator_01_operatorhub.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_03_config-operator_01_proxy.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_apiserver.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_console.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_dns.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_featuregate.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_00_cluster-version-operator_01_clusteroperator.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_00_cluster-version-operator_01_clusterversion.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_03_quota-openshift_01_clusterresourcequota.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_build.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_image.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_infrastructure.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_ingress.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_03_security-openshift_01_scc.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_authentication.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_imagecontentsourcepolicy.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_network.crd.yaml Nov 20 07:03:07 localhost bootkube.sh[2095]: Writing asset: /assets/config-bootstrap/manifests/0000_10_config-operator_01_oauth.crd.yaml Nov 20 07:03:08 localhost podman[3572]: 2019-11-20 07:03:08.001551366 +0000 UTC m=+7.505955380 container died 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:8527fbe39c874033ee3f22aadd3249b0deab20fab6055b5ca29d3e1209329b8c, name=ecstatic_maxwell) Nov 20 07:03:08 localhost systemd[1]: libpod-683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6.scope: Consumed 339ms CPU time Nov 20 07:03:08 localhost bootkube.sh[2095]: Rendering Kubernetes API server core manifests... Nov 20 07:03:08 localhost hyperkube[1909]: I1120 07:03:08.255659 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:08 localhost hyperkube[1909]: I1120 07:03:08.259142 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:08 localhost hyperkube[1909]: I1120 07:03:08.259313 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:08 localhost hyperkube[1909]: I1120 07:03:08.259346 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:08 localhost podman[3645]: 2019-11-20 07:03:08.283039319 +0000 UTC m=+0.255305972 container cleanup 683c405245d7c33cecbb5c98657444d500a5d7b39aee585d405faf22cab9a0e6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:8527fbe39c874033ee3f22aadd3249b0deab20fab6055b5ca29d3e1209329b8c, name=ecstatic_maxwell) Nov 20 07:03:16 localhost podman[3649]: 2019-11-20 07:03:16.011269322 +0000 UTC m=+7.960826209 image pull Nov 20 07:03:16 localhost podman[3649]: 2019-11-20 07:03:16.052876025 +0000 UTC m=+8.002432858 container create 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:5b8d3ed3a2cf32607c66ceaabd618ee877387ba2d21d6dc524795aca6ed042da, name=crazy_bell) Nov 20 07:03:16 localhost systemd[1]: Started libpod-conmon-6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2.scope. Nov 20 07:03:16 localhost systemd[1]: Created slice libcontainer_3693_systemd_test_default.slice. Nov 20 07:03:16 localhost systemd[1]: Removed slice libcontainer_3693_systemd_test_default.slice. Nov 20 07:03:16 localhost systemd[1]: Started libcontainer container 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2. Nov 20 07:03:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:16 localhost podman[3649]: 2019-11-20 07:03:16.481720518 +0000 UTC m=+8.431277371 container init 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:5b8d3ed3a2cf32607c66ceaabd618ee877387ba2d21d6dc524795aca6ed042da, name=crazy_bell) Nov 20 07:03:16 localhost podman[3649]: 2019-11-20 07:03:16.503157984 +0000 UTC m=+8.452714821 container start 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:5b8d3ed3a2cf32607c66ceaabd618ee877387ba2d21d6dc524795aca6ed042da, name=crazy_bell) Nov 20 07:03:16 localhost podman[3649]: 2019-11-20 07:03:16.503391232 +0000 UTC m=+8.452948097 container attach 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:5b8d3ed3a2cf32607c66ceaabd618ee877387ba2d21d6dc524795aca6ed042da, name=crazy_bell) Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/bootstrap-manifests/kube-apiserver-pod.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/00_openshift-kube-apiserver-ns.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/cluster-role-kube-apiserver.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/configmap-sa-token-signing-certs.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/secret-aggregator-client-signer.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/secret-control-plane-client-signer.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/secret-loadbalancer-serving-signer.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/00_openshift-kube-apiserver-operator-ns.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/cluster-role-binding-kube-apiserver.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/configmap-admin-kubeconfig-client-ca.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/configmap-csr-controller-ca.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/secret-kube-apiserver-to-kubelet-signer.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/secret-localhost-serving-signer.yaml Nov 20 07:03:16 localhost bootkube.sh[2095]: Writing asset: /assets/kube-apiserver-bootstrap/manifests/secret-service-network-serving-signer.yaml Nov 20 07:03:16 localhost podman[3649]: 2019-11-20 07:03:16.631518837 +0000 UTC m=+8.581075724 container died 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:5b8d3ed3a2cf32607c66ceaabd618ee877387ba2d21d6dc524795aca6ed042da, name=crazy_bell) Nov 20 07:03:16 localhost systemd[1]: libpod-6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2.scope: Consumed 440ms CPU time Nov 20 07:03:16 localhost bootkube.sh[2095]: Rendering Kubernetes Controller Manager core manifests... Nov 20 07:03:16 localhost podman[3728]: 2019-11-20 07:03:16.969333845 +0000 UTC m=+0.311777407 container cleanup 6d47ef555e74bc2196461ba7fbab1cdd418d04d294b2f1d428de2053f7444af2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:5b8d3ed3a2cf32607c66ceaabd618ee877387ba2d21d6dc524795aca6ed042da, name=crazy_bell) Nov 20 07:03:18 localhost hyperkube[1909]: I1120 07:03:18.266664 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:18 localhost hyperkube[1909]: I1120 07:03:18.269209 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:18 localhost hyperkube[1909]: I1120 07:03:18.269284 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:18 localhost hyperkube[1909]: I1120 07:03:18.269323 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:20 localhost approve-csr.sh[2096]: The connection to the server localhost:6443 was refused - did you specify the right host or port? Nov 20 07:03:23 localhost podman[3734]: 2019-11-20 07:03:23.67838291 +0000 UTC m=+6.993222496 image pull Nov 20 07:03:23 localhost podman[3734]: 2019-11-20 07:03:23.723084076 +0000 UTC m=+7.037923584 container create b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:104ce4123369eb8d019d5c48abad9822f45bac2ea3f8979575111bc35c5bb30b, name=focused_carson) Nov 20 07:03:23 localhost systemd[1]: Started libpod-conmon-b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5.scope. Nov 20 07:03:23 localhost systemd[1]: Created slice libcontainer_3790_systemd_test_default.slice. Nov 20 07:03:23 localhost systemd[1]: Removed slice libcontainer_3790_systemd_test_default.slice. Nov 20 07:03:23 localhost systemd[1]: Started libcontainer container b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5. Nov 20 07:03:23 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:24 localhost podman[3734]: 2019-11-20 07:03:24.157907936 +0000 UTC m=+7.472747471 container init b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:104ce4123369eb8d019d5c48abad9822f45bac2ea3f8979575111bc35c5bb30b, name=focused_carson) Nov 20 07:03:24 localhost podman[3734]: 2019-11-20 07:03:24.178436806 +0000 UTC m=+7.493276378 container start b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:104ce4123369eb8d019d5c48abad9822f45bac2ea3f8979575111bc35c5bb30b, name=focused_carson) Nov 20 07:03:24 localhost podman[3734]: 2019-11-20 07:03:24.178847541 +0000 UTC m=+7.493687129 container attach b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:104ce4123369eb8d019d5c48abad9822f45bac2ea3f8979575111bc35c5bb30b, name=focused_carson) Nov 20 07:03:24 localhost bootkube.sh[2095]: Writing asset: /assets/kube-controller-manager-bootstrap/bootstrap-manifests/kube-controller-manager-pod.yaml Nov 20 07:03:24 localhost bootkube.sh[2095]: Writing asset: /assets/kube-controller-manager-bootstrap/manifests/secret-csr-signer-signer.yaml Nov 20 07:03:24 localhost bootkube.sh[2095]: Writing asset: /assets/kube-controller-manager-bootstrap/manifests/secret-initial-kube-controller-manager-service-account-private-key.yaml Nov 20 07:03:24 localhost bootkube.sh[2095]: Writing asset: /assets/kube-controller-manager-bootstrap/manifests/00_openshift-kube-controller-manager-ns.yaml Nov 20 07:03:24 localhost bootkube.sh[2095]: Writing asset: /assets/kube-controller-manager-bootstrap/manifests/00_openshift-kube-controller-manager-operator-ns.yaml Nov 20 07:03:24 localhost systemd[1]: libpod-b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5.scope: Consumed 425ms CPU time Nov 20 07:03:24 localhost podman[3734]: 2019-11-20 07:03:24.317476903 +0000 UTC m=+7.632316469 container died b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:104ce4123369eb8d019d5c48abad9822f45bac2ea3f8979575111bc35c5bb30b, name=focused_carson) Nov 20 07:03:24 localhost bootkube.sh[2095]: Rendering Kubernetes Scheduler core manifests... Nov 20 07:03:25 localhost podman[3825]: 2019-11-20 07:03:25.965238157 +0000 UTC m=+1.649418319 container cleanup b7b86530e9cff4bff48f9016734bbc5ab93afe7e7985b0d27cac5cf0aad14bb5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:104ce4123369eb8d019d5c48abad9822f45bac2ea3f8979575111bc35c5bb30b, name=focused_carson) Nov 20 07:03:28 localhost hyperkube[1909]: I1120 07:03:28.286898 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:28 localhost hyperkube[1909]: I1120 07:03:28.289543 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:28 localhost hyperkube[1909]: I1120 07:03:28.289619 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:28 localhost hyperkube[1909]: I1120 07:03:28.289652 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:32 localhost podman[3837]: 2019-11-20 07:03:32.834268339 +0000 UTC m=+8.457563204 image pull Nov 20 07:03:32 localhost podman[3837]: 2019-11-20 07:03:32.874433624 +0000 UTC m=+8.497728390 container create 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:e9240df2779225ed82997045431047729f9482f70d32c8634f4ec25880c1ccf7, name=admiring_margulis) Nov 20 07:03:32 localhost systemd[1]: Started libpod-conmon-97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f.scope. Nov 20 07:03:32 localhost systemd[1]: Created slice libcontainer_3874_systemd_test_default.slice. Nov 20 07:03:32 localhost systemd[1]: Removed slice libcontainer_3874_systemd_test_default.slice. Nov 20 07:03:32 localhost systemd[1]: Started libcontainer container 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f. Nov 20 07:03:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:33 localhost podman[3837]: 2019-11-20 07:03:33.302850053 +0000 UTC m=+8.926144831 container init 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:e9240df2779225ed82997045431047729f9482f70d32c8634f4ec25880c1ccf7, name=admiring_margulis) Nov 20 07:03:33 localhost podman[3837]: 2019-11-20 07:03:33.323689062 +0000 UTC m=+8.946983868 container start 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:e9240df2779225ed82997045431047729f9482f70d32c8634f4ec25880c1ccf7, name=admiring_margulis) Nov 20 07:03:33 localhost podman[3837]: 2019-11-20 07:03:33.323841375 +0000 UTC m=+8.947136154 container attach 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:e9240df2779225ed82997045431047729f9482f70d32c8634f4ec25880c1ccf7, name=admiring_margulis) Nov 20 07:03:33 localhost bootkube.sh[2095]: Writing asset: /assets/kube-scheduler-bootstrap/bootstrap-manifests/kube-scheduler-pod.yaml Nov 20 07:03:33 localhost bootkube.sh[2095]: Writing asset: /assets/kube-scheduler-bootstrap/manifests/00_openshift-kube-scheduler-ns.yaml Nov 20 07:03:33 localhost systemd[1]: libpod-97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f.scope: Consumed 384ms CPU time Nov 20 07:03:33 localhost podman[3837]: 2019-11-20 07:03:33.449898638 +0000 UTC m=+9.073193428 container died 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:e9240df2779225ed82997045431047729f9482f70d32c8634f4ec25880c1ccf7, name=admiring_margulis) Nov 20 07:03:33 localhost bootkube.sh[2095]: Rendering Ingress Operator core manifests... Nov 20 07:03:33 localhost podman[3910]: 2019-11-20 07:03:33.750375599 +0000 UTC m=+0.293334720 container cleanup 97ebb387118a3cf7d6bfcf8c7c2b841a9b032bb43321c3fdee18ffd976f9630f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:e9240df2779225ed82997045431047729f9482f70d32c8634f4ec25880c1ccf7, name=admiring_margulis) Nov 20 07:03:38 localhost hyperkube[1909]: I1120 07:03:38.316249 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:38 localhost hyperkube[1909]: I1120 07:03:38.318786 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:38 localhost hyperkube[1909]: I1120 07:03:38.318829 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:38 localhost hyperkube[1909]: I1120 07:03:38.318851 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:40 localhost approve-csr.sh[2096]: The connection to the server localhost:6443 was refused - did you specify the right host or port? Nov 20 07:03:40 localhost podman[3922]: 2019-11-20 07:03:40.604123351 +0000 UTC m=+7.092697228 image pull Nov 20 07:03:40 localhost podman[3922]: 2019-11-20 07:03:40.64927337 +0000 UTC m=+7.137847196 container create 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:33a3e9ac5406bcb93c7569c15c148f71303aed16bebf25df0e9cbf4c85ecbd0b, name=peaceful_easley) Nov 20 07:03:40 localhost systemd[1]: Started libpod-conmon-25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93.scope. Nov 20 07:03:40 localhost systemd[1]: Created slice libcontainer_3985_systemd_test_default.slice. Nov 20 07:03:40 localhost systemd[1]: Removed slice libcontainer_3985_systemd_test_default.slice. Nov 20 07:03:40 localhost systemd[1]: Started libcontainer container 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93. Nov 20 07:03:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:41 localhost podman[3922]: 2019-11-20 07:03:41.072920122 +0000 UTC m=+7.561493945 container init 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:33a3e9ac5406bcb93c7569c15c148f71303aed16bebf25df0e9cbf4c85ecbd0b, name=peaceful_easley) Nov 20 07:03:41 localhost podman[3922]: 2019-11-20 07:03:41.102860397 +0000 UTC m=+7.591434265 container start 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:33a3e9ac5406bcb93c7569c15c148f71303aed16bebf25df0e9cbf4c85ecbd0b, name=peaceful_easley) Nov 20 07:03:41 localhost podman[3922]: 2019-11-20 07:03:41.103331948 +0000 UTC m=+7.591905836 container attach 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:33a3e9ac5406bcb93c7569c15c148f71303aed16bebf25df0e9cbf4c85ecbd0b, name=peaceful_easley) Nov 20 07:03:41 localhost bootkube.sh[2095]: wrote /assets/ingress-operator-manifests/cluster-ingress-00-custom-resource-definition.yaml Nov 20 07:03:41 localhost bootkube.sh[2095]: wrote /assets/ingress-operator-manifests/cluster-ingress-00-namespace.yaml Nov 20 07:03:41 localhost systemd[1]: libpod-25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93.scope: Consumed 332ms CPU time Nov 20 07:03:41 localhost podman[3922]: 2019-11-20 07:03:41.166458873 +0000 UTC m=+7.655032726 container died 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:33a3e9ac5406bcb93c7569c15c148f71303aed16bebf25df0e9cbf4c85ecbd0b, name=peaceful_easley) Nov 20 07:03:41 localhost bootkube.sh[2095]: Rendering MCO manifests... Nov 20 07:03:41 localhost podman[4020]: 2019-11-20 07:03:41.410842805 +0000 UTC m=+0.247540737 container cleanup 25ed961d406f8233cc5bd74d7f491d9a7388666737d5c8062d611dcad7291d93 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:33a3e9ac5406bcb93c7569c15c148f71303aed16bebf25df0e9cbf4c85ecbd0b, name=peaceful_easley) Nov 20 07:03:48 localhost hyperkube[1909]: I1120 07:03:48.326757 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:48 localhost hyperkube[1909]: I1120 07:03:48.329146 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:48 localhost hyperkube[1909]: I1120 07:03:48.329203 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:48 localhost hyperkube[1909]: I1120 07:03:48.329248 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:52 localhost podman[4031]: 2019-11-20 07:03:52.810423399 +0000 UTC m=+11.602224270 image pull Nov 20 07:03:52 localhost podman[4031]: 2019-11-20 07:03:52.863500501 +0000 UTC m=+11.655301237 container create 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:6625bb97a35604080af348340f0788df36455352b1a039f073cb6894c548fb78, name=nostalgic_einstein) Nov 20 07:03:52 localhost systemd[1]: Started libpod-conmon-41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624.scope. Nov 20 07:03:52 localhost systemd[1]: Created slice libcontainer_4068_systemd_test_default.slice. Nov 20 07:03:52 localhost systemd[1]: Removed slice libcontainer_4068_systemd_test_default.slice. Nov 20 07:03:52 localhost systemd[1]: Started libcontainer container 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624. Nov 20 07:03:53 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:53 localhost podman[4031]: 2019-11-20 07:03:53.299803842 +0000 UTC m=+12.091604564 container init 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:6625bb97a35604080af348340f0788df36455352b1a039f073cb6894c548fb78, name=nostalgic_einstein) Nov 20 07:03:53 localhost podman[4031]: 2019-11-20 07:03:53.322113117 +0000 UTC m=+12.113913838 container start 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:6625bb97a35604080af348340f0788df36455352b1a039f073cb6894c548fb78, name=nostalgic_einstein) Nov 20 07:03:53 localhost podman[4031]: 2019-11-20 07:03:53.322575947 +0000 UTC m=+12.114376694 container attach 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:6625bb97a35604080af348340f0788df36455352b1a039f073cb6894c548fb78, name=nostalgic_einstein) Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.332812 1 bootstrap.go:89] Version: machine-config-daemon-4.3.0-201910221717-34-g56c91185-dirty (56c91185b2344912558730bca6273dd85681dd31) Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.338495 1 bootstrap.go:184] manifests/machineconfigcontroller/controllerconfig.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.346100 1 bootstrap.go:184] manifests/master.machineconfigpool.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.346561 1 bootstrap.go:184] manifests/worker.machineconfigpool.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.347087 1 bootstrap.go:184] manifests/bootstrap-pod-v2.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.347747 1 bootstrap.go:184] manifests/machineconfigserver/csr-bootstrap-role-binding.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.348323 1 bootstrap.go:184] manifests/machineconfigserver/kube-apiserver-serving-ca-configmap.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.348880 1 bootstrap.go:184] manifests/ovirt/coredns.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.349696 1 bootstrap.go:184] manifests/ovirt/coredns-corefile.tmpl Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.350350 1 bootstrap.go:184] manifests/ovirt/keepalived.yaml Nov 20 07:03:53 localhost bootkube.sh[2095]: I1120 07:03:53.350901 1 bootstrap.go:184] manifests/ovirt/keepalived.conf.tmpl Nov 20 07:03:53 localhost systemd[1]: libpod-41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624.scope: Consumed 315ms CPU time Nov 20 07:03:53 localhost podman[4031]: 2019-11-20 07:03:53.394391188 +0000 UTC m=+12.186191926 container died 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:6625bb97a35604080af348340f0788df36455352b1a039f073cb6894c548fb78, name=nostalgic_einstein) Nov 20 07:03:53 localhost bootkube.sh[2095]: Rendering CCO manifests... Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.479058 1909 kubelet.go:1908] SyncLoop (ADD, "file"): "bootstrap-machine-config-operator-localhost_default(e043298090fa9607a7bd38b92360f729)" Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.479291 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.490847 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.490926 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.490973 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.504629 1909 kubelet.go:1908] SyncLoop (ADD, "file"): "coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)" Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.504754 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.506768 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.506837 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.506874 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.513691 1909 kubelet.go:1908] SyncLoop (ADD, "file"): "keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)" Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.513844 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.516222 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.516285 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.516308 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:53 localhost systemd[1]: Created slice libcontainer container kubepods-burstable-pode043298090fa9607a7bd38b92360f729.slice. Nov 20 07:03:53 localhost systemd[1]: Created slice libcontainer container kubepods-burstable-poda3183db06e25bd66e7f8f564bad04b82.slice. Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.538499 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:53 localhost systemd[1]: Created slice libcontainer container kubepods-burstable-pod6772eabec456c65362c0b66ae75ba039.slice. Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.549938 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.551907 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.551952 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.551972 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.557379 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.559622 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.559674 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.559696 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.610415 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.610518 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.610562 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.642882 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "server-certs" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-server-certs") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.643054 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "server-basedir" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-server-basedir") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647274 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "conf-dir" (UniqueName: "kubernetes.io/empty-dir/a3183db06e25bd66e7f8f564bad04b82-conf-dir") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647369 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-resource-dir") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647450 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "conf-dir" (UniqueName: "kubernetes.io/empty-dir/6772eabec456c65362c0b66ae75ba039-conf-dir") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647573 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "manifests" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-manifests") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647636 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "bootstrap-kubeconfig" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-bootstrap-kubeconfig") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647706 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "bootstrap-manifests" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-bootstrap-manifests") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647796 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-resource-dir") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647929 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-kubeconfig") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.647974 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "manifests" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-manifests") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.648016 1909 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-kubeconfig") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748644 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "server-basedir" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-server-basedir") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748755 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "conf-dir" (UniqueName: "kubernetes.io/empty-dir/a3183db06e25bd66e7f8f564bad04b82-conf-dir") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748828 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-resource-dir") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748882 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-resource-dir") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748899 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "conf-dir" (UniqueName: "kubernetes.io/empty-dir/6772eabec456c65362c0b66ae75ba039-conf-dir") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748830 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "server-basedir" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-server-basedir") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.748968 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "manifests" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-manifests") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749077 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "server-certs" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-server-certs") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749167 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "bootstrap-manifests" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-bootstrap-manifests") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749242 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-resource-dir") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749318 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-kubeconfig") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749390 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "manifests" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-manifests") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749466 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-kubeconfig") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749543 1909 reconciler.go:252] operationExecutor.MountVolume started for volume "bootstrap-kubeconfig" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-bootstrap-kubeconfig") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749560 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "conf-dir" (UniqueName: "kubernetes.io/empty-dir/a3183db06e25bd66e7f8f564bad04b82-conf-dir") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749622 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "conf-dir" (UniqueName: "kubernetes.io/empty-dir/6772eabec456c65362c0b66ae75ba039-conf-dir") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749175 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "manifests" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-manifests") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749708 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-resource-dir") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749758 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "manifests" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-manifests") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749848 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "server-certs" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-server-certs") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749881 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/6772eabec456c65362c0b66ae75ba039-kubeconfig") pod "keepalived-localhost" (UID: "6772eabec456c65362c0b66ae75ba039") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.749947 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/a3183db06e25bd66e7f8f564bad04b82-kubeconfig") pod "coredns-localhost" (UID: "a3183db06e25bd66e7f8f564bad04b82") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.750050 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "bootstrap-manifests" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-bootstrap-manifests") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.750137 1909 operation_generator.go:744] MountVolume.SetUp succeeded for volume "bootstrap-kubeconfig" (UniqueName: "kubernetes.io/host-path/e043298090fa9607a7bd38b92360f729-bootstrap-kubeconfig") pod "bootstrap-machine-config-operator-localhost" (UID: "e043298090fa9607a7bd38b92360f729") Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.852795 1909 kuberuntime_manager.go:409] No sandbox for pod "coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)" can be found. Need to start a new one Nov 20 07:03:53 localhost hyperkube[1909]: E1120 07:03:53.853228 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.860403 1909 kuberuntime_manager.go:409] No sandbox for pod "keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)" can be found. Need to start a new one Nov 20 07:03:53 localhost hyperkube[1909]: E1120 07:03:53.860558 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:53 localhost hyperkube[1909]: I1120 07:03:53.911635 1909 kuberuntime_manager.go:409] No sandbox for pod "bootstrap-machine-config-operator-localhost_default(e043298090fa9607a7bd38b92360f729)" can be found. Need to start a new one Nov 20 07:03:53 localhost hyperkube[1909]: E1120 07:03:53.911842 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:53 localhost podman[4101]: 2019-11-20 07:03:53.92913429 +0000 UTC m=+0.517302559 container cleanup 41c09cff387a5f0d2e504d274b316adbf959b1afad8808eb806a8e89cbfed624 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:6625bb97a35604080af348340f0788df36455352b1a039f073cb6894c548fb78, name=nostalgic_einstein) Nov 20 07:03:56 localhost systemd[1]: Started crio-conmon-58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5.scope. Nov 20 07:03:56 localhost systemd[1]: Started crio-conmon-1b04aee02c8f09f247c10e9697c27762e140d6fc8d348c6b7f13d73d2dff4599.scope. Nov 20 07:03:56 localhost systemd[1]: Started crio-conmon-e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1.scope. Nov 20 07:03:56 localhost systemd[1]: Started libcontainer container 58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5. Nov 20 07:03:56 localhost systemd[1]: Started libcontainer container e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1. Nov 20 07:03:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:56 localhost systemd[1]: Started libcontainer container 1b04aee02c8f09f247c10e9697c27762e140d6fc8d348c6b7f13d73d2dff4599. Nov 20 07:03:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:56 localhost hyperkube[1909]: E1120 07:03:56.626915 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:56 localhost hyperkube[1909]: I1120 07:03:56.629932 1909 provider.go:98] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 20 07:03:56 localhost hyperkube[1909]: E1120 07:03:56.656838 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:56 localhost hyperkube[1909]: E1120 07:03:56.667481 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:56 localhost systemd[1]: Started crio-conmon-98036f95eaeccabfa34e80723635d6bb5611e9d5d01f1f5d25168b108306aa54.scope. Nov 20 07:03:56 localhost systemd[1]: Created slice libcontainer_4267_systemd_test_default.slice. Nov 20 07:03:56 localhost systemd[1]: Removed slice libcontainer_4267_systemd_test_default.slice. Nov 20 07:03:56 localhost systemd[1]: Started libcontainer container 98036f95eaeccabfa34e80723635d6bb5611e9d5d01f1f5d25168b108306aa54. Nov 20 07:03:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.177067 1909 kubelet.go:1953] SyncLoop (PLEG): "keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)", event: &pleg.PodLifecycleEvent{ID:"6772eabec456c65362c0b66ae75ba039", Type:"ContainerStarted", Data:"e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1"} Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.178279 1909 kubelet.go:1953] SyncLoop (PLEG): "coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)", event: &pleg.PodLifecycleEvent{ID:"a3183db06e25bd66e7f8f564bad04b82", Type:"ContainerStarted", Data:"58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5"} Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.179964 1909 kubelet.go:1953] SyncLoop (PLEG): "bootstrap-machine-config-operator-localhost_default(e043298090fa9607a7bd38b92360f729)", event: &pleg.PodLifecycleEvent{ID:"e043298090fa9607a7bd38b92360f729", Type:"ContainerStarted", Data:"98036f95eaeccabfa34e80723635d6bb5611e9d5d01f1f5d25168b108306aa54"} Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.180049 1909 kubelet.go:1953] SyncLoop (PLEG): "bootstrap-machine-config-operator-localhost_default(e043298090fa9607a7bd38b92360f729)", event: &pleg.PodLifecycleEvent{ID:"e043298090fa9607a7bd38b92360f729", Type:"ContainerStarted", Data:"1b04aee02c8f09f247c10e9697c27762e140d6fc8d348c6b7f13d73d2dff4599"} Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.180442 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.182726 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.182780 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:57 localhost hyperkube[1909]: I1120 07:03:57.182803 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:57 localhost hyperkube[1909]: E1120 07:03:57.182984 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:57 localhost systemd[1]: crio-98036f95eaeccabfa34e80723635d6bb5611e9d5d01f1f5d25168b108306aa54.scope: Consumed 539ms CPU time Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.183704 1909 kubelet.go:1953] SyncLoop (PLEG): "bootstrap-machine-config-operator-localhost_default(e043298090fa9607a7bd38b92360f729)", event: &pleg.PodLifecycleEvent{ID:"e043298090fa9607a7bd38b92360f729", Type:"ContainerDied", Data:"98036f95eaeccabfa34e80723635d6bb5611e9d5d01f1f5d25168b108306aa54"} Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.184300 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.186737 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.186771 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.186790 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:58 localhost hyperkube[1909]: E1120 07:03:58.193247 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:03:58 localhost systemd[1]: Started crio-conmon-5d29092888ae0fb7e70cfc41802786e03a2792e1defd5f2ece3c0a0d1029519b.scope. Nov 20 07:03:58 localhost systemd[1]: Created slice libcontainer_4335_systemd_test_default.slice. Nov 20 07:03:58 localhost systemd[1]: Removed slice libcontainer_4335_systemd_test_default.slice. Nov 20 07:03:58 localhost systemd[1]: Started libcontainer container 5d29092888ae0fb7e70cfc41802786e03a2792e1defd5f2ece3c0a0d1029519b. Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.347901 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.350629 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.350692 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:58 localhost hyperkube[1909]: I1120 07:03:58.350727 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:03:59 localhost hyperkube[1909]: I1120 07:03:59.187497 1909 kubelet.go:1953] SyncLoop (PLEG): "bootstrap-machine-config-operator-localhost_default(e043298090fa9607a7bd38b92360f729)", event: &pleg.PodLifecycleEvent{ID:"e043298090fa9607a7bd38b92360f729", Type:"ContainerStarted", Data:"5d29092888ae0fb7e70cfc41802786e03a2792e1defd5f2ece3c0a0d1029519b"} Nov 20 07:03:59 localhost hyperkube[1909]: I1120 07:03:59.187951 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:03:59 localhost hyperkube[1909]: I1120 07:03:59.190227 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:03:59 localhost hyperkube[1909]: I1120 07:03:59.190297 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:03:59 localhost hyperkube[1909]: I1120 07:03:59.190327 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:03:59 localhost hyperkube[1909]: E1120 07:03:59.190813 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:00 localhost hyperkube[1909]: I1120 07:04:00.189898 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:00 localhost hyperkube[1909]: I1120 07:04:00.192209 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:00 localhost hyperkube[1909]: I1120 07:04:00.192298 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:00 localhost hyperkube[1909]: I1120 07:04:00.192339 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:00 localhost hyperkube[1909]: E1120 07:04:00.192908 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:00 localhost approve-csr.sh[2096]: The connection to the server localhost:6443 was refused - did you specify the right host or port? Nov 20 07:04:00 localhost podman[4123]: 2019-11-20 07:04:00.695637774 +0000 UTC m=+7.214168503 image pull Nov 20 07:04:00 localhost podman[4123]: 2019-11-20 07:04:00.742908314 +0000 UTC m=+7.261439022 container create f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:f448d63b8a69472518129456c29dcc8898a29dbe9689866d16fbc51e97af6c51, name=recursing_dhawan) Nov 20 07:04:00 localhost systemd[1]: Started libpod-conmon-f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4.scope. Nov 20 07:04:00 localhost systemd[1]: Created slice libcontainer_4404_systemd_test_default.slice. Nov 20 07:04:00 localhost systemd[1]: Removed slice libcontainer_4404_systemd_test_default.slice. Nov 20 07:04:00 localhost systemd[1]: Started libcontainer container f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4. Nov 20 07:04:00 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:01 localhost podman[4123]: 2019-11-20 07:04:01.187166803 +0000 UTC m=+7.705697531 container init f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:f448d63b8a69472518129456c29dcc8898a29dbe9689866d16fbc51e97af6c51, name=recursing_dhawan) Nov 20 07:04:01 localhost podman[4123]: 2019-11-20 07:04:01.208127093 +0000 UTC m=+7.726657844 container start f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:f448d63b8a69472518129456c29dcc8898a29dbe9689866d16fbc51e97af6c51, name=recursing_dhawan) Nov 20 07:04:01 localhost podman[4123]: 2019-11-20 07:04:01.208301982 +0000 UTC m=+7.726832705 container attach f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:f448d63b8a69472518129456c29dcc8898a29dbe9689866d16fbc51e97af6c51, name=recursing_dhawan) Nov 20 07:04:01 localhost bootkube.sh[2095]: time="2019-11-20T07:04:01Z" level=info msg="Rendering files to /assets/cco-bootstrap" Nov 20 07:04:01 localhost podman[4123]: 2019-11-20 07:04:01.259409933 +0000 UTC m=+7.777940686 container died f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:f448d63b8a69472518129456c29dcc8898a29dbe9689866d16fbc51e97af6c51, name=recursing_dhawan) Nov 20 07:04:01 localhost systemd[1]: libpod-f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4.scope: Consumed 344ms CPU time Nov 20 07:04:01 localhost bootkube.sh[2095]: Starting etcd certificate signer... Nov 20 07:04:01 localhost podman[4440]: 2019-11-20 07:04:01.586715484 +0000 UTC m=+0.303242970 container cleanup f077bff2cfc2f6af193de7b99bca94d96709a758387e41b25cc2c485b75de6c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:f448d63b8a69472518129456c29dcc8898a29dbe9689866d16fbc51e97af6c51, name=recursing_dhawan) Nov 20 07:04:08 localhost hyperkube[1909]: I1120 07:04:08.376056 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:08 localhost hyperkube[1909]: I1120 07:04:08.378728 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:08 localhost hyperkube[1909]: I1120 07:04:08.378805 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:08 localhost hyperkube[1909]: I1120 07:04:08.378883 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:14 localhost podman[4444]: 2019-11-20 07:04:14.783648937 +0000 UTC m=+13.478012959 image pull Nov 20 07:04:14 localhost podman[4444]: 2019-11-20 07:04:14.928072087 +0000 UTC m=+13.622436039 container create 067f1755b9e63e4301e43e6b5f77be66f1200be54c19fc64dbe267bb2e06e40e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:63fe05aef7074c7b5aee4f7522b3287464d09fbaec5ee3fd364f43dd436384f3, name=etcd-signer) Nov 20 07:04:14 localhost systemd[1]: Started crio-conmon-8114774551bffe1fd507eab6dfe9fea4f520c86e578d08e35d1076ea56c0dd9b.scope. Nov 20 07:04:15 localhost systemd[1]: Created slice libcontainer_4527_systemd_test_default.slice. Nov 20 07:04:15 localhost systemd[1]: Started libpod-conmon-067f1755b9e63e4301e43e6b5f77be66f1200be54c19fc64dbe267bb2e06e40e.scope. Nov 20 07:04:15 localhost systemd[1]: Started crio-conmon-9763e5ea3d4c900ee125e088c5c978e0e53b6509af2d9f4336edcdbb3badb689.scope. Nov 20 07:04:15 localhost systemd[1]: Removed slice libcontainer_4527_systemd_test_default.slice. Nov 20 07:04:15 localhost systemd[1]: Started libcontainer container 8114774551bffe1fd507eab6dfe9fea4f520c86e578d08e35d1076ea56c0dd9b. Nov 20 07:04:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:15 localhost systemd[1]: Started libcontainer container 067f1755b9e63e4301e43e6b5f77be66f1200be54c19fc64dbe267bb2e06e40e. Nov 20 07:04:15 localhost systemd[1]: Started libcontainer container 9763e5ea3d4c900ee125e088c5c978e0e53b6509af2d9f4336edcdbb3badb689. Nov 20 07:04:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:15 localhost systemd[1]: Stopped libcontainer container 8114774551bffe1fd507eab6dfe9fea4f520c86e578d08e35d1076ea56c0dd9b. Nov 20 07:04:15 localhost systemd[1]: crio-8114774551bffe1fd507eab6dfe9fea4f520c86e578d08e35d1076ea56c0dd9b.scope: Consumed 30ms CPU time Nov 20 07:04:15 localhost crio[1857]: time="2019-11-20 07:04:15.180411793Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:15 localhost systemd[1]: Stopped libcontainer container 9763e5ea3d4c900ee125e088c5c978e0e53b6509af2d9f4336edcdbb3badb689. Nov 20 07:04:15 localhost systemd[1]: crio-9763e5ea3d4c900ee125e088c5c978e0e53b6509af2d9f4336edcdbb3badb689.scope: Consumed 26ms CPU time Nov 20 07:04:15 localhost crio[1857]: time="2019-11-20 07:04:15.195872291Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:15 localhost podman[4444]: 2019-11-20 07:04:15.675812329 +0000 UTC m=+14.370176262 container init 067f1755b9e63e4301e43e6b5f77be66f1200be54c19fc64dbe267bb2e06e40e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:63fe05aef7074c7b5aee4f7522b3287464d09fbaec5ee3fd364f43dd436384f3, name=etcd-signer) Nov 20 07:04:15 localhost podman[4444]: 2019-11-20 07:04:15.796540682 +0000 UTC m=+14.490904637 container start 067f1755b9e63e4301e43e6b5f77be66f1200be54c19fc64dbe267bb2e06e40e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:63fe05aef7074c7b5aee4f7522b3287464d09fbaec5ee3fd364f43dd436384f3, name=etcd-signer) Nov 20 07:04:15 localhost bootkube.sh[2095]: 067f1755b9e63e4301e43e6b5f77be66f1200be54c19fc64dbe267bb2e06e40e Nov 20 07:04:16 localhost hyperkube[1909]: E1120 07:04:16.489527 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:16 localhost hyperkube[1909]: E1120 07:04:16.489714 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:16 localhost hyperkube[1909]: E1120 07:04:16.489850 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:16 localhost bootkube.sh[2095]: Waiting for etcd cluster... Nov 20 07:04:16 localhost hyperkube[1909]: E1120 07:04:16.569994 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:16 localhost hyperkube[1909]: E1120 07:04:16.570149 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:16 localhost hyperkube[1909]: E1120 07:04:16.570204 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.240103 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.240327 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.242097 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.242168 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.242200 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.242436 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.242454 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.242464 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:17 localhost hyperkube[1909]: I1120 07:04:17.242676 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.242870 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:17 localhost systemd[1]: Started crio-conmon-3b9c5143472a670bdf484f7b17d245fddcc7847f4b34b9c0bfb0fd8a558f1cce.scope. Nov 20 07:04:17 localhost systemd[1]: Started crio-conmon-5e1dda97eacfce3bf2a033c3c5f64ef58530efeb393f30d1c70adcecffbeee68.scope. Nov 20 07:04:17 localhost systemd[1]: Started libcontainer container 3b9c5143472a670bdf484f7b17d245fddcc7847f4b34b9c0bfb0fd8a558f1cce. Nov 20 07:04:17 localhost systemd[1]: Started libcontainer container 5e1dda97eacfce3bf2a033c3c5f64ef58530efeb393f30d1c70adcecffbeee68. Nov 20 07:04:17 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:17 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:17 localhost systemd[1]: Stopped libcontainer container 5e1dda97eacfce3bf2a033c3c5f64ef58530efeb393f30d1c70adcecffbeee68. Nov 20 07:04:17 localhost systemd[1]: crio-5e1dda97eacfce3bf2a033c3c5f64ef58530efeb393f30d1c70adcecffbeee68.scope: Consumed 31ms CPU time Nov 20 07:04:17 localhost systemd[1]: Stopped libcontainer container 3b9c5143472a670bdf484f7b17d245fddcc7847f4b34b9c0bfb0fd8a558f1cce. Nov 20 07:04:17 localhost systemd[1]: crio-3b9c5143472a670bdf484f7b17d245fddcc7847f4b34b9c0bfb0fd8a558f1cce.scope: Consumed 31ms CPU time Nov 20 07:04:17 localhost crio[1857]: time="2019-11-20 07:04:17.521380755Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:17 localhost crio[1857]: time="2019-11-20 07:04:17.521899554Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.636913 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.637131 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.637259 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.663855 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.664039 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:17 localhost hyperkube[1909]: E1120 07:04:17.664156 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:18 localhost hyperkube[1909]: I1120 07:04:18.613623 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:18 localhost hyperkube[1909]: I1120 07:04:18.616375 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:18 localhost hyperkube[1909]: I1120 07:04:18.616424 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:18 localhost hyperkube[1909]: I1120 07:04:18.616445 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:18 localhost hyperkube[1909]: W1120 07:04:18.628362 1909 conversion.go:110] Could not get instant cpu stats: cumulative stats decrease Nov 20 07:04:20 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:04:23 localhost podman[4627]: 2019-11-20 07:04:23.476170671 +0000 UTC m=+6.952340153 image pull Nov 20 07:04:23 localhost podman[4627]: 2019-11-20 07:04:23.520400769 +0000 UTC m=+6.996570234 container create f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:23 localhost systemd[1]: Started libpod-conmon-f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd.scope. Nov 20 07:04:23 localhost systemd[1]: Created slice libcontainer_4731_systemd_test_default.slice. Nov 20 07:04:23 localhost systemd[1]: Removed slice libcontainer_4731_systemd_test_default.slice. Nov 20 07:04:23 localhost systemd[1]: Started libcontainer container f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd. Nov 20 07:04:23 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:23 localhost podman[4627]: 2019-11-20 07:04:23.937259123 +0000 UTC m=+7.413428580 container init f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:23 localhost podman[4627]: 2019-11-20 07:04:23.958024883 +0000 UTC m=+7.434194318 container start f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:23 localhost podman[4627]: 2019-11-20 07:04:23.958189809 +0000 UTC m=+7.434359274 container attach f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:28 localhost hyperkube[1909]: I1120 07:04:28.644339 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:28 localhost hyperkube[1909]: I1120 07:04:28.646556 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:28 localhost hyperkube[1909]: I1120 07:04:28.646615 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:28 localhost hyperkube[1909]: I1120 07:04:28.646638 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:28 localhost hyperkube[1909]: W1120 07:04:28.654695 1909 conversion.go:110] Could not get instant cpu stats: cumulative stats decrease Nov 20 07:04:28 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:28.972Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-38ad941b-cdb0-47be-b02e-25c783fdd9cd/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:28 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:28.972Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ac2a4d6a-1912-4366-8ca9-2d7f119023e3/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:28 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:28.973Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fb80d7bf-133d-41c2-9d54-5c111bb1075c/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:28 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:28 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:28 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:28 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:04:28 localhost systemd[1]: libpod-f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd.scope: Consumed 365ms CPU time Nov 20 07:04:29 localhost podman[4627]: 2019-11-20 07:04:29.022555472 +0000 UTC m=+12.498724959 container died f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:29 localhost podman[4627]: 2019-11-20 07:04:29.234426844 +0000 UTC m=+12.710596344 container remove f003f435e7d0a4d86ac6ed437cbdeba5a42968c01683810a44612a946b0d4dfd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:29 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:04:32 localhost hyperkube[1909]: I1120 07:04:32.026412 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:32 localhost hyperkube[1909]: I1120 07:04:32.029127 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:32 localhost hyperkube[1909]: I1120 07:04:32.029198 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:32 localhost hyperkube[1909]: I1120 07:04:32.029238 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:32 localhost hyperkube[1909]: E1120 07:04:32.029594 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:32 localhost systemd[1]: Started crio-conmon-1f9b6d5f03cb1a5d44c0e1b1572f918c9a78ca05a77d7de6a77aecc39bbe6fd6.scope. Nov 20 07:04:32 localhost systemd[1]: Created slice libcontainer_4791_systemd_test_default.slice. Nov 20 07:04:32 localhost systemd[1]: Removed slice libcontainer_4791_systemd_test_default.slice. Nov 20 07:04:32 localhost systemd[1]: Started libcontainer container 1f9b6d5f03cb1a5d44c0e1b1572f918c9a78ca05a77d7de6a77aecc39bbe6fd6. Nov 20 07:04:32 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:32 localhost systemd[1]: Stopped libcontainer container 1f9b6d5f03cb1a5d44c0e1b1572f918c9a78ca05a77d7de6a77aecc39bbe6fd6. Nov 20 07:04:32 localhost systemd[1]: crio-1f9b6d5f03cb1a5d44c0e1b1572f918c9a78ca05a77d7de6a77aecc39bbe6fd6.scope: Consumed 44ms CPU time Nov 20 07:04:32 localhost crio[1857]: time="2019-11-20 07:04:32.244253241Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:32 localhost hyperkube[1909]: E1120 07:04:32.292803 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:32 localhost hyperkube[1909]: E1120 07:04:32.292979 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:32 localhost hyperkube[1909]: E1120 07:04:32.293077 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:33 localhost hyperkube[1909]: I1120 07:04:33.025982 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:33 localhost hyperkube[1909]: I1120 07:04:33.028349 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:33 localhost hyperkube[1909]: I1120 07:04:33.028452 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:33 localhost hyperkube[1909]: I1120 07:04:33.028474 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:33 localhost hyperkube[1909]: E1120 07:04:33.028792 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:33 localhost systemd[1]: Started crio-conmon-87f5682a00c8b5232cdd7ec1b8822497aa0fc9d2670bb53be2ef79071dd2bfd5.scope. Nov 20 07:04:33 localhost systemd[1]: Created slice libcontainer_4820_systemd_test_default.slice. Nov 20 07:04:33 localhost systemd[1]: Removed slice libcontainer_4820_systemd_test_default.slice. Nov 20 07:04:33 localhost systemd[1]: Started libcontainer container 87f5682a00c8b5232cdd7ec1b8822497aa0fc9d2670bb53be2ef79071dd2bfd5. Nov 20 07:04:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:33 localhost systemd[1]: Stopped libcontainer container 87f5682a00c8b5232cdd7ec1b8822497aa0fc9d2670bb53be2ef79071dd2bfd5. Nov 20 07:04:33 localhost systemd[1]: crio-87f5682a00c8b5232cdd7ec1b8822497aa0fc9d2670bb53be2ef79071dd2bfd5.scope: Consumed 46ms CPU time Nov 20 07:04:33 localhost crio[1857]: time="2019-11-20 07:04:33.251951770Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:33 localhost hyperkube[1909]: E1120 07:04:33.295537 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:33 localhost hyperkube[1909]: E1120 07:04:33.295685 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:33 localhost hyperkube[1909]: E1120 07:04:33.295736 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:34 localhost podman[4849]: 2019-11-20 07:04:34.431566444 +0000 UTC m=+0.152937151 container create 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:34 localhost systemd[1]: Started libpod-conmon-9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b.scope. Nov 20 07:04:34 localhost systemd[1]: Created slice libcontainer_4862_systemd_test_default.slice. Nov 20 07:04:34 localhost systemd[1]: Removed slice libcontainer_4862_systemd_test_default.slice. Nov 20 07:04:34 localhost systemd[1]: Started libcontainer container 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b. Nov 20 07:04:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:34 localhost podman[4849]: 2019-11-20 07:04:34.865956373 +0000 UTC m=+0.587327094 container init 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:34 localhost podman[4849]: 2019-11-20 07:04:34.886760891 +0000 UTC m=+0.608131591 container start 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:34 localhost podman[4849]: 2019-11-20 07:04:34.886887418 +0000 UTC m=+0.608258096 container attach 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:38 localhost hyperkube[1909]: I1120 07:04:38.663720 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:38 localhost hyperkube[1909]: I1120 07:04:38.666401 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:38 localhost hyperkube[1909]: I1120 07:04:38.666464 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:38 localhost hyperkube[1909]: I1120 07:04:38.666494 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:39 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:39.899Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-cb5c30e0-78e2-4f04-9640-ee3dc087a132/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:39 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:39.899Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ee16921a-8ba6-4cd5-993b-b68388c01489/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:39 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:39.900Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c30a7b9b-c049-4407-a75c-a66818170ddc/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:39 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:39 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:39 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:39 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:04:39 localhost systemd[1]: libpod-9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b.scope: Consumed 364ms CPU time Nov 20 07:04:39 localhost podman[4849]: 2019-11-20 07:04:39.928996723 +0000 UTC m=+5.650367485 container died 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:40 localhost podman[4849]: 2019-11-20 07:04:40.008304791 +0000 UTC m=+5.729675564 container remove 9582e7d7c66e7eeea26cd1324ad7ee2c5135dfb5382e64ce41138c40dac2ee2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:40 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:04:41 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:04:45 localhost hyperkube[1909]: I1120 07:04:45.026244 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:45 localhost hyperkube[1909]: I1120 07:04:45.029351 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:45 localhost hyperkube[1909]: I1120 07:04:45.029404 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:45 localhost hyperkube[1909]: I1120 07:04:45.029426 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:45 localhost hyperkube[1909]: E1120 07:04:45.029685 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:45 localhost systemd[1]: Started crio-conmon-2d681501f657a728f585709a4dd4809efdf37ed6666b35a574ff34d46c66012d.scope. Nov 20 07:04:45 localhost systemd[1]: Created slice libcontainer_4961_systemd_test_default.slice. Nov 20 07:04:45 localhost systemd[1]: Removed slice libcontainer_4961_systemd_test_default.slice. Nov 20 07:04:45 localhost systemd[1]: Started libcontainer container 2d681501f657a728f585709a4dd4809efdf37ed6666b35a574ff34d46c66012d. Nov 20 07:04:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:45 localhost podman[4952]: 2019-11-20 07:04:45.264520809 +0000 UTC m=+0.214964942 container create f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:45 localhost systemd[1]: crio-2d681501f657a728f585709a4dd4809efdf37ed6666b35a574ff34d46c66012d.scope: Consumed 43ms CPU time Nov 20 07:04:45 localhost crio[1857]: time="2019-11-20 07:04:45.292785455Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:45 localhost systemd[1]: Started libpod-conmon-f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45.scope. Nov 20 07:04:45 localhost systemd[1]: Created slice libcontainer_4996_systemd_test_default.slice. Nov 20 07:04:45 localhost systemd[1]: Removed slice libcontainer_4996_systemd_test_default.slice. Nov 20 07:04:45 localhost hyperkube[1909]: E1120 07:04:45.361153 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:45 localhost hyperkube[1909]: E1120 07:04:45.361318 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:45 localhost hyperkube[1909]: E1120 07:04:45.361393 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:45 localhost systemd[1]: Started libcontainer container f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45. Nov 20 07:04:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:45 localhost podman[4952]: 2019-11-20 07:04:45.731244046 +0000 UTC m=+0.681688196 container init f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:45 localhost podman[4952]: 2019-11-20 07:04:45.752806098 +0000 UTC m=+0.703250264 container start f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:45 localhost podman[4952]: 2019-11-20 07:04:45.752984847 +0000 UTC m=+0.703429004 container attach f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:47 localhost hyperkube[1909]: I1120 07:04:47.026081 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:47 localhost hyperkube[1909]: I1120 07:04:47.028632 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:47 localhost hyperkube[1909]: I1120 07:04:47.028726 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:47 localhost hyperkube[1909]: I1120 07:04:47.028749 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:47 localhost hyperkube[1909]: E1120 07:04:47.028949 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:47 localhost systemd[1]: Started crio-conmon-e421878b1ef45956b070afb9e55a4bd3b598e9b1d6d102962adbaa5be04b9538.scope. Nov 20 07:04:47 localhost systemd[1]: Created slice libcontainer_5034_systemd_test_default.slice. Nov 20 07:04:47 localhost systemd[1]: Removed slice libcontainer_5034_systemd_test_default.slice. Nov 20 07:04:47 localhost systemd[1]: Started libcontainer container e421878b1ef45956b070afb9e55a4bd3b598e9b1d6d102962adbaa5be04b9538. Nov 20 07:04:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:47 localhost systemd[1]: Stopped libcontainer container e421878b1ef45956b070afb9e55a4bd3b598e9b1d6d102962adbaa5be04b9538. Nov 20 07:04:47 localhost systemd[1]: crio-e421878b1ef45956b070afb9e55a4bd3b598e9b1d6d102962adbaa5be04b9538.scope: Consumed 35ms CPU time Nov 20 07:04:47 localhost crio[1857]: time="2019-11-20 07:04:47.225397221Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:47 localhost hyperkube[1909]: E1120 07:04:47.272077 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:47 localhost hyperkube[1909]: E1120 07:04:47.272279 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:47 localhost hyperkube[1909]: E1120 07:04:47.272352 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:48 localhost hyperkube[1909]: I1120 07:04:48.683287 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:48 localhost hyperkube[1909]: I1120 07:04:48.685676 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:48 localhost hyperkube[1909]: I1120 07:04:48.685734 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:48 localhost hyperkube[1909]: I1120 07:04:48.685757 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:50 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:50.767Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-558180ae-af86-4b31-99ca-db0b9987cb88/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:50 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:50.767Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-afd28f89-354b-43ce-a3f7-768a8697703e/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:50 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:04:50.768Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-586e376c-a3c1-4a8d-8bb9-2e13a625f1e0/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:04:50 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:50 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:50 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:04:50 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:04:50 localhost systemd[1]: libpod-f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45.scope: Consumed 377ms CPU time Nov 20 07:04:50 localhost podman[4952]: 2019-11-20 07:04:50.814875848 +0000 UTC m=+5.765320034 container died f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:50 localhost podman[4952]: 2019-11-20 07:04:50.891415936 +0000 UTC m=+5.841860112 container remove f2a0a7c92020e29e5ae1d78c20f9bdf7474c572925a23e2d2ea711ca951d9a45 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:50 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:04:56 localhost podman[5088]: 2019-11-20 07:04:56.080680617 +0000 UTC m=+0.154162068 container create 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:56 localhost systemd[1]: Started libpod-conmon-2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193.scope. Nov 20 07:04:56 localhost systemd[1]: Created slice libcontainer_5102_systemd_test_default.slice. Nov 20 07:04:56 localhost systemd[1]: Removed slice libcontainer_5102_systemd_test_default.slice. Nov 20 07:04:56 localhost systemd[1]: Started libcontainer container 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193. Nov 20 07:04:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:56 localhost podman[5088]: 2019-11-20 07:04:56.474533188 +0000 UTC m=+0.548014662 container init 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:56 localhost podman[5088]: 2019-11-20 07:04:56.497139564 +0000 UTC m=+0.570621039 container start 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:56 localhost podman[5088]: 2019-11-20 07:04:56.497342707 +0000 UTC m=+0.570824192 container attach 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.026189 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.028511 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.028579 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.028616 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:04:58 localhost hyperkube[1909]: E1120 07:04:58.028911 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:04:58 localhost systemd[1]: Started crio-conmon-c72c7efe019f578a9c3daab4c1e8b781f4a3df27a4d604b3365666cb23d33539.scope. Nov 20 07:04:58 localhost systemd[1]: Created slice libcontainer_5141_systemd_test_default.slice. Nov 20 07:04:58 localhost systemd[1]: Removed slice libcontainer_5141_systemd_test_default.slice. Nov 20 07:04:58 localhost systemd[1]: Started libcontainer container c72c7efe019f578a9c3daab4c1e8b781f4a3df27a4d604b3365666cb23d33539. Nov 20 07:04:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:04:58 localhost systemd[1]: Stopped libcontainer container c72c7efe019f578a9c3daab4c1e8b781f4a3df27a4d604b3365666cb23d33539. Nov 20 07:04:58 localhost systemd[1]: crio-c72c7efe019f578a9c3daab4c1e8b781f4a3df27a4d604b3365666cb23d33539.scope: Consumed 41ms CPU time Nov 20 07:04:58 localhost crio[1857]: time="2019-11-20 07:04:58.260046842Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:58 localhost hyperkube[1909]: E1120 07:04:58.309065 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:58 localhost hyperkube[1909]: E1120 07:04:58.309226 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:04:58 localhost hyperkube[1909]: E1120 07:04:58.309278 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.700620 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.702818 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.702890 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:04:58 localhost hyperkube[1909]: I1120 07:04:58.702915 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:01 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:05:01 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:01.513Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e3429347-ff20-4032-a28f-9d96499f4034/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:01 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:01.513Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-37fc8596-b96c-4ab2-923c-7903a01e73b2/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:01 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:01.513Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-51c02866-ff41-4891-86d2-21a9d0ef7ebb/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:01 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:01 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:01 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:01 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:05:01 localhost systemd[1]: libpod-2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193.scope: Consumed 345ms CPU time Nov 20 07:05:01 localhost podman[5088]: 2019-11-20 07:05:01.542735716 +0000 UTC m=+5.616217307 container died 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:01 localhost podman[5088]: 2019-11-20 07:05:01.62562616 +0000 UTC m=+5.699107671 container remove 2c300fb36d81e7131421d0902b4c30c124791592862e8c15dcee8283b85fd193 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:01 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:05:02 localhost hyperkube[1909]: I1120 07:05:02.025976 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:02 localhost hyperkube[1909]: I1120 07:05:02.028092 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:02 localhost hyperkube[1909]: I1120 07:05:02.028159 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:02 localhost hyperkube[1909]: I1120 07:05:02.028196 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:02 localhost hyperkube[1909]: E1120 07:05:02.028480 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:02 localhost systemd[1]: Started crio-conmon-4aad19a94c142d72ebc52ed47485c8888a5f7053fab94f7d255635d4ba913b80.scope. Nov 20 07:05:02 localhost systemd[1]: Created slice libcontainer_5210_systemd_test_default.slice. Nov 20 07:05:02 localhost systemd[1]: Removed slice libcontainer_5210_systemd_test_default.slice. Nov 20 07:05:02 localhost systemd[1]: Started libcontainer container 4aad19a94c142d72ebc52ed47485c8888a5f7053fab94f7d255635d4ba913b80. Nov 20 07:05:02 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:02 localhost systemd[1]: Stopped libcontainer container 4aad19a94c142d72ebc52ed47485c8888a5f7053fab94f7d255635d4ba913b80. Nov 20 07:05:02 localhost systemd[1]: crio-4aad19a94c142d72ebc52ed47485c8888a5f7053fab94f7d255635d4ba913b80.scope: Consumed 35ms CPU time Nov 20 07:05:02 localhost crio[1857]: time="2019-11-20 07:05:02.240129894Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:02 localhost hyperkube[1909]: E1120 07:05:02.284258 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:02 localhost hyperkube[1909]: E1120 07:05:02.284412 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:02 localhost hyperkube[1909]: E1120 07:05:02.284465 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:06 localhost podman[5240]: 2019-11-20 07:05:06.826890564 +0000 UTC m=+0.167724830 container create 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:06 localhost systemd[1]: Started libpod-conmon-1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d.scope. Nov 20 07:05:06 localhost systemd[1]: Created slice libcontainer_5253_systemd_test_default.slice. Nov 20 07:05:06 localhost systemd[1]: Removed slice libcontainer_5253_systemd_test_default.slice. Nov 20 07:05:06 localhost systemd[1]: Started libcontainer container 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d. Nov 20 07:05:06 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:07 localhost podman[5240]: 2019-11-20 07:05:07.260401623 +0000 UTC m=+0.601235913 container init 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:07 localhost podman[5240]: 2019-11-20 07:05:07.282662321 +0000 UTC m=+0.623496623 container start 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:07 localhost podman[5240]: 2019-11-20 07:05:07.282868841 +0000 UTC m=+0.623703131 container attach 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:08 localhost hyperkube[1909]: I1120 07:05:08.717797 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:08 localhost hyperkube[1909]: I1120 07:05:08.720134 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:08 localhost hyperkube[1909]: I1120 07:05:08.720189 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:08 localhost hyperkube[1909]: I1120 07:05:08.720212 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:09 localhost hyperkube[1909]: I1120 07:05:09.025971 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:09 localhost hyperkube[1909]: I1120 07:05:09.028234 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:09 localhost hyperkube[1909]: I1120 07:05:09.028471 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:09 localhost hyperkube[1909]: I1120 07:05:09.028517 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:09 localhost hyperkube[1909]: E1120 07:05:09.028827 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:09 localhost systemd[1]: Started crio-conmon-55fb89b0429712c055b88f3f7a72e72c3129cce4724ed329eeb9dabba1c68079.scope. Nov 20 07:05:09 localhost systemd[1]: Created slice libcontainer_5294_systemd_test_default.slice. Nov 20 07:05:09 localhost systemd[1]: Removed slice libcontainer_5294_systemd_test_default.slice. Nov 20 07:05:09 localhost systemd[1]: Started libcontainer container 55fb89b0429712c055b88f3f7a72e72c3129cce4724ed329eeb9dabba1c68079. Nov 20 07:05:09 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:09 localhost systemd[1]: Stopped libcontainer container 55fb89b0429712c055b88f3f7a72e72c3129cce4724ed329eeb9dabba1c68079. Nov 20 07:05:09 localhost systemd[1]: crio-55fb89b0429712c055b88f3f7a72e72c3129cce4724ed329eeb9dabba1c68079.scope: Consumed 39ms CPU time Nov 20 07:05:09 localhost crio[1857]: time="2019-11-20 07:05:09.256218399Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:09 localhost hyperkube[1909]: E1120 07:05:09.321241 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:09 localhost hyperkube[1909]: E1120 07:05:09.321454 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:09 localhost hyperkube[1909]: E1120 07:05:09.321554 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:12.298Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9fa33e74-612c-40e5-86e0-75d40cda3667/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:12.298Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d74d4452-6657-4512-9862-47cfb343ce2b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:12.298Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e1921afc-9e97-4746-bf52-0aa0d396611b/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:12 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:12 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:12 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:12 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:05:12 localhost systemd[1]: libpod-1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d.scope: Consumed 355ms CPU time Nov 20 07:05:12 localhost podman[5240]: 2019-11-20 07:05:12.346636955 +0000 UTC m=+5.687471298 container died 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:12 localhost podman[5240]: 2019-11-20 07:05:12.419844048 +0000 UTC m=+5.760678370 container remove 1dcc20901fc53dba8a626e1bf740b215f951ab3fb8ccdf28d182dd5fd35fde2d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:12 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.026446 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.026553 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.029100 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.029141 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.029161 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.029108 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.029261 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:14 localhost hyperkube[1909]: I1120 07:05:14.029300 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:14 localhost hyperkube[1909]: E1120 07:05:14.029542 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:14 localhost hyperkube[1909]: E1120 07:05:14.029621 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:14 localhost systemd[1]: Started crio-conmon-891306c8a2647f61dce86e1650b50fb470632208d8bbccd9294966dcdc13bf66.scope. Nov 20 07:05:14 localhost systemd[1]: Created slice libcontainer_5345_systemd_test_default.slice. Nov 20 07:05:14 localhost systemd[1]: Removed slice libcontainer_5345_systemd_test_default.slice. Nov 20 07:05:14 localhost systemd[1]: Started libcontainer container 891306c8a2647f61dce86e1650b50fb470632208d8bbccd9294966dcdc13bf66. Nov 20 07:05:14 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:14 localhost systemd[1]: Stopped libcontainer container 891306c8a2647f61dce86e1650b50fb470632208d8bbccd9294966dcdc13bf66. Nov 20 07:05:14 localhost systemd[1]: crio-891306c8a2647f61dce86e1650b50fb470632208d8bbccd9294966dcdc13bf66.scope: Consumed 34ms CPU time Nov 20 07:05:14 localhost crio[1857]: time="2019-11-20 07:05:14.241133637Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:14 localhost hyperkube[1909]: E1120 07:05:14.302440 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:14 localhost hyperkube[1909]: E1120 07:05:14.302607 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:14 localhost hyperkube[1909]: E1120 07:05:14.302661 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:17 localhost podman[5371]: 2019-11-20 07:05:17.611987919 +0000 UTC m=+0.158222896 container create f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:17 localhost systemd[1]: Started libpod-conmon-f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3.scope. Nov 20 07:05:17 localhost systemd[1]: Created slice libcontainer_5385_systemd_test_default.slice. Nov 20 07:05:17 localhost systemd[1]: Removed slice libcontainer_5385_systemd_test_default.slice. Nov 20 07:05:17 localhost systemd[1]: Started libcontainer container f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3. Nov 20 07:05:17 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:18 localhost podman[5371]: 2019-11-20 07:05:18.027918461 +0000 UTC m=+0.574153439 container init f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:18 localhost podman[5371]: 2019-11-20 07:05:18.062181012 +0000 UTC m=+0.608415996 container start f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:18 localhost podman[5371]: 2019-11-20 07:05:18.062716709 +0000 UTC m=+0.608951697 container attach f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:18 localhost hyperkube[1909]: I1120 07:05:18.736818 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:18 localhost hyperkube[1909]: I1120 07:05:18.739616 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:18 localhost hyperkube[1909]: I1120 07:05:18.739672 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:18 localhost hyperkube[1909]: I1120 07:05:18.739701 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:20 localhost hyperkube[1909]: I1120 07:05:20.026335 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:20 localhost hyperkube[1909]: I1120 07:05:20.029122 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:20 localhost hyperkube[1909]: I1120 07:05:20.029177 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:20 localhost hyperkube[1909]: I1120 07:05:20.029210 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:20 localhost hyperkube[1909]: E1120 07:05:20.029459 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:20 localhost systemd[1]: Started crio-conmon-cdd666f63992f81e7ea71cacb92919dea45f66a26a9c66cfeb276f75f31d9913.scope. Nov 20 07:05:20 localhost systemd[1]: Created slice libcontainer_5425_systemd_test_default.slice. Nov 20 07:05:20 localhost systemd[1]: Removed slice libcontainer_5425_systemd_test_default.slice. Nov 20 07:05:20 localhost systemd[1]: Started libcontainer container cdd666f63992f81e7ea71cacb92919dea45f66a26a9c66cfeb276f75f31d9913. Nov 20 07:05:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:20 localhost systemd[1]: Stopped libcontainer container cdd666f63992f81e7ea71cacb92919dea45f66a26a9c66cfeb276f75f31d9913. Nov 20 07:05:20 localhost systemd[1]: crio-cdd666f63992f81e7ea71cacb92919dea45f66a26a9c66cfeb276f75f31d9913.scope: Consumed 36ms CPU time Nov 20 07:05:20 localhost crio[1857]: time="2019-11-20 07:05:20.252979517Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:20 localhost hyperkube[1909]: E1120 07:05:20.311064 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:20 localhost hyperkube[1909]: E1120 07:05:20.311221 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:20 localhost hyperkube[1909]: E1120 07:05:20.311286 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:21 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:05:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:23.086Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-74d35c14-e374-4256-a57e-77ae57fe7e8e/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:23.087Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b8280bdb-62cf-47aa-acab-fec667f04e22/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:23.086Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-650eead6-854c-4afe-a051-c8accc4e6a2d/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:23 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:23 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:23 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:23 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:05:23 localhost systemd[1]: libpod-f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3.scope: Consumed 365ms CPU time Nov 20 07:05:23 localhost podman[5371]: 2019-11-20 07:05:23.131730099 +0000 UTC m=+5.677965127 container died f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:23 localhost podman[5371]: 2019-11-20 07:05:23.201917621 +0000 UTC m=+5.748152632 container remove f78bc34ce1d3153126d56c3ace9514b70e5ace9b5087e9d3ea30f07c46e65fc3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:23 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:05:26 localhost hyperkube[1909]: I1120 07:05:26.025901 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:26 localhost hyperkube[1909]: I1120 07:05:26.028552 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:26 localhost hyperkube[1909]: I1120 07:05:26.028632 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:26 localhost hyperkube[1909]: I1120 07:05:26.028746 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:26 localhost hyperkube[1909]: E1120 07:05:26.029074 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:26 localhost systemd[1]: Started crio-conmon-b62abbc2085a0d5c1ec403b705282b22ddace0ee5aaee4b19cfb59e201ac499d.scope. Nov 20 07:05:26 localhost systemd[1]: Created slice libcontainer_5489_systemd_test_default.slice. Nov 20 07:05:26 localhost systemd[1]: Removed slice libcontainer_5489_systemd_test_default.slice. Nov 20 07:05:26 localhost systemd[1]: Started libcontainer container b62abbc2085a0d5c1ec403b705282b22ddace0ee5aaee4b19cfb59e201ac499d. Nov 20 07:05:26 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:26 localhost systemd[1]: Stopped libcontainer container b62abbc2085a0d5c1ec403b705282b22ddace0ee5aaee4b19cfb59e201ac499d. Nov 20 07:05:26 localhost systemd[1]: crio-b62abbc2085a0d5c1ec403b705282b22ddace0ee5aaee4b19cfb59e201ac499d.scope: Consumed 39ms CPU time Nov 20 07:05:26 localhost crio[1857]: time="2019-11-20 07:05:26.249904907Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:26 localhost hyperkube[1909]: E1120 07:05:26.308154 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:26 localhost hyperkube[1909]: E1120 07:05:26.308306 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:26 localhost hyperkube[1909]: E1120 07:05:26.308374 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:28 localhost podman[5520]: 2019-11-20 07:05:28.396270207 +0000 UTC m=+0.159412445 container create 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:28 localhost systemd[1]: Started libpod-conmon-0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697.scope. Nov 20 07:05:28 localhost systemd[1]: Created slice libcontainer_5533_systemd_test_default.slice. Nov 20 07:05:28 localhost systemd[1]: Removed slice libcontainer_5533_systemd_test_default.slice. Nov 20 07:05:28 localhost systemd[1]: Started libcontainer container 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697. Nov 20 07:05:28 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:28 localhost hyperkube[1909]: I1120 07:05:28.756813 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:28 localhost hyperkube[1909]: I1120 07:05:28.758932 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:28 localhost hyperkube[1909]: I1120 07:05:28.758976 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:28 localhost hyperkube[1909]: I1120 07:05:28.758997 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:28 localhost podman[5520]: 2019-11-20 07:05:28.810720909 +0000 UTC m=+0.573863056 container init 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:28 localhost podman[5520]: 2019-11-20 07:05:28.83283763 +0000 UTC m=+0.595979765 container start 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:28 localhost podman[5520]: 2019-11-20 07:05:28.832979384 +0000 UTC m=+0.596121521 container attach 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:31 localhost hyperkube[1909]: I1120 07:05:31.025960 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:31 localhost hyperkube[1909]: I1120 07:05:31.029150 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:31 localhost hyperkube[1909]: I1120 07:05:31.029228 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:31 localhost hyperkube[1909]: I1120 07:05:31.029280 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:31 localhost hyperkube[1909]: E1120 07:05:31.029557 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:31 localhost systemd[1]: Started crio-conmon-cec0a384c5b919c85aeb85af5ae940d939e5c6370c9edd94c0ddfd887522e265.scope. Nov 20 07:05:31 localhost systemd[1]: Created slice libcontainer_5572_systemd_test_default.slice. Nov 20 07:05:31 localhost systemd[1]: Removed slice libcontainer_5572_systemd_test_default.slice. Nov 20 07:05:31 localhost systemd[1]: Started libcontainer container cec0a384c5b919c85aeb85af5ae940d939e5c6370c9edd94c0ddfd887522e265. Nov 20 07:05:31 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:31 localhost systemd[1]: Stopped libcontainer container cec0a384c5b919c85aeb85af5ae940d939e5c6370c9edd94c0ddfd887522e265. Nov 20 07:05:31 localhost systemd[1]: crio-cec0a384c5b919c85aeb85af5ae940d939e5c6370c9edd94c0ddfd887522e265.scope: Consumed 37ms CPU time Nov 20 07:05:31 localhost crio[1857]: time="2019-11-20 07:05:31.246739633Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:31 localhost hyperkube[1909]: E1120 07:05:31.300109 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:31 localhost hyperkube[1909]: E1120 07:05:31.300273 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:31 localhost hyperkube[1909]: E1120 07:05:31.300326 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:33.846Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2af14c9d-1433-456c-b88e-92ed97bef53e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:33.846Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-63db1752-48ef-45c7-9b95-0b0001aad2fc/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:33.846Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-04e41ec7-b89f-4a56-9eb4-883417ea327f/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:33 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:33 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:33 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:33 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:05:33 localhost systemd[1]: libpod-0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697.scope: Consumed 347ms CPU time Nov 20 07:05:33 localhost podman[5520]: 2019-11-20 07:05:33.899648813 +0000 UTC m=+5.662791021 container died 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:33 localhost podman[5520]: 2019-11-20 07:05:33.965344244 +0000 UTC m=+5.728486483 container remove 0be7d11a238580569961e091bfef4fb424c80118c4d1ab559740794aeec19697 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:33 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.026169 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.028419 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.028475 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.028500 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:38 localhost hyperkube[1909]: E1120 07:05:38.028710 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:38 localhost systemd[1]: Started crio-conmon-fb6af1c435229f81378d324c107c445ed53291bb781df9a4d65a0498d27567cd.scope. Nov 20 07:05:38 localhost systemd[1]: Created slice libcontainer_5623_systemd_test_default.slice. Nov 20 07:05:38 localhost systemd[1]: Removed slice libcontainer_5623_systemd_test_default.slice. Nov 20 07:05:38 localhost systemd[1]: Started libcontainer container fb6af1c435229f81378d324c107c445ed53291bb781df9a4d65a0498d27567cd. Nov 20 07:05:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:38 localhost systemd[1]: Stopped libcontainer container fb6af1c435229f81378d324c107c445ed53291bb781df9a4d65a0498d27567cd. Nov 20 07:05:38 localhost systemd[1]: crio-fb6af1c435229f81378d324c107c445ed53291bb781df9a4d65a0498d27567cd.scope: Consumed 34ms CPU time Nov 20 07:05:38 localhost crio[1857]: time="2019-11-20 07:05:38.263186625Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:38 localhost hyperkube[1909]: E1120 07:05:38.318543 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:38 localhost hyperkube[1909]: E1120 07:05:38.318718 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:38 localhost hyperkube[1909]: E1120 07:05:38.318794 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.773272 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.775405 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.775469 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:38 localhost hyperkube[1909]: I1120 07:05:38.775511 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:39 localhost podman[5663]: 2019-11-20 07:05:39.147110841 +0000 UTC m=+0.145118901 container create da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:39 localhost systemd[1]: Started libpod-conmon-da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8.scope. Nov 20 07:05:39 localhost systemd[1]: Created slice libcontainer_5677_systemd_test_default.slice. Nov 20 07:05:39 localhost systemd[1]: Removed slice libcontainer_5677_systemd_test_default.slice. Nov 20 07:05:39 localhost systemd[1]: Started libcontainer container da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8. Nov 20 07:05:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:39 localhost podman[5663]: 2019-11-20 07:05:39.552181803 +0000 UTC m=+0.550189891 container init da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:39 localhost podman[5663]: 2019-11-20 07:05:39.577943685 +0000 UTC m=+0.575951758 container start da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:39 localhost podman[5663]: 2019-11-20 07:05:39.578456496 +0000 UTC m=+0.576464635 container attach da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:41 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:05:43 localhost hyperkube[1909]: I1120 07:05:43.026122 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:43 localhost hyperkube[1909]: I1120 07:05:43.028542 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:43 localhost hyperkube[1909]: I1120 07:05:43.028605 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:43 localhost hyperkube[1909]: I1120 07:05:43.028628 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:43 localhost hyperkube[1909]: E1120 07:05:43.028876 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:43 localhost systemd[1]: Started crio-conmon-c37dbae277ef4766fb5e6fa7544b6275c5dad2bc4031c28f060075a4a4912903.scope. Nov 20 07:05:43 localhost systemd[1]: Created slice libcontainer_5729_systemd_test_default.slice. Nov 20 07:05:43 localhost systemd[1]: Removed slice libcontainer_5729_systemd_test_default.slice. Nov 20 07:05:43 localhost systemd[1]: Started libcontainer container c37dbae277ef4766fb5e6fa7544b6275c5dad2bc4031c28f060075a4a4912903. Nov 20 07:05:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:43 localhost systemd[1]: Stopped libcontainer container c37dbae277ef4766fb5e6fa7544b6275c5dad2bc4031c28f060075a4a4912903. Nov 20 07:05:43 localhost systemd[1]: crio-c37dbae277ef4766fb5e6fa7544b6275c5dad2bc4031c28f060075a4a4912903.scope: Consumed 36ms CPU time Nov 20 07:05:43 localhost crio[1857]: time="2019-11-20 07:05:43.260399549Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:43 localhost hyperkube[1909]: E1120 07:05:43.324810 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:43 localhost hyperkube[1909]: E1120 07:05:43.324954 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:43 localhost hyperkube[1909]: E1120 07:05:43.325090 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:44 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:44.595Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-02d9d02e-e2b7-4e38-b846-f8827009093c/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:44 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:44.595Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8415a86a-25a1-438b-8b8b-2eb36f83f25e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:44 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:44.595Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b22ea9cd-77f9-47ef-b4f9-f43d934a62e1/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:44 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:44 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:44 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:44 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:05:44 localhost systemd[1]: libpod-da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8.scope: Consumed 352ms CPU time Nov 20 07:05:44 localhost podman[5663]: 2019-11-20 07:05:44.647513728 +0000 UTC m=+5.645521831 container died da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:44 localhost podman[5663]: 2019-11-20 07:05:44.720358991 +0000 UTC m=+5.718367079 container remove da9246128acdbcfefa3efa09b7e8a160b7728cbd2357c70f851015781ca6dbb8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:44 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:05:48 localhost hyperkube[1909]: I1120 07:05:48.789711 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:48 localhost hyperkube[1909]: I1120 07:05:48.792261 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:48 localhost hyperkube[1909]: I1120 07:05:48.792338 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:48 localhost hyperkube[1909]: I1120 07:05:48.792376 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:49 localhost podman[5780]: 2019-11-20 07:05:49.917149842 +0000 UTC m=+0.164741466 container create d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:49 localhost systemd[1]: Started libpod-conmon-d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28.scope. Nov 20 07:05:49 localhost systemd[1]: Created slice libcontainer_5794_systemd_test_default.slice. Nov 20 07:05:49 localhost systemd[1]: Removed slice libcontainer_5794_systemd_test_default.slice. Nov 20 07:05:50 localhost systemd[1]: Started libcontainer container d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28. Nov 20 07:05:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:50 localhost podman[5780]: 2019-11-20 07:05:50.344480913 +0000 UTC m=+0.592072553 container init d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:50 localhost podman[5780]: 2019-11-20 07:05:50.374058193 +0000 UTC m=+0.621649835 container start d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:50 localhost podman[5780]: 2019-11-20 07:05:50.374270823 +0000 UTC m=+0.621862490 container attach d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:51 localhost hyperkube[1909]: I1120 07:05:51.025795 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:51 localhost hyperkube[1909]: I1120 07:05:51.028666 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:51 localhost hyperkube[1909]: I1120 07:05:51.028731 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:51 localhost hyperkube[1909]: I1120 07:05:51.028766 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:51 localhost hyperkube[1909]: E1120 07:05:51.029089 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:51 localhost systemd[1]: Started crio-conmon-31ee5e1bd733e449c2d155e1b4905a908d3329dd689ce20e40a9bad9fcaf8a78.scope. Nov 20 07:05:51 localhost systemd[1]: Created slice libcontainer_5832_systemd_test_default.slice. Nov 20 07:05:51 localhost systemd[1]: Removed slice libcontainer_5832_systemd_test_default.slice. Nov 20 07:05:51 localhost hyperkube[1909]: W1120 07:05:51.115968 1909 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/libcontainer_5832_systemd_test_default.slice": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/libcontainer_5832_systemd_test_default.slice: no such file or directory Nov 20 07:05:51 localhost systemd[1]: Started libcontainer container 31ee5e1bd733e449c2d155e1b4905a908d3329dd689ce20e40a9bad9fcaf8a78. Nov 20 07:05:51 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:51 localhost systemd[1]: Stopped libcontainer container 31ee5e1bd733e449c2d155e1b4905a908d3329dd689ce20e40a9bad9fcaf8a78. Nov 20 07:05:51 localhost systemd[1]: crio-31ee5e1bd733e449c2d155e1b4905a908d3329dd689ce20e40a9bad9fcaf8a78.scope: Consumed 40ms CPU time Nov 20 07:05:51 localhost crio[1857]: time="2019-11-20 07:05:51.246740913Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:51 localhost hyperkube[1909]: E1120 07:05:51.298219 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:51 localhost hyperkube[1909]: E1120 07:05:51.298370 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:51 localhost hyperkube[1909]: E1120 07:05:51.298422 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:55 localhost hyperkube[1909]: I1120 07:05:55.026155 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:55 localhost hyperkube[1909]: I1120 07:05:55.028964 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:55 localhost hyperkube[1909]: I1120 07:05:55.029057 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:55 localhost hyperkube[1909]: I1120 07:05:55.029081 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:05:55 localhost hyperkube[1909]: E1120 07:05:55.029326 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:05:55 localhost systemd[1]: Started crio-conmon-8cd5527f7bf042215f4fb7d91e18d24af671a13ef79135672526d94721f2490c.scope. Nov 20 07:05:55 localhost systemd[1]: Created slice libcontainer_5864_systemd_test_default.slice. Nov 20 07:05:55 localhost systemd[1]: Removed slice libcontainer_5864_systemd_test_default.slice. Nov 20 07:05:55 localhost systemd[1]: Started libcontainer container 8cd5527f7bf042215f4fb7d91e18d24af671a13ef79135672526d94721f2490c. Nov 20 07:05:55 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:05:55 localhost systemd[1]: Stopped libcontainer container 8cd5527f7bf042215f4fb7d91e18d24af671a13ef79135672526d94721f2490c. Nov 20 07:05:55 localhost systemd[1]: crio-8cd5527f7bf042215f4fb7d91e18d24af671a13ef79135672526d94721f2490c.scope: Consumed 35ms CPU time Nov 20 07:05:55 localhost crio[1857]: time="2019-11-20 07:05:55.248503981Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:55 localhost hyperkube[1909]: E1120 07:05:55.298579 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:55 localhost hyperkube[1909]: E1120 07:05:55.298729 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:05:55 localhost hyperkube[1909]: E1120 07:05:55.298780 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:05:55 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:55.384Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-010239c5-6c0c-435f-a3e6-5ca36e200478/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:55 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:55.384Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-095e1aec-791f-44a7-9ea3-c48fb0dea665/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:55 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:05:55.384Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a433d978-6f91-49ec-8552-d6950a403239/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:05:55 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:55 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:55 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:05:55 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:05:55 localhost systemd[1]: libpod-d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28.scope: Consumed 340ms CPU time Nov 20 07:05:55 localhost podman[5780]: 2019-11-20 07:05:55.431772049 +0000 UTC m=+5.679363728 container died d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:55 localhost podman[5780]: 2019-11-20 07:05:55.491315943 +0000 UTC m=+5.738907595 container remove d9d7cd25bc1e26a60d569750fd7a266f2607c110cba3bc89f30f36d28d165b28 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:05:55 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:05:58 localhost hyperkube[1909]: I1120 07:05:58.810235 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:05:58 localhost hyperkube[1909]: I1120 07:05:58.812741 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:05:58 localhost hyperkube[1909]: I1120 07:05:58.812945 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:05:58 localhost hyperkube[1909]: I1120 07:05:58.812989 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:00 localhost podman[5913]: 2019-11-20 07:06:00.669362558 +0000 UTC m=+0.143328090 container create 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:00 localhost systemd[1]: Started libpod-conmon-7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb.scope. Nov 20 07:06:00 localhost systemd[1]: Created slice libcontainer_5929_systemd_test_default.slice. Nov 20 07:06:00 localhost systemd[1]: Removed slice libcontainer_5929_systemd_test_default.slice. Nov 20 07:06:00 localhost systemd[1]: Started libcontainer container 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb. Nov 20 07:06:00 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:01 localhost podman[5913]: 2019-11-20 07:06:01.085447507 +0000 UTC m=+0.559413029 container init 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:01 localhost podman[5913]: 2019-11-20 07:06:01.11513833 +0000 UTC m=+0.589103876 container start 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:01 localhost podman[5913]: 2019-11-20 07:06:01.115345901 +0000 UTC m=+0.589311403 container attach 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:01 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:06:03 localhost hyperkube[1909]: I1120 07:06:03.026285 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:03 localhost hyperkube[1909]: I1120 07:06:03.030377 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:03 localhost hyperkube[1909]: I1120 07:06:03.030433 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:03 localhost hyperkube[1909]: I1120 07:06:03.030454 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:03 localhost hyperkube[1909]: E1120 07:06:03.030711 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:03 localhost systemd[1]: Started crio-conmon-8e6d04ff44688bc4b8ceee1e6e123c7143a6f36b99c4fa1ad8205ed8566500f8.scope. Nov 20 07:06:03 localhost systemd[1]: Created slice libcontainer_5986_systemd_test_default.slice. Nov 20 07:06:03 localhost systemd[1]: Removed slice libcontainer_5986_systemd_test_default.slice. Nov 20 07:06:03 localhost systemd[1]: Started libcontainer container 8e6d04ff44688bc4b8ceee1e6e123c7143a6f36b99c4fa1ad8205ed8566500f8. Nov 20 07:06:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:03 localhost systemd[1]: Stopped libcontainer container 8e6d04ff44688bc4b8ceee1e6e123c7143a6f36b99c4fa1ad8205ed8566500f8. Nov 20 07:06:03 localhost crio[1857]: time="2019-11-20 07:06:03.261309321Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:03 localhost hyperkube[1909]: E1120 07:06:03.315652 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:03 localhost hyperkube[1909]: E1120 07:06:03.315797 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:03 localhost hyperkube[1909]: E1120 07:06:03.315849 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:06.133Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6f5923f3-2352-45de-a825-1163c6ab4b49/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:06.133Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-919caeff-5e11-4394-a820-7572994f3d48/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:06.133Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-31f85c4d-46d0-446e-a47b-bb360b862bc6/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:06 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:06 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:06 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:06 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:06:06 localhost systemd[1]: libpod-7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb.scope: Consumed 347ms CPU time Nov 20 07:06:06 localhost podman[5913]: 2019-11-20 07:06:06.179477013 +0000 UTC m=+5.653442576 container died 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:06 localhost podman[5913]: 2019-11-20 07:06:06.263695441 +0000 UTC m=+5.737660983 container remove 7c3ba11c23e6029fb296fac0c8683735e285bd9c3cec96f3cf07cfa590fb52cb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:06 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:06:08 localhost hyperkube[1909]: I1120 07:06:08.827725 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:08 localhost hyperkube[1909]: I1120 07:06:08.830307 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:08 localhost hyperkube[1909]: I1120 07:06:08.830628 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:08 localhost hyperkube[1909]: I1120 07:06:08.830668 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:09 localhost hyperkube[1909]: I1120 07:06:09.026064 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:09 localhost hyperkube[1909]: I1120 07:06:09.028140 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:09 localhost hyperkube[1909]: I1120 07:06:09.028192 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:09 localhost hyperkube[1909]: I1120 07:06:09.028215 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:09 localhost hyperkube[1909]: E1120 07:06:09.028442 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:09 localhost systemd[1]: Started crio-conmon-8fe580b51957a1877168ded3704dd0543b2c3ec3a6c751b7c5952e76b87e3c20.scope. Nov 20 07:06:09 localhost systemd[1]: Created slice libcontainer_6039_systemd_test_default.slice. Nov 20 07:06:09 localhost systemd[1]: Removed slice libcontainer_6039_systemd_test_default.slice. Nov 20 07:06:09 localhost systemd[1]: Started libcontainer container 8fe580b51957a1877168ded3704dd0543b2c3ec3a6c751b7c5952e76b87e3c20. Nov 20 07:06:09 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:09 localhost systemd-logind[1725]: New session 2 of user user1. Nov 20 07:06:09 localhost systemd[1]: Started Session 2 of user user1. Nov 20 07:06:09 localhost login[1852]: pam_unix(login:session): session opened for user user1 by LOGIN(uid=0) Nov 20 07:06:09 localhost login[1852]: DIALUP AT ttyS0 BY user1 Nov 20 07:06:09 localhost login[1852]: LOGIN ON ttyS0 BY user1 Nov 20 07:06:09 localhost systemd[1]: Stopped libcontainer container 8fe580b51957a1877168ded3704dd0543b2c3ec3a6c751b7c5952e76b87e3c20. Nov 20 07:06:09 localhost systemd[1]: crio-8fe580b51957a1877168ded3704dd0543b2c3ec3a6c751b7c5952e76b87e3c20.scope: Consumed 44ms CPU time Nov 20 07:06:09 localhost crio[1857]: time="2019-11-20 07:06:09.275411309Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:09 localhost hyperkube[1909]: E1120 07:06:09.362120 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:09 localhost hyperkube[1909]: E1120 07:06:09.362944 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:09 localhost hyperkube[1909]: E1120 07:06:09.363052 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:11 localhost podman[6103]: 2019-11-20 07:06:11.461915672 +0000 UTC m=+0.162819042 container create 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:11 localhost systemd[1]: Started libpod-conmon-84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1.scope. Nov 20 07:06:11 localhost systemd[1]: Created slice libcontainer_6117_systemd_test_default.slice. Nov 20 07:06:11 localhost systemd[1]: Removed slice libcontainer_6117_systemd_test_default.slice. Nov 20 07:06:11 localhost systemd[1]: Started libcontainer container 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1. Nov 20 07:06:11 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:11 localhost podman[6103]: 2019-11-20 07:06:11.907250377 +0000 UTC m=+0.608153772 container init 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:11 localhost podman[6103]: 2019-11-20 07:06:11.92915511 +0000 UTC m=+0.630058529 container start 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:11 localhost podman[6103]: 2019-11-20 07:06:11.929328964 +0000 UTC m=+0.630232396 container attach 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:16 localhost hyperkube[1909]: I1120 07:06:16.026330 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:16 localhost hyperkube[1909]: I1120 07:06:16.030482 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:16 localhost hyperkube[1909]: I1120 07:06:16.030540 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:16 localhost hyperkube[1909]: I1120 07:06:16.030563 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:16 localhost hyperkube[1909]: E1120 07:06:16.030755 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:16 localhost systemd[1]: Started crio-conmon-b98615a6853f7242798dbd181d424806fb9252dffb23e073695553732335b844.scope. Nov 20 07:06:16 localhost systemd[1]: Created slice libcontainer_6156_systemd_test_default.slice. Nov 20 07:06:16 localhost systemd[1]: Removed slice libcontainer_6156_systemd_test_default.slice. Nov 20 07:06:16 localhost systemd[1]: Started libcontainer container b98615a6853f7242798dbd181d424806fb9252dffb23e073695553732335b844. Nov 20 07:06:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:16 localhost systemd[1]: Stopped libcontainer container b98615a6853f7242798dbd181d424806fb9252dffb23e073695553732335b844. Nov 20 07:06:16 localhost systemd[1]: crio-b98615a6853f7242798dbd181d424806fb9252dffb23e073695553732335b844.scope: Consumed 39ms CPU time Nov 20 07:06:16 localhost crio[1857]: time="2019-11-20 07:06:16.248849906Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:16 localhost hyperkube[1909]: E1120 07:06:16.303453 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:16 localhost hyperkube[1909]: E1120 07:06:16.303610 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:16 localhost hyperkube[1909]: E1120 07:06:16.303662 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:16.944Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-12273e96-52f9-46da-907c-c21ddd70f300/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:16.944Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1ba15bd3-b99d-4ae3-bf0e-267853c7e867/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:16.944Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ac424ac0-c5b0-4a95-841a-7f4055d27d24/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:16 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:16 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:16 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:16 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:06:16 localhost systemd[1]: libpod-84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1.scope: Consumed 397ms CPU time Nov 20 07:06:16 localhost podman[6103]: 2019-11-20 07:06:16.986988028 +0000 UTC m=+5.687891480 container died 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:17 localhost podman[6103]: 2019-11-20 07:06:17.049592543 +0000 UTC m=+5.750495992 container remove 84613ade9a0d3962095dfacde1e62f8f9c69338bbe8d91a66a270abe539943e1 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:17 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:06:18 localhost hyperkube[1909]: I1120 07:06:18.846631 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:18 localhost hyperkube[1909]: I1120 07:06:18.850303 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:18 localhost hyperkube[1909]: I1120 07:06:18.850384 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:18 localhost hyperkube[1909]: I1120 07:06:18.850421 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:21 localhost hyperkube[1909]: I1120 07:06:21.025870 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:21 localhost hyperkube[1909]: I1120 07:06:21.027908 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:21 localhost hyperkube[1909]: I1120 07:06:21.027982 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:21 localhost hyperkube[1909]: I1120 07:06:21.028047 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:21 localhost hyperkube[1909]: E1120 07:06:21.028545 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:22 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:06:22 localhost podman[6218]: 2019-11-20 07:06:22.244501712 +0000 UTC m=+0.157086680 container create 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:22 localhost systemd[1]: Started libpod-conmon-775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0.scope. Nov 20 07:06:22 localhost systemd[1]: Created slice libcontainer_6239_systemd_test_default.slice. Nov 20 07:06:22 localhost systemd[1]: Removed slice libcontainer_6239_systemd_test_default.slice. Nov 20 07:06:22 localhost systemd[1]: Started libcontainer container 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0. Nov 20 07:06:22 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:22 localhost podman[6218]: 2019-11-20 07:06:22.660823785 +0000 UTC m=+0.573408766 container init 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:22 localhost podman[6218]: 2019-11-20 07:06:22.680588453 +0000 UTC m=+0.593173439 container start 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:22 localhost podman[6218]: 2019-11-20 07:06:22.68080114 +0000 UTC m=+0.593386128 container attach 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:24 localhost hyperkube[1909]: I1120 07:06:24.025937 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:24 localhost hyperkube[1909]: I1120 07:06:24.028281 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:24 localhost hyperkube[1909]: I1120 07:06:24.028331 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:24 localhost hyperkube[1909]: I1120 07:06:24.028353 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:24 localhost hyperkube[1909]: E1120 07:06:24.028527 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:24 localhost systemd[1]: Started crio-conmon-fc4a997381f2d8e5884ffa846f5e27c347ffc9a84a462ddc9d91754bc4c8108c.scope. Nov 20 07:06:24 localhost systemd[1]: Created slice libcontainer_6280_systemd_test_default.slice. Nov 20 07:06:24 localhost systemd[1]: Removed slice libcontainer_6280_systemd_test_default.slice. Nov 20 07:06:24 localhost systemd[1]: Started libcontainer container fc4a997381f2d8e5884ffa846f5e27c347ffc9a84a462ddc9d91754bc4c8108c. Nov 20 07:06:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:24 localhost systemd[1]: Stopped libcontainer container fc4a997381f2d8e5884ffa846f5e27c347ffc9a84a462ddc9d91754bc4c8108c. Nov 20 07:06:24 localhost systemd[1]: crio-fc4a997381f2d8e5884ffa846f5e27c347ffc9a84a462ddc9d91754bc4c8108c.scope: Consumed 34ms CPU time Nov 20 07:06:24 localhost crio[1857]: time="2019-11-20 07:06:24.258066118Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:24 localhost hyperkube[1909]: E1120 07:06:24.325459 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:24 localhost hyperkube[1909]: E1120 07:06:24.325634 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:24 localhost hyperkube[1909]: E1120 07:06:24.325693 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:27.696Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fa426623-b9aa-4132-8a6b-e21539635438/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:27.697Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-27b5062c-9f52-4a52-81b0-1bd0acfcfa2c/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:27.697Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-45fd90e8-1828-4741-a573-b2fdfb026ee1/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:27 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:27 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:27 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:27 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:06:27 localhost systemd[1]: libpod-775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0.scope: Consumed 339ms CPU time Nov 20 07:06:27 localhost podman[6218]: 2019-11-20 07:06:27.744918354 +0000 UTC m=+5.657503445 container died 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:27 localhost podman[6218]: 2019-11-20 07:06:27.808801031 +0000 UTC m=+5.721386052 container remove 775fb0cdf7091a5eaf2aa65a0ab7c8a5038aaf2edb2fd1a03091ce631f1b56a0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:27 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:06:28 localhost hyperkube[1909]: I1120 07:06:28.867608 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:28 localhost hyperkube[1909]: I1120 07:06:28.869875 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:28 localhost hyperkube[1909]: I1120 07:06:28.869950 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:28 localhost hyperkube[1909]: I1120 07:06:28.869992 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:29 localhost hyperkube[1909]: I1120 07:06:29.025908 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:29 localhost hyperkube[1909]: I1120 07:06:29.028116 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:29 localhost hyperkube[1909]: I1120 07:06:29.028197 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:29 localhost hyperkube[1909]: I1120 07:06:29.028230 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:29 localhost hyperkube[1909]: E1120 07:06:29.028480 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:29 localhost systemd[1]: Started crio-conmon-ed7dc9c97450b7a14fe48257745b83dc51cba7b99f907b7de6b77aafc5b2a188.scope. Nov 20 07:06:29 localhost systemd[1]: Created slice libcontainer_6331_systemd_test_default.slice. Nov 20 07:06:29 localhost systemd[1]: Removed slice libcontainer_6331_systemd_test_default.slice. Nov 20 07:06:29 localhost systemd[1]: Started libcontainer container ed7dc9c97450b7a14fe48257745b83dc51cba7b99f907b7de6b77aafc5b2a188. Nov 20 07:06:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:29 localhost systemd[1]: Stopped libcontainer container ed7dc9c97450b7a14fe48257745b83dc51cba7b99f907b7de6b77aafc5b2a188. Nov 20 07:06:29 localhost systemd[1]: crio-ed7dc9c97450b7a14fe48257745b83dc51cba7b99f907b7de6b77aafc5b2a188.scope: Consumed 34ms CPU time Nov 20 07:06:29 localhost crio[1857]: time="2019-11-20 07:06:29.238528320Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:29 localhost hyperkube[1909]: E1120 07:06:29.286711 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:29 localhost hyperkube[1909]: E1120 07:06:29.286859 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:29 localhost hyperkube[1909]: E1120 07:06:29.286911 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:33 localhost podman[6360]: 2019-11-20 07:06:33.045220233 +0000 UTC m=+0.188863981 container create ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:33 localhost systemd[1]: Started libpod-conmon-ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b.scope. Nov 20 07:06:33 localhost systemd[1]: Created slice libcontainer_6373_systemd_test_default.slice. Nov 20 07:06:33 localhost systemd[1]: Removed slice libcontainer_6373_systemd_test_default.slice. Nov 20 07:06:33 localhost systemd[1]: Started libcontainer container ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b. Nov 20 07:06:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:33 localhost podman[6360]: 2019-11-20 07:06:33.450357037 +0000 UTC m=+0.594000787 container init ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:33 localhost podman[6360]: 2019-11-20 07:06:33.471555902 +0000 UTC m=+0.615199632 container start ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:33 localhost podman[6360]: 2019-11-20 07:06:33.471693728 +0000 UTC m=+0.615337459 container attach ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.026062 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.028206 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.028256 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.028278 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:38 localhost hyperkube[1909]: E1120 07:06:38.028526 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:38 localhost systemd[1]: Started crio-conmon-9cfe50efb76cfb1562c8ae09b6fbf51327dcd33295c8b9aeccc33dbcc9b19bad.scope. Nov 20 07:06:38 localhost systemd[1]: Created slice libcontainer_6414_systemd_test_default.slice. Nov 20 07:06:38 localhost systemd[1]: Removed slice libcontainer_6414_systemd_test_default.slice. Nov 20 07:06:38 localhost systemd[1]: Started libcontainer container 9cfe50efb76cfb1562c8ae09b6fbf51327dcd33295c8b9aeccc33dbcc9b19bad. Nov 20 07:06:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:38 localhost systemd[1]: Stopped libcontainer container 9cfe50efb76cfb1562c8ae09b6fbf51327dcd33295c8b9aeccc33dbcc9b19bad. Nov 20 07:06:38 localhost systemd[1]: crio-9cfe50efb76cfb1562c8ae09b6fbf51327dcd33295c8b9aeccc33dbcc9b19bad.scope: Consumed 35ms CPU time Nov 20 07:06:38 localhost crio[1857]: time="2019-11-20 07:06:38.233392117Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:38 localhost hyperkube[1909]: E1120 07:06:38.299219 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:38 localhost hyperkube[1909]: E1120 07:06:38.299392 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:38 localhost hyperkube[1909]: E1120 07:06:38.299479 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:38 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:38.487Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1b07c4ab-6a58-47d6-b74c-87c6cdc52c13/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:38 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:38.487Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2316a108-e897-4141-9b19-6cd5cbaa2561/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:38 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:38.488Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-aa4745f3-6717-4a91-a8ef-b835a4841fa4/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:38 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:38 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:38 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:38 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:06:38 localhost systemd[1]: libpod-ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b.scope: Consumed 332ms CPU time Nov 20 07:06:38 localhost podman[6360]: 2019-11-20 07:06:38.535715917 +0000 UTC m=+5.679359692 container died ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:38 localhost podman[6360]: 2019-11-20 07:06:38.593735307 +0000 UTC m=+5.737379105 container remove ba16dbfaadfd33e8fd12b4204fa7dcc8c28cbf08cf72fe398dc7113b772fca9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:38 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.895995 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.898742 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.898788 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:38 localhost hyperkube[1909]: I1120 07:06:38.898819 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:42 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:06:43 localhost podman[6487]: 2019-11-20 07:06:43.784534093 +0000 UTC m=+0.143273329 container create d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:43 localhost systemd[1]: Started libpod-conmon-d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425.scope. Nov 20 07:06:43 localhost systemd[1]: Created slice libcontainer_6502_systemd_test_default.slice. Nov 20 07:06:43 localhost systemd[1]: Removed slice libcontainer_6502_systemd_test_default.slice. Nov 20 07:06:43 localhost systemd[1]: Started libcontainer container d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425. Nov 20 07:06:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:44 localhost hyperkube[1909]: I1120 07:06:44.026083 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:44 localhost hyperkube[1909]: I1120 07:06:44.028427 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:44 localhost hyperkube[1909]: I1120 07:06:44.028486 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:44 localhost hyperkube[1909]: I1120 07:06:44.028508 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:44 localhost hyperkube[1909]: E1120 07:06:44.028720 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:44 localhost systemd[1]: Started crio-conmon-923e7c438baff221ed35af1553dfeae5600b280b3a41ad253ccd72d85e4cc22b.scope. Nov 20 07:06:44 localhost systemd[1]: Created slice libcontainer_6524_systemd_test_default.slice. Nov 20 07:06:44 localhost systemd[1]: Removed slice libcontainer_6524_systemd_test_default.slice. Nov 20 07:06:44 localhost systemd[1]: Started libcontainer container 923e7c438baff221ed35af1553dfeae5600b280b3a41ad253ccd72d85e4cc22b. Nov 20 07:06:44 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:44 localhost podman[6487]: 2019-11-20 07:06:44.235102585 +0000 UTC m=+0.593841884 container init d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:44 localhost systemd[1]: Stopped libcontainer container 923e7c438baff221ed35af1553dfeae5600b280b3a41ad253ccd72d85e4cc22b. Nov 20 07:06:44 localhost systemd[1]: crio-923e7c438baff221ed35af1553dfeae5600b280b3a41ad253ccd72d85e4cc22b.scope: Consumed 38ms CPU time Nov 20 07:06:44 localhost crio[1857]: time="2019-11-20 07:06:44.262579424Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:44 localhost podman[6487]: 2019-11-20 07:06:44.273110086 +0000 UTC m=+0.631849340 container start d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:44 localhost podman[6487]: 2019-11-20 07:06:44.273368347 +0000 UTC m=+0.632107650 container attach d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:44 localhost hyperkube[1909]: E1120 07:06:44.319666 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:44 localhost hyperkube[1909]: E1120 07:06:44.319810 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:44 localhost hyperkube[1909]: E1120 07:06:44.319880 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:48 localhost hyperkube[1909]: I1120 07:06:48.912996 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:48 localhost hyperkube[1909]: I1120 07:06:48.915928 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:48 localhost hyperkube[1909]: I1120 07:06:48.915994 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:48 localhost hyperkube[1909]: I1120 07:06:48.916067 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:49.275Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1348b5a0-10c7-45f5-b015-2e00e80a3b0b/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:49.275Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d2460d8e-de41-42ad-b08c-54aa7ba5b375/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:06:49.276Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1cb70939-a23c-4dec-9830-c60b4f0807b0/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:06:49 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:49 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:49 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:06:49 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:06:49 localhost systemd[1]: libpod-d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425.scope: Consumed 363ms CPU time Nov 20 07:06:49 localhost podman[6487]: 2019-11-20 07:06:49.320837355 +0000 UTC m=+5.679576648 container died d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:49 localhost podman[6487]: 2019-11-20 07:06:49.397973468 +0000 UTC m=+5.756712773 container remove d0326f1b93591f27bfb5b88c310256c94774cf97d5272d4377d8c5d9f8d70425 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:49 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:06:50 localhost hyperkube[1909]: I1120 07:06:50.026121 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:50 localhost hyperkube[1909]: I1120 07:06:50.028143 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:50 localhost hyperkube[1909]: I1120 07:06:50.028219 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:50 localhost hyperkube[1909]: I1120 07:06:50.028257 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:50 localhost hyperkube[1909]: E1120 07:06:50.028543 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:50 localhost systemd[1]: Started crio-conmon-56dcba935e7ef8f0f38aa697969a90a896ea0d6475b31ee623bfef35c6f52397.scope. Nov 20 07:06:50 localhost systemd[1]: Created slice libcontainer_6590_systemd_test_default.slice. Nov 20 07:06:50 localhost systemd[1]: Removed slice libcontainer_6590_systemd_test_default.slice. Nov 20 07:06:50 localhost systemd[1]: Started libcontainer container 56dcba935e7ef8f0f38aa697969a90a896ea0d6475b31ee623bfef35c6f52397. Nov 20 07:06:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:50 localhost systemd[1]: Stopped libcontainer container 56dcba935e7ef8f0f38aa697969a90a896ea0d6475b31ee623bfef35c6f52397. Nov 20 07:06:50 localhost systemd[1]: crio-56dcba935e7ef8f0f38aa697969a90a896ea0d6475b31ee623bfef35c6f52397.scope: Consumed 37ms CPU time Nov 20 07:06:50 localhost crio[1857]: time="2019-11-20 07:06:50.238062722Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:50 localhost hyperkube[1909]: E1120 07:06:50.285169 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:50 localhost hyperkube[1909]: E1120 07:06:50.285360 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:50 localhost hyperkube[1909]: E1120 07:06:50.285432 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:54 localhost podman[6619]: 2019-11-20 07:06:54.584774474 +0000 UTC m=+0.153062272 container create c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:54 localhost systemd[1]: Started libpod-conmon-c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b.scope. Nov 20 07:06:54 localhost systemd[1]: Created slice libcontainer_6633_systemd_test_default.slice. Nov 20 07:06:54 localhost systemd[1]: Removed slice libcontainer_6633_systemd_test_default.slice. Nov 20 07:06:54 localhost systemd[1]: Started libcontainer container c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b. Nov 20 07:06:54 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:54 localhost podman[6619]: 2019-11-20 07:06:54.97514007 +0000 UTC m=+0.543427843 container init c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:54 localhost podman[6619]: 2019-11-20 07:06:54.995403025 +0000 UTC m=+0.563690799 container start c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:54 localhost podman[6619]: 2019-11-20 07:06:54.995541163 +0000 UTC m=+0.563828953 container attach c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:06:58 localhost hyperkube[1909]: I1120 07:06:58.936100 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:58 localhost hyperkube[1909]: I1120 07:06:58.938642 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:58 localhost hyperkube[1909]: I1120 07:06:58.938700 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:58 localhost hyperkube[1909]: I1120 07:06:58.938750 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:59 localhost hyperkube[1909]: I1120 07:06:59.025951 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:06:59 localhost hyperkube[1909]: I1120 07:06:59.028299 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:06:59 localhost hyperkube[1909]: I1120 07:06:59.028364 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:06:59 localhost hyperkube[1909]: I1120 07:06:59.028402 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:06:59 localhost hyperkube[1909]: E1120 07:06:59.028692 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:06:59 localhost systemd[1]: Started crio-conmon-97c08d1193806e85f97be7fbdc998e70b4b26d10f06cca1401489328514bb600.scope. Nov 20 07:06:59 localhost systemd[1]: Created slice libcontainer_6673_systemd_test_default.slice. Nov 20 07:06:59 localhost systemd[1]: Removed slice libcontainer_6673_systemd_test_default.slice. Nov 20 07:06:59 localhost systemd[1]: Started libcontainer container 97c08d1193806e85f97be7fbdc998e70b4b26d10f06cca1401489328514bb600. Nov 20 07:06:59 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:06:59 localhost systemd[1]: Stopped libcontainer container 97c08d1193806e85f97be7fbdc998e70b4b26d10f06cca1401489328514bb600. Nov 20 07:06:59 localhost systemd[1]: crio-97c08d1193806e85f97be7fbdc998e70b4b26d10f06cca1401489328514bb600.scope: Consumed 38ms CPU time Nov 20 07:06:59 localhost crio[1857]: time="2019-11-20 07:06:59.244151950Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:06:59 localhost hyperkube[1909]: E1120 07:06:59.303643 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:59 localhost hyperkube[1909]: E1120 07:06:59.303784 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:06:59 localhost hyperkube[1909]: E1120 07:06:59.303843 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:00.009Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e5bbe521-a13c-41cc-a91a-bbd654993412/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:00.009Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c08620f2-c02a-42e2-a6b3-667fa9b12433/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:00.009Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-eb45462e-6d5a-44b2-894e-2b9b143c9bd9/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:00 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:00 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:00 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:00 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:07:00 localhost podman[6619]: 2019-11-20 07:07:00.029351069 +0000 UTC m=+5.597638912 container died c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:00 localhost systemd[1]: libpod-c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b.scope: Consumed 331ms CPU time Nov 20 07:07:00 localhost podman[6619]: 2019-11-20 07:07:00.097171346 +0000 UTC m=+5.665459187 container remove c20294ff89226817eceaa1758ea896e0a794dc603a30f8673fc291842d96344b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:00 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:07:02 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:07:05 localhost hyperkube[1909]: I1120 07:07:05.025960 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:05 localhost hyperkube[1909]: I1120 07:07:05.028094 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:05 localhost hyperkube[1909]: I1120 07:07:05.028144 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:05 localhost hyperkube[1909]: I1120 07:07:05.028164 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:05 localhost hyperkube[1909]: E1120 07:07:05.028341 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:05 localhost systemd[1]: Started crio-conmon-e48de52d1e55ef3f065e6c70dbc43066b477ce492a1a8ba816b8a79417ad81ba.scope. Nov 20 07:07:05 localhost systemd[1]: Created slice libcontainer_6740_systemd_test_default.slice. Nov 20 07:07:05 localhost systemd[1]: Removed slice libcontainer_6740_systemd_test_default.slice. Nov 20 07:07:05 localhost systemd[1]: Started libcontainer container e48de52d1e55ef3f065e6c70dbc43066b477ce492a1a8ba816b8a79417ad81ba. Nov 20 07:07:05 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:05 localhost systemd[1]: Stopped libcontainer container e48de52d1e55ef3f065e6c70dbc43066b477ce492a1a8ba816b8a79417ad81ba. Nov 20 07:07:05 localhost crio[1857]: time="2019-11-20 07:07:05.234472843Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:05 localhost hyperkube[1909]: E1120 07:07:05.301273 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:05 localhost hyperkube[1909]: E1120 07:07:05.301441 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:05 localhost hyperkube[1909]: E1120 07:07:05.301509 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:05 localhost podman[6747]: 2019-11-20 07:07:05.318198264 +0000 UTC m=+0.179699207 container create 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:05 localhost systemd[1]: Started libpod-conmon-736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c.scope. Nov 20 07:07:05 localhost systemd[1]: Created slice libcontainer_6785_systemd_test_default.slice. Nov 20 07:07:05 localhost systemd[1]: Removed slice libcontainer_6785_systemd_test_default.slice. Nov 20 07:07:05 localhost systemd[1]: Started libcontainer container 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c. Nov 20 07:07:05 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:05 localhost podman[6747]: 2019-11-20 07:07:05.745716848 +0000 UTC m=+0.607217787 container init 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:05 localhost podman[6747]: 2019-11-20 07:07:05.769856607 +0000 UTC m=+0.631357550 container start 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:05 localhost podman[6747]: 2019-11-20 07:07:05.770511023 +0000 UTC m=+0.632011998 container attach 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:08 localhost hyperkube[1909]: I1120 07:07:08.957469 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:08 localhost hyperkube[1909]: I1120 07:07:08.959724 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:08 localhost hyperkube[1909]: I1120 07:07:08.959783 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:08 localhost hyperkube[1909]: I1120 07:07:08.959807 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:10.787Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-15853211-6143-4039-a3a5-33136fb7134f/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:10.787Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-4e6845f9-a7ae-4294-9fea-1ef42a5c2081/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:10.787Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-61df95ab-b3d8-4f31-9c19-d77acbc9633b/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:10 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:10 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:10 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:10 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:07:10 localhost podman[6747]: 2019-11-20 07:07:10.812633068 +0000 UTC m=+5.674134052 container died 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:10 localhost systemd[1]: libpod-736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c.scope: Consumed 362ms CPU time Nov 20 07:07:10 localhost podman[6747]: 2019-11-20 07:07:10.872138684 +0000 UTC m=+5.733639665 container remove 736b3d0c4d86f0e90679c7f5131323e47ad9147e7059b01fd6752e702e17d44c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:10 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:07:11 localhost hyperkube[1909]: I1120 07:07:11.026275 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:11 localhost hyperkube[1909]: I1120 07:07:11.028623 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:11 localhost hyperkube[1909]: I1120 07:07:11.028686 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:11 localhost hyperkube[1909]: I1120 07:07:11.028722 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:11 localhost hyperkube[1909]: E1120 07:07:11.029026 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:11 localhost systemd[1]: Started crio-conmon-e9bb285c27f3c0a65ef07b32e16c0830c43e76fb6af43a759ba15a6384189d7a.scope. Nov 20 07:07:11 localhost systemd[1]: Created slice libcontainer_6846_systemd_test_default.slice. Nov 20 07:07:11 localhost systemd[1]: Removed slice libcontainer_6846_systemd_test_default.slice. Nov 20 07:07:11 localhost systemd[1]: Started libcontainer container e9bb285c27f3c0a65ef07b32e16c0830c43e76fb6af43a759ba15a6384189d7a. Nov 20 07:07:11 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:11 localhost systemd[1]: Stopped libcontainer container e9bb285c27f3c0a65ef07b32e16c0830c43e76fb6af43a759ba15a6384189d7a. Nov 20 07:07:11 localhost crio[1857]: time="2019-11-20 07:07:11.303824557Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:11 localhost hyperkube[1909]: E1120 07:07:11.352532 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:11 localhost hyperkube[1909]: E1120 07:07:11.352702 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:11 localhost hyperkube[1909]: E1120 07:07:11.352851 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:16 localhost podman[6875]: 2019-11-20 07:07:16.066996873 +0000 UTC m=+0.161558410 container create bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:16 localhost systemd[1851]: Starting Cleanup of User's Temporary Files and Directories... Nov 20 07:07:16 localhost systemd[1]: Started libpod-conmon-bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c.scope. Nov 20 07:07:16 localhost systemd[1851]: Started Cleanup of User's Temporary Files and Directories. Nov 20 07:07:16 localhost systemd[1]: Created slice libcontainer_6890_systemd_test_default.slice. Nov 20 07:07:16 localhost systemd[1]: Removed slice libcontainer_6890_systemd_test_default.slice. Nov 20 07:07:16 localhost systemd[1]: Started libcontainer container bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c. Nov 20 07:07:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:16 localhost podman[6875]: 2019-11-20 07:07:16.536842743 +0000 UTC m=+0.631404300 container init bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:16 localhost podman[6875]: 2019-11-20 07:07:16.562217317 +0000 UTC m=+0.656778882 container start bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:16 localhost podman[6875]: 2019-11-20 07:07:16.562405968 +0000 UTC m=+0.656967499 container attach bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:18 localhost hyperkube[1909]: I1120 07:07:18.975098 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:18 localhost hyperkube[1909]: I1120 07:07:18.977811 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:18 localhost hyperkube[1909]: I1120 07:07:18.977868 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:18 localhost hyperkube[1909]: I1120 07:07:18.977891 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:19 localhost hyperkube[1909]: I1120 07:07:19.026067 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:19 localhost hyperkube[1909]: I1120 07:07:19.028528 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:19 localhost hyperkube[1909]: I1120 07:07:19.028594 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:19 localhost hyperkube[1909]: I1120 07:07:19.028631 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:19 localhost hyperkube[1909]: E1120 07:07:19.028980 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:19 localhost systemd[1]: Started crio-conmon-7fedadfa3ecb1c9aabc8ae18bf46528ad6103c7baa5bed0e5cb6acbf123e22f4.scope. Nov 20 07:07:19 localhost systemd[1]: Created slice libcontainer_6933_systemd_test_default.slice. Nov 20 07:07:19 localhost systemd[1]: Removed slice libcontainer_6933_systemd_test_default.slice. Nov 20 07:07:19 localhost systemd[1]: Started libcontainer container 7fedadfa3ecb1c9aabc8ae18bf46528ad6103c7baa5bed0e5cb6acbf123e22f4. Nov 20 07:07:19 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:19 localhost systemd[1]: Stopped libcontainer container 7fedadfa3ecb1c9aabc8ae18bf46528ad6103c7baa5bed0e5cb6acbf123e22f4. Nov 20 07:07:19 localhost systemd[1]: crio-7fedadfa3ecb1c9aabc8ae18bf46528ad6103c7baa5bed0e5cb6acbf123e22f4.scope: Consumed 43ms CPU time Nov 20 07:07:19 localhost crio[1857]: time="2019-11-20 07:07:19.261969721Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:19 localhost hyperkube[1909]: E1120 07:07:19.316580 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:19 localhost hyperkube[1909]: E1120 07:07:19.316774 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:19 localhost hyperkube[1909]: E1120 07:07:19.316858 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:21.577Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-44dcf2f4-6a58-43cc-b6f2-188ddfb5724d/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:21.577Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d41e964a-bb6d-4fca-a114-038a052c8153/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:21.577Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2837744b-878c-4446-80b7-bba7c06a999d/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:21 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:21 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:21 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:21 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:07:21 localhost systemd[1]: libpod-bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c.scope: Consumed 375ms CPU time Nov 20 07:07:21 localhost podman[6875]: 2019-11-20 07:07:21.626712255 +0000 UTC m=+5.721273843 container died bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:21 localhost podman[6875]: 2019-11-20 07:07:21.694890697 +0000 UTC m=+5.789452290 container remove bfa3f0313fa9e18b98a82fd5ff4fd8325909522518b6a9ab2cd088ab2d379e6c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:21 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:07:22 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:07:23 localhost hyperkube[1909]: I1120 07:07:23.025945 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:23 localhost hyperkube[1909]: I1120 07:07:23.028452 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:23 localhost hyperkube[1909]: I1120 07:07:23.028525 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:23 localhost hyperkube[1909]: I1120 07:07:23.028562 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:23 localhost hyperkube[1909]: E1120 07:07:23.028863 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:23 localhost systemd[1]: Started crio-conmon-8dcab712208238f26e52c1f68ae3fbd37781e12a0160b589bb398933db8afedd.scope. Nov 20 07:07:23 localhost systemd[1]: Created slice libcontainer_6999_systemd_test_default.slice. Nov 20 07:07:23 localhost systemd[1]: Removed slice libcontainer_6999_systemd_test_default.slice. Nov 20 07:07:23 localhost systemd[1]: Started libcontainer container 8dcab712208238f26e52c1f68ae3fbd37781e12a0160b589bb398933db8afedd. Nov 20 07:07:23 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:23 localhost systemd[1]: Stopped libcontainer container 8dcab712208238f26e52c1f68ae3fbd37781e12a0160b589bb398933db8afedd. Nov 20 07:07:23 localhost systemd[1]: crio-8dcab712208238f26e52c1f68ae3fbd37781e12a0160b589bb398933db8afedd.scope: Consumed 38ms CPU time Nov 20 07:07:23 localhost crio[1857]: time="2019-11-20 07:07:23.245338545Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:23 localhost hyperkube[1909]: E1120 07:07:23.293209 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:23 localhost hyperkube[1909]: E1120 07:07:23.293398 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:23 localhost hyperkube[1909]: E1120 07:07:23.293469 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:26 localhost podman[7028]: 2019-11-20 07:07:26.889351222 +0000 UTC m=+0.156061778 container create e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:26 localhost systemd[1]: Started libpod-conmon-e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998.scope. Nov 20 07:07:26 localhost systemd[1]: Created slice libcontainer_7041_systemd_test_default.slice. Nov 20 07:07:26 localhost systemd[1]: Removed slice libcontainer_7041_systemd_test_default.slice. Nov 20 07:07:26 localhost systemd[1]: Started libcontainer container e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998. Nov 20 07:07:27 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:27 localhost podman[7028]: 2019-11-20 07:07:27.344958847 +0000 UTC m=+0.611669399 container init e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:27 localhost podman[7028]: 2019-11-20 07:07:27.373601112 +0000 UTC m=+0.640311675 container start e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:27 localhost podman[7028]: 2019-11-20 07:07:27.373821177 +0000 UTC m=+0.640531809 container attach e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:28 localhost hyperkube[1909]: I1120 07:07:28.994663 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:28 localhost hyperkube[1909]: I1120 07:07:28.996747 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:28 localhost hyperkube[1909]: I1120 07:07:28.996786 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:28 localhost hyperkube[1909]: I1120 07:07:28.996805 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:32 localhost hyperkube[1909]: I1120 07:07:32.025930 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:32 localhost hyperkube[1909]: I1120 07:07:32.028040 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:32 localhost hyperkube[1909]: I1120 07:07:32.028091 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:32 localhost hyperkube[1909]: I1120 07:07:32.028114 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:32 localhost hyperkube[1909]: E1120 07:07:32.028351 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:32 localhost systemd[1]: Started crio-conmon-51f293a4efa3a2f33546fc8982dbf6a5da59c97ce6096c637074a9a38028e384.scope. Nov 20 07:07:32 localhost systemd[1]: Created slice libcontainer_7084_systemd_test_default.slice. Nov 20 07:07:32 localhost systemd[1]: Removed slice libcontainer_7084_systemd_test_default.slice. Nov 20 07:07:32 localhost systemd[1]: Started libcontainer container 51f293a4efa3a2f33546fc8982dbf6a5da59c97ce6096c637074a9a38028e384. Nov 20 07:07:32 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:32 localhost systemd[1]: Stopped libcontainer container 51f293a4efa3a2f33546fc8982dbf6a5da59c97ce6096c637074a9a38028e384. Nov 20 07:07:32 localhost systemd[1]: crio-51f293a4efa3a2f33546fc8982dbf6a5da59c97ce6096c637074a9a38028e384.scope: Consumed 48ms CPU time Nov 20 07:07:32 localhost crio[1857]: time="2019-11-20 07:07:32.287835285Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:32 localhost hyperkube[1909]: E1120 07:07:32.343715 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:32 localhost hyperkube[1909]: E1120 07:07:32.343871 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:32 localhost hyperkube[1909]: E1120 07:07:32.343939 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:32 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:32.390Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8d61293c-daac-4aac-a31b-4bfc0e78ce16/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:32 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:32.390Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-241ef593-c599-4a1e-b5f5-abda0a61916a/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:32 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:32.390Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a42e5814-52f3-4d2f-8a69-6909df9bc406/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:32 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:32 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:32 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:32 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:07:32 localhost systemd[1]: libpod-e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998.scope: Consumed 390ms CPU time Nov 20 07:07:32 localhost podman[7028]: 2019-11-20 07:07:32.440696471 +0000 UTC m=+5.707407045 container died e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:32 localhost podman[7028]: 2019-11-20 07:07:32.503554538 +0000 UTC m=+5.770265116 container remove e9ef2a3155dfb59febb1d35ebac538ec4403c3b40c484044cca1d9927e76a998 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:32 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:07:35 localhost hyperkube[1909]: I1120 07:07:35.026076 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:35 localhost hyperkube[1909]: I1120 07:07:35.028119 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:35 localhost hyperkube[1909]: I1120 07:07:35.028170 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:35 localhost hyperkube[1909]: I1120 07:07:35.028191 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:35 localhost hyperkube[1909]: E1120 07:07:35.028384 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:35 localhost systemd[1]: Started crio-conmon-3ba6d86cc56a55695878dfa7328bc3cb38041b34bd41d747591dacd2c3f841ff.scope. Nov 20 07:07:35 localhost systemd[1]: Created slice libcontainer_7136_systemd_test_default.slice. Nov 20 07:07:35 localhost systemd[1]: Removed slice libcontainer_7136_systemd_test_default.slice. Nov 20 07:07:35 localhost systemd[1]: Started libcontainer container 3ba6d86cc56a55695878dfa7328bc3cb38041b34bd41d747591dacd2c3f841ff. Nov 20 07:07:35 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:35 localhost systemd[1]: Stopped libcontainer container 3ba6d86cc56a55695878dfa7328bc3cb38041b34bd41d747591dacd2c3f841ff. Nov 20 07:07:35 localhost systemd[1]: crio-3ba6d86cc56a55695878dfa7328bc3cb38041b34bd41d747591dacd2c3f841ff.scope: Consumed 31ms CPU time Nov 20 07:07:35 localhost crio[1857]: time="2019-11-20 07:07:35.255601062Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:35 localhost hyperkube[1909]: E1120 07:07:35.305631 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:35 localhost hyperkube[1909]: E1120 07:07:35.305801 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:35 localhost hyperkube[1909]: E1120 07:07:35.305875 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:37 localhost podman[7166]: 2019-11-20 07:07:37.682155845 +0000 UTC m=+0.143510571 container create d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:37 localhost systemd[1]: Started libpod-conmon-d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702.scope. Nov 20 07:07:37 localhost systemd[1]: Created slice libcontainer_7180_systemd_test_default.slice. Nov 20 07:07:37 localhost systemd[1]: Removed slice libcontainer_7180_systemd_test_default.slice. Nov 20 07:07:37 localhost systemd[1]: Started libcontainer container d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702. Nov 20 07:07:37 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:38 localhost hyperkube[1909]: I1120 07:07:38.025373 1909 kubelet.go:1312] Image garbage collection succeeded Nov 20 07:07:38 localhost podman[7166]: 2019-11-20 07:07:38.087890995 +0000 UTC m=+0.549245723 container init d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:38 localhost podman[7166]: 2019-11-20 07:07:38.111985367 +0000 UTC m=+0.573340108 container start d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:38 localhost podman[7166]: 2019-11-20 07:07:38.11217238 +0000 UTC m=+0.573527121 container attach d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:38 localhost hyperkube[1909]: E1120 07:07:38.214472 1909 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service Nov 20 07:07:39 localhost hyperkube[1909]: I1120 07:07:39.011601 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:39 localhost hyperkube[1909]: I1120 07:07:39.014355 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:39 localhost hyperkube[1909]: I1120 07:07:39.014415 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:39 localhost hyperkube[1909]: I1120 07:07:39.014438 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:42 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:07:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:43.125Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-19d4ffc3-2681-4ae9-8921-8e1cc10cf44a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:43.125Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2888ce28-3f95-4264-b846-c67a8848ed3c/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:43.124Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a32fdb44-8a26-4424-a95f-1a25d20ad6da/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:43 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:43 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:43 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:43 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:07:43 localhost systemd[1]: libpod-d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702.scope: Consumed 343ms CPU time Nov 20 07:07:43 localhost podman[7166]: 2019-11-20 07:07:43.170593802 +0000 UTC m=+5.631948572 container died d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:43 localhost podman[7166]: 2019-11-20 07:07:43.248495809 +0000 UTC m=+5.709850599 container remove d0289f8575cb9a7a6e39087d67ff14abd6804adcdea0207c5ae9964060dc4702 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:43 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:07:46 localhost hyperkube[1909]: I1120 07:07:46.026075 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:46 localhost hyperkube[1909]: I1120 07:07:46.028153 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:46 localhost hyperkube[1909]: I1120 07:07:46.028197 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:46 localhost hyperkube[1909]: I1120 07:07:46.028217 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:46 localhost hyperkube[1909]: E1120 07:07:46.028395 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:46 localhost systemd[1]: Started crio-conmon-bf4c60db289cafc92d35775378be44b7dc7400637756bb0e1e9880fd3c4b228f.scope. Nov 20 07:07:46 localhost systemd[1]: Created slice libcontainer_7267_systemd_test_default.slice. Nov 20 07:07:46 localhost systemd[1]: Removed slice libcontainer_7267_systemd_test_default.slice. Nov 20 07:07:46 localhost systemd[1]: Started libcontainer container bf4c60db289cafc92d35775378be44b7dc7400637756bb0e1e9880fd3c4b228f. Nov 20 07:07:46 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:46 localhost systemd[1]: Stopped libcontainer container bf4c60db289cafc92d35775378be44b7dc7400637756bb0e1e9880fd3c4b228f. Nov 20 07:07:46 localhost systemd[1]: crio-bf4c60db289cafc92d35775378be44b7dc7400637756bb0e1e9880fd3c4b228f.scope: Consumed 36ms CPU time Nov 20 07:07:46 localhost crio[1857]: time="2019-11-20 07:07:46.258639007Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:46 localhost hyperkube[1909]: E1120 07:07:46.313593 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:46 localhost hyperkube[1909]: E1120 07:07:46.313794 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:46 localhost hyperkube[1909]: E1120 07:07:46.313868 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:48 localhost hyperkube[1909]: I1120 07:07:48.026213 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:48 localhost hyperkube[1909]: I1120 07:07:48.028743 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:48 localhost hyperkube[1909]: I1120 07:07:48.028819 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:48 localhost hyperkube[1909]: I1120 07:07:48.028855 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:48 localhost hyperkube[1909]: E1120 07:07:48.029455 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:48 localhost podman[7296]: 2019-11-20 07:07:48.470051179 +0000 UTC m=+0.187273949 container create e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:48 localhost systemd[1]: Started libpod-conmon-e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d.scope. Nov 20 07:07:48 localhost systemd[1]: Created slice libcontainer_7310_systemd_test_default.slice. Nov 20 07:07:48 localhost systemd[1]: Removed slice libcontainer_7310_systemd_test_default.slice. Nov 20 07:07:48 localhost systemd[1]: Started libcontainer container e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d. Nov 20 07:07:48 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:48 localhost podman[7296]: 2019-11-20 07:07:48.887422004 +0000 UTC m=+0.604644798 container init e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:48 localhost podman[7296]: 2019-11-20 07:07:48.912568735 +0000 UTC m=+0.629791546 container start e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:48 localhost podman[7296]: 2019-11-20 07:07:48.912902788 +0000 UTC m=+0.630125606 container attach e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:49 localhost hyperkube[1909]: I1120 07:07:49.029291 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:49 localhost hyperkube[1909]: I1120 07:07:49.031798 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:49 localhost hyperkube[1909]: I1120 07:07:49.031853 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:49 localhost hyperkube[1909]: I1120 07:07:49.031875 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:50 localhost hyperkube[1909]: I1120 07:07:50.026393 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:50 localhost hyperkube[1909]: I1120 07:07:50.032407 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:50 localhost hyperkube[1909]: I1120 07:07:50.032492 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:50 localhost hyperkube[1909]: I1120 07:07:50.032528 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:50 localhost hyperkube[1909]: E1120 07:07:50.032921 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:50 localhost systemd[1]: Started crio-conmon-a71cf1c72501c62a8bfc642104a61183afb102ed1c5125f97e9d998701c15d65.scope. Nov 20 07:07:50 localhost systemd[1]: Created slice libcontainer_7347_systemd_test_default.slice. Nov 20 07:07:50 localhost systemd[1]: Removed slice libcontainer_7347_systemd_test_default.slice. Nov 20 07:07:50 localhost systemd[1]: Started libcontainer container a71cf1c72501c62a8bfc642104a61183afb102ed1c5125f97e9d998701c15d65. Nov 20 07:07:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:50 localhost systemd[1]: Stopped libcontainer container a71cf1c72501c62a8bfc642104a61183afb102ed1c5125f97e9d998701c15d65. Nov 20 07:07:50 localhost systemd[1]: crio-a71cf1c72501c62a8bfc642104a61183afb102ed1c5125f97e9d998701c15d65.scope: Consumed 34ms CPU time Nov 20 07:07:50 localhost crio[1857]: time="2019-11-20 07:07:50.250491108Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:50 localhost hyperkube[1909]: E1120 07:07:50.306075 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:50 localhost hyperkube[1909]: E1120 07:07:50.306264 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:50 localhost hyperkube[1909]: E1120 07:07:50.306336 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:53.928Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5a62adb5-eb15-40d2-af54-37c5c2cb0a72/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:53.929Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-647a2bed-cf58-4af7-abbf-a689acd9b3e2/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:07:53.929Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ae1b0554-4bb2-46e3-a7e1-16859cc7012b/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:07:53 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:53 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:53 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:07:53 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:07:53 localhost systemd[1]: libpod-e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d.scope: Consumed 350ms CPU time Nov 20 07:07:53 localhost podman[7296]: 2019-11-20 07:07:53.970654442 +0000 UTC m=+5.687877277 container died e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:54 localhost podman[7296]: 2019-11-20 07:07:54.045911737 +0000 UTC m=+5.763134546 container remove e1a1650c0f2c2a5ae0caad8f860c00343f58b78d68d2a5d3dd776b55c6633a5d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:54 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:07:58 localhost hyperkube[1909]: I1120 07:07:58.026491 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:58 localhost hyperkube[1909]: I1120 07:07:58.029539 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:58 localhost hyperkube[1909]: I1120 07:07:58.029597 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:58 localhost hyperkube[1909]: I1120 07:07:58.029630 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:58 localhost hyperkube[1909]: E1120 07:07:58.029916 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:07:58 localhost systemd[1]: Started crio-conmon-3d94c3ad9d59e328f2e022335bd96b0595803b325b144f4362f79e3d8af806a9.scope. Nov 20 07:07:58 localhost systemd[1]: Created slice libcontainer_7403_systemd_test_default.slice. Nov 20 07:07:58 localhost systemd[1]: Removed slice libcontainer_7403_systemd_test_default.slice. Nov 20 07:07:58 localhost systemd[1]: Started libcontainer container 3d94c3ad9d59e328f2e022335bd96b0595803b325b144f4362f79e3d8af806a9. Nov 20 07:07:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:58 localhost systemd[1]: Stopped libcontainer container 3d94c3ad9d59e328f2e022335bd96b0595803b325b144f4362f79e3d8af806a9. Nov 20 07:07:58 localhost systemd[1]: crio-3d94c3ad9d59e328f2e022335bd96b0595803b325b144f4362f79e3d8af806a9.scope: Consumed 43ms CPU time Nov 20 07:07:58 localhost crio[1857]: time="2019-11-20 07:07:58.274147459Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:58 localhost hyperkube[1909]: E1120 07:07:58.339988 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:58 localhost hyperkube[1909]: E1120 07:07:58.340195 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:07:58 localhost hyperkube[1909]: E1120 07:07:58.340248 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:07:59 localhost hyperkube[1909]: I1120 07:07:59.046227 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:07:59 localhost hyperkube[1909]: I1120 07:07:59.048415 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:07:59 localhost hyperkube[1909]: I1120 07:07:59.048485 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:07:59 localhost hyperkube[1909]: I1120 07:07:59.048508 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:07:59 localhost podman[7431]: 2019-11-20 07:07:59.252827521 +0000 UTC m=+0.160435633 container create af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:59 localhost systemd[1]: Started libpod-conmon-af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103.scope. Nov 20 07:07:59 localhost systemd[1]: Created slice libcontainer_7445_systemd_test_default.slice. Nov 20 07:07:59 localhost systemd[1]: Removed slice libcontainer_7445_systemd_test_default.slice. Nov 20 07:07:59 localhost systemd[1]: Started libcontainer container af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103. Nov 20 07:07:59 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:07:59 localhost podman[7431]: 2019-11-20 07:07:59.688834603 +0000 UTC m=+0.596442722 container init af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:59 localhost podman[7431]: 2019-11-20 07:07:59.710319386 +0000 UTC m=+0.617927528 container start af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:07:59 localhost podman[7431]: 2019-11-20 07:07:59.710519402 +0000 UTC m=+0.618127528 container attach af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:03 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:08:03 localhost hyperkube[1909]: I1120 07:08:03.025873 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:03 localhost hyperkube[1909]: I1120 07:08:03.028229 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:03 localhost hyperkube[1909]: I1120 07:08:03.028285 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:03 localhost hyperkube[1909]: I1120 07:08:03.028309 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:03 localhost hyperkube[1909]: E1120 07:08:03.028533 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:03 localhost systemd[1]: Started crio-conmon-4c36069d79cf90837dfabc5b9c047112e2d130eb41e46317ee94aa33209e3bdb.scope. Nov 20 07:08:03 localhost systemd[1]: Created slice libcontainer_7498_systemd_test_default.slice. Nov 20 07:08:03 localhost systemd[1]: Removed slice libcontainer_7498_systemd_test_default.slice. Nov 20 07:08:03 localhost systemd[1]: Started libcontainer container 4c36069d79cf90837dfabc5b9c047112e2d130eb41e46317ee94aa33209e3bdb. Nov 20 07:08:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:03 localhost systemd[1]: Stopped libcontainer container 4c36069d79cf90837dfabc5b9c047112e2d130eb41e46317ee94aa33209e3bdb. Nov 20 07:08:03 localhost systemd[1]: crio-4c36069d79cf90837dfabc5b9c047112e2d130eb41e46317ee94aa33209e3bdb.scope: Consumed 38ms CPU time Nov 20 07:08:03 localhost crio[1857]: time="2019-11-20 07:08:03.247629708Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:03 localhost hyperkube[1909]: E1120 07:08:03.301105 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:03 localhost hyperkube[1909]: E1120 07:08:03.301243 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:03 localhost hyperkube[1909]: E1120 07:08:03.301294 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:04.731Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b53cb702-8b80-436f-beb7-777bdcfb2455/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:04.731Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-70ce01d1-4f10-4373-aa85-7e08bf96c08a/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:04.731Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ce3ab329-ac9e-461b-ad3e-8fc38293a8c0/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:04 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:04 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:04 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:04 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:08:04 localhost systemd[1]: libpod-af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103.scope: Consumed 362ms CPU time Nov 20 07:08:04 localhost podman[7431]: 2019-11-20 07:08:04.777861133 +0000 UTC m=+5.685469289 container died af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:04 localhost podman[7431]: 2019-11-20 07:08:04.849287564 +0000 UTC m=+5.756895702 container remove af2057a1b2592a26021ca83c7b896c3937525f53a988251dfe0ba230c58a4103 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:04 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.026269 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.028704 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.028761 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.028784 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:09 localhost hyperkube[1909]: E1120 07:08:09.028992 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.063038 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.065667 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.065718 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:09 localhost hyperkube[1909]: I1120 07:08:09.065752 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:09 localhost systemd[1]: Started crio-conmon-4b728a7ae42ab86214f823841c28ba68da167f911dd8294a1ecf4d379bb1471b.scope. Nov 20 07:08:09 localhost systemd[1]: Created slice libcontainer_7551_systemd_test_default.slice. Nov 20 07:08:09 localhost systemd[1]: Removed slice libcontainer_7551_systemd_test_default.slice. Nov 20 07:08:09 localhost systemd[1]: Started libcontainer container 4b728a7ae42ab86214f823841c28ba68da167f911dd8294a1ecf4d379bb1471b. Nov 20 07:08:09 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:09 localhost systemd[1]: Stopped libcontainer container 4b728a7ae42ab86214f823841c28ba68da167f911dd8294a1ecf4d379bb1471b. Nov 20 07:08:09 localhost systemd[1]: crio-4b728a7ae42ab86214f823841c28ba68da167f911dd8294a1ecf4d379bb1471b.scope: Consumed 37ms CPU time Nov 20 07:08:09 localhost crio[1857]: time="2019-11-20 07:08:09.248617545Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:09 localhost hyperkube[1909]: E1120 07:08:09.304691 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:09 localhost hyperkube[1909]: E1120 07:08:09.304872 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:09 localhost hyperkube[1909]: E1120 07:08:09.304951 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:10 localhost podman[7579]: 2019-11-20 07:08:10.043644258 +0000 UTC m=+0.160529430 container create e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:10 localhost systemd[1]: Started libpod-conmon-e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48.scope. Nov 20 07:08:10 localhost systemd[1]: Created slice libcontainer_7593_systemd_test_default.slice. Nov 20 07:08:10 localhost systemd[1]: Removed slice libcontainer_7593_systemd_test_default.slice. Nov 20 07:08:10 localhost systemd[1]: Started libcontainer container e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48. Nov 20 07:08:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:10 localhost podman[7579]: 2019-11-20 07:08:10.503132591 +0000 UTC m=+0.620017776 container init e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:10 localhost podman[7579]: 2019-11-20 07:08:10.52579452 +0000 UTC m=+0.642679683 container start e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:10 localhost podman[7579]: 2019-11-20 07:08:10.526059049 +0000 UTC m=+0.642944270 container attach e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:15.538Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b7878c47-d86c-493e-a35c-732b29f99b97/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:15.538Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ccfbc7b6-e6b6-45de-983d-5c75f42b3e47/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:15.538Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-de535480-4d23-4af9-a70c-bda70d02fcda/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:15 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:15 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:15 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:15 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:08:15 localhost podman[7579]: 2019-11-20 07:08:15.562764267 +0000 UTC m=+5.679649481 container died e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:15 localhost systemd[1]: libpod-e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48.scope: Consumed 375ms CPU time Nov 20 07:08:15 localhost podman[7579]: 2019-11-20 07:08:15.656911259 +0000 UTC m=+5.773796468 container remove e8d2fd786d0cce19c00c21efcf0e029f752544d88e1218471a79e648aa440e48 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:15 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.026031 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.029131 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.029213 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.029253 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:19 localhost hyperkube[1909]: E1120 07:08:19.029560 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:19 localhost systemd[1]: Started crio-conmon-a98bffc04bfb7c5c12295dbe31dac2e97182705464c2e32937b355ffd9150c50.scope. Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.089855 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.094300 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.094355 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:19 localhost hyperkube[1909]: I1120 07:08:19.094375 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:19 localhost systemd[1]: Created slice libcontainer_7653_systemd_test_default.slice. Nov 20 07:08:19 localhost systemd[1]: Removed slice libcontainer_7653_systemd_test_default.slice. Nov 20 07:08:19 localhost systemd[1]: Started libcontainer container a98bffc04bfb7c5c12295dbe31dac2e97182705464c2e32937b355ffd9150c50. Nov 20 07:08:19 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:19 localhost systemd[1]: Stopped libcontainer container a98bffc04bfb7c5c12295dbe31dac2e97182705464c2e32937b355ffd9150c50. Nov 20 07:08:19 localhost systemd[1]: crio-a98bffc04bfb7c5c12295dbe31dac2e97182705464c2e32937b355ffd9150c50.scope: Consumed 39ms CPU time Nov 20 07:08:19 localhost crio[1857]: time="2019-11-20 07:08:19.256850311Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:19 localhost hyperkube[1909]: E1120 07:08:19.306645 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:19 localhost hyperkube[1909]: E1120 07:08:19.306836 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:19 localhost hyperkube[1909]: E1120 07:08:19.306967 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:20 localhost podman[7680]: 2019-11-20 07:08:20.845211001 +0000 UTC m=+0.149885725 container create d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:20 localhost systemd[1]: Started libpod-conmon-d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b.scope. Nov 20 07:08:20 localhost systemd[1]: Created slice libcontainer_7694_systemd_test_default.slice. Nov 20 07:08:20 localhost systemd[1]: Removed slice libcontainer_7694_systemd_test_default.slice. Nov 20 07:08:20 localhost systemd[1]: Started libcontainer container d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b. Nov 20 07:08:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:21 localhost podman[7680]: 2019-11-20 07:08:21.279614353 +0000 UTC m=+0.584289048 container init d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:21 localhost podman[7680]: 2019-11-20 07:08:21.300368382 +0000 UTC m=+0.605043138 container start d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:21 localhost podman[7680]: 2019-11-20 07:08:21.300696618 +0000 UTC m=+0.605371351 container attach d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:22 localhost hyperkube[1909]: I1120 07:08:22.031755 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:22 localhost hyperkube[1909]: I1120 07:08:22.034593 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:22 localhost hyperkube[1909]: I1120 07:08:22.034673 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:22 localhost hyperkube[1909]: I1120 07:08:22.034711 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:22 localhost hyperkube[1909]: E1120 07:08:22.035041 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:22 localhost systemd[1]: Started crio-conmon-a192f5247eba98ed1c2a76006ea15b71ec9118ca607a9e413b4e974d386b5ce2.scope. Nov 20 07:08:22 localhost systemd[1]: Created slice libcontainer_7732_systemd_test_default.slice. Nov 20 07:08:22 localhost systemd[1]: Removed slice libcontainer_7732_systemd_test_default.slice. Nov 20 07:08:22 localhost systemd[1]: Started libcontainer container a192f5247eba98ed1c2a76006ea15b71ec9118ca607a9e413b4e974d386b5ce2. Nov 20 07:08:22 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:22 localhost systemd[1]: Stopped libcontainer container a192f5247eba98ed1c2a76006ea15b71ec9118ca607a9e413b4e974d386b5ce2. Nov 20 07:08:22 localhost systemd[1]: crio-a192f5247eba98ed1c2a76006ea15b71ec9118ca607a9e413b4e974d386b5ce2.scope: Consumed 38ms CPU time Nov 20 07:08:22 localhost crio[1857]: time="2019-11-20 07:08:22.275188227Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:22 localhost hyperkube[1909]: E1120 07:08:22.321805 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:22 localhost hyperkube[1909]: E1120 07:08:22.322080 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:22 localhost hyperkube[1909]: E1120 07:08:22.322164 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:23 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:08:26 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:26.315Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3e3af3ab-36a9-4f53-b0ee-93c3077047de/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:26 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:26.315Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-37dea67e-6821-41d8-af5b-3877b7b3e1ed/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:26 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:26.315Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f39607c8-384c-40d0-8798-841190550a17/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:26 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:26 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:26 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:26 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:08:26 localhost systemd[1]: libpod-d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b.scope: Consumed 340ms CPU time Nov 20 07:08:26 localhost podman[7680]: 2019-11-20 07:08:26.343589851 +0000 UTC m=+5.648264598 container died d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:26 localhost podman[7680]: 2019-11-20 07:08:26.415355171 +0000 UTC m=+5.720029913 container remove d5cc3c166827d9c8e4ad16aedd0a422acaa303321b7c06c7fbd59ef72bf01b2b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:26 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:08:29 localhost hyperkube[1909]: I1120 07:08:29.112198 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:29 localhost hyperkube[1909]: I1120 07:08:29.114759 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:29 localhost hyperkube[1909]: I1120 07:08:29.114828 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:29 localhost hyperkube[1909]: I1120 07:08:29.114878 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:31 localhost podman[7797]: 2019-11-20 07:08:31.601542091 +0000 UTC m=+0.151614696 container create bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:31 localhost systemd[1]: Started libpod-conmon-bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb.scope. Nov 20 07:08:31 localhost systemd[1]: Created slice libcontainer_7811_systemd_test_default.slice. Nov 20 07:08:31 localhost systemd[1]: Removed slice libcontainer_7811_systemd_test_default.slice. Nov 20 07:08:31 localhost systemd[1]: Started libcontainer container bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb. Nov 20 07:08:31 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:32 localhost podman[7797]: 2019-11-20 07:08:32.095237931 +0000 UTC m=+0.645310552 container init bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:32 localhost podman[7797]: 2019-11-20 07:08:32.117906677 +0000 UTC m=+0.667979309 container start bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:32 localhost podman[7797]: 2019-11-20 07:08:32.118137014 +0000 UTC m=+0.668209664 container attach bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:34 localhost hyperkube[1909]: I1120 07:08:34.025971 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:34 localhost hyperkube[1909]: I1120 07:08:34.028183 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:34 localhost hyperkube[1909]: I1120 07:08:34.028241 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:34 localhost hyperkube[1909]: I1120 07:08:34.028263 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:34 localhost hyperkube[1909]: E1120 07:08:34.028450 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:34 localhost systemd[1]: Started crio-conmon-84d9d6b36dd0c266978902817561c4d3e967239670e2d10194c6627f50fcabc0.scope. Nov 20 07:08:34 localhost systemd[1]: Created slice libcontainer_7853_systemd_test_default.slice. Nov 20 07:08:34 localhost systemd[1]: Removed slice libcontainer_7853_systemd_test_default.slice. Nov 20 07:08:34 localhost systemd[1]: Started libcontainer container 84d9d6b36dd0c266978902817561c4d3e967239670e2d10194c6627f50fcabc0. Nov 20 07:08:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:34 localhost systemd[1]: Stopped libcontainer container 84d9d6b36dd0c266978902817561c4d3e967239670e2d10194c6627f50fcabc0. Nov 20 07:08:34 localhost systemd[1]: crio-84d9d6b36dd0c266978902817561c4d3e967239670e2d10194c6627f50fcabc0.scope: Consumed 33ms CPU time Nov 20 07:08:34 localhost crio[1857]: time="2019-11-20 07:08:34.244138314Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:34 localhost hyperkube[1909]: E1120 07:08:34.306187 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:34 localhost hyperkube[1909]: E1120 07:08:34.306324 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:34 localhost hyperkube[1909]: E1120 07:08:34.306375 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:37 localhost hyperkube[1909]: I1120 07:08:37.025958 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:37 localhost hyperkube[1909]: I1120 07:08:37.028297 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:37 localhost hyperkube[1909]: I1120 07:08:37.028341 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:37 localhost hyperkube[1909]: I1120 07:08:37.028363 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:37 localhost hyperkube[1909]: E1120 07:08:37.028564 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:37 localhost systemd[1]: Started crio-conmon-9b7a5fb0a889b96fb2a673d8bb13df5243eb751b97b828d1ef5363e36b7ad899.scope. Nov 20 07:08:37 localhost systemd[1]: Created slice libcontainer_7883_systemd_test_default.slice. Nov 20 07:08:37 localhost systemd[1]: Removed slice libcontainer_7883_systemd_test_default.slice. Nov 20 07:08:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:37.133Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-293eb4da-69da-4551-9776-1e4429cbd622/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:37.133Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f62b303a-e870-45e8-b70c-e3c94fb6cd5a/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:37.133Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-4838e616-6e44-45cd-af91-b66e92fc5917/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:37 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:37 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:37 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:37 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:08:37 localhost systemd[1]: Started libcontainer container 9b7a5fb0a889b96fb2a673d8bb13df5243eb751b97b828d1ef5363e36b7ad899. Nov 20 07:08:37 localhost systemd[1]: libpod-bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb.scope: Consumed 430ms CPU time Nov 20 07:08:37 localhost podman[7797]: 2019-11-20 07:08:37.174752873 +0000 UTC m=+5.724825524 container died bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:37 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:37 localhost podman[7797]: 2019-11-20 07:08:37.248133022 +0000 UTC m=+5.798205673 container remove bee32524001c11869cfa722353e2981953204987f7b54074a9effa7816a372fb (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:37 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:08:37 localhost systemd[1]: Stopped libcontainer container 9b7a5fb0a889b96fb2a673d8bb13df5243eb751b97b828d1ef5363e36b7ad899. Nov 20 07:08:37 localhost systemd[1]: crio-9b7a5fb0a889b96fb2a673d8bb13df5243eb751b97b828d1ef5363e36b7ad899.scope: Consumed 36ms CPU time Nov 20 07:08:37 localhost crio[1857]: time="2019-11-20 07:08:37.257741871Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:37 localhost hyperkube[1909]: E1120 07:08:37.300396 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:37 localhost hyperkube[1909]: E1120 07:08:37.300535 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:37 localhost hyperkube[1909]: E1120 07:08:37.300589 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:39 localhost hyperkube[1909]: I1120 07:08:39.130936 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:39 localhost hyperkube[1909]: I1120 07:08:39.133344 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:39 localhost hyperkube[1909]: I1120 07:08:39.133415 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:39 localhost hyperkube[1909]: I1120 07:08:39.133447 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:42 localhost podman[7944]: 2019-11-20 07:08:42.440439779 +0000 UTC m=+0.156073443 container create 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:42 localhost systemd[1]: Started libpod-conmon-94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8.scope. Nov 20 07:08:42 localhost systemd[1]: Created slice libcontainer_7957_systemd_test_default.slice. Nov 20 07:08:42 localhost systemd[1]: Removed slice libcontainer_7957_systemd_test_default.slice. Nov 20 07:08:42 localhost systemd[1]: Started libcontainer container 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8. Nov 20 07:08:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:42 localhost podman[7944]: 2019-11-20 07:08:42.906432704 +0000 UTC m=+0.622066414 container init 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:42 localhost podman[7944]: 2019-11-20 07:08:42.931668766 +0000 UTC m=+0.647302460 container start 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:42 localhost podman[7944]: 2019-11-20 07:08:42.9318524 +0000 UTC m=+0.647486089 container attach 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:43 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:08:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:47.951Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6ed0d038-9714-4209-93a5-47298689d9ab/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:47.951Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0aafca02-18fc-4234-b75e-5481d779feb1/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:47.951Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0d7c4035-f8d7-48be-94e4-a83d19db4261/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:47 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:47 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:47 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:47 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:08:47 localhost systemd[1]: libpod-94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8.scope: Consumed 394ms CPU time Nov 20 07:08:47 localhost podman[7944]: 2019-11-20 07:08:47.999459963 +0000 UTC m=+5.715093680 container died 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:48 localhost podman[7944]: 2019-11-20 07:08:48.109987417 +0000 UTC m=+5.825621265 container remove 94399979e1befe55ccca4a4f3c7b79ceb714fefc76a771d3b58e41567a20d6f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:48 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.025960 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.028217 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.028270 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.028291 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:49 localhost hyperkube[1909]: E1120 07:08:49.028504 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:49 localhost systemd[1]: Started crio-conmon-a0ce66d9a629db3511065bfd412adcfb1caf6913b62116917dda67e90a7dac60.scope. Nov 20 07:08:49 localhost systemd[1]: Created slice libcontainer_8035_systemd_test_default.slice. Nov 20 07:08:49 localhost systemd[1]: Removed slice libcontainer_8035_systemd_test_default.slice. Nov 20 07:08:49 localhost systemd[1]: Started libcontainer container a0ce66d9a629db3511065bfd412adcfb1caf6913b62116917dda67e90a7dac60. Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.151349 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.153496 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.153546 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:49 localhost hyperkube[1909]: I1120 07:08:49.153568 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:49 localhost systemd[1]: Stopped libcontainer container a0ce66d9a629db3511065bfd412adcfb1caf6913b62116917dda67e90a7dac60. Nov 20 07:08:49 localhost systemd[1]: crio-a0ce66d9a629db3511065bfd412adcfb1caf6913b62116917dda67e90a7dac60.scope: Consumed 34ms CPU time Nov 20 07:08:49 localhost crio[1857]: time="2019-11-20 07:08:49.226112195Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:49 localhost hyperkube[1909]: E1120 07:08:49.278059 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:49 localhost hyperkube[1909]: E1120 07:08:49.278250 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:49 localhost hyperkube[1909]: E1120 07:08:49.278356 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:50 localhost hyperkube[1909]: I1120 07:08:50.026333 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:50 localhost hyperkube[1909]: I1120 07:08:50.028950 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:50 localhost hyperkube[1909]: I1120 07:08:50.029035 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:50 localhost hyperkube[1909]: I1120 07:08:50.029073 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:50 localhost hyperkube[1909]: E1120 07:08:50.029357 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:50 localhost systemd[1]: Started crio-conmon-854965f7986ca95eb1bb24766a8682c21958c3b34b6e8675829052beadb3c568.scope. Nov 20 07:08:50 localhost systemd[1]: Created slice libcontainer_8066_systemd_test_default.slice. Nov 20 07:08:50 localhost systemd[1]: Removed slice libcontainer_8066_systemd_test_default.slice. Nov 20 07:08:50 localhost systemd[1]: Started libcontainer container 854965f7986ca95eb1bb24766a8682c21958c3b34b6e8675829052beadb3c568. Nov 20 07:08:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:50 localhost systemd[1]: Stopped libcontainer container 854965f7986ca95eb1bb24766a8682c21958c3b34b6e8675829052beadb3c568. Nov 20 07:08:50 localhost systemd[1]: crio-854965f7986ca95eb1bb24766a8682c21958c3b34b6e8675829052beadb3c568.scope: Consumed 42ms CPU time Nov 20 07:08:50 localhost crio[1857]: time="2019-11-20 07:08:50.267173316Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:50 localhost hyperkube[1909]: E1120 07:08:50.316676 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:50 localhost hyperkube[1909]: E1120 07:08:50.316858 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:08:50 localhost hyperkube[1909]: E1120 07:08:50.316950 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:08:53 localhost podman[8093]: 2019-11-20 07:08:53.29412299 +0000 UTC m=+0.151345314 container create 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:53 localhost systemd[1]: Started libpod-conmon-334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717.scope. Nov 20 07:08:53 localhost systemd[1]: Created slice libcontainer_8108_systemd_test_default.slice. Nov 20 07:08:53 localhost systemd[1]: Removed slice libcontainer_8108_systemd_test_default.slice. Nov 20 07:08:53 localhost systemd[1]: Started libcontainer container 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717. Nov 20 07:08:53 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:08:53 localhost podman[8093]: 2019-11-20 07:08:53.683969699 +0000 UTC m=+0.541192015 container init 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:53 localhost podman[8093]: 2019-11-20 07:08:53.704778798 +0000 UTC m=+0.562001131 container start 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:53 localhost podman[8093]: 2019-11-20 07:08:53.70491551 +0000 UTC m=+0.562137867 container attach 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:56 localhost hyperkube[1909]: I1120 07:08:56.026286 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:56 localhost hyperkube[1909]: I1120 07:08:56.029736 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:56 localhost hyperkube[1909]: I1120 07:08:56.029955 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:56 localhost hyperkube[1909]: I1120 07:08:56.030048 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:08:56 localhost hyperkube[1909]: E1120 07:08:56.030587 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:08:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:58.718Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-44f4c1cc-1e36-45b9-a294-29d249995246/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:58.718Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5d9a3037-1316-46b9-9ea2-04daf2f8a5d8/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:08:58.719Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f6c38806-3286-4054-99b7-752681be7c56/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:08:58 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:58 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:58 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:08:58 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:08:58 localhost systemd[1]: libpod-334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717.scope: Consumed 334ms CPU time Nov 20 07:08:58 localhost podman[8093]: 2019-11-20 07:08:58.770401436 +0000 UTC m=+5.627623797 container died 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:58 localhost podman[8093]: 2019-11-20 07:08:58.839992142 +0000 UTC m=+5.697214485 container remove 334a0faca4e81d6140f2040862223a379aa35ecb4da8f45867575baaa6c7e717 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:08:58 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:08:59 localhost hyperkube[1909]: I1120 07:08:59.169572 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:08:59 localhost hyperkube[1909]: I1120 07:08:59.172199 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:08:59 localhost hyperkube[1909]: I1120 07:08:59.172265 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:08:59 localhost hyperkube[1909]: I1120 07:08:59.172310 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.025976 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.026193 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.028317 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.028377 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.028413 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.028674 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.028942 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.029002 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: I1120 07:09:03.029074 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.029300 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:03 localhost systemd[1]: Started crio-conmon-c51a6877ffeb5682cb826099f7b5bcdc756c2bf2cfb70e8e2275d660eae746e4.scope. Nov 20 07:09:03 localhost systemd[1]: Started crio-conmon-b22078fc1d13a166a25c8c104fa9b32b233091cd8b5e14cf5d42daa0a658107a.scope. Nov 20 07:09:03 localhost systemd[1]: Started libcontainer container c51a6877ffeb5682cb826099f7b5bcdc756c2bf2cfb70e8e2275d660eae746e4. Nov 20 07:09:03 localhost systemd[1]: Started libcontainer container b22078fc1d13a166a25c8c104fa9b32b233091cd8b5e14cf5d42daa0a658107a. Nov 20 07:09:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:03 localhost systemd[1]: Stopped libcontainer container b22078fc1d13a166a25c8c104fa9b32b233091cd8b5e14cf5d42daa0a658107a. Nov 20 07:09:03 localhost systemd[1]: crio-b22078fc1d13a166a25c8c104fa9b32b233091cd8b5e14cf5d42daa0a658107a.scope: Consumed 31ms CPU time Nov 20 07:09:03 localhost systemd[1]: Stopped libcontainer container c51a6877ffeb5682cb826099f7b5bcdc756c2bf2cfb70e8e2275d660eae746e4. Nov 20 07:09:03 localhost crio[1857]: time="2019-11-20 07:09:03.294478379Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:03 localhost crio[1857]: time="2019-11-20 07:09:03.294536144Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.356774 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.356921 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.356983 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.380597 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.380700 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:03 localhost hyperkube[1909]: E1120 07:09:03.380743 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:03 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:09:04 localhost podman[8248]: 2019-11-20 07:09:04.030433478 +0000 UTC m=+0.155672587 container create f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:04 localhost systemd[1]: Started libpod-conmon-f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b.scope. Nov 20 07:09:04 localhost systemd[1]: Created slice libcontainer_8262_systemd_test_default.slice. Nov 20 07:09:04 localhost systemd[1]: Removed slice libcontainer_8262_systemd_test_default.slice. Nov 20 07:09:04 localhost systemd[1]: Started libcontainer container f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b. Nov 20 07:09:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:04 localhost podman[8248]: 2019-11-20 07:09:04.435055524 +0000 UTC m=+0.560294630 container init f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:04 localhost podman[8248]: 2019-11-20 07:09:04.455342834 +0000 UTC m=+0.580581955 container start f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:04 localhost podman[8248]: 2019-11-20 07:09:04.455478514 +0000 UTC m=+0.580717590 container attach f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:09 localhost hyperkube[1909]: I1120 07:09:09.192848 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:09 localhost hyperkube[1909]: I1120 07:09:09.194959 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:09 localhost hyperkube[1909]: I1120 07:09:09.195029 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:09 localhost hyperkube[1909]: I1120 07:09:09.195054 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:09 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:09.468Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9dd218bd-d1f9-4e12-822b-4f26b33682e5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:09 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:09.468Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6eddfb3f-b601-453c-a6b4-d581eadc4c83/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:09 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:09.468Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e472c901-6720-4753-ad01-7f99b5b8d615/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:09 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:09 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:09 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:09 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:09:09 localhost systemd[1]: libpod-f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b.scope: Consumed 336ms CPU time Nov 20 07:09:09 localhost podman[8248]: 2019-11-20 07:09:09.577609658 +0000 UTC m=+5.702848779 container died f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:09 localhost podman[8248]: 2019-11-20 07:09:09.692766574 +0000 UTC m=+5.818005744 container remove f72194857bf453d934368ef15750f5e3e7247845d48b28f937dc48206da1b31b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:09 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:09:14 localhost podman[8322]: 2019-11-20 07:09:14.880275992 +0000 UTC m=+0.151910068 container create d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:14 localhost systemd[1]: Started libpod-conmon-d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78.scope. Nov 20 07:09:14 localhost systemd[1]: Created slice libcontainer_8335_systemd_test_default.slice. Nov 20 07:09:14 localhost systemd[1]: Removed slice libcontainer_8335_systemd_test_default.slice. Nov 20 07:09:14 localhost systemd[1]: Started libcontainer container d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78. Nov 20 07:09:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:15 localhost podman[8322]: 2019-11-20 07:09:15.285712951 +0000 UTC m=+0.557347020 container init d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:15 localhost podman[8322]: 2019-11-20 07:09:15.307122784 +0000 UTC m=+0.578756872 container start d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:15 localhost podman[8322]: 2019-11-20 07:09:15.30726632 +0000 UTC m=+0.578900407 container attach d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:16 localhost hyperkube[1909]: I1120 07:09:16.026177 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:16 localhost hyperkube[1909]: I1120 07:09:16.028550 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:16 localhost hyperkube[1909]: I1120 07:09:16.028595 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:16 localhost hyperkube[1909]: I1120 07:09:16.028615 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:16 localhost hyperkube[1909]: E1120 07:09:16.028798 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:16 localhost systemd[1]: Started crio-conmon-44ab8c9ca93fd036f5606363f12ab7ab6d15341aec861f02e7918f00e2216196.scope. Nov 20 07:09:16 localhost systemd[1]: Created slice libcontainer_8373_systemd_test_default.slice. Nov 20 07:09:16 localhost systemd[1]: Removed slice libcontainer_8373_systemd_test_default.slice. Nov 20 07:09:16 localhost systemd[1]: Started libcontainer container 44ab8c9ca93fd036f5606363f12ab7ab6d15341aec861f02e7918f00e2216196. Nov 20 07:09:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:16 localhost systemd[1]: Stopped libcontainer container 44ab8c9ca93fd036f5606363f12ab7ab6d15341aec861f02e7918f00e2216196. Nov 20 07:09:16 localhost systemd[1]: crio-44ab8c9ca93fd036f5606363f12ab7ab6d15341aec861f02e7918f00e2216196.scope: Consumed 38ms CPU time Nov 20 07:09:16 localhost crio[1857]: time="2019-11-20 07:09:16.247721671Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:16 localhost hyperkube[1909]: E1120 07:09:16.305318 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:16 localhost hyperkube[1909]: E1120 07:09:16.305468 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:16 localhost hyperkube[1909]: E1120 07:09:16.305520 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:17 localhost hyperkube[1909]: I1120 07:09:17.025920 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:17 localhost hyperkube[1909]: I1120 07:09:17.027856 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:17 localhost hyperkube[1909]: I1120 07:09:17.027904 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:17 localhost hyperkube[1909]: I1120 07:09:17.027924 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:17 localhost hyperkube[1909]: E1120 07:09:17.028157 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:17 localhost systemd[1]: Started crio-conmon-3f09a47d71bf0acc708627de7a526cdf5b635d5f93e83729eef24c88ca4801d5.scope. Nov 20 07:09:17 localhost systemd[1]: Created slice libcontainer_8405_systemd_test_default.slice. Nov 20 07:09:17 localhost systemd[1]: Removed slice libcontainer_8405_systemd_test_default.slice. Nov 20 07:09:17 localhost systemd[1]: Started libcontainer container 3f09a47d71bf0acc708627de7a526cdf5b635d5f93e83729eef24c88ca4801d5. Nov 20 07:09:17 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:17 localhost systemd[1]: Stopped libcontainer container 3f09a47d71bf0acc708627de7a526cdf5b635d5f93e83729eef24c88ca4801d5. Nov 20 07:09:17 localhost systemd[1]: crio-3f09a47d71bf0acc708627de7a526cdf5b635d5f93e83729eef24c88ca4801d5.scope: Consumed 33ms CPU time Nov 20 07:09:17 localhost crio[1857]: time="2019-11-20 07:09:17.249648141Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:17 localhost hyperkube[1909]: E1120 07:09:17.299317 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:17 localhost hyperkube[1909]: E1120 07:09:17.299469 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:17 localhost hyperkube[1909]: E1120 07:09:17.299543 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:19 localhost hyperkube[1909]: I1120 07:09:19.211652 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:19 localhost hyperkube[1909]: I1120 07:09:19.214281 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:19 localhost hyperkube[1909]: I1120 07:09:19.214357 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:19 localhost hyperkube[1909]: I1120 07:09:19.214398 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:20 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:20.321Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-cbcf3977-9053-46cb-8ab4-4d9bce5e322e/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:20 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:20.321Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8693ccd9-6352-49cd-be1d-5d63978085b0/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:20 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:20.321Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b1074d5a-7312-4445-8ca3-b64b28c58529/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:20 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:20 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:20 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:20 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:09:20 localhost systemd[1]: libpod-d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78.scope: Consumed 335ms CPU time Nov 20 07:09:20 localhost podman[8322]: 2019-11-20 07:09:20.365573139 +0000 UTC m=+5.637207271 container died d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:20 localhost podman[8322]: 2019-11-20 07:09:20.453208034 +0000 UTC m=+5.724842147 container remove d65341ddf695f4594b2106c54217f854cbe4ef867a9e6a9de9c2b545d2f49b78 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:20 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:09:23 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:09:25 localhost podman[8471]: 2019-11-20 07:09:25.652204101 +0000 UTC m=+0.164927828 container create 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:25 localhost systemd[1]: Started libpod-conmon-40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec.scope. Nov 20 07:09:25 localhost systemd[1]: Created slice libcontainer_8485_systemd_test_default.slice. Nov 20 07:09:25 localhost systemd[1]: Removed slice libcontainer_8485_systemd_test_default.slice. Nov 20 07:09:25 localhost systemd[1]: Started libcontainer container 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec. Nov 20 07:09:25 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:26 localhost podman[8471]: 2019-11-20 07:09:26.047367418 +0000 UTC m=+0.560091163 container init 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:26 localhost podman[8471]: 2019-11-20 07:09:26.071542807 +0000 UTC m=+0.584266518 container start 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:26 localhost podman[8471]: 2019-11-20 07:09:26.071997229 +0000 UTC m=+0.584720993 container attach 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:27 localhost hyperkube[1909]: I1120 07:09:27.025874 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:27 localhost hyperkube[1909]: I1120 07:09:27.028350 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:27 localhost hyperkube[1909]: I1120 07:09:27.028403 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:27 localhost hyperkube[1909]: I1120 07:09:27.028426 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:27 localhost hyperkube[1909]: E1120 07:09:27.028611 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:27 localhost systemd[1]: Started crio-conmon-aeb184e3cbdafcc70f0c4f6cda087a2558beae368b8e44997eab192f6418ae48.scope. Nov 20 07:09:27 localhost systemd[1]: Created slice libcontainer_8524_systemd_test_default.slice. Nov 20 07:09:27 localhost systemd[1]: Removed slice libcontainer_8524_systemd_test_default.slice. Nov 20 07:09:27 localhost systemd[1]: Started libcontainer container aeb184e3cbdafcc70f0c4f6cda087a2558beae368b8e44997eab192f6418ae48. Nov 20 07:09:27 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:27 localhost systemd[1]: Stopped libcontainer container aeb184e3cbdafcc70f0c4f6cda087a2558beae368b8e44997eab192f6418ae48. Nov 20 07:09:27 localhost systemd[1]: crio-aeb184e3cbdafcc70f0c4f6cda087a2558beae368b8e44997eab192f6418ae48.scope: Consumed 34ms CPU time Nov 20 07:09:27 localhost crio[1857]: time="2019-11-20 07:09:27.231721096Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:27 localhost hyperkube[1909]: E1120 07:09:27.277977 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:27 localhost hyperkube[1909]: E1120 07:09:27.278153 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:27 localhost hyperkube[1909]: E1120 07:09:27.278209 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.025906 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.028511 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.028566 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.028588 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:29 localhost hyperkube[1909]: E1120 07:09:29.028803 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:29 localhost systemd[1]: Started crio-conmon-66001ff6309fb1882b5ca3b28fe15dba07298116d8cbb46c3dca2e47c23bab87.scope. Nov 20 07:09:29 localhost systemd[1]: Created slice libcontainer_8557_systemd_test_default.slice. Nov 20 07:09:29 localhost systemd[1]: Removed slice libcontainer_8557_systemd_test_default.slice. Nov 20 07:09:29 localhost systemd[1]: Started libcontainer container 66001ff6309fb1882b5ca3b28fe15dba07298116d8cbb46c3dca2e47c23bab87. Nov 20 07:09:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.229182 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.231604 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.231673 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:29 localhost hyperkube[1909]: I1120 07:09:29.231698 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:29 localhost systemd[1]: Stopped libcontainer container 66001ff6309fb1882b5ca3b28fe15dba07298116d8cbb46c3dca2e47c23bab87. Nov 20 07:09:29 localhost crio[1857]: time="2019-11-20 07:09:29.251125384Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:29 localhost hyperkube[1909]: E1120 07:09:29.259696 1909 cadvisor_stats_provider.go:403] Partial failure issuing cadvisor.ContainerInfoV2: partial failures: ["/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6772eabec456c65362c0b66ae75ba039.slice/crio-66001ff6309fb1882b5ca3b28fe15dba07298116d8cbb46c3dca2e47c23bab87.scope": RecentStats: unable to find data in memory cache] Nov 20 07:09:29 localhost hyperkube[1909]: E1120 07:09:29.309509 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:29 localhost hyperkube[1909]: E1120 07:09:29.309693 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:29 localhost hyperkube[1909]: E1120 07:09:29.309793 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:31 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:31.087Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0071fdee-4f8f-4ba7-a8a7-6651acc9e1b9/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:31 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:31.087Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ba677eef-2943-4bbd-8469-e5469bbb0f42/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:31 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:31.088Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ce135366-5c97-4e65-b6d1-ce71ad81f00a/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:31 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:31 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:31 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:31 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:09:31 localhost systemd[1]: libpod-40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec.scope: Consumed 334ms CPU time Nov 20 07:09:31 localhost podman[8471]: 2019-11-20 07:09:31.134602251 +0000 UTC m=+5.647326021 container died 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:31 localhost podman[8471]: 2019-11-20 07:09:31.192378817 +0000 UTC m=+5.705102580 container remove 40c412855190ccae6441f4b230759ccc973056b544a820b39223a887126f90ec (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:31 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:09:36 localhost podman[8607]: 2019-11-20 07:09:36.374072246 +0000 UTC m=+0.147580477 container create 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:36 localhost systemd[1]: Started libpod-conmon-7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2.scope. Nov 20 07:09:36 localhost systemd[1]: Created slice libcontainer_8620_systemd_test_default.slice. Nov 20 07:09:36 localhost systemd[1]: Removed slice libcontainer_8620_systemd_test_default.slice. Nov 20 07:09:36 localhost systemd[1]: Started libcontainer container 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2. Nov 20 07:09:36 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:36 localhost podman[8607]: 2019-11-20 07:09:36.827434975 +0000 UTC m=+0.600943188 container init 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:36 localhost podman[8607]: 2019-11-20 07:09:36.848601197 +0000 UTC m=+0.622109425 container start 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:36 localhost podman[8607]: 2019-11-20 07:09:36.849110123 +0000 UTC m=+0.622618393 container attach 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:39 localhost hyperkube[1909]: I1120 07:09:39.261930 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:39 localhost hyperkube[1909]: I1120 07:09:39.264083 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:39 localhost hyperkube[1909]: I1120 07:09:39.264137 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:39 localhost hyperkube[1909]: I1120 07:09:39.264162 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:40 localhost hyperkube[1909]: I1120 07:09:40.026407 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:40 localhost hyperkube[1909]: I1120 07:09:40.029138 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:40 localhost hyperkube[1909]: I1120 07:09:40.029182 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:40 localhost hyperkube[1909]: I1120 07:09:40.029203 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:40 localhost hyperkube[1909]: E1120 07:09:40.029399 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:40 localhost systemd[1]: Started crio-conmon-4dfbc3fa63d76d5309ef4dd714671404da0943f53048b867c15c39952edb5a49.scope. Nov 20 07:09:40 localhost systemd[1]: Created slice libcontainer_8673_systemd_test_default.slice. Nov 20 07:09:40 localhost systemd[1]: Removed slice libcontainer_8673_systemd_test_default.slice. Nov 20 07:09:40 localhost systemd[1]: Started libcontainer container 4dfbc3fa63d76d5309ef4dd714671404da0943f53048b867c15c39952edb5a49. Nov 20 07:09:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:40 localhost systemd[1]: Stopped libcontainer container 4dfbc3fa63d76d5309ef4dd714671404da0943f53048b867c15c39952edb5a49. Nov 20 07:09:40 localhost systemd[1]: crio-4dfbc3fa63d76d5309ef4dd714671404da0943f53048b867c15c39952edb5a49.scope: Consumed 40ms CPU time Nov 20 07:09:40 localhost crio[1857]: time="2019-11-20 07:09:40.256885471Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:40 localhost hyperkube[1909]: E1120 07:09:40.303580 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:40 localhost hyperkube[1909]: E1120 07:09:40.303726 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:40 localhost hyperkube[1909]: E1120 07:09:40.303776 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:41 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:41.866Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0143afaa-12d1-44df-8da2-aaf76a302ea9/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:41 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:41.866Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-7e7d7739-879c-4cb9-aa05-c4b679608a86/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:41 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:41.866Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-bcc67417-1241-407d-8319-e6fcd5470cfb/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:41 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:41 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:41 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:41 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:09:41 localhost systemd[1]: libpod-7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2.scope: Consumed 384ms CPU time Nov 20 07:09:41 localhost podman[8607]: 2019-11-20 07:09:41.918613993 +0000 UTC m=+5.692122245 container died 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:42 localhost podman[8607]: 2019-11-20 07:09:42.006427606 +0000 UTC m=+5.779935851 container remove 7662b0193205ef659436f67634dee549d99c97526c614dd0981d6887e30af4e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:42 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:09:42 localhost hyperkube[1909]: I1120 07:09:42.028625 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:42 localhost hyperkube[1909]: I1120 07:09:42.031081 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:42 localhost hyperkube[1909]: I1120 07:09:42.031131 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:42 localhost hyperkube[1909]: I1120 07:09:42.031165 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:42 localhost hyperkube[1909]: E1120 07:09:42.031451 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:42 localhost systemd[1]: Started crio-conmon-edd319b54bd34ddc2e329698268a23e08499bd317f909ed4e019c8694cdb168f.scope. Nov 20 07:09:42 localhost systemd[1]: Created slice libcontainer_8721_systemd_test_default.slice. Nov 20 07:09:42 localhost systemd[1]: Removed slice libcontainer_8721_systemd_test_default.slice. Nov 20 07:09:42 localhost systemd[1]: Started libcontainer container edd319b54bd34ddc2e329698268a23e08499bd317f909ed4e019c8694cdb168f. Nov 20 07:09:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:42 localhost systemd[1]: Stopped libcontainer container edd319b54bd34ddc2e329698268a23e08499bd317f909ed4e019c8694cdb168f. Nov 20 07:09:42 localhost systemd[1]: crio-edd319b54bd34ddc2e329698268a23e08499bd317f909ed4e019c8694cdb168f.scope: Consumed 35ms CPU time Nov 20 07:09:42 localhost crio[1857]: time="2019-11-20 07:09:42.310942272Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:42 localhost hyperkube[1909]: E1120 07:09:42.359887 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:42 localhost hyperkube[1909]: E1120 07:09:42.360101 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:42 localhost hyperkube[1909]: E1120 07:09:42.360175 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:43 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:09:47 localhost podman[8764]: 2019-11-20 07:09:47.201095746 +0000 UTC m=+0.158440805 container create 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:47 localhost systemd[1]: Started libpod-conmon-6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098.scope. Nov 20 07:09:47 localhost systemd[1]: Created slice libcontainer_8778_systemd_test_default.slice. Nov 20 07:09:47 localhost systemd[1]: Removed slice libcontainer_8778_systemd_test_default.slice. Nov 20 07:09:47 localhost systemd[1]: Started libcontainer container 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098. Nov 20 07:09:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:47 localhost podman[8764]: 2019-11-20 07:09:47.62325224 +0000 UTC m=+0.580597301 container init 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:47 localhost podman[8764]: 2019-11-20 07:09:47.650760403 +0000 UTC m=+0.608105470 container start 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:47 localhost podman[8764]: 2019-11-20 07:09:47.650946978 +0000 UTC m=+0.608292022 container attach 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:49 localhost hyperkube[1909]: I1120 07:09:49.279149 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:49 localhost hyperkube[1909]: I1120 07:09:49.281366 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:49 localhost hyperkube[1909]: I1120 07:09:49.281420 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:49 localhost hyperkube[1909]: I1120 07:09:49.281441 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:52 localhost hyperkube[1909]: I1120 07:09:52.026077 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:52 localhost hyperkube[1909]: I1120 07:09:52.028771 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:52 localhost hyperkube[1909]: I1120 07:09:52.028818 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:52 localhost hyperkube[1909]: I1120 07:09:52.028845 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:52 localhost hyperkube[1909]: E1120 07:09:52.029178 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:52 localhost systemd[1]: Started crio-conmon-bb54f44a3c7a5184126084145fe8c3f1df75c75598466f2e98830256c0b762a9.scope. Nov 20 07:09:52 localhost systemd[1]: Created slice libcontainer_8818_systemd_test_default.slice. Nov 20 07:09:52 localhost systemd[1]: Removed slice libcontainer_8818_systemd_test_default.slice. Nov 20 07:09:52 localhost systemd[1]: Started libcontainer container bb54f44a3c7a5184126084145fe8c3f1df75c75598466f2e98830256c0b762a9. Nov 20 07:09:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:52 localhost systemd[1]: Stopped libcontainer container bb54f44a3c7a5184126084145fe8c3f1df75c75598466f2e98830256c0b762a9. Nov 20 07:09:52 localhost crio[1857]: time="2019-11-20 07:09:52.282617230Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:52 localhost hyperkube[1909]: E1120 07:09:52.343221 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:52 localhost hyperkube[1909]: E1120 07:09:52.343440 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:52 localhost hyperkube[1909]: E1120 07:09:52.343516 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:52 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:52.667Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fd3a2c34-3d85-4a60-801b-419a61c80d3b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:52 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:52.668Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1be25888-cd79-4c00-8498-cd93fe47ff74/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:52 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:09:52.668Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-82361477-d47b-4be7-934c-34ed265b5c6b/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:09:52 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:52 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:52 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:09:52 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:09:52 localhost systemd[1]: libpod-6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098.scope: Consumed 351ms CPU time Nov 20 07:09:52 localhost podman[8764]: 2019-11-20 07:09:52.71388274 +0000 UTC m=+5.671227855 container died 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:52 localhost podman[8764]: 2019-11-20 07:09:52.7844133 +0000 UTC m=+5.741758396 container remove 6e0452f57f17c53510e42cad763dadba6d0f2ccbe1539283c6387b32e76d8098 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:52 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:09:56 localhost hyperkube[1909]: I1120 07:09:56.026061 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:56 localhost hyperkube[1909]: I1120 07:09:56.028191 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:56 localhost hyperkube[1909]: I1120 07:09:56.028270 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:56 localhost hyperkube[1909]: I1120 07:09:56.028298 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:09:56 localhost hyperkube[1909]: E1120 07:09:56.028561 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:09:56 localhost systemd[1]: Started crio-conmon-8f09f79dfa296bd425ed8b52c2fd853432427df4a06904ba528b671fd73c0ec8.scope. Nov 20 07:09:56 localhost systemd[1]: Created slice libcontainer_8871_systemd_test_default.slice. Nov 20 07:09:56 localhost systemd[1]: Removed slice libcontainer_8871_systemd_test_default.slice. Nov 20 07:09:56 localhost systemd[1]: Started libcontainer container 8f09f79dfa296bd425ed8b52c2fd853432427df4a06904ba528b671fd73c0ec8. Nov 20 07:09:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:56 localhost systemd[1]: Stopped libcontainer container 8f09f79dfa296bd425ed8b52c2fd853432427df4a06904ba528b671fd73c0ec8. Nov 20 07:09:56 localhost systemd[1]: crio-8f09f79dfa296bd425ed8b52c2fd853432427df4a06904ba528b671fd73c0ec8.scope: Consumed 35ms CPU time Nov 20 07:09:56 localhost crio[1857]: time="2019-11-20 07:09:56.230774764Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:56 localhost hyperkube[1909]: E1120 07:09:56.283081 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:56 localhost hyperkube[1909]: E1120 07:09:56.283395 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:09:56 localhost hyperkube[1909]: E1120 07:09:56.283483 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:09:57 localhost podman[8901]: 2019-11-20 07:09:57.974707805 +0000 UTC m=+0.156710272 container create 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:58 localhost systemd[1]: Started libpod-conmon-0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802.scope. Nov 20 07:09:58 localhost systemd[1]: Created slice libcontainer_8915_systemd_test_default.slice. Nov 20 07:09:58 localhost systemd[1]: Removed slice libcontainer_8915_systemd_test_default.slice. Nov 20 07:09:58 localhost systemd[1]: Started libcontainer container 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802. Nov 20 07:09:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:09:58 localhost podman[8901]: 2019-11-20 07:09:58.433589837 +0000 UTC m=+0.615592295 container init 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:58 localhost podman[8901]: 2019-11-20 07:09:58.455470943 +0000 UTC m=+0.637473465 container start 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:58 localhost podman[8901]: 2019-11-20 07:09:58.455671657 +0000 UTC m=+0.637674177 container attach 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:09:59 localhost hyperkube[1909]: I1120 07:09:59.300140 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:09:59 localhost hyperkube[1909]: I1120 07:09:59.303119 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:09:59 localhost hyperkube[1909]: I1120 07:09:59.303198 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:09:59 localhost hyperkube[1909]: I1120 07:09:59.303248 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:03 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:03.474Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d98f9495-111a-43c3-9dcf-2ad81b020777/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:03 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:03.474Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6743e22a-45d3-4941-b26e-40d937299c07/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:03 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:03.474Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-eb208d86-e418-4cf7-88ab-7b6495e260f6/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:03 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:03 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:03 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:03 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:10:03 localhost systemd[1]: libpod-0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802.scope: Consumed 387ms CPU time Nov 20 07:10:03 localhost podman[8901]: 2019-11-20 07:10:03.521703126 +0000 UTC m=+5.703705618 container died 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:03 localhost podman[8901]: 2019-11-20 07:10:03.585631918 +0000 UTC m=+5.767634400 container remove 0701508855d654ce95b6787607e3ff8fe140713afa3e14be5577af65aba73802 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:03 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:10:04 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.026194 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.026202 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.029319 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.029382 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.029418 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.029450 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.029390 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:07 localhost hyperkube[1909]: I1120 07:10:07.029526 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.029703 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.029715 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:07 localhost systemd[1]: Started crio-conmon-e30bd3b5e997e47b363377b880a802e180af2ed5f055f6cd639d76277287b8bc.scope. Nov 20 07:10:07 localhost systemd[1]: Started crio-conmon-6f942a07a49eb3d2558277862cd8b6076703ce8d3d6f8b5bdd0e50c481aa9774.scope. Nov 20 07:10:07 localhost systemd[1]: Started libcontainer container 6f942a07a49eb3d2558277862cd8b6076703ce8d3d6f8b5bdd0e50c481aa9774. Nov 20 07:10:07 localhost systemd[1]: Started libcontainer container e30bd3b5e997e47b363377b880a802e180af2ed5f055f6cd639d76277287b8bc. Nov 20 07:10:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:07 localhost systemd[1]: Stopped libcontainer container e30bd3b5e997e47b363377b880a802e180af2ed5f055f6cd639d76277287b8bc. Nov 20 07:10:07 localhost systemd[1]: crio-e30bd3b5e997e47b363377b880a802e180af2ed5f055f6cd639d76277287b8bc.scope: Consumed 32ms CPU time Nov 20 07:10:07 localhost systemd[1]: Stopped libcontainer container 6f942a07a49eb3d2558277862cd8b6076703ce8d3d6f8b5bdd0e50c481aa9774. Nov 20 07:10:07 localhost crio[1857]: time="2019-11-20 07:10:07.316301851Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:07 localhost crio[1857]: time="2019-11-20 07:10:07.322297179Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.380407 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.380593 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.380664 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.409463 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.409629 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:07 localhost hyperkube[1909]: E1120 07:10:07.409699 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:08 localhost podman[9052]: 2019-11-20 07:10:08.769122128 +0000 UTC m=+0.150857799 container create c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:08 localhost systemd[1]: Started libpod-conmon-c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4.scope. Nov 20 07:10:08 localhost systemd[1]: Created slice libcontainer_9065_systemd_test_default.slice. Nov 20 07:10:08 localhost systemd[1]: Removed slice libcontainer_9065_systemd_test_default.slice. Nov 20 07:10:08 localhost systemd[1]: Started libcontainer container c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4. Nov 20 07:10:08 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:09 localhost podman[9052]: 2019-11-20 07:10:09.189597261 +0000 UTC m=+0.571332912 container init c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:09 localhost podman[9052]: 2019-11-20 07:10:09.211170964 +0000 UTC m=+0.592906632 container start c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:09 localhost podman[9052]: 2019-11-20 07:10:09.21130369 +0000 UTC m=+0.593039376 container attach c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:09 localhost hyperkube[1909]: I1120 07:10:09.328568 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:09 localhost hyperkube[1909]: I1120 07:10:09.331422 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:09 localhost hyperkube[1909]: I1120 07:10:09.331489 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:09 localhost hyperkube[1909]: I1120 07:10:09.331516 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:14 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:14.225Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-01b45a23-b55a-45ea-a2f2-e9a71e72d91f/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:14 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:14.225Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3d7132de-7af2-4f54-9f05-a1ddd816b02b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:14 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:14.225Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-83b52d8e-8d84-42e7-b9c5-2d623c40d742/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:14 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:14 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:14 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:14 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:10:14 localhost systemd[1]: libpod-c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4.scope: Consumed 336ms CPU time Nov 20 07:10:14 localhost podman[9052]: 2019-11-20 07:10:14.271811539 +0000 UTC m=+5.653547336 container died c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:14 localhost podman[9052]: 2019-11-20 07:10:14.351192817 +0000 UTC m=+5.732928519 container remove c0730dbce71fcadec2dcccc969edd5044c377d0cdaefc95a3b243139fc69a9c4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:14 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:10:18 localhost hyperkube[1909]: I1120 07:10:18.026135 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:18 localhost hyperkube[1909]: I1120 07:10:18.028141 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:18 localhost hyperkube[1909]: I1120 07:10:18.028187 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:18 localhost hyperkube[1909]: I1120 07:10:18.028219 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:18 localhost hyperkube[1909]: E1120 07:10:18.028432 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:18 localhost systemd[1]: Started crio-conmon-808922ed9b0c04e5edefe0412f75e876e97d6a24bdab8897e5bdb285b3e80d3f.scope. Nov 20 07:10:18 localhost systemd[1]: Created slice libcontainer_9127_systemd_test_default.slice. Nov 20 07:10:18 localhost systemd[1]: Removed slice libcontainer_9127_systemd_test_default.slice. Nov 20 07:10:18 localhost systemd[1]: Started libcontainer container 808922ed9b0c04e5edefe0412f75e876e97d6a24bdab8897e5bdb285b3e80d3f. Nov 20 07:10:18 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:18 localhost systemd[1]: Stopped libcontainer container 808922ed9b0c04e5edefe0412f75e876e97d6a24bdab8897e5bdb285b3e80d3f. Nov 20 07:10:18 localhost systemd[1]: crio-808922ed9b0c04e5edefe0412f75e876e97d6a24bdab8897e5bdb285b3e80d3f.scope: Consumed 35ms CPU time Nov 20 07:10:18 localhost crio[1857]: time="2019-11-20 07:10:18.222718359Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:18 localhost hyperkube[1909]: E1120 07:10:18.279693 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:18 localhost hyperkube[1909]: E1120 07:10:18.279899 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:18 localhost hyperkube[1909]: E1120 07:10:18.279956 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:19 localhost hyperkube[1909]: I1120 07:10:19.351273 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:19 localhost hyperkube[1909]: I1120 07:10:19.354570 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:19 localhost hyperkube[1909]: I1120 07:10:19.354650 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:19 localhost hyperkube[1909]: I1120 07:10:19.354693 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:19 localhost podman[9157]: 2019-11-20 07:10:19.534998362 +0000 UTC m=+0.142458425 container create ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:19 localhost systemd[1]: Started libpod-conmon-ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9.scope. Nov 20 07:10:19 localhost systemd[1]: Created slice libcontainer_9170_systemd_test_default.slice. Nov 20 07:10:19 localhost systemd[1]: Removed slice libcontainer_9170_systemd_test_default.slice. Nov 20 07:10:19 localhost systemd[1]: Started libcontainer container ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9. Nov 20 07:10:19 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:19 localhost podman[9157]: 2019-11-20 07:10:19.956528081 +0000 UTC m=+0.563988099 container init ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:19 localhost podman[9157]: 2019-11-20 07:10:19.977154403 +0000 UTC m=+0.584614450 container start ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:19 localhost podman[9157]: 2019-11-20 07:10:19.977437494 +0000 UTC m=+0.584897496 container attach ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:20 localhost hyperkube[1909]: I1120 07:10:20.026134 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:20 localhost hyperkube[1909]: I1120 07:10:20.029178 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:20 localhost hyperkube[1909]: I1120 07:10:20.029256 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:20 localhost hyperkube[1909]: I1120 07:10:20.029296 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:20 localhost hyperkube[1909]: E1120 07:10:20.029568 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:20 localhost systemd[1]: Started crio-conmon-f10d578f630469a3c1d46c777f4e7d982a798407c9d99f45c9de93ff7f7b4b1c.scope. Nov 20 07:10:20 localhost systemd[1]: Created slice libcontainer_9211_systemd_test_default.slice. Nov 20 07:10:20 localhost systemd[1]: Removed slice libcontainer_9211_systemd_test_default.slice. Nov 20 07:10:20 localhost systemd[1]: Started libcontainer container f10d578f630469a3c1d46c777f4e7d982a798407c9d99f45c9de93ff7f7b4b1c. Nov 20 07:10:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:20 localhost systemd[1]: Stopped libcontainer container f10d578f630469a3c1d46c777f4e7d982a798407c9d99f45c9de93ff7f7b4b1c. Nov 20 07:10:20 localhost crio[1857]: time="2019-11-20 07:10:20.228895769Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:20 localhost hyperkube[1909]: E1120 07:10:20.286718 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:20 localhost hyperkube[1909]: E1120 07:10:20.286900 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:20 localhost hyperkube[1909]: E1120 07:10:20.286953 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:24 localhost hyperkube[1909]: I1120 07:10:24.026389 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:24 localhost hyperkube[1909]: I1120 07:10:24.030462 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:24 localhost hyperkube[1909]: I1120 07:10:24.030538 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:24 localhost hyperkube[1909]: I1120 07:10:24.030573 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:24 localhost hyperkube[1909]: E1120 07:10:24.031140 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:24 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:10:24 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:24.992Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-7f43cdb5-7980-4124-96da-719960ac0822/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:24 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:24.992Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-393c2c4b-8edf-43ce-8da6-7dc20e4da0a4/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:24 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:24.992Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e87a6e38-bb76-456a-9b1e-da7e99c92a6c/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:24 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:24 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:24 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:24 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:10:25 localhost systemd[1]: libpod-ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9.scope: Consumed 344ms CPU time Nov 20 07:10:25 localhost podman[9157]: 2019-11-20 07:10:25.039581287 +0000 UTC m=+5.647041312 container died ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:25 localhost podman[9157]: 2019-11-20 07:10:25.120158276 +0000 UTC m=+5.727618325 container remove ad6b9bad356558d792d14db9dd0d6d081281ba71004100dfc30442e42a5effe9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:25 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:10:29 localhost hyperkube[1909]: I1120 07:10:29.382104 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:29 localhost hyperkube[1909]: I1120 07:10:29.385228 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:29 localhost hyperkube[1909]: I1120 07:10:29.385286 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:29 localhost hyperkube[1909]: I1120 07:10:29.385323 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:30 localhost podman[9276]: 2019-11-20 07:10:30.326294795 +0000 UTC m=+0.170572899 container create 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:30 localhost systemd[1]: Started libpod-conmon-31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055.scope. Nov 20 07:10:30 localhost systemd[1]: Created slice libcontainer_9290_systemd_test_default.slice. Nov 20 07:10:30 localhost systemd[1]: Removed slice libcontainer_9290_systemd_test_default.slice. Nov 20 07:10:30 localhost systemd[1]: Started libcontainer container 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055. Nov 20 07:10:30 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:30 localhost podman[9276]: 2019-11-20 07:10:30.756893615 +0000 UTC m=+0.601171732 container init 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:30 localhost podman[9276]: 2019-11-20 07:10:30.778512817 +0000 UTC m=+0.622790976 container start 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:30 localhost podman[9276]: 2019-11-20 07:10:30.778694037 +0000 UTC m=+0.622972152 container attach 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:33 localhost hyperkube[1909]: I1120 07:10:33.026092 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:33 localhost hyperkube[1909]: I1120 07:10:33.028721 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:33 localhost hyperkube[1909]: I1120 07:10:33.028766 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:33 localhost hyperkube[1909]: I1120 07:10:33.028787 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:33 localhost hyperkube[1909]: E1120 07:10:33.028992 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:33 localhost systemd[1]: Started crio-conmon-db10c76ca45cee4e6b36d96c35376bf2b635adb146efa0c2114b4ded578a5bdb.scope. Nov 20 07:10:33 localhost systemd[1]: Created slice libcontainer_9328_systemd_test_default.slice. Nov 20 07:10:33 localhost systemd[1]: Removed slice libcontainer_9328_systemd_test_default.slice. Nov 20 07:10:33 localhost systemd[1]: Started libcontainer container db10c76ca45cee4e6b36d96c35376bf2b635adb146efa0c2114b4ded578a5bdb. Nov 20 07:10:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:33 localhost systemd[1]: Stopped libcontainer container db10c76ca45cee4e6b36d96c35376bf2b635adb146efa0c2114b4ded578a5bdb. Nov 20 07:10:33 localhost systemd[1]: crio-db10c76ca45cee4e6b36d96c35376bf2b635adb146efa0c2114b4ded578a5bdb.scope: Consumed 38ms CPU time Nov 20 07:10:33 localhost crio[1857]: time="2019-11-20 07:10:33.232084403Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:33 localhost hyperkube[1909]: E1120 07:10:33.289271 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:33 localhost hyperkube[1909]: E1120 07:10:33.289416 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:33 localhost hyperkube[1909]: E1120 07:10:33.289470 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:34 localhost hyperkube[1909]: I1120 07:10:34.025988 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:34 localhost hyperkube[1909]: I1120 07:10:34.028113 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:34 localhost hyperkube[1909]: I1120 07:10:34.028171 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:34 localhost hyperkube[1909]: I1120 07:10:34.028194 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:34 localhost hyperkube[1909]: E1120 07:10:34.028390 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:34 localhost systemd[1]: Started crio-conmon-7b209357943ae947e1fb7ea7619f53e0a421b3dcc5a2e5ee92b480ce8d525834.scope. Nov 20 07:10:34 localhost systemd[1]: Created slice libcontainer_9359_systemd_test_default.slice. Nov 20 07:10:34 localhost systemd[1]: Removed slice libcontainer_9359_systemd_test_default.slice. Nov 20 07:10:34 localhost systemd[1]: Started libcontainer container 7b209357943ae947e1fb7ea7619f53e0a421b3dcc5a2e5ee92b480ce8d525834. Nov 20 07:10:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:34 localhost systemd[1]: Stopped libcontainer container 7b209357943ae947e1fb7ea7619f53e0a421b3dcc5a2e5ee92b480ce8d525834. Nov 20 07:10:34 localhost systemd[1]: crio-7b209357943ae947e1fb7ea7619f53e0a421b3dcc5a2e5ee92b480ce8d525834.scope: Consumed 38ms CPU time Nov 20 07:10:34 localhost crio[1857]: time="2019-11-20 07:10:34.242983883Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:34 localhost hyperkube[1909]: E1120 07:10:34.292341 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:34 localhost hyperkube[1909]: E1120 07:10:34.292502 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:34 localhost hyperkube[1909]: E1120 07:10:34.292581 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:35.794Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-338dec66-dc81-4338-8496-98c06706cf55/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:35.795Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a09e8fa9-09e2-438b-b4a4-6175396a1a8d/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:35.794Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ab61c042-760c-4aa4-b3c5-09bd19dc60fa/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:35 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:35 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:35 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:35 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:10:35 localhost systemd[1]: libpod-31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055.scope: Consumed 339ms CPU time Nov 20 07:10:35 localhost podman[9276]: 2019-11-20 07:10:35.845606097 +0000 UTC m=+5.689884249 container died 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:35 localhost podman[9276]: 2019-11-20 07:10:35.922821412 +0000 UTC m=+5.767099578 container remove 31ed0186194f56a160c9f6c910e3a06f73eb965cff2eb5c53e5ad9d9444a4055 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:35 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:10:39 localhost hyperkube[1909]: I1120 07:10:39.403762 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:39 localhost hyperkube[1909]: I1120 07:10:39.406735 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:39 localhost hyperkube[1909]: I1120 07:10:39.406786 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:39 localhost hyperkube[1909]: I1120 07:10:39.406816 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:41 localhost podman[9421]: 2019-11-20 07:10:41.115829826 +0000 UTC m=+0.148772091 container create 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:41 localhost systemd[1]: Started libpod-conmon-733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9.scope. Nov 20 07:10:41 localhost systemd[1]: Created slice libcontainer_9435_systemd_test_default.slice. Nov 20 07:10:41 localhost systemd[1]: Removed slice libcontainer_9435_systemd_test_default.slice. Nov 20 07:10:41 localhost systemd[1]: Started libcontainer container 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9. Nov 20 07:10:41 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:41 localhost podman[9421]: 2019-11-20 07:10:41.52879232 +0000 UTC m=+0.561734557 container init 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:41 localhost podman[9421]: 2019-11-20 07:10:41.549987523 +0000 UTC m=+0.582929775 container start 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:41 localhost podman[9421]: 2019-11-20 07:10:41.550316541 +0000 UTC m=+0.583258805 container attach 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:44 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:10:45 localhost hyperkube[1909]: I1120 07:10:45.025803 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:45 localhost hyperkube[1909]: I1120 07:10:45.028306 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:45 localhost hyperkube[1909]: I1120 07:10:45.028373 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:45 localhost hyperkube[1909]: I1120 07:10:45.028402 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:45 localhost hyperkube[1909]: E1120 07:10:45.028602 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:45 localhost systemd[1]: Started crio-conmon-db50203da52ce11c094c3ac9d54c6d2b20c37d12e9ebc5acccc66e8774fa5819.scope. Nov 20 07:10:45 localhost systemd[1]: Created slice libcontainer_9490_systemd_test_default.slice. Nov 20 07:10:45 localhost systemd[1]: Removed slice libcontainer_9490_systemd_test_default.slice. Nov 20 07:10:45 localhost systemd[1]: Started libcontainer container db50203da52ce11c094c3ac9d54c6d2b20c37d12e9ebc5acccc66e8774fa5819. Nov 20 07:10:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:45 localhost systemd[1]: Stopped libcontainer container db50203da52ce11c094c3ac9d54c6d2b20c37d12e9ebc5acccc66e8774fa5819. Nov 20 07:10:45 localhost systemd[1]: crio-db50203da52ce11c094c3ac9d54c6d2b20c37d12e9ebc5acccc66e8774fa5819.scope: Consumed 35ms CPU time Nov 20 07:10:45 localhost crio[1857]: time="2019-11-20 07:10:45.235968293Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:45 localhost hyperkube[1909]: E1120 07:10:45.309207 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:45 localhost hyperkube[1909]: E1120 07:10:45.309360 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:45 localhost hyperkube[1909]: E1120 07:10:45.309411 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:46.565Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8730f127-6dfe-45e3-a277-f9530c4d0d02/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:46.565Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-73b84276-bef1-4daf-acd3-01f57418cee7/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:46.565Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fb41aa4e-934b-4984-b970-07f0047d318f/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:46 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:46 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:46 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:46 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:10:46 localhost systemd[1]: libpod-733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9.scope: Consumed 348ms CPU time Nov 20 07:10:46 localhost podman[9421]: 2019-11-20 07:10:46.613563066 +0000 UTC m=+5.646505356 container died 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:46 localhost podman[9421]: 2019-11-20 07:10:46.687862328 +0000 UTC m=+5.720804583 container remove 733759fcff56ed2c9e44ff02ff9343ef237a7e8b468d9d966c1f35748ae4cff9 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:46 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:10:47 localhost hyperkube[1909]: I1120 07:10:47.026444 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:47 localhost hyperkube[1909]: I1120 07:10:47.032305 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:47 localhost hyperkube[1909]: I1120 07:10:47.032369 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:47 localhost hyperkube[1909]: I1120 07:10:47.032392 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:47 localhost hyperkube[1909]: E1120 07:10:47.032628 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:47 localhost systemd[1]: Started crio-conmon-4ded3d7969de2b894465bce5129d44d9d265c187e9025d75ee5e2e572e4c4145.scope. Nov 20 07:10:47 localhost systemd[1]: Created slice libcontainer_9538_systemd_test_default.slice. Nov 20 07:10:47 localhost systemd[1]: Removed slice libcontainer_9538_systemd_test_default.slice. Nov 20 07:10:47 localhost systemd[1]: Started libcontainer container 4ded3d7969de2b894465bce5129d44d9d265c187e9025d75ee5e2e572e4c4145. Nov 20 07:10:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:47 localhost systemd[1]: Stopped libcontainer container 4ded3d7969de2b894465bce5129d44d9d265c187e9025d75ee5e2e572e4c4145. Nov 20 07:10:47 localhost systemd[1]: crio-4ded3d7969de2b894465bce5129d44d9d265c187e9025d75ee5e2e572e4c4145.scope: Consumed 38ms CPU time Nov 20 07:10:47 localhost crio[1857]: time="2019-11-20 07:10:47.248328243Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:47 localhost hyperkube[1909]: E1120 07:10:47.292327 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:47 localhost hyperkube[1909]: E1120 07:10:47.292510 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:47 localhost hyperkube[1909]: E1120 07:10:47.292589 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:49 localhost hyperkube[1909]: I1120 07:10:49.426893 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:49 localhost hyperkube[1909]: I1120 07:10:49.429744 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:49 localhost hyperkube[1909]: I1120 07:10:49.429811 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:49 localhost hyperkube[1909]: I1120 07:10:49.429841 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:51 localhost podman[9568]: 2019-11-20 07:10:51.876695888 +0000 UTC m=+0.149056237 container create cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:51 localhost systemd[1]: Started libpod-conmon-cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855.scope. Nov 20 07:10:51 localhost systemd[1]: Created slice libcontainer_9582_systemd_test_default.slice. Nov 20 07:10:51 localhost systemd[1]: Removed slice libcontainer_9582_systemd_test_default.slice. Nov 20 07:10:51 localhost systemd[1]: Started libcontainer container cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855. Nov 20 07:10:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:52 localhost podman[9568]: 2019-11-20 07:10:52.338029436 +0000 UTC m=+0.610389796 container init cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:52 localhost podman[9568]: 2019-11-20 07:10:52.36176923 +0000 UTC m=+0.634129621 container start cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:52 localhost podman[9568]: 2019-11-20 07:10:52.361954634 +0000 UTC m=+0.634314984 container attach cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:57 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:57.377Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-53d95f79-744d-4d8b-bb75-955b150e24c1/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:57 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:57.377Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-49eb9799-b807-4342-8575-71e234cc4460/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:57 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:10:57.377Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a7b23480-4a34-4009-bd5b-73b9945ed57b/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:10:57 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:57 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:57 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:10:57 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:10:57 localhost systemd[1]: libpod-cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855.scope: Consumed 390ms CPU time Nov 20 07:10:57 localhost podman[9568]: 2019-11-20 07:10:57.430113809 +0000 UTC m=+5.702474207 container died cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:57 localhost podman[9568]: 2019-11-20 07:10:57.505853115 +0000 UTC m=+5.778213487 container remove cb7b660a88419602a85acf7d7c693e58d6d507a88deb54c0a54f863151cd1855 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:10:57 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.025891 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.027854 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.027918 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.027942 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:10:59 localhost hyperkube[1909]: E1120 07:10:59.028185 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:10:59 localhost systemd[1]: Started crio-conmon-b434513e6d31d61dfba7f8050b2eeb9188f9f537936431a1c3c320ab66ede41a.scope. Nov 20 07:10:59 localhost systemd[1]: Created slice libcontainer_9644_systemd_test_default.slice. Nov 20 07:10:59 localhost systemd[1]: Removed slice libcontainer_9644_systemd_test_default.slice. Nov 20 07:10:59 localhost systemd[1]: Started libcontainer container b434513e6d31d61dfba7f8050b2eeb9188f9f537936431a1c3c320ab66ede41a. Nov 20 07:10:59 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:10:59 localhost systemd[1]: Stopped libcontainer container b434513e6d31d61dfba7f8050b2eeb9188f9f537936431a1c3c320ab66ede41a. Nov 20 07:10:59 localhost systemd[1]: crio-b434513e6d31d61dfba7f8050b2eeb9188f9f537936431a1c3c320ab66ede41a.scope: Consumed 39ms CPU time Nov 20 07:10:59 localhost crio[1857]: time="2019-11-20 07:10:59.242865272Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:59 localhost hyperkube[1909]: E1120 07:10:59.319141 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:59 localhost hyperkube[1909]: E1120 07:10:59.319316 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:10:59 localhost hyperkube[1909]: E1120 07:10:59.319390 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.451056 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.453207 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.453281 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:10:59 localhost hyperkube[1909]: I1120 07:10:59.453318 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:00 localhost hyperkube[1909]: I1120 07:11:00.031720 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:00 localhost hyperkube[1909]: I1120 07:11:00.034099 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:00 localhost hyperkube[1909]: I1120 07:11:00.034162 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:00 localhost hyperkube[1909]: I1120 07:11:00.034200 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:00 localhost hyperkube[1909]: E1120 07:11:00.034476 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:00 localhost systemd[1]: Started crio-conmon-c3bb7339c0dc2c3cf5e8c0fb62de3bf4f46e9149987386d16a8ef9ef75596f6e.scope. Nov 20 07:11:00 localhost systemd[1]: Created slice libcontainer_9673_systemd_test_default.slice. Nov 20 07:11:00 localhost systemd[1]: Removed slice libcontainer_9673_systemd_test_default.slice. Nov 20 07:11:00 localhost systemd[1]: Started libcontainer container c3bb7339c0dc2c3cf5e8c0fb62de3bf4f46e9149987386d16a8ef9ef75596f6e. Nov 20 07:11:00 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:00 localhost systemd[1]: Stopped libcontainer container c3bb7339c0dc2c3cf5e8c0fb62de3bf4f46e9149987386d16a8ef9ef75596f6e. Nov 20 07:11:00 localhost systemd[1]: crio-c3bb7339c0dc2c3cf5e8c0fb62de3bf4f46e9149987386d16a8ef9ef75596f6e.scope: Consumed 38ms CPU time Nov 20 07:11:00 localhost crio[1857]: time="2019-11-20 07:11:00.247089890Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:00 localhost hyperkube[1909]: E1120 07:11:00.299185 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:00 localhost hyperkube[1909]: E1120 07:11:00.299361 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:00 localhost hyperkube[1909]: E1120 07:11:00.299437 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:02 localhost podman[9700]: 2019-11-20 07:11:02.693714327 +0000 UTC m=+0.149866510 container create 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:02 localhost systemd[1]: Started libpod-conmon-2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a.scope. Nov 20 07:11:02 localhost systemd[1]: Created slice libcontainer_9714_systemd_test_default.slice. Nov 20 07:11:02 localhost systemd[1]: Removed slice libcontainer_9714_systemd_test_default.slice. Nov 20 07:11:02 localhost systemd[1]: Started libcontainer container 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a. Nov 20 07:11:02 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:03 localhost podman[9700]: 2019-11-20 07:11:03.157317003 +0000 UTC m=+0.613469212 container init 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:03 localhost podman[9700]: 2019-11-20 07:11:03.179176653 +0000 UTC m=+0.635328860 container start 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:03 localhost podman[9700]: 2019-11-20 07:11:03.1794424 +0000 UTC m=+0.635594638 container attach 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:04 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:11:08 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:08.195Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a1159586-9923-436a-9728-147a51a82c08/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:08 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:08.195Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f3e1b067-e2e3-4d79-be42-0b998dd37b85/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:08 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:08.195Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-58690dc6-dc08-486f-b934-7252ddb3c98a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:08 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:08 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:08 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:08 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:11:08 localhost systemd[1]: libpod-2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a.scope: Consumed 377ms CPU time Nov 20 07:11:08 localhost podman[9700]: 2019-11-20 07:11:08.245657712 +0000 UTC m=+5.701809972 container died 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:08 localhost podman[9700]: 2019-11-20 07:11:08.324200212 +0000 UTC m=+5.780352450 container remove 2f6fe45520a823daf15226b7ccad89a3409b356dc03f9cfae09b7a715d1f9f4a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:08 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:11:09 localhost hyperkube[1909]: I1120 07:11:09.470403 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:09 localhost hyperkube[1909]: I1120 07:11:09.473126 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:09 localhost hyperkube[1909]: I1120 07:11:09.473180 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:09 localhost hyperkube[1909]: I1120 07:11:09.473206 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:10 localhost hyperkube[1909]: I1120 07:11:10.026090 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:10 localhost hyperkube[1909]: I1120 07:11:10.028151 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:10 localhost hyperkube[1909]: I1120 07:11:10.028202 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:10 localhost hyperkube[1909]: I1120 07:11:10.028223 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:10 localhost hyperkube[1909]: E1120 07:11:10.028414 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:10 localhost systemd[1]: Started crio-conmon-76c6408b71e3e6ec2bff97b5cbc148abab735709c682d90f02e9e20fcd1848ef.scope. Nov 20 07:11:10 localhost systemd[1]: Created slice libcontainer_9788_systemd_test_default.slice. Nov 20 07:11:10 localhost systemd[1]: Removed slice libcontainer_9788_systemd_test_default.slice. Nov 20 07:11:10 localhost systemd[1]: Started libcontainer container 76c6408b71e3e6ec2bff97b5cbc148abab735709c682d90f02e9e20fcd1848ef. Nov 20 07:11:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:10 localhost systemd[1]: Stopped libcontainer container 76c6408b71e3e6ec2bff97b5cbc148abab735709c682d90f02e9e20fcd1848ef. Nov 20 07:11:10 localhost systemd[1]: crio-76c6408b71e3e6ec2bff97b5cbc148abab735709c682d90f02e9e20fcd1848ef.scope: Consumed 38ms CPU time Nov 20 07:11:10 localhost crio[1857]: time="2019-11-20 07:11:10.237737570Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:10 localhost hyperkube[1909]: E1120 07:11:10.292181 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:10 localhost hyperkube[1909]: E1120 07:11:10.292422 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:10 localhost hyperkube[1909]: E1120 07:11:10.292492 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:13 localhost podman[9818]: 2019-11-20 07:11:13.513873336 +0000 UTC m=+0.153286980 container create aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:13 localhost systemd[1]: Started libpod-conmon-aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b.scope. Nov 20 07:11:13 localhost systemd[1]: Created slice libcontainer_9832_systemd_test_default.slice. Nov 20 07:11:13 localhost systemd[1]: Removed slice libcontainer_9832_systemd_test_default.slice. Nov 20 07:11:13 localhost systemd[1]: Started libcontainer container aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b. Nov 20 07:11:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:13 localhost podman[9818]: 2019-11-20 07:11:13.914666463 +0000 UTC m=+0.554079989 container init aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:13 localhost podman[9818]: 2019-11-20 07:11:13.935956891 +0000 UTC m=+0.575370485 container start aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:13 localhost podman[9818]: 2019-11-20 07:11:13.936138965 +0000 UTC m=+0.575552523 container attach aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:14 localhost hyperkube[1909]: I1120 07:11:14.025982 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:14 localhost hyperkube[1909]: I1120 07:11:14.028042 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:14 localhost hyperkube[1909]: I1120 07:11:14.028091 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:14 localhost hyperkube[1909]: I1120 07:11:14.028112 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:14 localhost hyperkube[1909]: E1120 07:11:14.028315 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:14 localhost systemd[1]: Started crio-conmon-b6e04202d49c0c5da597fbf5fce0b8b37725fb369eaac94289cec7925d5e233a.scope. Nov 20 07:11:14 localhost systemd[1]: Created slice libcontainer_9872_systemd_test_default.slice. Nov 20 07:11:14 localhost systemd[1]: Removed slice libcontainer_9872_systemd_test_default.slice. Nov 20 07:11:14 localhost systemd[1]: Started libcontainer container b6e04202d49c0c5da597fbf5fce0b8b37725fb369eaac94289cec7925d5e233a. Nov 20 07:11:14 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:14 localhost systemd[1]: Stopped libcontainer container b6e04202d49c0c5da597fbf5fce0b8b37725fb369eaac94289cec7925d5e233a. Nov 20 07:11:14 localhost systemd[1]: crio-b6e04202d49c0c5da597fbf5fce0b8b37725fb369eaac94289cec7925d5e233a.scope: Consumed 35ms CPU time Nov 20 07:11:14 localhost crio[1857]: time="2019-11-20 07:11:14.265215138Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:14 localhost hyperkube[1909]: E1120 07:11:14.311134 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:14 localhost hyperkube[1909]: E1120 07:11:14.311287 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:14 localhost hyperkube[1909]: E1120 07:11:14.311364 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:18 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:18.948Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6edd6652-97a1-4313-9639-46475532fdab/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:18 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:18.948Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-80c242dc-7f39-4fbc-89de-8edc75995b66/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:18 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:18.948Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-7d7bc9bb-bdee-4fe4-9379-a597272481bf/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:18 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:18 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:18 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:18 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:11:18 localhost systemd[1]: libpod-aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b.scope: Consumed 334ms CPU time Nov 20 07:11:19 localhost podman[9818]: 2019-11-20 07:11:19.00254941 +0000 UTC m=+5.641962990 container died aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:19 localhost podman[9818]: 2019-11-20 07:11:19.06440326 +0000 UTC m=+5.703816968 container remove aad2c15b1c327847edfaf30595f5788c2beaef306729ff3665c614966299f13b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:19 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:11:19 localhost hyperkube[1909]: I1120 07:11:19.489752 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:19 localhost hyperkube[1909]: I1120 07:11:19.491957 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:19 localhost hyperkube[1909]: I1120 07:11:19.492054 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:19 localhost hyperkube[1909]: I1120 07:11:19.492093 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:22 localhost hyperkube[1909]: I1120 07:11:22.026081 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:22 localhost hyperkube[1909]: I1120 07:11:22.028226 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:22 localhost hyperkube[1909]: I1120 07:11:22.028314 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:22 localhost hyperkube[1909]: I1120 07:11:22.028357 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:22 localhost hyperkube[1909]: E1120 07:11:22.028700 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:22 localhost systemd[1]: Started crio-conmon-36db75c646b5eefa61e0ace54dcadbdd69aa9998dd5feb53b471ed225ef674af.scope. Nov 20 07:11:22 localhost systemd[1]: Created slice libcontainer_9921_systemd_test_default.slice. Nov 20 07:11:22 localhost systemd[1]: Removed slice libcontainer_9921_systemd_test_default.slice. Nov 20 07:11:22 localhost systemd[1]: Started libcontainer container 36db75c646b5eefa61e0ace54dcadbdd69aa9998dd5feb53b471ed225ef674af. Nov 20 07:11:22 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:22 localhost systemd[1]: Stopped libcontainer container 36db75c646b5eefa61e0ace54dcadbdd69aa9998dd5feb53b471ed225ef674af. Nov 20 07:11:22 localhost systemd[1]: crio-36db75c646b5eefa61e0ace54dcadbdd69aa9998dd5feb53b471ed225ef674af.scope: Consumed 46ms CPU time Nov 20 07:11:22 localhost crio[1857]: time="2019-11-20 07:11:22.277687290Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:22 localhost hyperkube[1909]: E1120 07:11:22.329853 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:22 localhost hyperkube[1909]: E1120 07:11:22.330037 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:22 localhost hyperkube[1909]: E1120 07:11:22.330094 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:24 localhost podman[9951]: 2019-11-20 07:11:24.253499542 +0000 UTC m=+0.155149803 container create fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:24 localhost systemd[1]: Started libpod-conmon-fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa.scope. Nov 20 07:11:24 localhost systemd[1]: Created slice libcontainer_9964_systemd_test_default.slice. Nov 20 07:11:24 localhost systemd[1]: Removed slice libcontainer_9964_systemd_test_default.slice. Nov 20 07:11:24 localhost systemd[1]: Started libcontainer container fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa. Nov 20 07:11:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:24 localhost podman[9951]: 2019-11-20 07:11:24.684757779 +0000 UTC m=+0.586408047 container init fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:24 localhost podman[9951]: 2019-11-20 07:11:24.71079977 +0000 UTC m=+0.612450031 container start fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:24 localhost podman[9951]: 2019-11-20 07:11:24.711114707 +0000 UTC m=+0.612764972 container attach fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:24 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:11:25 localhost hyperkube[1909]: I1120 07:11:25.025864 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:25 localhost hyperkube[1909]: I1120 07:11:25.051554 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:25 localhost hyperkube[1909]: I1120 07:11:25.051609 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:25 localhost hyperkube[1909]: I1120 07:11:25.051631 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:25 localhost hyperkube[1909]: E1120 07:11:25.051829 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:25 localhost systemd[1]: Started crio-conmon-21a398756ef047813efbe523eddc6902e864a1843db57f3200b46e95e6613827.scope. Nov 20 07:11:25 localhost systemd[1]: Created slice libcontainer_10022_systemd_test_default.slice. Nov 20 07:11:25 localhost systemd[1]: Removed slice libcontainer_10022_systemd_test_default.slice. Nov 20 07:11:25 localhost systemd[1]: Started libcontainer container 21a398756ef047813efbe523eddc6902e864a1843db57f3200b46e95e6613827. Nov 20 07:11:25 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:25 localhost systemd[1]: Stopped libcontainer container 21a398756ef047813efbe523eddc6902e864a1843db57f3200b46e95e6613827. Nov 20 07:11:25 localhost crio[1857]: time="2019-11-20 07:11:25.253541774Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:25 localhost hyperkube[1909]: E1120 07:11:25.303912 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:25 localhost hyperkube[1909]: E1120 07:11:25.304110 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:25 localhost hyperkube[1909]: E1120 07:11:25.304186 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:29 localhost hyperkube[1909]: I1120 07:11:29.507780 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:29 localhost hyperkube[1909]: I1120 07:11:29.510389 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:29 localhost hyperkube[1909]: I1120 07:11:29.510449 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:29 localhost hyperkube[1909]: I1120 07:11:29.510471 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:29 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:29.725Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5cd62a49-8c67-4d0b-b201-a0b0061f7249/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:29 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:29.727Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-422e8cd2-8c02-4f26-8a3b-80fd4ecf20aa/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:29 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:29.727Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1cea2af5-e8da-4d97-bcfe-6506fe74cf86/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:29 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:29 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:29 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:29 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:11:29 localhost systemd[1]: libpod-fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa.scope: Consumed 359ms CPU time Nov 20 07:11:29 localhost podman[9951]: 2019-11-20 07:11:29.775814492 +0000 UTC m=+5.677464762 container died fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:29 localhost podman[9951]: 2019-11-20 07:11:29.90998156 +0000 UTC m=+5.811631840 container remove fc9b51d076bf291974025c8874d9dc19845dd7573770327a7b61f2e3e5fc72aa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:29 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:11:33 localhost hyperkube[1909]: I1120 07:11:33.025967 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:33 localhost hyperkube[1909]: I1120 07:11:33.028230 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:33 localhost hyperkube[1909]: I1120 07:11:33.028304 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:33 localhost hyperkube[1909]: I1120 07:11:33.028338 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:33 localhost hyperkube[1909]: E1120 07:11:33.028578 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:33 localhost systemd[1]: Started crio-conmon-1337f369612c0576e6cc59776cb7ed2477dbe964b3ba47c3452c70e25ef22982.scope. Nov 20 07:11:33 localhost systemd[1]: Created slice libcontainer_10072_systemd_test_default.slice. Nov 20 07:11:33 localhost systemd[1]: Removed slice libcontainer_10072_systemd_test_default.slice. Nov 20 07:11:33 localhost systemd[1]: Started libcontainer container 1337f369612c0576e6cc59776cb7ed2477dbe964b3ba47c3452c70e25ef22982. Nov 20 07:11:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:33 localhost systemd[1]: Stopped libcontainer container 1337f369612c0576e6cc59776cb7ed2477dbe964b3ba47c3452c70e25ef22982. Nov 20 07:11:33 localhost systemd[1]: crio-1337f369612c0576e6cc59776cb7ed2477dbe964b3ba47c3452c70e25ef22982.scope: Consumed 35ms CPU time Nov 20 07:11:33 localhost crio[1857]: time="2019-11-20 07:11:33.240266077Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:33 localhost hyperkube[1909]: E1120 07:11:33.293310 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:33 localhost hyperkube[1909]: E1120 07:11:33.293736 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:33 localhost hyperkube[1909]: E1120 07:11:33.293825 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:35 localhost podman[10100]: 2019-11-20 07:11:35.087467192 +0000 UTC m=+0.142038806 container create a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:35 localhost systemd[1]: Started libpod-conmon-a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842.scope. Nov 20 07:11:35 localhost systemd[1]: Created slice libcontainer_10113_systemd_test_default.slice. Nov 20 07:11:35 localhost systemd[1]: Removed slice libcontainer_10113_systemd_test_default.slice. Nov 20 07:11:35 localhost systemd[1]: Started libcontainer container a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842. Nov 20 07:11:35 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:35 localhost podman[10100]: 2019-11-20 07:11:35.499762625 +0000 UTC m=+0.554334265 container init a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:35 localhost podman[10100]: 2019-11-20 07:11:35.523628255 +0000 UTC m=+0.578199866 container start a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:35 localhost podman[10100]: 2019-11-20 07:11:35.523804619 +0000 UTC m=+0.578376268 container attach a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:38 localhost hyperkube[1909]: I1120 07:11:38.026231 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:38 localhost hyperkube[1909]: I1120 07:11:38.028655 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:38 localhost hyperkube[1909]: I1120 07:11:38.028724 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:38 localhost hyperkube[1909]: I1120 07:11:38.028758 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:38 localhost hyperkube[1909]: E1120 07:11:38.029059 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:38 localhost systemd[1]: Started crio-conmon-51dc7dba396b1e4d09868906b97668c939c1735f8241424980426e8188414589.scope. Nov 20 07:11:38 localhost systemd[1]: Created slice libcontainer_10154_systemd_test_default.slice. Nov 20 07:11:38 localhost systemd[1]: Removed slice libcontainer_10154_systemd_test_default.slice. Nov 20 07:11:38 localhost systemd[1]: Started libcontainer container 51dc7dba396b1e4d09868906b97668c939c1735f8241424980426e8188414589. Nov 20 07:11:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:38 localhost systemd[1]: Stopped libcontainer container 51dc7dba396b1e4d09868906b97668c939c1735f8241424980426e8188414589. Nov 20 07:11:38 localhost systemd[1]: crio-51dc7dba396b1e4d09868906b97668c939c1735f8241424980426e8188414589.scope: Consumed 45ms CPU time Nov 20 07:11:38 localhost crio[1857]: time="2019-11-20 07:11:38.260248535Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:38 localhost hyperkube[1909]: E1120 07:11:38.331038 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:38 localhost hyperkube[1909]: E1120 07:11:38.331168 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:38 localhost hyperkube[1909]: E1120 07:11:38.331230 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:39 localhost hyperkube[1909]: I1120 07:11:39.525151 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:39 localhost hyperkube[1909]: I1120 07:11:39.527711 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:39 localhost hyperkube[1909]: I1120 07:11:39.527786 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:39 localhost hyperkube[1909]: I1120 07:11:39.527822 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:40 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:40.539Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2269f0cc-b3de-4e83-9ff0-cdc280f3eb1f/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:40 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:40.540Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-be2a96d8-0819-425f-8a20-44ed682b7741/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:40 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:40.539Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8fd87603-5cb7-4430-bf38-60949587b798/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:40 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:40 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:40 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:40 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:11:40 localhost systemd[1]: libpod-a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842.scope: Consumed 343ms CPU time Nov 20 07:11:40 localhost podman[10100]: 2019-11-20 07:11:40.587143498 +0000 UTC m=+5.641715193 container died a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:40 localhost podman[10100]: 2019-11-20 07:11:40.664161294 +0000 UTC m=+5.718732963 container remove a03f9cf1a1b6fd50b939bff47ad7fa38a12e80c690e6951b5d12be17299e6842 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:40 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:11:45 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:11:45 localhost podman[10234]: 2019-11-20 07:11:45.887566657 +0000 UTC m=+0.182170836 container create b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:45 localhost systemd[1]: Started libpod-conmon-b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae.scope. Nov 20 07:11:45 localhost systemd[1]: Created slice libcontainer_10247_systemd_test_default.slice. Nov 20 07:11:45 localhost systemd[1]: Removed slice libcontainer_10247_systemd_test_default.slice. Nov 20 07:11:45 localhost systemd[1]: Started libcontainer container b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae. Nov 20 07:11:46 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:46 localhost podman[10234]: 2019-11-20 07:11:46.291256194 +0000 UTC m=+0.585860375 container init b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:46 localhost podman[10234]: 2019-11-20 07:11:46.311093529 +0000 UTC m=+0.605697716 container start b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:46 localhost podman[10234]: 2019-11-20 07:11:46.311499131 +0000 UTC m=+0.606103342 container attach b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:47 localhost hyperkube[1909]: I1120 07:11:47.025846 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:47 localhost hyperkube[1909]: I1120 07:11:47.027908 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:47 localhost hyperkube[1909]: I1120 07:11:47.027964 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:47 localhost hyperkube[1909]: I1120 07:11:47.027986 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:47 localhost hyperkube[1909]: E1120 07:11:47.028262 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:47 localhost systemd[1]: Started crio-conmon-fc0c5fc8c41870546e3be9d46a41d4ed788a37d78fbbdfedfce33b35d4846231.scope. Nov 20 07:11:47 localhost systemd[1]: Created slice libcontainer_10287_systemd_test_default.slice. Nov 20 07:11:47 localhost systemd[1]: Removed slice libcontainer_10287_systemd_test_default.slice. Nov 20 07:11:47 localhost systemd[1]: Started libcontainer container fc0c5fc8c41870546e3be9d46a41d4ed788a37d78fbbdfedfce33b35d4846231. Nov 20 07:11:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:47 localhost systemd[1]: Stopped libcontainer container fc0c5fc8c41870546e3be9d46a41d4ed788a37d78fbbdfedfce33b35d4846231. Nov 20 07:11:47 localhost systemd[1]: crio-fc0c5fc8c41870546e3be9d46a41d4ed788a37d78fbbdfedfce33b35d4846231.scope: Consumed 35ms CPU time Nov 20 07:11:47 localhost crio[1857]: time="2019-11-20 07:11:47.239914771Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:47 localhost hyperkube[1909]: E1120 07:11:47.299878 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:47 localhost hyperkube[1909]: E1120 07:11:47.300073 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:47 localhost hyperkube[1909]: E1120 07:11:47.300163 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:49 localhost hyperkube[1909]: I1120 07:11:49.551524 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:49 localhost hyperkube[1909]: I1120 07:11:49.554217 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:49 localhost hyperkube[1909]: I1120 07:11:49.554287 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:49 localhost hyperkube[1909]: I1120 07:11:49.554325 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.025933 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.026306 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.027969 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.028058 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.028083 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.027969 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.028160 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: I1120 07:11:50.028219 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:50 localhost hyperkube[1909]: E1120 07:11:50.028432 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:50 localhost hyperkube[1909]: E1120 07:11:50.028437 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:50 localhost systemd[1]: Started crio-conmon-4e3bdd74778735c2c2d084830451fe9504f6e368048f0c63f5e0f6e10fc2203a.scope. Nov 20 07:11:50 localhost systemd[1]: Created slice libcontainer_10323_systemd_test_default.slice. Nov 20 07:11:50 localhost systemd[1]: Removed slice libcontainer_10323_systemd_test_default.slice. Nov 20 07:11:50 localhost systemd[1]: Started libcontainer container 4e3bdd74778735c2c2d084830451fe9504f6e368048f0c63f5e0f6e10fc2203a. Nov 20 07:11:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:50 localhost systemd[1]: Stopped libcontainer container 4e3bdd74778735c2c2d084830451fe9504f6e368048f0c63f5e0f6e10fc2203a. Nov 20 07:11:50 localhost systemd[1]: crio-4e3bdd74778735c2c2d084830451fe9504f6e368048f0c63f5e0f6e10fc2203a.scope: Consumed 31ms CPU time Nov 20 07:11:50 localhost crio[1857]: time="2019-11-20 07:11:50.234638329Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:50 localhost hyperkube[1909]: E1120 07:11:50.283833 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:50 localhost hyperkube[1909]: E1120 07:11:50.283972 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:50 localhost hyperkube[1909]: E1120 07:11:50.284074 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:51 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:51.325Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-32eff707-bf75-40e2-be8c-fc0454a469c5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:51 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:51.325Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f4c62b9b-fd87-4676-80d9-096cf1ae7dc2/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:51 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:11:51.325Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-660c2785-8720-4b1a-87cb-267db481f122/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:11:51 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:51 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:51 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:11:51 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:11:51 localhost systemd[1]: libpod-b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae.scope: Consumed 340ms CPU time Nov 20 07:11:51 localhost podman[10234]: 2019-11-20 07:11:51.374943276 +0000 UTC m=+5.669547597 container died b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:51 localhost podman[10234]: 2019-11-20 07:11:51.443552907 +0000 UTC m=+5.738157210 container remove b1b8d140d0740a774527c37254a0e56d687f76a8db0d5c40a64fc650b80b7dae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:51 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:11:56 localhost podman[10377]: 2019-11-20 07:11:56.631264769 +0000 UTC m=+0.153390578 container create 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:56 localhost systemd[1]: Started libpod-conmon-2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966.scope. Nov 20 07:11:56 localhost systemd[1]: Created slice libcontainer_10391_systemd_test_default.slice. Nov 20 07:11:56 localhost systemd[1]: Removed slice libcontainer_10391_systemd_test_default.slice. Nov 20 07:11:56 localhost systemd[1]: Started libcontainer container 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966. Nov 20 07:11:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:57 localhost podman[10377]: 2019-11-20 07:11:57.041873042 +0000 UTC m=+0.563998863 container init 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:57 localhost podman[10377]: 2019-11-20 07:11:57.06278825 +0000 UTC m=+0.584914033 container start 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:57 localhost podman[10377]: 2019-11-20 07:11:57.062964331 +0000 UTC m=+0.585090162 container attach 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.026057 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.028498 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.028560 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.028597 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:11:59 localhost hyperkube[1909]: E1120 07:11:59.028855 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:11:59 localhost systemd[1]: Started crio-conmon-6bba94b678b5802bea8cb74dffa2260d9c3b2a3aab0328bb272e65b3944a3055.scope. Nov 20 07:11:59 localhost systemd[1]: Created slice libcontainer_10430_systemd_test_default.slice. Nov 20 07:11:59 localhost systemd[1]: Removed slice libcontainer_10430_systemd_test_default.slice. Nov 20 07:11:59 localhost systemd[1]: Started libcontainer container 6bba94b678b5802bea8cb74dffa2260d9c3b2a3aab0328bb272e65b3944a3055. Nov 20 07:11:59 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:11:59 localhost systemd[1]: Stopped libcontainer container 6bba94b678b5802bea8cb74dffa2260d9c3b2a3aab0328bb272e65b3944a3055. Nov 20 07:11:59 localhost systemd[1]: crio-6bba94b678b5802bea8cb74dffa2260d9c3b2a3aab0328bb272e65b3944a3055.scope: Consumed 32ms CPU time Nov 20 07:11:59 localhost crio[1857]: time="2019-11-20 07:11:59.236988839Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:59 localhost hyperkube[1909]: E1120 07:11:59.289081 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:59 localhost hyperkube[1909]: E1120 07:11:59.289232 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:11:59 localhost hyperkube[1909]: E1120 07:11:59.289287 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.573187 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.575778 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.575819 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:11:59 localhost hyperkube[1909]: I1120 07:11:59.575839 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:02 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:02.078Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-43862000-459b-4d12-8f67-c338d915576d/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:02 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:02.078Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-52c9d89e-f9a9-4e8f-bdf1-cd692d86850d/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:02 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:02.078Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d5b8c0c2-25ee-4ea1-81e6-2cca171796ad/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:02 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:02 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:02 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:02 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:12:02 localhost systemd[1]: libpod-2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966.scope: Consumed 339ms CPU time Nov 20 07:12:02 localhost podman[10377]: 2019-11-20 07:12:02.125493336 +0000 UTC m=+5.647619170 container died 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:02 localhost podman[10377]: 2019-11-20 07:12:02.202570813 +0000 UTC m=+5.724696644 container remove 2736ae10fe6c558b20e2553b84614ad145368c388d222d2638be4c423ff36966 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:02 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:12:04 localhost hyperkube[1909]: I1120 07:12:04.026388 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:04 localhost hyperkube[1909]: I1120 07:12:04.029194 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:04 localhost hyperkube[1909]: I1120 07:12:04.029263 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:04 localhost hyperkube[1909]: I1120 07:12:04.029300 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:04 localhost hyperkube[1909]: E1120 07:12:04.029607 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:04 localhost systemd[1]: Started crio-conmon-70ca872e0fc0e2a6dfaef00b69ff297297d3dbfafb7659cf941f34ad857b5758.scope. Nov 20 07:12:04 localhost systemd[1]: Created slice libcontainer_10482_systemd_test_default.slice. Nov 20 07:12:04 localhost systemd[1]: Removed slice libcontainer_10482_systemd_test_default.slice. Nov 20 07:12:04 localhost systemd[1]: Started libcontainer container 70ca872e0fc0e2a6dfaef00b69ff297297d3dbfafb7659cf941f34ad857b5758. Nov 20 07:12:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:04 localhost systemd[1]: Stopped libcontainer container 70ca872e0fc0e2a6dfaef00b69ff297297d3dbfafb7659cf941f34ad857b5758. Nov 20 07:12:04 localhost systemd[1]: crio-70ca872e0fc0e2a6dfaef00b69ff297297d3dbfafb7659cf941f34ad857b5758.scope: Consumed 42ms CPU time Nov 20 07:12:04 localhost crio[1857]: time="2019-11-20 07:12:04.275730150Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:04 localhost hyperkube[1909]: E1120 07:12:04.332874 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:04 localhost hyperkube[1909]: E1120 07:12:04.333079 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:04 localhost hyperkube[1909]: E1120 07:12:04.333150 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:05 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:12:07 localhost podman[10522]: 2019-11-20 07:12:07.406378262 +0000 UTC m=+0.169559447 container create f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:07 localhost systemd[1]: Started libpod-conmon-f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d.scope. Nov 20 07:12:07 localhost systemd[1]: Created slice libcontainer_10537_systemd_test_default.slice. Nov 20 07:12:07 localhost systemd[1]: Removed slice libcontainer_10537_systemd_test_default.slice. Nov 20 07:12:07 localhost systemd[1]: Started libcontainer container f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d. Nov 20 07:12:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:07 localhost podman[10522]: 2019-11-20 07:12:07.82575653 +0000 UTC m=+0.588937698 container init f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:07 localhost podman[10522]: 2019-11-20 07:12:07.848098204 +0000 UTC m=+0.611279360 container start f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:07 localhost podman[10522]: 2019-11-20 07:12:07.84883485 +0000 UTC m=+0.612016039 container attach f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:09 localhost hyperkube[1909]: I1120 07:12:09.596776 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:09 localhost hyperkube[1909]: I1120 07:12:09.599138 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:09 localhost hyperkube[1909]: I1120 07:12:09.599257 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:09 localhost hyperkube[1909]: I1120 07:12:09.599296 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:11 localhost hyperkube[1909]: I1120 07:12:11.026039 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:11 localhost hyperkube[1909]: I1120 07:12:11.028385 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:11 localhost hyperkube[1909]: I1120 07:12:11.028441 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:11 localhost hyperkube[1909]: I1120 07:12:11.028463 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:11 localhost hyperkube[1909]: E1120 07:12:11.028671 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:11 localhost systemd[1]: Started crio-conmon-2758b9b36d85721a71e9949b91b38d8576cb51c40abe1bd9e6d3a9ead5faceea.scope. Nov 20 07:12:11 localhost systemd[1]: Created slice libcontainer_10578_systemd_test_default.slice. Nov 20 07:12:11 localhost systemd[1]: Removed slice libcontainer_10578_systemd_test_default.slice. Nov 20 07:12:11 localhost systemd[1]: Started libcontainer container 2758b9b36d85721a71e9949b91b38d8576cb51c40abe1bd9e6d3a9ead5faceea. Nov 20 07:12:11 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:11 localhost systemd[1]: Stopped libcontainer container 2758b9b36d85721a71e9949b91b38d8576cb51c40abe1bd9e6d3a9ead5faceea. Nov 20 07:12:11 localhost systemd[1]: crio-2758b9b36d85721a71e9949b91b38d8576cb51c40abe1bd9e6d3a9ead5faceea.scope: Consumed 35ms CPU time Nov 20 07:12:11 localhost crio[1857]: time="2019-11-20 07:12:11.238058044Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:11 localhost hyperkube[1909]: E1120 07:12:11.287301 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:11 localhost hyperkube[1909]: E1120 07:12:11.287471 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:11 localhost hyperkube[1909]: E1120 07:12:11.287546 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:12.862Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d60434b3-7a06-48ca-8c0e-a1ad3c9ccc08/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:12.862Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1cad202c-3be0-4411-863b-506271f84d01/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:12.862Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8c4e1aee-abb8-478a-855f-eef51a3c7fd4/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:12 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:12 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:12 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:12 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:12:12 localhost systemd[1]: libpod-f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d.scope: Consumed 360ms CPU time Nov 20 07:12:12 localhost podman[10522]: 2019-11-20 07:12:12.908770169 +0000 UTC m=+5.671951386 container died f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:12 localhost podman[10522]: 2019-11-20 07:12:12.985302469 +0000 UTC m=+5.748483679 container remove f1235dd5cc4838d4c82aa5e7365ce9b8e249ff484892fe6c968969aa9b1e133d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:12 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:12:16 localhost hyperkube[1909]: I1120 07:12:16.026081 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:16 localhost hyperkube[1909]: I1120 07:12:16.028131 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:16 localhost hyperkube[1909]: I1120 07:12:16.028183 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:16 localhost hyperkube[1909]: I1120 07:12:16.028207 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:16 localhost hyperkube[1909]: E1120 07:12:16.028410 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:16 localhost systemd[1]: Started crio-conmon-bd27b66873c2857d2ca9578d08adab9b972a8306e90307ed3307849ab3f7c793.scope. Nov 20 07:12:16 localhost systemd[1]: Created slice libcontainer_10630_systemd_test_default.slice. Nov 20 07:12:16 localhost systemd[1]: Removed slice libcontainer_10630_systemd_test_default.slice. Nov 20 07:12:16 localhost systemd[1]: Started libcontainer container bd27b66873c2857d2ca9578d08adab9b972a8306e90307ed3307849ab3f7c793. Nov 20 07:12:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:16 localhost systemd[1]: Stopped libcontainer container bd27b66873c2857d2ca9578d08adab9b972a8306e90307ed3307849ab3f7c793. Nov 20 07:12:16 localhost systemd[1]: crio-bd27b66873c2857d2ca9578d08adab9b972a8306e90307ed3307849ab3f7c793.scope: Consumed 32ms CPU time Nov 20 07:12:16 localhost crio[1857]: time="2019-11-20 07:12:16.223910579Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:16 localhost hyperkube[1909]: E1120 07:12:16.281131 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:16 localhost hyperkube[1909]: E1120 07:12:16.281278 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:16 localhost hyperkube[1909]: E1120 07:12:16.281334 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:18 localhost podman[10658]: 2019-11-20 07:12:18.15945474 +0000 UTC m=+0.139708047 container create 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:18 localhost systemd[1]: Started libpod-conmon-94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7.scope. Nov 20 07:12:18 localhost systemd[1]: Created slice libcontainer_10672_systemd_test_default.slice. Nov 20 07:12:18 localhost systemd[1]: Removed slice libcontainer_10672_systemd_test_default.slice. Nov 20 07:12:18 localhost systemd[1]: Started libcontainer container 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7. Nov 20 07:12:18 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:18 localhost podman[10658]: 2019-11-20 07:12:18.563111706 +0000 UTC m=+0.543365029 container init 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:18 localhost podman[10658]: 2019-11-20 07:12:18.584916361 +0000 UTC m=+0.565169706 container start 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:18 localhost podman[10658]: 2019-11-20 07:12:18.58508039 +0000 UTC m=+0.565333717 container attach 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:19 localhost hyperkube[1909]: I1120 07:12:19.613945 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:19 localhost hyperkube[1909]: I1120 07:12:19.616845 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:19 localhost hyperkube[1909]: I1120 07:12:19.616891 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:19 localhost hyperkube[1909]: I1120 07:12:19.616911 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:23.598Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-7f998156-0021-45f1-8df8-feee20c123e5/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:23.598Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6718976b-b692-4e85-ba66-73984c81e348/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:23.599Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-00a1380d-e95e-4857-8b61-5ab5666aad6e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:23 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:23 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:23 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:23 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:12:23 localhost systemd[1]: libpod-94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7.scope: Consumed 339ms CPU time Nov 20 07:12:23 localhost podman[10658]: 2019-11-20 07:12:23.655827246 +0000 UTC m=+5.636080633 container died 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:23 localhost podman[10658]: 2019-11-20 07:12:23.741775364 +0000 UTC m=+5.722028723 container remove 94a2ec6e680caecf120a25ecd85b37c20c28045f0fbe4627e845ce53ca7536f7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:23 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:12:24 localhost hyperkube[1909]: I1120 07:12:24.026298 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:24 localhost hyperkube[1909]: I1120 07:12:24.029045 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:24 localhost hyperkube[1909]: I1120 07:12:24.029114 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:24 localhost hyperkube[1909]: I1120 07:12:24.029150 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:24 localhost hyperkube[1909]: E1120 07:12:24.029495 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:24 localhost systemd[1]: Started crio-conmon-a17554c3d1cbc1598db346f7893eb48cea42bc8759d38e5af4785a2b21c6d431.scope. Nov 20 07:12:24 localhost systemd[1]: Created slice libcontainer_10730_systemd_test_default.slice. Nov 20 07:12:24 localhost systemd[1]: Removed slice libcontainer_10730_systemd_test_default.slice. Nov 20 07:12:24 localhost systemd[1]: Started libcontainer container a17554c3d1cbc1598db346f7893eb48cea42bc8759d38e5af4785a2b21c6d431. Nov 20 07:12:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:24 localhost systemd[1]: Stopped libcontainer container a17554c3d1cbc1598db346f7893eb48cea42bc8759d38e5af4785a2b21c6d431. Nov 20 07:12:24 localhost crio[1857]: time="2019-11-20 07:12:24.229897406Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:24 localhost hyperkube[1909]: E1120 07:12:24.287968 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:24 localhost hyperkube[1909]: E1120 07:12:24.288177 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:24 localhost hyperkube[1909]: E1120 07:12:24.288270 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:25 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:12:27 localhost hyperkube[1909]: I1120 07:12:27.026060 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:27 localhost hyperkube[1909]: I1120 07:12:27.028605 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:27 localhost hyperkube[1909]: I1120 07:12:27.028662 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:27 localhost hyperkube[1909]: I1120 07:12:27.028687 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:27 localhost hyperkube[1909]: E1120 07:12:27.028892 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:27 localhost systemd[1]: Started crio-conmon-fec4b398bd3ba6dd5eac0d181fe2d88932467f3698d843d82393887287d24e77.scope. Nov 20 07:12:27 localhost systemd[1]: Created slice libcontainer_10774_systemd_test_default.slice. Nov 20 07:12:27 localhost systemd[1]: Removed slice libcontainer_10774_systemd_test_default.slice. Nov 20 07:12:27 localhost systemd[1]: Started libcontainer container fec4b398bd3ba6dd5eac0d181fe2d88932467f3698d843d82393887287d24e77. Nov 20 07:12:27 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:27 localhost systemd[1]: Stopped libcontainer container fec4b398bd3ba6dd5eac0d181fe2d88932467f3698d843d82393887287d24e77. Nov 20 07:12:27 localhost systemd[1]: crio-fec4b398bd3ba6dd5eac0d181fe2d88932467f3698d843d82393887287d24e77.scope: Consumed 38ms CPU time Nov 20 07:12:27 localhost crio[1857]: time="2019-11-20 07:12:27.255645123Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:27 localhost hyperkube[1909]: E1120 07:12:27.312344 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:27 localhost hyperkube[1909]: E1120 07:12:27.312511 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:27 localhost hyperkube[1909]: E1120 07:12:27.312582 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:28 localhost podman[10803]: 2019-11-20 07:12:28.953570314 +0000 UTC m=+0.176206130 container create 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:28 localhost systemd[1]: Started libpod-conmon-35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913.scope. Nov 20 07:12:29 localhost systemd[1]: Created slice libcontainer_10817_systemd_test_default.slice. Nov 20 07:12:29 localhost systemd[1]: Removed slice libcontainer_10817_systemd_test_default.slice. Nov 20 07:12:29 localhost systemd[1]: Started libcontainer container 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913. Nov 20 07:12:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:29 localhost podman[10803]: 2019-11-20 07:12:29.425362872 +0000 UTC m=+0.647998701 container init 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:29 localhost podman[10803]: 2019-11-20 07:12:29.449816645 +0000 UTC m=+0.672452494 container start 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:29 localhost podman[10803]: 2019-11-20 07:12:29.450840893 +0000 UTC m=+0.673476707 container attach 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:29 localhost hyperkube[1909]: I1120 07:12:29.641788 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:29 localhost hyperkube[1909]: I1120 07:12:29.644784 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:29 localhost hyperkube[1909]: I1120 07:12:29.644855 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:29 localhost hyperkube[1909]: I1120 07:12:29.644889 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:34 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:34.461Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5181d3cc-6e22-4d46-89d4-c1f6af948b3f/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:34 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:34.462Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1fb0034e-8609-4f54-890b-ec7d7efec46f/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:34 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:34.462Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2308069b-1f8c-4bdf-b102-588a4bece601/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:34 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:34 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:34 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:34 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:12:34 localhost systemd[1]: libpod-35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913.scope: Consumed 392ms CPU time Nov 20 07:12:34 localhost podman[10803]: 2019-11-20 07:12:34.508762719 +0000 UTC m=+5.731398580 container died 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:34 localhost podman[10803]: 2019-11-20 07:12:34.604875954 +0000 UTC m=+5.827511824 container remove 35762f2f15b535fc4ad94c7d5aae21dddee428b29f1b16ed86f33984bc407913 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:34 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:12:35 localhost hyperkube[1909]: I1120 07:12:35.026173 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:35 localhost hyperkube[1909]: I1120 07:12:35.029196 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:35 localhost hyperkube[1909]: I1120 07:12:35.029266 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:35 localhost hyperkube[1909]: I1120 07:12:35.029303 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:35 localhost hyperkube[1909]: E1120 07:12:35.029609 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:35 localhost systemd[1]: Started crio-conmon-e5f8cf670e2e8c7115c36083fce6b779def90b819aa6c80d69339f8861770b08.scope. Nov 20 07:12:35 localhost systemd[1]: Created slice libcontainer_10879_systemd_test_default.slice. Nov 20 07:12:35 localhost systemd[1]: Removed slice libcontainer_10879_systemd_test_default.slice. Nov 20 07:12:35 localhost systemd[1]: Started libcontainer container e5f8cf670e2e8c7115c36083fce6b779def90b819aa6c80d69339f8861770b08. Nov 20 07:12:35 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:35 localhost systemd[1]: Stopped libcontainer container e5f8cf670e2e8c7115c36083fce6b779def90b819aa6c80d69339f8861770b08. Nov 20 07:12:35 localhost systemd[1]: crio-e5f8cf670e2e8c7115c36083fce6b779def90b819aa6c80d69339f8861770b08.scope: Consumed 40ms CPU time Nov 20 07:12:35 localhost crio[1857]: time="2019-11-20 07:12:35.261294397Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:35 localhost hyperkube[1909]: E1120 07:12:35.311764 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:35 localhost hyperkube[1909]: E1120 07:12:35.311915 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:35 localhost hyperkube[1909]: E1120 07:12:35.311966 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:38 localhost hyperkube[1909]: E1120 07:12:38.216193 1909 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service Nov 20 07:12:39 localhost hyperkube[1909]: I1120 07:12:39.662795 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:39 localhost hyperkube[1909]: I1120 07:12:39.665505 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:39 localhost hyperkube[1909]: I1120 07:12:39.665563 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:39 localhost hyperkube[1909]: I1120 07:12:39.665588 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:39 localhost podman[10920]: 2019-11-20 07:12:39.818072033 +0000 UTC m=+0.177736005 container create eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:39 localhost systemd[1]: Started libpod-conmon-eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b.scope. Nov 20 07:12:39 localhost systemd[1]: Created slice libcontainer_10935_systemd_test_default.slice. Nov 20 07:12:39 localhost systemd[1]: Removed slice libcontainer_10935_systemd_test_default.slice. Nov 20 07:12:39 localhost systemd[1]: Started libcontainer container eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b. Nov 20 07:12:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:40 localhost podman[10920]: 2019-11-20 07:12:40.2616108 +0000 UTC m=+0.621274757 container init eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:40 localhost podman[10920]: 2019-11-20 07:12:40.284636944 +0000 UTC m=+0.644300892 container start eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:40 localhost podman[10920]: 2019-11-20 07:12:40.284773558 +0000 UTC m=+0.644437495 container attach eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:42 localhost hyperkube[1909]: I1120 07:12:42.026208 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:42 localhost hyperkube[1909]: I1120 07:12:42.028891 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:42 localhost hyperkube[1909]: I1120 07:12:42.028941 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:42 localhost hyperkube[1909]: I1120 07:12:42.028962 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:42 localhost hyperkube[1909]: E1120 07:12:42.029300 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:42 localhost systemd[1]: Started crio-conmon-2cb356333bbfa2fe26d407bbfbad7da943d832c427ea7b95fdea5a1e42e8ef91.scope. Nov 20 07:12:42 localhost systemd[1]: Created slice libcontainer_10975_systemd_test_default.slice. Nov 20 07:12:42 localhost systemd[1]: Removed slice libcontainer_10975_systemd_test_default.slice. Nov 20 07:12:42 localhost systemd[1]: Started libcontainer container 2cb356333bbfa2fe26d407bbfbad7da943d832c427ea7b95fdea5a1e42e8ef91. Nov 20 07:12:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:42 localhost systemd[1]: Stopped libcontainer container 2cb356333bbfa2fe26d407bbfbad7da943d832c427ea7b95fdea5a1e42e8ef91. Nov 20 07:12:42 localhost systemd[1]: crio-2cb356333bbfa2fe26d407bbfbad7da943d832c427ea7b95fdea5a1e42e8ef91.scope: Consumed 38ms CPU time Nov 20 07:12:42 localhost crio[1857]: time="2019-11-20 07:12:42.266907317Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:42 localhost hyperkube[1909]: E1120 07:12:42.315608 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:42 localhost hyperkube[1909]: E1120 07:12:42.316100 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:42 localhost hyperkube[1909]: E1120 07:12:42.316158 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:45 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:45.299Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-bb170337-36a6-470f-a9be-ba330046c9c2/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:45 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:45.299Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-044b1d86-a918-4fb7-ba77-7c28969b3006/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:45 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:45.299Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-472a40ab-55fb-4424-b363-5c52609d70be/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:45 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:45 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:45 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:45 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:12:45 localhost systemd[1]: libpod-eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b.scope: Consumed 365ms CPU time Nov 20 07:12:45 localhost podman[10920]: 2019-11-20 07:12:45.345597788 +0000 UTC m=+5.705261805 container died eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:45 localhost podman[10920]: 2019-11-20 07:12:45.420073711 +0000 UTC m=+5.779737757 container remove eaa812c837df9885b88dc085a2b6c1bbb00d752fa6b754a11aa671bfba452a9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:45 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:12:45 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:12:47 localhost hyperkube[1909]: I1120 07:12:47.025814 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:47 localhost hyperkube[1909]: I1120 07:12:47.027972 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:47 localhost hyperkube[1909]: I1120 07:12:47.028040 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:47 localhost hyperkube[1909]: I1120 07:12:47.028062 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:47 localhost hyperkube[1909]: E1120 07:12:47.028247 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:47 localhost systemd[1]: Started crio-conmon-017e452d915a2b0f16ccbce2de8d017446d91738a7ac2100ceabc025e3f118ac.scope. Nov 20 07:12:47 localhost systemd[1]: Created slice libcontainer_11042_systemd_test_default.slice. Nov 20 07:12:47 localhost systemd[1]: Removed slice libcontainer_11042_systemd_test_default.slice. Nov 20 07:12:47 localhost systemd[1]: Started libcontainer container 017e452d915a2b0f16ccbce2de8d017446d91738a7ac2100ceabc025e3f118ac. Nov 20 07:12:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:47 localhost systemd[1]: Stopped libcontainer container 017e452d915a2b0f16ccbce2de8d017446d91738a7ac2100ceabc025e3f118ac. Nov 20 07:12:47 localhost systemd[1]: crio-017e452d915a2b0f16ccbce2de8d017446d91738a7ac2100ceabc025e3f118ac.scope: Consumed 35ms CPU time Nov 20 07:12:47 localhost crio[1857]: time="2019-11-20 07:12:47.235645981Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:47 localhost hyperkube[1909]: E1120 07:12:47.292432 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:47 localhost hyperkube[1909]: E1120 07:12:47.292590 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:47 localhost hyperkube[1909]: E1120 07:12:47.292647 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:49 localhost hyperkube[1909]: I1120 07:12:49.681723 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:49 localhost hyperkube[1909]: I1120 07:12:49.684484 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:49 localhost hyperkube[1909]: I1120 07:12:49.684548 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:49 localhost hyperkube[1909]: I1120 07:12:49.684596 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:50 localhost podman[11070]: 2019-11-20 07:12:50.608125212 +0000 UTC m=+0.153054735 container create f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:50 localhost systemd[1]: Started libpod-conmon-f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882.scope. Nov 20 07:12:50 localhost systemd[1]: Created slice libcontainer_11084_systemd_test_default.slice. Nov 20 07:12:50 localhost systemd[1]: Removed slice libcontainer_11084_systemd_test_default.slice. Nov 20 07:12:50 localhost systemd[1]: Started libcontainer container f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882. Nov 20 07:12:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:51 localhost podman[11070]: 2019-11-20 07:12:51.01957076 +0000 UTC m=+0.564500282 container init f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:51 localhost podman[11070]: 2019-11-20 07:12:51.039730945 +0000 UTC m=+0.584660482 container start f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:51 localhost podman[11070]: 2019-11-20 07:12:51.039910934 +0000 UTC m=+0.584840495 container attach f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:56 localhost hyperkube[1909]: I1120 07:12:56.025964 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:56 localhost hyperkube[1909]: I1120 07:12:56.027928 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:56 localhost hyperkube[1909]: I1120 07:12:56.027986 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:56 localhost hyperkube[1909]: I1120 07:12:56.028034 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:12:56 localhost hyperkube[1909]: E1120 07:12:56.028227 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:12:56 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:56.056Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-99947cb9-547b-4cae-9940-9d72a8d2235f/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:56 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:56.056Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1070f03f-ac33-4a00-bb63-c82dc40c2e8d/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:56 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:12:56.057Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d1db3b86-d4b2-496c-9287-cae0ca365706/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:12:56 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:56 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:56 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:12:56 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:12:56 localhost systemd[1]: libpod-f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882.scope: Consumed 350ms CPU time Nov 20 07:12:56 localhost systemd[1]: Started crio-conmon-f959d457ad0e7baae45ad3014643c22e20eab0243070df7d4a7b75d5b9c38810.scope. Nov 20 07:12:56 localhost podman[11070]: 2019-11-20 07:12:56.107501895 +0000 UTC m=+5.652431459 container died f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:56 localhost systemd[1]: Created slice libcontainer_11126_systemd_test_default.slice. Nov 20 07:12:56 localhost systemd[1]: Removed slice libcontainer_11126_systemd_test_default.slice. Nov 20 07:12:56 localhost systemd[1]: Started libcontainer container f959d457ad0e7baae45ad3014643c22e20eab0243070df7d4a7b75d5b9c38810. Nov 20 07:12:56 localhost podman[11070]: 2019-11-20 07:12:56.188679212 +0000 UTC m=+5.733608789 container remove f006384ef14211385fa1a103390cf71b3bd2d590c21049dea2b9229fb73ad882 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:12:56 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:12:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:12:56 localhost systemd[1]: Stopped libcontainer container f959d457ad0e7baae45ad3014643c22e20eab0243070df7d4a7b75d5b9c38810. Nov 20 07:12:56 localhost crio[1857]: time="2019-11-20 07:12:56.274332013Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:56 localhost hyperkube[1909]: E1120 07:12:56.324342 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:56 localhost hyperkube[1909]: E1120 07:12:56.324507 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:12:56 localhost hyperkube[1909]: E1120 07:12:56.324583 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:12:59 localhost hyperkube[1909]: I1120 07:12:59.702067 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:12:59 localhost hyperkube[1909]: I1120 07:12:59.704307 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:12:59 localhost hyperkube[1909]: I1120 07:12:59.704379 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:12:59 localhost hyperkube[1909]: I1120 07:12:59.704402 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:01 localhost hyperkube[1909]: I1120 07:13:01.025975 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:01 localhost hyperkube[1909]: I1120 07:13:01.028542 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:01 localhost hyperkube[1909]: I1120 07:13:01.028609 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:01 localhost hyperkube[1909]: I1120 07:13:01.028647 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:01 localhost hyperkube[1909]: E1120 07:13:01.029041 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:01 localhost systemd[1]: Started crio-conmon-23a5a37e2159f95de00fd0583ae91d9ef1d070fb662ea4fc86a86fdc7231dfbc.scope. Nov 20 07:13:01 localhost systemd[1]: Created slice libcontainer_11178_systemd_test_default.slice. Nov 20 07:13:01 localhost systemd[1]: Removed slice libcontainer_11178_systemd_test_default.slice. Nov 20 07:13:01 localhost systemd[1]: Started libcontainer container 23a5a37e2159f95de00fd0583ae91d9ef1d070fb662ea4fc86a86fdc7231dfbc. Nov 20 07:13:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:01 localhost systemd[1]: Stopped libcontainer container 23a5a37e2159f95de00fd0583ae91d9ef1d070fb662ea4fc86a86fdc7231dfbc. Nov 20 07:13:01 localhost systemd[1]: crio-23a5a37e2159f95de00fd0583ae91d9ef1d070fb662ea4fc86a86fdc7231dfbc.scope: Consumed 35ms CPU time Nov 20 07:13:01 localhost crio[1857]: time="2019-11-20 07:13:01.279876785Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:01 localhost hyperkube[1909]: E1120 07:13:01.338468 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:01 localhost hyperkube[1909]: E1120 07:13:01.338618 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:01 localhost hyperkube[1909]: E1120 07:13:01.338671 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:01 localhost podman[11196]: 2019-11-20 07:13:01.389793505 +0000 UTC m=+0.157943164 container create dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:01 localhost systemd[1]: Started libpod-conmon-dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab.scope. Nov 20 07:13:01 localhost systemd[1]: Created slice libcontainer_11220_systemd_test_default.slice. Nov 20 07:13:01 localhost systemd[1]: Removed slice libcontainer_11220_systemd_test_default.slice. Nov 20 07:13:01 localhost systemd[1]: Started libcontainer container dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab. Nov 20 07:13:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:01 localhost podman[11196]: 2019-11-20 07:13:01.823983959 +0000 UTC m=+0.592133611 container init dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:01 localhost podman[11196]: 2019-11-20 07:13:01.84430598 +0000 UTC m=+0.612455630 container start dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:01 localhost podman[11196]: 2019-11-20 07:13:01.844483138 +0000 UTC m=+0.612632780 container attach dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:05 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:13:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:06.859Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0469317d-1bd2-4483-8a94-e4b23c5d0dee/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:06.859Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-84440e21-13ff-4c17-bc2a-c713faa6d221/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:06.859Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-484aafd5-0739-4b4d-aa16-55aeb6fecd48/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:06 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:06 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:06 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:06 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:13:06 localhost podman[11196]: 2019-11-20 07:13:06.883616467 +0000 UTC m=+5.651766164 container died dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:06 localhost systemd[1]: libpod-dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab.scope: Consumed 370ms CPU time Nov 20 07:13:06 localhost podman[11196]: 2019-11-20 07:13:06.966797183 +0000 UTC m=+5.734947002 container remove dcad6216032bd07faa86f1fc0f5db9d5fdc54f0d7bc09b505ac0108588156dab (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:06 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:13:07 localhost hyperkube[1909]: I1120 07:13:07.026225 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:07 localhost hyperkube[1909]: I1120 07:13:07.029495 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:07 localhost hyperkube[1909]: I1120 07:13:07.029562 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:07 localhost hyperkube[1909]: I1120 07:13:07.029619 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:07 localhost hyperkube[1909]: E1120 07:13:07.029892 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:07 localhost systemd[1]: Started crio-conmon-2b470324a4809dd4418d67cb6f80277229a73260fca5dd67f38db6a18c157a93.scope. Nov 20 07:13:07 localhost systemd[1]: Created slice libcontainer_11307_systemd_test_default.slice. Nov 20 07:13:07 localhost systemd[1]: Removed slice libcontainer_11307_systemd_test_default.slice. Nov 20 07:13:07 localhost systemd[1]: Started libcontainer container 2b470324a4809dd4418d67cb6f80277229a73260fca5dd67f38db6a18c157a93. Nov 20 07:13:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:07 localhost systemd[1]: Stopped libcontainer container 2b470324a4809dd4418d67cb6f80277229a73260fca5dd67f38db6a18c157a93. Nov 20 07:13:07 localhost systemd[1]: crio-2b470324a4809dd4418d67cb6f80277229a73260fca5dd67f38db6a18c157a93.scope: Consumed 35ms CPU time Nov 20 07:13:07 localhost crio[1857]: time="2019-11-20 07:13:07.248640297Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:07 localhost hyperkube[1909]: E1120 07:13:07.293705 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:07 localhost hyperkube[1909]: E1120 07:13:07.293871 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:07 localhost hyperkube[1909]: E1120 07:13:07.293941 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:09 localhost hyperkube[1909]: I1120 07:13:09.719940 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:09 localhost hyperkube[1909]: I1120 07:13:09.722222 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:09 localhost hyperkube[1909]: I1120 07:13:09.722276 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:09 localhost hyperkube[1909]: I1120 07:13:09.722299 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:12 localhost podman[11337]: 2019-11-20 07:13:12.158395341 +0000 UTC m=+0.158929428 container create 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:12 localhost systemd[1]: Started libpod-conmon-62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24.scope. Nov 20 07:13:12 localhost systemd[1]: Created slice libcontainer_11351_systemd_test_default.slice. Nov 20 07:13:12 localhost systemd[1]: Removed slice libcontainer_11351_systemd_test_default.slice. Nov 20 07:13:12 localhost systemd[1]: Started libcontainer container 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24. Nov 20 07:13:12 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:12 localhost podman[11337]: 2019-11-20 07:13:12.561182811 +0000 UTC m=+0.561716788 container init 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:12 localhost podman[11337]: 2019-11-20 07:13:12.580728902 +0000 UTC m=+0.581262903 container start 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:12 localhost podman[11337]: 2019-11-20 07:13:12.580874774 +0000 UTC m=+0.581408738 container attach 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:13 localhost hyperkube[1909]: I1120 07:13:13.025971 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:13 localhost hyperkube[1909]: I1120 07:13:13.028377 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:13 localhost hyperkube[1909]: I1120 07:13:13.028473 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:13 localhost hyperkube[1909]: I1120 07:13:13.028505 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:13 localhost hyperkube[1909]: E1120 07:13:13.028700 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:13 localhost systemd[1]: Started crio-conmon-df1d9dd555d93624295a8e2631348a1c30eb5ecb985f4cb0263227165ff4899d.scope. Nov 20 07:13:13 localhost systemd[1]: Created slice libcontainer_11389_systemd_test_default.slice. Nov 20 07:13:13 localhost systemd[1]: Removed slice libcontainer_11389_systemd_test_default.slice. Nov 20 07:13:13 localhost systemd[1]: Started libcontainer container df1d9dd555d93624295a8e2631348a1c30eb5ecb985f4cb0263227165ff4899d. Nov 20 07:13:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:13 localhost systemd[1]: Stopped libcontainer container df1d9dd555d93624295a8e2631348a1c30eb5ecb985f4cb0263227165ff4899d. Nov 20 07:13:13 localhost systemd[1]: crio-df1d9dd555d93624295a8e2631348a1c30eb5ecb985f4cb0263227165ff4899d.scope: Consumed 40ms CPU time Nov 20 07:13:13 localhost crio[1857]: time="2019-11-20 07:13:13.245906503Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:13 localhost hyperkube[1909]: E1120 07:13:13.299303 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:13 localhost hyperkube[1909]: E1120 07:13:13.299510 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:13 localhost hyperkube[1909]: E1120 07:13:13.299566 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:15 localhost hyperkube[1909]: I1120 07:13:15.025796 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:15 localhost hyperkube[1909]: I1120 07:13:15.027682 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:15 localhost hyperkube[1909]: I1120 07:13:15.027756 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:15 localhost hyperkube[1909]: I1120 07:13:15.027793 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:15 localhost hyperkube[1909]: E1120 07:13:15.028342 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:17 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:17.594Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fc7f6fe1-6dc5-4b90-b626-28cda5e7b272/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:17 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:17.594Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b2162227-433c-4a53-9a1b-8b138c333c18/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:17 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:17.594Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6e7c7f13-e61e-4da6-800e-cb8d272c3de4/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:17 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:17 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:17 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:17 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:13:17 localhost systemd[1]: libpod-62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24.scope: Consumed 330ms CPU time Nov 20 07:13:17 localhost podman[11337]: 2019-11-20 07:13:17.639103953 +0000 UTC m=+5.639637973 container died 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:17 localhost podman[11337]: 2019-11-20 07:13:17.710934061 +0000 UTC m=+5.711468078 container remove 62be1432c6d3959b3d0773837e83518d442efb7f00224b79529e3d389dfb2c24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:17 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.026043 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.037386 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.037481 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.037512 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:19 localhost hyperkube[1909]: E1120 07:13:19.037815 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:19 localhost systemd[1]: Started crio-conmon-81b9679519b4b6eff4ffcc35387ad81c039bbbf742c3aceaedd917391ec86552.scope. Nov 20 07:13:19 localhost systemd[1]: Created slice libcontainer_11443_systemd_test_default.slice. Nov 20 07:13:19 localhost systemd[1]: Removed slice libcontainer_11443_systemd_test_default.slice. Nov 20 07:13:19 localhost systemd[1]: Started libcontainer container 81b9679519b4b6eff4ffcc35387ad81c039bbbf742c3aceaedd917391ec86552. Nov 20 07:13:19 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:19 localhost systemd[1]: Stopped libcontainer container 81b9679519b4b6eff4ffcc35387ad81c039bbbf742c3aceaedd917391ec86552. Nov 20 07:13:19 localhost systemd[1]: crio-81b9679519b4b6eff4ffcc35387ad81c039bbbf742c3aceaedd917391ec86552.scope: Consumed 45ms CPU time Nov 20 07:13:19 localhost crio[1857]: time="2019-11-20 07:13:19.270780761Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:19 localhost hyperkube[1909]: E1120 07:13:19.323907 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:19 localhost hyperkube[1909]: E1120 07:13:19.324122 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:19 localhost hyperkube[1909]: E1120 07:13:19.324202 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.736249 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.738357 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.738437 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:19 localhost hyperkube[1909]: I1120 07:13:19.738464 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:22 localhost podman[11476]: 2019-11-20 07:13:22.913398379 +0000 UTC m=+0.168630302 container create 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:22 localhost systemd[1]: Started libpod-conmon-5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01.scope. Nov 20 07:13:22 localhost systemd[1]: Created slice libcontainer_11489_systemd_test_default.slice. Nov 20 07:13:22 localhost systemd[1]: Removed slice libcontainer_11489_systemd_test_default.slice. Nov 20 07:13:23 localhost systemd[1]: Started libcontainer container 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01. Nov 20 07:13:23 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:23 localhost podman[11476]: 2019-11-20 07:13:23.330535635 +0000 UTC m=+0.585767553 container init 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:23 localhost podman[11476]: 2019-11-20 07:13:23.349605729 +0000 UTC m=+0.604837638 container start 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:23 localhost podman[11476]: 2019-11-20 07:13:23.3497416 +0000 UTC m=+0.604973500 container attach 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:25 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:13:26 localhost hyperkube[1909]: I1120 07:13:26.026279 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:26 localhost hyperkube[1909]: I1120 07:13:26.028687 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:26 localhost hyperkube[1909]: I1120 07:13:26.028738 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:26 localhost hyperkube[1909]: I1120 07:13:26.028761 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:26 localhost hyperkube[1909]: E1120 07:13:26.028976 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:26 localhost systemd[1]: Started crio-conmon-7fa1e1c90281bb2146b4dc87cfd738e0ab56baf68ac6c29104fc7267f629ecdb.scope. Nov 20 07:13:26 localhost systemd[1]: Created slice libcontainer_11543_systemd_test_default.slice. Nov 20 07:13:26 localhost systemd[1]: Removed slice libcontainer_11543_systemd_test_default.slice. Nov 20 07:13:26 localhost systemd[1]: Started libcontainer container 7fa1e1c90281bb2146b4dc87cfd738e0ab56baf68ac6c29104fc7267f629ecdb. Nov 20 07:13:26 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:26 localhost systemd[1]: Stopped libcontainer container 7fa1e1c90281bb2146b4dc87cfd738e0ab56baf68ac6c29104fc7267f629ecdb. Nov 20 07:13:26 localhost systemd[1]: crio-7fa1e1c90281bb2146b4dc87cfd738e0ab56baf68ac6c29104fc7267f629ecdb.scope: Consumed 35ms CPU time Nov 20 07:13:26 localhost crio[1857]: time="2019-11-20 07:13:26.231751460Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:26 localhost hyperkube[1909]: E1120 07:13:26.287811 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:26 localhost hyperkube[1909]: E1120 07:13:26.288034 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:26 localhost hyperkube[1909]: E1120 07:13:26.288107 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:28 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:28.362Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b117de6d-4cd3-4b50-97b0-0040d4db9fc1/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:28 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:28.362Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-426ecc78-26b3-4b40-bd1d-d500de4cab02/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:28 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:28.362Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-50fde17c-b2e0-4156-b31f-fd2fcfb79fba/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:28 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:28 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:28 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:28 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:13:28 localhost systemd[1]: libpod-5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01.scope: Consumed 342ms CPU time Nov 20 07:13:28 localhost podman[11476]: 2019-11-20 07:13:28.408673471 +0000 UTC m=+5.663905417 container died 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:28 localhost podman[11476]: 2019-11-20 07:13:28.481368352 +0000 UTC m=+5.736600282 container remove 5d280b78bdf78410d5be6ba84fcf3738c30aba9ffebbfab23c6e512625464d01 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:28 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:13:29 localhost hyperkube[1909]: I1120 07:13:29.754890 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:29 localhost hyperkube[1909]: I1120 07:13:29.757954 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:29 localhost hyperkube[1909]: I1120 07:13:29.758034 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:29 localhost hyperkube[1909]: I1120 07:13:29.758058 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:33 localhost podman[11595]: 2019-11-20 07:13:33.667233256 +0000 UTC m=+0.152308052 container create 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:33 localhost systemd[1]: Started libpod-conmon-3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772.scope. Nov 20 07:13:33 localhost systemd[1]: Created slice libcontainer_11609_systemd_test_default.slice. Nov 20 07:13:33 localhost systemd[1]: Removed slice libcontainer_11609_systemd_test_default.slice. Nov 20 07:13:33 localhost systemd[1]: Started libcontainer container 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772. Nov 20 07:13:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:34 localhost hyperkube[1909]: I1120 07:13:34.025948 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:34 localhost hyperkube[1909]: I1120 07:13:34.028134 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:34 localhost hyperkube[1909]: I1120 07:13:34.028174 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:34 localhost hyperkube[1909]: I1120 07:13:34.028197 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:34 localhost hyperkube[1909]: E1120 07:13:34.028388 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:34 localhost podman[11595]: 2019-11-20 07:13:34.077977634 +0000 UTC m=+0.563052471 container init 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:34 localhost systemd[1]: Started crio-conmon-6a79b664678d19d9f19f889379773aea416d2374f338e64d1368ab3ff197f795.scope. Nov 20 07:13:34 localhost podman[11595]: 2019-11-20 07:13:34.098909978 +0000 UTC m=+0.583984782 container start 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:34 localhost podman[11595]: 2019-11-20 07:13:34.099082347 +0000 UTC m=+0.584157184 container attach 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:34 localhost systemd[1]: Created slice libcontainer_11636_systemd_test_default.slice. Nov 20 07:13:34 localhost systemd[1]: Removed slice libcontainer_11636_systemd_test_default.slice. Nov 20 07:13:34 localhost systemd[1]: Started libcontainer container 6a79b664678d19d9f19f889379773aea416d2374f338e64d1368ab3ff197f795. Nov 20 07:13:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:34 localhost systemd[1]: Stopped libcontainer container 6a79b664678d19d9f19f889379773aea416d2374f338e64d1368ab3ff197f795. Nov 20 07:13:34 localhost crio[1857]: time="2019-11-20 07:13:34.236733731Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:34 localhost hyperkube[1909]: E1120 07:13:34.288563 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:34 localhost hyperkube[1909]: E1120 07:13:34.288960 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:34 localhost hyperkube[1909]: E1120 07:13:34.289045 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.025980 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.028484 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.028531 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.028552 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:39 localhost hyperkube[1909]: E1120 07:13:39.028743 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:39 localhost systemd[1]: Started crio-conmon-c2a64e867b180b88f99e248fe808420011056c390613ca6139e3b52a9fea0b83.scope. Nov 20 07:13:39 localhost systemd[1]: Created slice libcontainer_11691_systemd_test_default.slice. Nov 20 07:13:39 localhost systemd[1]: Removed slice libcontainer_11691_systemd_test_default.slice. Nov 20 07:13:39 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:39.115Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b2f28dfd-41da-4db6-a3ce-09e1a05a8d43/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:39 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:39.115Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e61ee7e6-88ed-4692-8de2-9c02009f885b/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:39 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:39.115Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5bed4ad4-4c8a-4c5d-957b-196d3ef561f0/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:39 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:39 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:39 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:39 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:13:39 localhost systemd[1]: Started libcontainer container c2a64e867b180b88f99e248fe808420011056c390613ca6139e3b52a9fea0b83. Nov 20 07:13:39 localhost podman[11595]: 2019-11-20 07:13:39.135404068 +0000 UTC m=+5.620478954 container died 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:39 localhost systemd[1]: libpod-3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772.scope: Consumed 331ms CPU time Nov 20 07:13:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:39 localhost podman[11595]: 2019-11-20 07:13:39.233440213 +0000 UTC m=+5.718515065 container remove 3fadd7b43e64121738b38b5da4b9204abd8975b17286e2de16e21aae3978e772 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:39 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:13:39 localhost systemd[1]: Stopped libcontainer container c2a64e867b180b88f99e248fe808420011056c390613ca6139e3b52a9fea0b83. Nov 20 07:13:39 localhost crio[1857]: time="2019-11-20 07:13:39.250603947Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:39 localhost hyperkube[1909]: E1120 07:13:39.307300 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:39 localhost hyperkube[1909]: E1120 07:13:39.307453 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:39 localhost hyperkube[1909]: E1120 07:13:39.307517 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.773743 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.775835 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.775891 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:39 localhost hyperkube[1909]: I1120 07:13:39.775913 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:44 localhost podman[11745]: 2019-11-20 07:13:44.425833268 +0000 UTC m=+0.154430967 container create dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:44 localhost systemd[1]: Started libpod-conmon-dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f.scope. Nov 20 07:13:44 localhost systemd[1]: Created slice libcontainer_11759_systemd_test_default.slice. Nov 20 07:13:44 localhost systemd[1]: Removed slice libcontainer_11759_systemd_test_default.slice. Nov 20 07:13:44 localhost systemd[1]: Started libcontainer container dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f. Nov 20 07:13:44 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:44 localhost podman[11745]: 2019-11-20 07:13:44.87415014 +0000 UTC m=+0.602747839 container init dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:44 localhost podman[11745]: 2019-11-20 07:13:44.899531805 +0000 UTC m=+0.628129540 container start dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:44 localhost podman[11745]: 2019-11-20 07:13:44.899989975 +0000 UTC m=+0.628587694 container attach dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:46 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:13:48 localhost hyperkube[1909]: I1120 07:13:48.026368 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:48 localhost hyperkube[1909]: I1120 07:13:48.029186 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:48 localhost hyperkube[1909]: I1120 07:13:48.029248 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:48 localhost hyperkube[1909]: I1120 07:13:48.029285 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:48 localhost hyperkube[1909]: E1120 07:13:48.029557 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:48 localhost systemd[1]: Started crio-conmon-d8ee423401987a28a2cf303a84e0854c4ccf55a81831b4b58ea1e1ebbb372fbd.scope. Nov 20 07:13:48 localhost systemd[1]: Created slice libcontainer_11814_systemd_test_default.slice. Nov 20 07:13:48 localhost systemd[1]: Removed slice libcontainer_11814_systemd_test_default.slice. Nov 20 07:13:48 localhost systemd[1]: Started libcontainer container d8ee423401987a28a2cf303a84e0854c4ccf55a81831b4b58ea1e1ebbb372fbd. Nov 20 07:13:48 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:48 localhost systemd[1]: Stopped libcontainer container d8ee423401987a28a2cf303a84e0854c4ccf55a81831b4b58ea1e1ebbb372fbd. Nov 20 07:13:48 localhost systemd[1]: crio-d8ee423401987a28a2cf303a84e0854c4ccf55a81831b4b58ea1e1ebbb372fbd.scope: Consumed 39ms CPU time Nov 20 07:13:48 localhost crio[1857]: time="2019-11-20 07:13:48.266106209Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:48 localhost hyperkube[1909]: E1120 07:13:48.327143 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:48 localhost hyperkube[1909]: E1120 07:13:48.327306 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:48 localhost hyperkube[1909]: E1120 07:13:48.327380 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:49 localhost hyperkube[1909]: I1120 07:13:49.791060 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:49 localhost hyperkube[1909]: I1120 07:13:49.793489 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:49 localhost hyperkube[1909]: I1120 07:13:49.793553 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:49 localhost hyperkube[1909]: I1120 07:13:49.793587 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:49.918Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-49041f80-2f8c-4fe5-ad5b-05a82219bfaa/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:49.918Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9292e439-680a-40d2-9812-eb58df38c82a/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:13:49.918Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3fdb3ec2-d910-4167-b2de-4eb0d2193ecf/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:13:49 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:49 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:49 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:13:49 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:13:49 localhost systemd[1]: libpod-dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f.scope: Consumed 383ms CPU time Nov 20 07:13:49 localhost podman[11745]: 2019-11-20 07:13:49.968844986 +0000 UTC m=+5.697442722 container died dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:50 localhost podman[11745]: 2019-11-20 07:13:50.031992262 +0000 UTC m=+5.760590001 container remove dcc1bcda210251722998229eb1500c9bdebcacbc5c637a55d9fed2062b912b1f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:50 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:13:52 localhost hyperkube[1909]: I1120 07:13:52.026110 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:52 localhost hyperkube[1909]: I1120 07:13:52.028347 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:52 localhost hyperkube[1909]: I1120 07:13:52.028403 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:52 localhost hyperkube[1909]: I1120 07:13:52.028432 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:13:52 localhost hyperkube[1909]: E1120 07:13:52.028684 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:13:52 localhost systemd[1]: Started crio-conmon-8b496dc714f68785ade05de66f201cefff5daf08444121f6cfe9143a7b4254fb.scope. Nov 20 07:13:52 localhost systemd[1]: Created slice libcontainer_11868_systemd_test_default.slice. Nov 20 07:13:52 localhost systemd[1]: Removed slice libcontainer_11868_systemd_test_default.slice. Nov 20 07:13:52 localhost systemd[1]: Started libcontainer container 8b496dc714f68785ade05de66f201cefff5daf08444121f6cfe9143a7b4254fb. Nov 20 07:13:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:52 localhost systemd[1]: Stopped libcontainer container 8b496dc714f68785ade05de66f201cefff5daf08444121f6cfe9143a7b4254fb. Nov 20 07:13:52 localhost systemd[1]: crio-8b496dc714f68785ade05de66f201cefff5daf08444121f6cfe9143a7b4254fb.scope: Consumed 44ms CPU time Nov 20 07:13:52 localhost crio[1857]: time="2019-11-20 07:13:52.266209297Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:52 localhost hyperkube[1909]: E1120 07:13:52.320421 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:52 localhost hyperkube[1909]: E1120 07:13:52.320565 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:13:52 localhost hyperkube[1909]: E1120 07:13:52.320615 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:13:55 localhost podman[11897]: 2019-11-20 07:13:55.212678162 +0000 UTC m=+0.147829318 container create 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:55 localhost systemd[1]: Started libpod-conmon-3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc.scope. Nov 20 07:13:55 localhost systemd[1]: Created slice libcontainer_11911_systemd_test_default.slice. Nov 20 07:13:55 localhost systemd[1]: Removed slice libcontainer_11911_systemd_test_default.slice. Nov 20 07:13:55 localhost systemd[1]: Started libcontainer container 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc. Nov 20 07:13:55 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:13:55 localhost podman[11897]: 2019-11-20 07:13:55.622023916 +0000 UTC m=+0.557175065 container init 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:55 localhost podman[11897]: 2019-11-20 07:13:55.645756959 +0000 UTC m=+0.580908102 container start 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:55 localhost podman[11897]: 2019-11-20 07:13:55.645962582 +0000 UTC m=+0.581113709 container attach 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:13:59 localhost hyperkube[1909]: I1120 07:13:59.809529 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:13:59 localhost hyperkube[1909]: I1120 07:13:59.811855 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:13:59 localhost hyperkube[1909]: I1120 07:13:59.811910 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:13:59 localhost hyperkube[1909]: I1120 07:13:59.811934 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:00.660Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-97158dbe-6daa-481c-bd83-b870158acf14/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:00.660Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-24165010-3243-471f-9d0d-9f22354b7c03/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:00.660Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-df8e06bc-7311-4b93-88e6-8a6e417a79be/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:00 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:00 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:00 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:00 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:14:00 localhost systemd[1]: libpod-3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc.scope: Consumed 324ms CPU time Nov 20 07:14:00 localhost podman[11897]: 2019-11-20 07:14:00.707653545 +0000 UTC m=+5.642804731 container died 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:00 localhost podman[11897]: 2019-11-20 07:14:00.793732515 +0000 UTC m=+5.728883699 container remove 3837df42f27be7736893516941150704d6feeb8a1defc4aab18abca3c27ffcdc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:00 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:14:03 localhost hyperkube[1909]: I1120 07:14:03.026263 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:03 localhost hyperkube[1909]: I1120 07:14:03.029151 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:03 localhost hyperkube[1909]: I1120 07:14:03.029220 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:03 localhost hyperkube[1909]: I1120 07:14:03.029244 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:03 localhost hyperkube[1909]: E1120 07:14:03.029458 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:03 localhost systemd[1]: Started crio-conmon-7b1328a4d22ea56bdc4a595481c455779e505a26daa05bf57554ae6e64a20b0c.scope. Nov 20 07:14:03 localhost systemd[1]: Created slice libcontainer_11973_systemd_test_default.slice. Nov 20 07:14:03 localhost systemd[1]: Removed slice libcontainer_11973_systemd_test_default.slice. Nov 20 07:14:03 localhost systemd[1]: Started libcontainer container 7b1328a4d22ea56bdc4a595481c455779e505a26daa05bf57554ae6e64a20b0c. Nov 20 07:14:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:03 localhost systemd[1]: Stopped libcontainer container 7b1328a4d22ea56bdc4a595481c455779e505a26daa05bf57554ae6e64a20b0c. Nov 20 07:14:03 localhost systemd[1]: crio-7b1328a4d22ea56bdc4a595481c455779e505a26daa05bf57554ae6e64a20b0c.scope: Consumed 36ms CPU time Nov 20 07:14:03 localhost crio[1857]: time="2019-11-20 07:14:03.256188502Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:03 localhost hyperkube[1909]: E1120 07:14:03.306225 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:03 localhost hyperkube[1909]: E1120 07:14:03.306377 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:03 localhost hyperkube[1909]: E1120 07:14:03.306429 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:05 localhost podman[12003]: 2019-11-20 07:14:05.989301303 +0000 UTC m=+0.159438037 container create 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:06 localhost systemd[1]: Started libpod-conmon-357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973.scope. Nov 20 07:14:06 localhost hyperkube[1909]: I1120 07:14:06.029610 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:06 localhost hyperkube[1909]: I1120 07:14:06.032060 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:06 localhost hyperkube[1909]: I1120 07:14:06.032120 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:06 localhost hyperkube[1909]: I1120 07:14:06.032144 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:06 localhost hyperkube[1909]: E1120 07:14:06.032343 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:06 localhost systemd[1]: Created slice libcontainer_12017_systemd_test_default.slice. Nov 20 07:14:06 localhost systemd[1]: Removed slice libcontainer_12017_systemd_test_default.slice. Nov 20 07:14:06 localhost systemd[1]: Started crio-conmon-83b44941da67aa01aed363c226308e0ede14f9c946cae95248bffedbb07e757a.scope. Nov 20 07:14:06 localhost systemd[1]: Started libcontainer container 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973. Nov 20 07:14:06 localhost systemd[1]: Created slice libcontainer_12029_systemd_test_default.slice. Nov 20 07:14:06 localhost systemd[1]: Removed slice libcontainer_12029_systemd_test_default.slice. Nov 20 07:14:06 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:06 localhost systemd[1]: Started libcontainer container 83b44941da67aa01aed363c226308e0ede14f9c946cae95248bffedbb07e757a. Nov 20 07:14:06 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:06 localhost systemd[1]: Stopped libcontainer container 83b44941da67aa01aed363c226308e0ede14f9c946cae95248bffedbb07e757a. Nov 20 07:14:06 localhost systemd[1]: crio-83b44941da67aa01aed363c226308e0ede14f9c946cae95248bffedbb07e757a.scope: Consumed 39ms CPU time Nov 20 07:14:06 localhost crio[1857]: time="2019-11-20 07:14:06.284809047Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:06 localhost hyperkube[1909]: E1120 07:14:06.360870 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:06 localhost hyperkube[1909]: E1120 07:14:06.361037 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:06 localhost hyperkube[1909]: E1120 07:14:06.361092 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:06 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:14:06 localhost podman[12003]: 2019-11-20 07:14:06.495640583 +0000 UTC m=+0.665777337 container init 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:06 localhost podman[12003]: 2019-11-20 07:14:06.517476442 +0000 UTC m=+0.687613170 container start 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:06 localhost podman[12003]: 2019-11-20 07:14:06.517737733 +0000 UTC m=+0.687874487 container attach 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:09 localhost hyperkube[1909]: I1120 07:14:09.826642 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:09 localhost hyperkube[1909]: I1120 07:14:09.829554 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:09 localhost hyperkube[1909]: I1120 07:14:09.829625 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:09 localhost hyperkube[1909]: I1120 07:14:09.829665 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:11 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:11.532Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-49c2d04f-db90-4fcc-b39d-9636870bb6e6/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:11 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:11.533Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-91e6664f-7d51-4c5f-ac4c-5eeb10146a3d/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:11 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:11.533Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-28f195c6-1df1-4ff6-80b0-d3f8b48a0d20/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:11 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:11 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:11 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:11 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:14:11 localhost podman[12003]: 2019-11-20 07:14:11.562673826 +0000 UTC m=+5.732810617 container died 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:11 localhost systemd[1]: libpod-357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973.scope: Consumed 362ms CPU time Nov 20 07:14:11 localhost podman[12003]: 2019-11-20 07:14:11.651650942 +0000 UTC m=+5.821787743 container remove 357a47a2441932f0d65802f63efc0be0e7a3cb9973cd2db4f08ae042d97bd973 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:11 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:14:16 localhost podman[12125]: 2019-11-20 07:14:16.851927479 +0000 UTC m=+0.165787096 container create cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:16 localhost systemd[1]: Started libpod-conmon-cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b.scope. Nov 20 07:14:16 localhost systemd[1]: Created slice libcontainer_12139_systemd_test_default.slice. Nov 20 07:14:16 localhost systemd[1]: Removed slice libcontainer_12139_systemd_test_default.slice. Nov 20 07:14:16 localhost systemd[1]: Started libcontainer container cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b. Nov 20 07:14:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:17 localhost podman[12125]: 2019-11-20 07:14:17.266218411 +0000 UTC m=+0.580078028 container init cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:17 localhost podman[12125]: 2019-11-20 07:14:17.287096441 +0000 UTC m=+0.600956080 container start cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:17 localhost podman[12125]: 2019-11-20 07:14:17.287410826 +0000 UTC m=+0.601270462 container attach cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:18 localhost hyperkube[1909]: I1120 07:14:18.026390 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:18 localhost hyperkube[1909]: I1120 07:14:18.029342 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:18 localhost hyperkube[1909]: I1120 07:14:18.029396 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:18 localhost hyperkube[1909]: I1120 07:14:18.029419 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:18 localhost hyperkube[1909]: E1120 07:14:18.029610 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:18 localhost systemd[1]: Started crio-conmon-ac0b7b2efe5b0c757576f9ce219c1977b9abe9fa54253502bd66a774ee10607e.scope. Nov 20 07:14:18 localhost systemd[1]: Created slice libcontainer_12178_systemd_test_default.slice. Nov 20 07:14:18 localhost systemd[1]: Removed slice libcontainer_12178_systemd_test_default.slice. Nov 20 07:14:18 localhost systemd[1]: Started libcontainer container ac0b7b2efe5b0c757576f9ce219c1977b9abe9fa54253502bd66a774ee10607e. Nov 20 07:14:18 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:18 localhost systemd[1]: Stopped libcontainer container ac0b7b2efe5b0c757576f9ce219c1977b9abe9fa54253502bd66a774ee10607e. Nov 20 07:14:18 localhost systemd[1]: crio-ac0b7b2efe5b0c757576f9ce219c1977b9abe9fa54253502bd66a774ee10607e.scope: Consumed 34ms CPU time Nov 20 07:14:18 localhost crio[1857]: time="2019-11-20 07:14:18.241886490Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:18 localhost hyperkube[1909]: E1120 07:14:18.297179 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:18 localhost hyperkube[1909]: E1120 07:14:18.297326 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:18 localhost hyperkube[1909]: E1120 07:14:18.297379 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:19 localhost hyperkube[1909]: I1120 07:14:19.848857 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:19 localhost hyperkube[1909]: I1120 07:14:19.851489 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:19 localhost hyperkube[1909]: I1120 07:14:19.851551 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:19 localhost hyperkube[1909]: I1120 07:14:19.851592 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:20 localhost hyperkube[1909]: I1120 07:14:20.026223 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:20 localhost hyperkube[1909]: I1120 07:14:20.028965 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:20 localhost hyperkube[1909]: I1120 07:14:20.029039 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:20 localhost hyperkube[1909]: I1120 07:14:20.029064 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:20 localhost hyperkube[1909]: E1120 07:14:20.029442 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:20 localhost systemd[1]: Started crio-conmon-ce1e31dc5924113f0097f498425a714654ae58cc696a2f8ae25f506061b9507b.scope. Nov 20 07:14:20 localhost systemd[1]: Created slice libcontainer_12211_systemd_test_default.slice. Nov 20 07:14:20 localhost systemd[1]: Removed slice libcontainer_12211_systemd_test_default.slice. Nov 20 07:14:20 localhost systemd[1]: Started libcontainer container ce1e31dc5924113f0097f498425a714654ae58cc696a2f8ae25f506061b9507b. Nov 20 07:14:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:20 localhost systemd[1]: Stopped libcontainer container ce1e31dc5924113f0097f498425a714654ae58cc696a2f8ae25f506061b9507b. Nov 20 07:14:20 localhost systemd[1]: crio-ce1e31dc5924113f0097f498425a714654ae58cc696a2f8ae25f506061b9507b.scope: Consumed 35ms CPU time Nov 20 07:14:20 localhost crio[1857]: time="2019-11-20 07:14:20.242428735Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:20 localhost hyperkube[1909]: E1120 07:14:20.288536 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:20 localhost hyperkube[1909]: E1120 07:14:20.288677 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:20 localhost hyperkube[1909]: E1120 07:14:20.288740 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:22 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:22.301Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-669b5a88-15ce-4845-a096-90287eed4f1c/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:22 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:22.301Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-23089460-7935-4d1e-a7eb-5b4b6a9c8782/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:22 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:22.302Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c1fabc60-ac09-40d6-a740-abd14919e48e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:22 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:22 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:22 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:22 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:14:22 localhost systemd[1]: libpod-cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b.scope: Consumed 356ms CPU time Nov 20 07:14:22 localhost podman[12125]: 2019-11-20 07:14:22.349589604 +0000 UTC m=+5.663449377 container died cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:22 localhost podman[12125]: 2019-11-20 07:14:22.420674652 +0000 UTC m=+5.734534289 container remove cfecd6ef566ee867861d53f7b01031c41975269b6369ceea2027c64b65984e9b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:22 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:14:26 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:14:27 localhost hyperkube[1909]: I1120 07:14:27.026211 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:27 localhost hyperkube[1909]: I1120 07:14:27.028705 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:27 localhost hyperkube[1909]: I1120 07:14:27.028798 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:27 localhost hyperkube[1909]: I1120 07:14:27.028835 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:27 localhost hyperkube[1909]: E1120 07:14:27.029447 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:27 localhost podman[12278]: 2019-11-20 07:14:27.594230016 +0000 UTC m=+0.140779222 container create 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:27 localhost systemd[1]: Started libpod-conmon-112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06.scope. Nov 20 07:14:27 localhost systemd[1]: Created slice libcontainer_12293_systemd_test_default.slice. Nov 20 07:14:27 localhost systemd[1]: Removed slice libcontainer_12293_systemd_test_default.slice. Nov 20 07:14:27 localhost systemd[1]: Started libcontainer container 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06. Nov 20 07:14:27 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:28 localhost podman[12278]: 2019-11-20 07:14:28.035082249 +0000 UTC m=+0.581631447 container init 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:28 localhost podman[12278]: 2019-11-20 07:14:28.055966328 +0000 UTC m=+0.602515552 container start 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:28 localhost podman[12278]: 2019-11-20 07:14:28.056137026 +0000 UTC m=+0.602686253 container attach 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:29 localhost hyperkube[1909]: I1120 07:14:29.867533 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:29 localhost hyperkube[1909]: I1120 07:14:29.870432 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:29 localhost hyperkube[1909]: I1120 07:14:29.870502 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:29 localhost hyperkube[1909]: I1120 07:14:29.870532 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:30 localhost hyperkube[1909]: I1120 07:14:30.026030 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:30 localhost hyperkube[1909]: I1120 07:14:30.027964 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:30 localhost hyperkube[1909]: I1120 07:14:30.028146 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:30 localhost hyperkube[1909]: I1120 07:14:30.028180 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:30 localhost hyperkube[1909]: E1120 07:14:30.028377 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:30 localhost systemd[1]: Started crio-conmon-15ac6f655dc287ab0875489fe16a4710d8cbf67a868751350b3b447b1e8d7664.scope. Nov 20 07:14:30 localhost systemd[1]: Created slice libcontainer_12333_systemd_test_default.slice. Nov 20 07:14:30 localhost systemd[1]: Removed slice libcontainer_12333_systemd_test_default.slice. Nov 20 07:14:30 localhost systemd[1]: Started libcontainer container 15ac6f655dc287ab0875489fe16a4710d8cbf67a868751350b3b447b1e8d7664. Nov 20 07:14:30 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:30 localhost systemd[1]: Stopped libcontainer container 15ac6f655dc287ab0875489fe16a4710d8cbf67a868751350b3b447b1e8d7664. Nov 20 07:14:30 localhost crio[1857]: time="2019-11-20 07:14:30.234931883Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:30 localhost hyperkube[1909]: E1120 07:14:30.292209 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:30 localhost hyperkube[1909]: E1120 07:14:30.292375 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:30 localhost hyperkube[1909]: E1120 07:14:30.292447 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:31 localhost dbus-daemon[1716]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.5' (uid=0 pid=1723 comm="/usr/sbin/NetworkManager --no-daemon " label="system_u:system_r:NetworkManager_t:s0") Nov 20 07:14:31 localhost systemd[1]: Starting Authorization Manager... Nov 20 07:14:32 localhost polkitd[12369]: Started polkitd version 0.115 Nov 20 07:14:32 localhost polkitd[12369]: Loading rules from directory /etc/polkit-1/rules.d Nov 20 07:14:32 localhost polkitd[12369]: Loading rules from directory /usr/share/polkit-1/rules.d Nov 20 07:14:32 localhost polkitd[12369]: Finished loading, compiling and executing 2 rules Nov 20 07:14:32 localhost dbus-daemon[1716]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Nov 20 07:14:32 localhost systemd[1]: Started Authorization Manager. Nov 20 07:14:32 localhost polkitd[12369]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Nov 20 07:14:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:33.070Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0b698b78-c1a4-41a1-af1b-deade9786c04/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:33.070Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2cae5774-f2e2-4696-a62b-450a0227fd2b/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:33.071Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1b4af400-099e-4f5c-ac1d-119a4b4d07c3/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:33 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:33 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:33 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:33 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:14:33 localhost systemd[1]: libpod-112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06.scope: Consumed 376ms CPU time Nov 20 07:14:33 localhost podman[12278]: 2019-11-20 07:14:33.121180409 +0000 UTC m=+5.667729672 container died 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:33 localhost podman[12278]: 2019-11-20 07:14:33.207435124 +0000 UTC m=+5.753984354 container remove 112b2858a80f5764b7f1900960b7c7aa90e2a731880d80f3a359ba3e1112bf06 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:33 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:14:35 localhost hyperkube[1909]: I1120 07:14:35.026378 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:35 localhost hyperkube[1909]: I1120 07:14:35.028647 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:35 localhost hyperkube[1909]: I1120 07:14:35.028700 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:35 localhost hyperkube[1909]: I1120 07:14:35.028722 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:35 localhost hyperkube[1909]: E1120 07:14:35.028934 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:35 localhost systemd[1]: Started crio-conmon-75b55a2bfec50ba4ded488d10513ba7ca09b8d912e0ece917150f824eaf0f640.scope. Nov 20 07:14:35 localhost systemd[1]: Created slice libcontainer_12432_systemd_test_default.slice. Nov 20 07:14:35 localhost systemd[1]: Removed slice libcontainer_12432_systemd_test_default.slice. Nov 20 07:14:35 localhost systemd[1]: Started libcontainer container 75b55a2bfec50ba4ded488d10513ba7ca09b8d912e0ece917150f824eaf0f640. Nov 20 07:14:35 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:35 localhost systemd[1]: Stopped libcontainer container 75b55a2bfec50ba4ded488d10513ba7ca09b8d912e0ece917150f824eaf0f640. Nov 20 07:14:35 localhost systemd[1]: crio-75b55a2bfec50ba4ded488d10513ba7ca09b8d912e0ece917150f824eaf0f640.scope: Consumed 36ms CPU time Nov 20 07:14:35 localhost crio[1857]: time="2019-11-20 07:14:35.228567223Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:35 localhost hyperkube[1909]: E1120 07:14:35.287661 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:35 localhost hyperkube[1909]: E1120 07:14:35.287836 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:35 localhost hyperkube[1909]: E1120 07:14:35.287920 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:38 localhost podman[12462]: 2019-11-20 07:14:38.421007739 +0000 UTC m=+0.177780536 container create f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:38 localhost systemd[1]: Started libpod-conmon-f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4.scope. Nov 20 07:14:38 localhost systemd[1]: Created slice libcontainer_12477_systemd_test_default.slice. Nov 20 07:14:38 localhost systemd[1]: Removed slice libcontainer_12477_systemd_test_default.slice. Nov 20 07:14:38 localhost systemd[1]: Started libcontainer container f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4. Nov 20 07:14:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:38 localhost podman[12462]: 2019-11-20 07:14:38.842096987 +0000 UTC m=+0.598869792 container init f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:38 localhost podman[12462]: 2019-11-20 07:14:38.863137332 +0000 UTC m=+0.619910212 container start f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:38 localhost podman[12462]: 2019-11-20 07:14:38.863335629 +0000 UTC m=+0.620108442 container attach f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:39 localhost hyperkube[1909]: I1120 07:14:39.886475 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:39 localhost hyperkube[1909]: I1120 07:14:39.889606 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:39 localhost hyperkube[1909]: I1120 07:14:39.889647 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:39 localhost hyperkube[1909]: I1120 07:14:39.889669 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:43.881Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-618842f2-e506-40dd-9e24-86b10353e0fb/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:43.881Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d8f4a8ac-4e70-4448-bc48-dc7bc5a60cb3/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:43.881Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-bf60e37a-e681-4784-9441-000d703363cb/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:43 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:43 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:43 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:43 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:14:43 localhost systemd[1]: libpod-f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4.scope: Consumed 365ms CPU time Nov 20 07:14:43 localhost podman[12462]: 2019-11-20 07:14:43.932666067 +0000 UTC m=+5.689439043 container died f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:44 localhost podman[12462]: 2019-11-20 07:14:44.008974535 +0000 UTC m=+5.765747363 container remove f490d99a94f04344bc117c3283cbee70dd90c4dc2cde31ab62ba62715abef9b4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:44 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:14:45 localhost hyperkube[1909]: I1120 07:14:45.025996 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:45 localhost hyperkube[1909]: I1120 07:14:45.028175 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:45 localhost hyperkube[1909]: I1120 07:14:45.028218 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:45 localhost hyperkube[1909]: I1120 07:14:45.028240 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:45 localhost hyperkube[1909]: E1120 07:14:45.028443 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:45 localhost systemd[1]: Started crio-conmon-29222d3a3b802f0d6b112027ca710b2d65e4f91214295c7f878df5d766fc6fe9.scope. Nov 20 07:14:45 localhost systemd[1]: Created slice libcontainer_12548_systemd_test_default.slice. Nov 20 07:14:45 localhost systemd[1]: Removed slice libcontainer_12548_systemd_test_default.slice. Nov 20 07:14:45 localhost systemd[1]: Started libcontainer container 29222d3a3b802f0d6b112027ca710b2d65e4f91214295c7f878df5d766fc6fe9. Nov 20 07:14:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:45 localhost systemd[1]: Stopped libcontainer container 29222d3a3b802f0d6b112027ca710b2d65e4f91214295c7f878df5d766fc6fe9. Nov 20 07:14:45 localhost crio[1857]: time="2019-11-20 07:14:45.246189008Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:45 localhost hyperkube[1909]: E1120 07:14:45.293230 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:45 localhost hyperkube[1909]: E1120 07:14:45.293417 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:45 localhost hyperkube[1909]: E1120 07:14:45.293491 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:46 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.025969 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.029874 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.029946 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.029990 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:49 localhost hyperkube[1909]: E1120 07:14:49.030412 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:49 localhost systemd[1]: Started crio-conmon-668abd7773795bdee1aa10b813c2491bf5dda97e9af37df3d75d4ee37ce42699.scope. Nov 20 07:14:49 localhost systemd[1]: Created slice libcontainer_12602_systemd_test_default.slice. Nov 20 07:14:49 localhost systemd[1]: Removed slice libcontainer_12602_systemd_test_default.slice. Nov 20 07:14:49 localhost systemd[1]: Started libcontainer container 668abd7773795bdee1aa10b813c2491bf5dda97e9af37df3d75d4ee37ce42699. Nov 20 07:14:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:49 localhost podman[12592]: 2019-11-20 07:14:49.198892346 +0000 UTC m=+0.152596287 container create 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:49 localhost systemd[1]: Started libpod-conmon-3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c.scope. Nov 20 07:14:49 localhost systemd[1]: crio-668abd7773795bdee1aa10b813c2491bf5dda97e9af37df3d75d4ee37ce42699.scope: Failed to kill control group /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3183db06e25bd66e7f8f564bad04b82.slice/crio-668abd7773795bdee1aa10b813c2491bf5dda97e9af37df3d75d4ee37ce42699.scope, ignoring: No such device Nov 20 07:14:49 localhost systemd[1]: Stopped libcontainer container 668abd7773795bdee1aa10b813c2491bf5dda97e9af37df3d75d4ee37ce42699. Nov 20 07:14:49 localhost crio[1857]: time="2019-11-20 07:14:49.242127664Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:49 localhost systemd[1]: Created slice libcontainer_12631_systemd_test_default.slice. Nov 20 07:14:49 localhost systemd[1]: Removed slice libcontainer_12631_systemd_test_default.slice. Nov 20 07:14:49 localhost hyperkube[1909]: E1120 07:14:49.303548 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:49 localhost hyperkube[1909]: E1120 07:14:49.303699 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:49 localhost hyperkube[1909]: E1120 07:14:49.303754 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:49 localhost systemd[1]: Started libcontainer container 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c. Nov 20 07:14:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:49 localhost podman[12592]: 2019-11-20 07:14:49.661667641 +0000 UTC m=+0.615371616 container init 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:49 localhost podman[12592]: 2019-11-20 07:14:49.684555489 +0000 UTC m=+0.638259460 container start 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:49 localhost podman[12592]: 2019-11-20 07:14:49.685129473 +0000 UTC m=+0.638833455 container attach 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.903712 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.906219 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.906282 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:49 localhost hyperkube[1909]: I1120 07:14:49.906319 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:54 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:54.701Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d5c8e0fc-7fc8-4e0a-a121-5234d29b69c9/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:54 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:54.701Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-44278a9c-80dc-4ced-8c29-dc184ace1443/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:54 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:14:54.701Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-993043f5-4d22-4bb4-90b3-96c1e1caff5a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:14:54 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:54 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:54 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:14:54 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:14:54 localhost systemd[1]: libpod-3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c.scope: Consumed 387ms CPU time Nov 20 07:14:54 localhost podman[12592]: 2019-11-20 07:14:54.747645551 +0000 UTC m=+5.701349551 container died 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:54 localhost podman[12592]: 2019-11-20 07:14:54.839581535 +0000 UTC m=+5.793285550 container remove 3623f5cd9ba2b8d436be9b9c80a6acf9cc99cb46a2309a815dff5c214287625c (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:14:54 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:14:56 localhost hyperkube[1909]: I1120 07:14:56.025983 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:56 localhost hyperkube[1909]: I1120 07:14:56.028568 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:56 localhost hyperkube[1909]: I1120 07:14:56.028617 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:56 localhost hyperkube[1909]: I1120 07:14:56.028647 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:14:56 localhost hyperkube[1909]: E1120 07:14:56.028837 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:14:56 localhost systemd[1]: Started crio-conmon-fe5b56d853f4745b27347a93aa1363afbeed25993fc21589e7117ed5fb4f1ba8.scope. Nov 20 07:14:56 localhost systemd[1]: Created slice libcontainer_12699_systemd_test_default.slice. Nov 20 07:14:56 localhost systemd[1]: Removed slice libcontainer_12699_systemd_test_default.slice. Nov 20 07:14:56 localhost systemd[1]: Started libcontainer container fe5b56d853f4745b27347a93aa1363afbeed25993fc21589e7117ed5fb4f1ba8. Nov 20 07:14:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:14:56 localhost systemd[1]: Stopped libcontainer container fe5b56d853f4745b27347a93aa1363afbeed25993fc21589e7117ed5fb4f1ba8. Nov 20 07:14:56 localhost systemd[1]: crio-fe5b56d853f4745b27347a93aa1363afbeed25993fc21589e7117ed5fb4f1ba8.scope: Consumed 35ms CPU time Nov 20 07:14:56 localhost crio[1857]: time="2019-11-20 07:14:56.251212804Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:56 localhost hyperkube[1909]: E1120 07:14:56.311754 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:56 localhost hyperkube[1909]: E1120 07:14:56.311892 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:14:56 localhost hyperkube[1909]: E1120 07:14:56.311945 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:14:59 localhost hyperkube[1909]: I1120 07:14:59.921833 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:14:59 localhost hyperkube[1909]: I1120 07:14:59.929390 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:14:59 localhost hyperkube[1909]: I1120 07:14:59.929540 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:14:59 localhost hyperkube[1909]: I1120 07:14:59.929585 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:00 localhost podman[12727]: 2019-11-20 07:15:00.048597341 +0000 UTC m=+0.157900151 container create 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:00 localhost systemd[1]: Started libpod-conmon-1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7.scope. Nov 20 07:15:00 localhost systemd[1]: Created slice libcontainer_12741_systemd_test_default.slice. Nov 20 07:15:00 localhost systemd[1]: Removed slice libcontainer_12741_systemd_test_default.slice. Nov 20 07:15:00 localhost systemd[1]: Started libcontainer container 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7. Nov 20 07:15:00 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:00 localhost podman[12727]: 2019-11-20 07:15:00.490791999 +0000 UTC m=+0.600094868 container init 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:00 localhost podman[12727]: 2019-11-20 07:15:00.511259039 +0000 UTC m=+0.620561874 container start 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:00 localhost podman[12727]: 2019-11-20 07:15:00.511431258 +0000 UTC m=+0.620734093 container attach 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:01 localhost hyperkube[1909]: I1120 07:15:01.026267 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:01 localhost hyperkube[1909]: I1120 07:15:01.029636 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:01 localhost hyperkube[1909]: I1120 07:15:01.029696 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:01 localhost hyperkube[1909]: I1120 07:15:01.029718 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:01 localhost hyperkube[1909]: E1120 07:15:01.029977 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:01 localhost systemd[1]: Started crio-conmon-06fedc106d1b6c94be679fdaf46e850271fd2e90eeca941d26834b6cbdc0fa2c.scope. Nov 20 07:15:01 localhost systemd[1]: Created slice libcontainer_12780_systemd_test_default.slice. Nov 20 07:15:01 localhost systemd[1]: Removed slice libcontainer_12780_systemd_test_default.slice. Nov 20 07:15:01 localhost systemd[1]: Started libcontainer container 06fedc106d1b6c94be679fdaf46e850271fd2e90eeca941d26834b6cbdc0fa2c. Nov 20 07:15:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:01 localhost systemd[1]: Stopped libcontainer container 06fedc106d1b6c94be679fdaf46e850271fd2e90eeca941d26834b6cbdc0fa2c. Nov 20 07:15:01 localhost systemd[1]: crio-06fedc106d1b6c94be679fdaf46e850271fd2e90eeca941d26834b6cbdc0fa2c.scope: Consumed 38ms CPU time Nov 20 07:15:01 localhost crio[1857]: time="2019-11-20 07:15:01.256382750Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:01 localhost hyperkube[1909]: E1120 07:15:01.305186 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:01 localhost hyperkube[1909]: E1120 07:15:01.305483 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:01 localhost hyperkube[1909]: E1120 07:15:01.305537 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:05 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:05.525Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e9c518b3-5c6d-45b2-9b5c-60c00c03eef6/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:05 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:05.525Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3d2b842d-6f01-4a10-a390-47ae47e111e7/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:05 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:05.525Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-658f12e0-f2e6-450a-93e3-cf94ea65151e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:05 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:05 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:05 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:05 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:15:05 localhost systemd[1]: libpod-1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7.scope: Consumed 359ms CPU time Nov 20 07:15:05 localhost podman[12727]: 2019-11-20 07:15:05.571277115 +0000 UTC m=+5.680579991 container died 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:05 localhost podman[12727]: 2019-11-20 07:15:05.637736459 +0000 UTC m=+5.747039328 container remove 1f2a5564ff49bf96d966e747c76044d54bea3b0c4a02a22fad82029b7b7c05a7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:05 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:15:06 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:15:08 localhost hyperkube[1909]: I1120 07:15:08.026242 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:08 localhost hyperkube[1909]: I1120 07:15:08.028769 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:08 localhost hyperkube[1909]: I1120 07:15:08.028833 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:08 localhost hyperkube[1909]: I1120 07:15:08.028870 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:08 localhost hyperkube[1909]: E1120 07:15:08.029200 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:08 localhost systemd[1]: Started crio-conmon-28b04df42cde0082dd40e292ce5e7d151c442c0a6fd3793a82029fd03a5ff979.scope. Nov 20 07:15:08 localhost systemd[1]: Created slice libcontainer_12847_systemd_test_default.slice. Nov 20 07:15:08 localhost systemd[1]: Removed slice libcontainer_12847_systemd_test_default.slice. Nov 20 07:15:08 localhost systemd[1]: Started libcontainer container 28b04df42cde0082dd40e292ce5e7d151c442c0a6fd3793a82029fd03a5ff979. Nov 20 07:15:08 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:08 localhost systemd[1]: Stopped libcontainer container 28b04df42cde0082dd40e292ce5e7d151c442c0a6fd3793a82029fd03a5ff979. Nov 20 07:15:08 localhost systemd[1]: crio-28b04df42cde0082dd40e292ce5e7d151c442c0a6fd3793a82029fd03a5ff979.scope: Consumed 39ms CPU time Nov 20 07:15:08 localhost crio[1857]: time="2019-11-20 07:15:08.246412329Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:08 localhost hyperkube[1909]: E1120 07:15:08.303838 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:08 localhost hyperkube[1909]: E1120 07:15:08.303989 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:08 localhost hyperkube[1909]: E1120 07:15:08.304064 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:09 localhost hyperkube[1909]: I1120 07:15:09.950451 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:09 localhost hyperkube[1909]: I1120 07:15:09.952686 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:09 localhost hyperkube[1909]: I1120 07:15:09.952752 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:09 localhost hyperkube[1909]: I1120 07:15:09.952775 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:10 localhost podman[12875]: 2019-11-20 07:15:10.83665893 +0000 UTC m=+0.162993891 container create 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:10 localhost systemd[1]: Started libpod-conmon-72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8.scope. Nov 20 07:15:10 localhost systemd[1]: Created slice libcontainer_12889_systemd_test_default.slice. Nov 20 07:15:10 localhost systemd[1]: Removed slice libcontainer_12889_systemd_test_default.slice. Nov 20 07:15:10 localhost systemd[1]: Started libcontainer container 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8. Nov 20 07:15:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:11 localhost podman[12875]: 2019-11-20 07:15:11.259233308 +0000 UTC m=+0.585568267 container init 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:11 localhost podman[12875]: 2019-11-20 07:15:11.280976536 +0000 UTC m=+0.607311502 container start 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:11 localhost podman[12875]: 2019-11-20 07:15:11.281536587 +0000 UTC m=+0.607871500 container attach 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:13 localhost hyperkube[1909]: I1120 07:15:13.025921 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:13 localhost hyperkube[1909]: I1120 07:15:13.028439 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:13 localhost hyperkube[1909]: I1120 07:15:13.028501 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:13 localhost hyperkube[1909]: I1120 07:15:13.028524 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:13 localhost hyperkube[1909]: E1120 07:15:13.028765 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:13 localhost systemd[1]: Started crio-conmon-a75ddf0dba76a0690a578b514f2a8bd6bef14961f664d4acd0ae2f6de30a2c85.scope. Nov 20 07:15:13 localhost systemd[1]: Created slice libcontainer_12927_systemd_test_default.slice. Nov 20 07:15:13 localhost systemd[1]: Removed slice libcontainer_12927_systemd_test_default.slice. Nov 20 07:15:13 localhost systemd[1]: Started libcontainer container a75ddf0dba76a0690a578b514f2a8bd6bef14961f664d4acd0ae2f6de30a2c85. Nov 20 07:15:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:13 localhost systemd[1]: Stopped libcontainer container a75ddf0dba76a0690a578b514f2a8bd6bef14961f664d4acd0ae2f6de30a2c85. Nov 20 07:15:13 localhost systemd[1]: crio-a75ddf0dba76a0690a578b514f2a8bd6bef14961f664d4acd0ae2f6de30a2c85.scope: Consumed 36ms CPU time Nov 20 07:15:13 localhost crio[1857]: time="2019-11-20 07:15:13.232582549Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:13 localhost hyperkube[1909]: E1120 07:15:13.283143 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:13 localhost hyperkube[1909]: E1120 07:15:13.283314 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:13 localhost hyperkube[1909]: E1120 07:15:13.283367 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:16.299Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-15cad106-3b4c-49e5-8d12-d88e13a88363/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:16.299Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-949fd220-bee2-4153-a6ac-3ee50a1963ce/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:16.299Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f32f0a72-e87e-4ba4-bd04-6794ff65be26/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:16 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:16 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:16 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:16 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:15:16 localhost systemd[1]: libpod-72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8.scope: Consumed 352ms CPU time Nov 20 07:15:16 localhost podman[12875]: 2019-11-20 07:15:16.348757525 +0000 UTC m=+5.675092611 container died 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:16 localhost podman[12875]: 2019-11-20 07:15:16.423223633 +0000 UTC m=+5.749558608 container remove 72bffb3e114b3e2838839d7c1451bb0ab085e9b5ba9744eef4a126b36ee785f8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:16 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:15:19 localhost hyperkube[1909]: I1120 07:15:19.967387 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:19 localhost hyperkube[1909]: I1120 07:15:19.969814 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:19 localhost hyperkube[1909]: I1120 07:15:19.969875 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:19 localhost hyperkube[1909]: I1120 07:15:19.969905 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:21 localhost podman[12980]: 2019-11-20 07:15:21.601925128 +0000 UTC m=+0.138788532 container create 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:21 localhost systemd[1]: Started libpod-conmon-9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd.scope. Nov 20 07:15:21 localhost systemd[1]: Created slice libcontainer_12994_systemd_test_default.slice. Nov 20 07:15:21 localhost systemd[1]: Removed slice libcontainer_12994_systemd_test_default.slice. Nov 20 07:15:21 localhost systemd[1]: Started libcontainer container 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd. Nov 20 07:15:21 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:22 localhost hyperkube[1909]: I1120 07:15:22.028134 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:22 localhost podman[12980]: 2019-11-20 07:15:22.029459231 +0000 UTC m=+0.566322652 container init 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:22 localhost hyperkube[1909]: I1120 07:15:22.032864 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:22 localhost hyperkube[1909]: I1120 07:15:22.032927 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:22 localhost hyperkube[1909]: I1120 07:15:22.032947 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:22 localhost hyperkube[1909]: E1120 07:15:22.033234 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:22 localhost podman[12980]: 2019-11-20 07:15:22.06376337 +0000 UTC m=+0.600626856 container start 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:22 localhost podman[12980]: 2019-11-20 07:15:22.063936167 +0000 UTC m=+0.600799569 container attach 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:22 localhost systemd[1]: Started crio-conmon-1ba01ba170521aeb51bf877168f8a9fdc8aed0704660ed460c78671463f36bdc.scope. Nov 20 07:15:22 localhost systemd[1]: Created slice libcontainer_13031_systemd_test_default.slice. Nov 20 07:15:22 localhost systemd[1]: Removed slice libcontainer_13031_systemd_test_default.slice. Nov 20 07:15:22 localhost systemd[1]: Started libcontainer container 1ba01ba170521aeb51bf877168f8a9fdc8aed0704660ed460c78671463f36bdc. Nov 20 07:15:22 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:22 localhost systemd[1]: Stopped libcontainer container 1ba01ba170521aeb51bf877168f8a9fdc8aed0704660ed460c78671463f36bdc. Nov 20 07:15:22 localhost systemd[1]: crio-1ba01ba170521aeb51bf877168f8a9fdc8aed0704660ed460c78671463f36bdc.scope: Consumed 41ms CPU time Nov 20 07:15:22 localhost crio[1857]: time="2019-11-20 07:15:22.304853473Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:22 localhost hyperkube[1909]: E1120 07:15:22.360536 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:22 localhost hyperkube[1909]: E1120 07:15:22.360712 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:22 localhost hyperkube[1909]: E1120 07:15:22.360783 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:27.079Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-978906f8-2f1c-483a-8edc-8e1abed7e5a5/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:27.080Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-17959e7a-456d-4210-ba42-d1a6bd1fa0f9/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:27.080Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-32c1bfcd-87f2-4ae4-a414-b369ff698df3/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:27 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:27 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:27 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:27 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:15:27 localhost podman[12980]: 2019-11-20 07:15:27.101422382 +0000 UTC m=+5.638285985 container died 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:27 localhost systemd[1]: libpod-9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd.scope: Consumed 350ms CPU time Nov 20 07:15:27 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:15:27 localhost podman[12980]: 2019-11-20 07:15:27.199163195 +0000 UTC m=+5.736026689 container remove 9854b0aac8647b2b6c9c80e5963b2ff9684fd87bd2c60487ae05bb80027ce8bd (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:27 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:15:28 localhost hyperkube[1909]: I1120 07:15:28.026266 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:28 localhost hyperkube[1909]: I1120 07:15:28.028620 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:28 localhost hyperkube[1909]: I1120 07:15:28.028694 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:28 localhost hyperkube[1909]: I1120 07:15:28.028729 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:28 localhost hyperkube[1909]: E1120 07:15:28.029141 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:28 localhost systemd[1]: Started crio-conmon-64ba2feacb5219d2c9bab520af1fd0a26b3a5caf2b962dd511eb039a87de5208.scope. Nov 20 07:15:28 localhost systemd[1]: Created slice libcontainer_13097_systemd_test_default.slice. Nov 20 07:15:28 localhost systemd[1]: Removed slice libcontainer_13097_systemd_test_default.slice. Nov 20 07:15:28 localhost systemd[1]: Started libcontainer container 64ba2feacb5219d2c9bab520af1fd0a26b3a5caf2b962dd511eb039a87de5208. Nov 20 07:15:28 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:28 localhost systemd[1]: Stopped libcontainer container 64ba2feacb5219d2c9bab520af1fd0a26b3a5caf2b962dd511eb039a87de5208. Nov 20 07:15:28 localhost systemd[1]: crio-64ba2feacb5219d2c9bab520af1fd0a26b3a5caf2b962dd511eb039a87de5208.scope: Consumed 41ms CPU time Nov 20 07:15:28 localhost crio[1857]: time="2019-11-20 07:15:28.261117917Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:28 localhost hyperkube[1909]: E1120 07:15:28.319485 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:28 localhost hyperkube[1909]: E1120 07:15:28.319663 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:28 localhost hyperkube[1909]: E1120 07:15:28.319744 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:29 localhost hyperkube[1909]: I1120 07:15:29.987807 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:29 localhost hyperkube[1909]: I1120 07:15:29.989915 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:29 localhost hyperkube[1909]: I1120 07:15:29.989978 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:29 localhost hyperkube[1909]: I1120 07:15:29.990033 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:32 localhost hyperkube[1909]: I1120 07:15:32.026167 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:32 localhost hyperkube[1909]: I1120 07:15:32.028420 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:32 localhost hyperkube[1909]: I1120 07:15:32.028507 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:32 localhost hyperkube[1909]: I1120 07:15:32.028557 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:32 localhost hyperkube[1909]: E1120 07:15:32.029218 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:32 localhost podman[13129]: 2019-11-20 07:15:32.386285014 +0000 UTC m=+0.148373283 container create 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:32 localhost systemd[1]: Started libpod-conmon-64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0.scope. Nov 20 07:15:32 localhost systemd[1]: Created slice libcontainer_13143_systemd_test_default.slice. Nov 20 07:15:32 localhost systemd[1]: Removed slice libcontainer_13143_systemd_test_default.slice. Nov 20 07:15:32 localhost systemd[1]: Started libcontainer container 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0. Nov 20 07:15:32 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:32 localhost podman[13129]: 2019-11-20 07:15:32.878628267 +0000 UTC m=+0.640716552 container init 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:32 localhost podman[13129]: 2019-11-20 07:15:32.903403474 +0000 UTC m=+0.665491758 container start 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:32 localhost podman[13129]: 2019-11-20 07:15:32.903561665 +0000 UTC m=+0.665649968 container attach 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:36 localhost hyperkube[1909]: I1120 07:15:36.026285 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:36 localhost hyperkube[1909]: I1120 07:15:36.028940 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:36 localhost hyperkube[1909]: I1120 07:15:36.029038 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:36 localhost hyperkube[1909]: I1120 07:15:36.029079 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:36 localhost hyperkube[1909]: E1120 07:15:36.029367 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:36 localhost systemd[1]: Started crio-conmon-de51ef98221fe283027cd5a0d7f2438e3ebfc5d632a7733b8ecb5f9ef8d8aa89.scope. Nov 20 07:15:36 localhost systemd[1]: Created slice libcontainer_13181_systemd_test_default.slice. Nov 20 07:15:36 localhost systemd[1]: Removed slice libcontainer_13181_systemd_test_default.slice. Nov 20 07:15:36 localhost systemd[1]: Started libcontainer container de51ef98221fe283027cd5a0d7f2438e3ebfc5d632a7733b8ecb5f9ef8d8aa89. Nov 20 07:15:36 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:36 localhost systemd[1]: Stopped libcontainer container de51ef98221fe283027cd5a0d7f2438e3ebfc5d632a7733b8ecb5f9ef8d8aa89. Nov 20 07:15:36 localhost systemd[1]: crio-de51ef98221fe283027cd5a0d7f2438e3ebfc5d632a7733b8ecb5f9ef8d8aa89.scope: Consumed 37ms CPU time Nov 20 07:15:36 localhost crio[1857]: time="2019-11-20 07:15:36.264251360Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:36 localhost hyperkube[1909]: E1120 07:15:36.325517 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:36 localhost hyperkube[1909]: E1120 07:15:36.325700 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:36 localhost hyperkube[1909]: E1120 07:15:36.325785 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:37.923Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a195c24d-bfdd-4694-8a9d-87ca103cdca3/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:37.923Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-30dced45-b5b6-4031-8615-3c07a9a64886/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:37.923Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-53ede97a-346e-4033-89d8-a514e0486431/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:37 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:37 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:37 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:37 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:15:37 localhost systemd[1]: libpod-64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0.scope: Consumed 408ms CPU time Nov 20 07:15:37 localhost podman[13129]: 2019-11-20 07:15:37.97179756 +0000 UTC m=+5.733885922 container died 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:38 localhost podman[13129]: 2019-11-20 07:15:38.044492092 +0000 UTC m=+5.806580394 container remove 64b32e0c2d066e663aa325cf93e3ae9f942d251bf9621ef0b8fd0f53981fa8d0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:38 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:15:40 localhost hyperkube[1909]: I1120 07:15:40.006824 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:40 localhost hyperkube[1909]: I1120 07:15:40.009500 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:40 localhost hyperkube[1909]: I1120 07:15:40.009568 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:40 localhost hyperkube[1909]: I1120 07:15:40.009606 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:43 localhost hyperkube[1909]: I1120 07:15:43.025986 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:43 localhost hyperkube[1909]: I1120 07:15:43.028966 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:43 localhost hyperkube[1909]: I1120 07:15:43.029061 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:43 localhost hyperkube[1909]: I1120 07:15:43.029125 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:43 localhost hyperkube[1909]: E1120 07:15:43.029429 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:43 localhost systemd[1]: Started crio-conmon-ef7151122ae6cb6e6980505f9766d7a7237db729e07a291fc44bd4117ff2ba37.scope. Nov 20 07:15:43 localhost systemd[1]: Created slice libcontainer_13244_systemd_test_default.slice. Nov 20 07:15:43 localhost systemd[1]: Removed slice libcontainer_13244_systemd_test_default.slice. Nov 20 07:15:43 localhost systemd[1]: Started libcontainer container ef7151122ae6cb6e6980505f9766d7a7237db729e07a291fc44bd4117ff2ba37. Nov 20 07:15:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:43 localhost systemd[1]: Stopped libcontainer container ef7151122ae6cb6e6980505f9766d7a7237db729e07a291fc44bd4117ff2ba37. Nov 20 07:15:43 localhost systemd[1]: crio-ef7151122ae6cb6e6980505f9766d7a7237db729e07a291fc44bd4117ff2ba37.scope: Consumed 35ms CPU time Nov 20 07:15:43 localhost crio[1857]: time="2019-11-20 07:15:43.269503616Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:43 localhost podman[13241]: 2019-11-20 07:15:43.269801773 +0000 UTC m=+0.173445434 container create b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:43 localhost systemd[1]: Started libpod-conmon-b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e.scope. Nov 20 07:15:43 localhost hyperkube[1909]: E1120 07:15:43.328042 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:43 localhost hyperkube[1909]: E1120 07:15:43.328188 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:43 localhost hyperkube[1909]: E1120 07:15:43.328263 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:43 localhost systemd[1]: Created slice libcontainer_13286_systemd_test_default.slice. Nov 20 07:15:43 localhost systemd[1]: Removed slice libcontainer_13286_systemd_test_default.slice. Nov 20 07:15:43 localhost systemd[1]: Started libcontainer container b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e. Nov 20 07:15:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:43 localhost podman[13241]: 2019-11-20 07:15:43.732646316 +0000 UTC m=+0.636289987 container init b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:43 localhost podman[13241]: 2019-11-20 07:15:43.761086748 +0000 UTC m=+0.664730540 container start b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:43 localhost podman[13241]: 2019-11-20 07:15:43.761286638 +0000 UTC m=+0.664930328 container attach b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:47 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:15:48 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:48.780Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-00d32403-43f7-4c3d-98b2-95205ed56999/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:48 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:48.780Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f6f9a80a-5495-422a-9e2a-9ff8fde903cf/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:48 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:48.780Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-741ba030-64cb-4fca-b911-fe8246dfa04a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:48 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:48 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:48 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:48 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:15:48 localhost systemd[1]: libpod-b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e.scope: Consumed 369ms CPU time Nov 20 07:15:48 localhost podman[13241]: 2019-11-20 07:15:48.832958651 +0000 UTC m=+5.736602347 container died b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:48 localhost podman[13241]: 2019-11-20 07:15:48.91657627 +0000 UTC m=+5.820219978 container remove b82938bd75071aa893a20cf6af44b0c5dea6314ed57b354627bb52ec4f747c6e (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:48 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:15:49 localhost hyperkube[1909]: I1120 07:15:49.025856 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:49 localhost hyperkube[1909]: I1120 07:15:49.028133 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:49 localhost hyperkube[1909]: I1120 07:15:49.028201 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:49 localhost hyperkube[1909]: I1120 07:15:49.028235 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:49 localhost hyperkube[1909]: E1120 07:15:49.028522 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:49 localhost systemd[1]: Started crio-conmon-80f848123d88df60c6484bcf2ea6e580a6b61af406f7592e4414fdbf62e0019c.scope. Nov 20 07:15:49 localhost systemd[1]: Created slice libcontainer_13364_systemd_test_default.slice. Nov 20 07:15:49 localhost systemd[1]: Removed slice libcontainer_13364_systemd_test_default.slice. Nov 20 07:15:49 localhost systemd[1]: Started libcontainer container 80f848123d88df60c6484bcf2ea6e580a6b61af406f7592e4414fdbf62e0019c. Nov 20 07:15:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:49 localhost systemd[1]: Stopped libcontainer container 80f848123d88df60c6484bcf2ea6e580a6b61af406f7592e4414fdbf62e0019c. Nov 20 07:15:49 localhost systemd[1]: crio-80f848123d88df60c6484bcf2ea6e580a6b61af406f7592e4414fdbf62e0019c.scope: Consumed 36ms CPU time Nov 20 07:15:49 localhost crio[1857]: time="2019-11-20 07:15:49.249266077Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:49 localhost hyperkube[1909]: E1120 07:15:49.298198 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:49 localhost hyperkube[1909]: E1120 07:15:49.298391 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:49 localhost hyperkube[1909]: E1120 07:15:49.298500 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:50 localhost hyperkube[1909]: I1120 07:15:50.030171 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:50 localhost hyperkube[1909]: I1120 07:15:50.032850 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:50 localhost hyperkube[1909]: I1120 07:15:50.032918 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:50 localhost hyperkube[1909]: I1120 07:15:50.032954 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:54 localhost podman[13395]: 2019-11-20 07:15:54.106238326 +0000 UTC m=+0.153340198 container create c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:54 localhost systemd[1]: Started libpod-conmon-c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef.scope. Nov 20 07:15:54 localhost systemd[1]: Created slice libcontainer_13409_systemd_test_default.slice. Nov 20 07:15:54 localhost systemd[1]: Removed slice libcontainer_13409_systemd_test_default.slice. Nov 20 07:15:54 localhost systemd[1]: Started libcontainer container c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef. Nov 20 07:15:54 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:54 localhost podman[13395]: 2019-11-20 07:15:54.517196766 +0000 UTC m=+0.564298642 container init c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:54 localhost podman[13395]: 2019-11-20 07:15:54.537931155 +0000 UTC m=+0.585033012 container start c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:54 localhost podman[13395]: 2019-11-20 07:15:54.538102016 +0000 UTC m=+0.585203889 container attach c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:57 localhost hyperkube[1909]: I1120 07:15:57.025997 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:15:57 localhost hyperkube[1909]: I1120 07:15:57.028690 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:15:57 localhost hyperkube[1909]: I1120 07:15:57.028751 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:15:57 localhost hyperkube[1909]: I1120 07:15:57.028774 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:15:57 localhost hyperkube[1909]: E1120 07:15:57.028995 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:15:57 localhost systemd[1]: Started crio-conmon-c7de6fdd20c9b1882f308d62a41c742a48401f1030f767d0637773b503a6c21d.scope. Nov 20 07:15:57 localhost systemd[1]: Created slice libcontainer_13446_systemd_test_default.slice. Nov 20 07:15:57 localhost systemd[1]: Removed slice libcontainer_13446_systemd_test_default.slice. Nov 20 07:15:57 localhost systemd[1]: Started libcontainer container c7de6fdd20c9b1882f308d62a41c742a48401f1030f767d0637773b503a6c21d. Nov 20 07:15:57 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:15:57 localhost systemd[1]: Stopped libcontainer container c7de6fdd20c9b1882f308d62a41c742a48401f1030f767d0637773b503a6c21d. Nov 20 07:15:57 localhost systemd[1]: crio-c7de6fdd20c9b1882f308d62a41c742a48401f1030f767d0637773b503a6c21d.scope: Consumed 34ms CPU time Nov 20 07:15:57 localhost crio[1857]: time="2019-11-20 07:15:57.256612869Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:57 localhost hyperkube[1909]: E1120 07:15:57.312182 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:57 localhost hyperkube[1909]: E1120 07:15:57.312420 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:15:57 localhost hyperkube[1909]: E1120 07:15:57.312513 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:15:59 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:59.552Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-177af9a8-affa-464d-a44f-bc7a16676bbe/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:59 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:59.552Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-4e4bfb99-600b-488a-aace-291529a3803b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:59 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:15:59.552Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-593c0e35-67e2-443f-8685-087f346532af/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:15:59 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:59 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:59 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:15:59 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:15:59 localhost systemd[1]: libpod-c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef.scope: Consumed 338ms CPU time Nov 20 07:15:59 localhost podman[13395]: 2019-11-20 07:15:59.605473513 +0000 UTC m=+5.652575413 container died c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:59 localhost podman[13395]: 2019-11-20 07:15:59.689150577 +0000 UTC m=+5.736252462 container remove c6d18af42a3b61ddf0d4534817e0d9c771d964ee67ed69551ebc2734dd9c75ef (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:15:59 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:16:00 localhost hyperkube[1909]: I1120 07:16:00.050051 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:00 localhost hyperkube[1909]: I1120 07:16:00.052358 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:00 localhost hyperkube[1909]: I1120 07:16:00.052410 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:00 localhost hyperkube[1909]: I1120 07:16:00.052433 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:01 localhost hyperkube[1909]: I1120 07:16:01.026268 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:01 localhost hyperkube[1909]: I1120 07:16:01.029323 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:01 localhost hyperkube[1909]: I1120 07:16:01.029395 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:01 localhost hyperkube[1909]: I1120 07:16:01.029426 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:01 localhost hyperkube[1909]: E1120 07:16:01.029730 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:01 localhost systemd[1]: Started crio-conmon-1afc49a555b116f1208d57264bed734497cb23fc0de4b962e594321a47f08018.scope. Nov 20 07:16:01 localhost systemd[1]: Created slice libcontainer_13503_systemd_test_default.slice. Nov 20 07:16:01 localhost systemd[1]: Removed slice libcontainer_13503_systemd_test_default.slice. Nov 20 07:16:01 localhost systemd[1]: Started libcontainer container 1afc49a555b116f1208d57264bed734497cb23fc0de4b962e594321a47f08018. Nov 20 07:16:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:01 localhost systemd[1]: Stopped libcontainer container 1afc49a555b116f1208d57264bed734497cb23fc0de4b962e594321a47f08018. Nov 20 07:16:01 localhost crio[1857]: time="2019-11-20 07:16:01.247412108Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:01 localhost hyperkube[1909]: E1120 07:16:01.300380 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:01 localhost hyperkube[1909]: E1120 07:16:01.300525 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:01 localhost hyperkube[1909]: E1120 07:16:01.300577 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:04 localhost podman[13534]: 2019-11-20 07:16:04.884822228 +0000 UTC m=+0.158324977 container create ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:04 localhost systemd[1]: Started libpod-conmon-ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f.scope. Nov 20 07:16:04 localhost systemd[1]: Created slice libcontainer_13547_systemd_test_default.slice. Nov 20 07:16:04 localhost systemd[1]: Removed slice libcontainer_13547_systemd_test_default.slice. Nov 20 07:16:04 localhost systemd[1]: Started libcontainer container ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f. Nov 20 07:16:05 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:05 localhost podman[13534]: 2019-11-20 07:16:05.345927807 +0000 UTC m=+0.619430527 container init ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:05 localhost podman[13534]: 2019-11-20 07:16:05.366321266 +0000 UTC m=+0.639824040 container start ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:05 localhost podman[13534]: 2019-11-20 07:16:05.366597193 +0000 UTC m=+0.640099978 container attach ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:07 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.026280 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.028782 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.028834 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.028865 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:10 localhost hyperkube[1909]: E1120 07:16:10.029145 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.067597 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.069693 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.069750 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:10 localhost hyperkube[1909]: I1120 07:16:10.069772 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:10 localhost systemd[1]: Started crio-conmon-5ad1a347465e9bab95f0c1d98ce471e84fc2acc5f45d11f0dc31f6f2465bc2c4.scope. Nov 20 07:16:10 localhost systemd[1]: Created slice libcontainer_13601_systemd_test_default.slice. Nov 20 07:16:10 localhost systemd[1]: Removed slice libcontainer_13601_systemd_test_default.slice. Nov 20 07:16:10 localhost systemd[1]: Started libcontainer container 5ad1a347465e9bab95f0c1d98ce471e84fc2acc5f45d11f0dc31f6f2465bc2c4. Nov 20 07:16:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:10 localhost systemd[1]: Stopped libcontainer container 5ad1a347465e9bab95f0c1d98ce471e84fc2acc5f45d11f0dc31f6f2465bc2c4. Nov 20 07:16:10 localhost crio[1857]: time="2019-11-20 07:16:10.236474103Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:10 localhost hyperkube[1909]: E1120 07:16:10.290569 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:10 localhost hyperkube[1909]: E1120 07:16:10.290729 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:10 localhost hyperkube[1909]: E1120 07:16:10.290781 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:10.380Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-cc0af27a-6dc0-4563-8f5a-27fe7b3364b6/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:10.380Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-62474d48-d048-46e6-ba3b-8db460c254f7/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:10.381Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f41fbeb0-0387-4c40-b1cf-28a6d08e9941/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:10 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:10 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:10 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:10 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:16:10 localhost systemd[1]: libpod-ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f.scope: Consumed 375ms CPU time Nov 20 07:16:10 localhost podman[13534]: 2019-11-20 07:16:10.431825786 +0000 UTC m=+5.705328599 container died ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:10 localhost podman[13534]: 2019-11-20 07:16:10.491180658 +0000 UTC m=+5.764683406 container remove ce2438e46419923e0beaed747572a2d0f8323b51260bb5fb4fa033dcfd559b2f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:10 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:16:14 localhost hyperkube[1909]: I1120 07:16:14.026500 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:14 localhost hyperkube[1909]: I1120 07:16:14.029521 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:14 localhost hyperkube[1909]: I1120 07:16:14.029589 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:14 localhost hyperkube[1909]: I1120 07:16:14.029639 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:14 localhost hyperkube[1909]: E1120 07:16:14.029934 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:14 localhost systemd[1]: Started crio-conmon-2af734472a16403424732785c4d1653c6e5b4b2c3fe474d7e342d1a755b71458.scope. Nov 20 07:16:14 localhost systemd[1]: Created slice libcontainer_13650_systemd_test_default.slice. Nov 20 07:16:14 localhost systemd[1]: Removed slice libcontainer_13650_systemd_test_default.slice. Nov 20 07:16:14 localhost systemd[1]: Started libcontainer container 2af734472a16403424732785c4d1653c6e5b4b2c3fe474d7e342d1a755b71458. Nov 20 07:16:14 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:14 localhost systemd[1]: Stopped libcontainer container 2af734472a16403424732785c4d1653c6e5b4b2c3fe474d7e342d1a755b71458. Nov 20 07:16:14 localhost systemd[1]: crio-2af734472a16403424732785c4d1653c6e5b4b2c3fe474d7e342d1a755b71458.scope: Consumed 42ms CPU time Nov 20 07:16:14 localhost crio[1857]: time="2019-11-20 07:16:14.253919246Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:14 localhost hyperkube[1909]: E1120 07:16:14.307526 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:14 localhost hyperkube[1909]: E1120 07:16:14.307701 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:14 localhost hyperkube[1909]: E1120 07:16:14.307759 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:15 localhost podman[13680]: 2019-11-20 07:16:15.707393682 +0000 UTC m=+0.165961167 container create 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:15 localhost systemd[1]: Started libpod-conmon-486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55.scope. Nov 20 07:16:15 localhost systemd[1]: Created slice libcontainer_13694_systemd_test_default.slice. Nov 20 07:16:15 localhost systemd[1]: Removed slice libcontainer_13694_systemd_test_default.slice. Nov 20 07:16:15 localhost systemd[1]: Started libcontainer container 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55. Nov 20 07:16:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:16 localhost podman[13680]: 2019-11-20 07:16:16.115220402 +0000 UTC m=+0.573787879 container init 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:16 localhost podman[13680]: 2019-11-20 07:16:16.135844895 +0000 UTC m=+0.594412415 container start 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:16 localhost podman[13680]: 2019-11-20 07:16:16.136112777 +0000 UTC m=+0.594680251 container attach 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:20 localhost hyperkube[1909]: I1120 07:16:20.085627 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:20 localhost hyperkube[1909]: I1120 07:16:20.088625 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:20 localhost hyperkube[1909]: I1120 07:16:20.088702 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:20 localhost hyperkube[1909]: I1120 07:16:20.088746 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:21.151Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-68bca175-d666-4452-8015-feec6a669c6b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:21.151Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0a3b45a5-a757-4155-8153-3c5c2d3bd4fc/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:21.152Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8713e3ab-c12f-4640-af30-8a5b3c1c3829/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:21 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:21 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:21 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:21 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:16:21 localhost systemd[1]: libpod-486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55.scope: Consumed 346ms CPU time Nov 20 07:16:21 localhost podman[13680]: 2019-11-20 07:16:21.203711454 +0000 UTC m=+5.662278963 container died 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:21 localhost podman[13680]: 2019-11-20 07:16:21.27514618 +0000 UTC m=+5.733713717 container remove 486aadb0fb732d7d6d055f1c80fbb3457b6204649c7a654a735843fcd8586c55 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:21 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:16:24 localhost hyperkube[1909]: I1120 07:16:24.025934 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:24 localhost hyperkube[1909]: I1120 07:16:24.028706 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:24 localhost hyperkube[1909]: I1120 07:16:24.028779 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:24 localhost hyperkube[1909]: I1120 07:16:24.028831 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:24 localhost hyperkube[1909]: E1120 07:16:24.029163 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:24 localhost systemd[1]: Started crio-conmon-1bf49cc02eb698fa66ca65567cb6710ae3002f5449d9d7c77a07d749d90b6a0e.scope. Nov 20 07:16:24 localhost systemd[1]: Created slice libcontainer_13756_systemd_test_default.slice. Nov 20 07:16:24 localhost systemd[1]: Removed slice libcontainer_13756_systemd_test_default.slice. Nov 20 07:16:24 localhost systemd[1]: Started libcontainer container 1bf49cc02eb698fa66ca65567cb6710ae3002f5449d9d7c77a07d749d90b6a0e. Nov 20 07:16:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:24 localhost systemd[1]: Stopped libcontainer container 1bf49cc02eb698fa66ca65567cb6710ae3002f5449d9d7c77a07d749d90b6a0e. Nov 20 07:16:24 localhost systemd[1]: crio-1bf49cc02eb698fa66ca65567cb6710ae3002f5449d9d7c77a07d749d90b6a0e.scope: Consumed 33ms CPU time Nov 20 07:16:24 localhost crio[1857]: time="2019-11-20 07:16:24.249941492Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:24 localhost hyperkube[1909]: E1120 07:16:24.298841 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:24 localhost hyperkube[1909]: E1120 07:16:24.298984 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:24 localhost hyperkube[1909]: E1120 07:16:24.299061 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:26 localhost podman[13784]: 2019-11-20 07:16:26.480938179 +0000 UTC m=+0.173413368 container create 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:26 localhost systemd[1]: Started libpod-conmon-6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b.scope. Nov 20 07:16:26 localhost systemd[1]: Created slice libcontainer_13797_systemd_test_default.slice. Nov 20 07:16:26 localhost systemd[1]: Removed slice libcontainer_13797_systemd_test_default.slice. Nov 20 07:16:26 localhost systemd[1]: Started libcontainer container 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b. Nov 20 07:16:26 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:26 localhost podman[13784]: 2019-11-20 07:16:26.889307766 +0000 UTC m=+0.581782951 container init 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:26 localhost podman[13784]: 2019-11-20 07:16:26.910027962 +0000 UTC m=+0.602503149 container start 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:26 localhost podman[13784]: 2019-11-20 07:16:26.910196663 +0000 UTC m=+0.602671942 container attach 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:27 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:16:29 localhost hyperkube[1909]: I1120 07:16:29.025857 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:29 localhost hyperkube[1909]: I1120 07:16:29.028101 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:29 localhost hyperkube[1909]: I1120 07:16:29.028154 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:29 localhost hyperkube[1909]: I1120 07:16:29.028177 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:29 localhost hyperkube[1909]: E1120 07:16:29.028379 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:29 localhost systemd[1]: Started crio-conmon-a31f7f07e031f7306c67e16b29a808d3fd9d54adf864d9586afb26c3fbd8e8e0.scope. Nov 20 07:16:29 localhost systemd[1]: Created slice libcontainer_13853_systemd_test_default.slice. Nov 20 07:16:29 localhost systemd[1]: Removed slice libcontainer_13853_systemd_test_default.slice. Nov 20 07:16:29 localhost systemd[1]: Started libcontainer container a31f7f07e031f7306c67e16b29a808d3fd9d54adf864d9586afb26c3fbd8e8e0. Nov 20 07:16:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:29 localhost systemd[1]: Stopped libcontainer container a31f7f07e031f7306c67e16b29a808d3fd9d54adf864d9586afb26c3fbd8e8e0. Nov 20 07:16:29 localhost systemd[1]: crio-a31f7f07e031f7306c67e16b29a808d3fd9d54adf864d9586afb26c3fbd8e8e0.scope: Consumed 37ms CPU time Nov 20 07:16:29 localhost crio[1857]: time="2019-11-20 07:16:29.251402807Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:29 localhost hyperkube[1909]: E1120 07:16:29.306073 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:29 localhost hyperkube[1909]: E1120 07:16:29.306235 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:29 localhost hyperkube[1909]: E1120 07:16:29.306310 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:30 localhost hyperkube[1909]: I1120 07:16:30.107687 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:30 localhost hyperkube[1909]: I1120 07:16:30.109840 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:30 localhost hyperkube[1909]: I1120 07:16:30.109953 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:30 localhost hyperkube[1909]: I1120 07:16:30.109976 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:31 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:31.923Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6bd077fe-6fc8-49d7-a42b-15e463ff31ac/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:31 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:31.923Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-15aaec38-992d-42be-a26f-98beb04d2d31/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:31 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:31.923Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b406b32d-3615-4277-a393-25413e960f0e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:31 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:31 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:31 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:31 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:16:31 localhost systemd[1]: libpod-6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b.scope: Consumed 335ms CPU time Nov 20 07:16:31 localhost podman[13784]: 2019-11-20 07:16:31.971630347 +0000 UTC m=+5.664105556 container died 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:32 localhost podman[13784]: 2019-11-20 07:16:32.049492662 +0000 UTC m=+5.741967889 container remove 6a71fe5847ff0a1836eb2790d5679e0a69fbdac050bff14f7baadd4f7429235b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:32 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:16:37 localhost podman[13903]: 2019-11-20 07:16:37.247754024 +0000 UTC m=+0.160440650 container create ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:37 localhost systemd[1]: Started libpod-conmon-ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce.scope. Nov 20 07:16:37 localhost systemd[1]: Created slice libcontainer_13916_systemd_test_default.slice. Nov 20 07:16:37 localhost systemd[1]: Removed slice libcontainer_13916_systemd_test_default.slice. Nov 20 07:16:37 localhost systemd[1]: Started libcontainer container ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce. Nov 20 07:16:37 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:37 localhost podman[13903]: 2019-11-20 07:16:37.650360468 +0000 UTC m=+0.563047130 container init ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:37 localhost podman[13903]: 2019-11-20 07:16:37.670807548 +0000 UTC m=+0.583494190 container start ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:37 localhost podman[13903]: 2019-11-20 07:16:37.670976376 +0000 UTC m=+0.583663005 container attach ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.026141 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.028623 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.028669 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.028699 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:40 localhost hyperkube[1909]: E1120 07:16:40.028895 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:40 localhost systemd[1]: Started crio-conmon-92fa8cd62ca981f0eaefa880b070622b79d49558a1b4084f16d5aac24cd82fe3.scope. Nov 20 07:16:40 localhost systemd[1]: Created slice libcontainer_13969_systemd_test_default.slice. Nov 20 07:16:40 localhost systemd[1]: Removed slice libcontainer_13969_systemd_test_default.slice. Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.128586 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.130662 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.130707 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:40 localhost hyperkube[1909]: I1120 07:16:40.130726 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:40 localhost systemd[1]: Started libcontainer container 92fa8cd62ca981f0eaefa880b070622b79d49558a1b4084f16d5aac24cd82fe3. Nov 20 07:16:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:40 localhost systemd[1]: Stopped libcontainer container 92fa8cd62ca981f0eaefa880b070622b79d49558a1b4084f16d5aac24cd82fe3. Nov 20 07:16:40 localhost systemd[1]: crio-92fa8cd62ca981f0eaefa880b070622b79d49558a1b4084f16d5aac24cd82fe3.scope: Consumed 39ms CPU time Nov 20 07:16:40 localhost crio[1857]: time="2019-11-20 07:16:40.242663834Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:40 localhost hyperkube[1909]: E1120 07:16:40.309918 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:40 localhost hyperkube[1909]: E1120 07:16:40.310110 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:40 localhost hyperkube[1909]: E1120 07:16:40.310167 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:42 localhost hyperkube[1909]: I1120 07:16:42.026391 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:42 localhost hyperkube[1909]: I1120 07:16:42.029114 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:42 localhost hyperkube[1909]: I1120 07:16:42.029176 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:42 localhost hyperkube[1909]: I1120 07:16:42.029222 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:42 localhost hyperkube[1909]: E1120 07:16:42.029544 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:42 localhost systemd[1]: Started crio-conmon-3283fce6003adf32352092fd32ba010663fe21ebaf2d44be54dde4f942f66cf8.scope. Nov 20 07:16:42 localhost systemd[1]: Created slice libcontainer_14000_systemd_test_default.slice. Nov 20 07:16:42 localhost systemd[1]: Removed slice libcontainer_14000_systemd_test_default.slice. Nov 20 07:16:42 localhost systemd[1]: Started libcontainer container 3283fce6003adf32352092fd32ba010663fe21ebaf2d44be54dde4f942f66cf8. Nov 20 07:16:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:42 localhost systemd[1]: Stopped libcontainer container 3283fce6003adf32352092fd32ba010663fe21ebaf2d44be54dde4f942f66cf8. Nov 20 07:16:42 localhost systemd[1]: crio-3283fce6003adf32352092fd32ba010663fe21ebaf2d44be54dde4f942f66cf8.scope: Consumed 33ms CPU time Nov 20 07:16:42 localhost crio[1857]: time="2019-11-20 07:16:42.302641458Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:42 localhost hyperkube[1909]: E1120 07:16:42.350252 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:42 localhost hyperkube[1909]: E1120 07:16:42.350408 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:42 localhost hyperkube[1909]: E1120 07:16:42.350498 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:42 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:42.685Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2ce08f01-c69a-49e5-8956-a070a08b1a1d/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:42 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:42.685Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-259a16f1-c0ac-4e22-9226-9a48a181cfc5/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:42 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:42.686Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c391dc1a-ae38-4543-9fe3-d37109a5c6e5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:42 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:42 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:42 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:42 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:16:42 localhost systemd[1]: libpod-ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce.scope: Consumed 339ms CPU time Nov 20 07:16:42 localhost podman[13903]: 2019-11-20 07:16:42.730778668 +0000 UTC m=+5.643465350 container died ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:42 localhost podman[13903]: 2019-11-20 07:16:42.792281509 +0000 UTC m=+5.704968189 container remove ebf84d57b7f354076494c40eb31dfa11e06a44ab28c034ad62dade3e598ae2ce (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:42 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:16:47 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:16:47 localhost podman[14059]: 2019-11-20 07:16:47.970001156 +0000 UTC m=+0.144892775 container create 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:48 localhost systemd[1]: Started libpod-conmon-784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43.scope. Nov 20 07:16:48 localhost systemd[1]: Created slice libcontainer_14075_systemd_test_default.slice. Nov 20 07:16:48 localhost systemd[1]: Removed slice libcontainer_14075_systemd_test_default.slice. Nov 20 07:16:48 localhost systemd[1]: Started libcontainer container 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43. Nov 20 07:16:48 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:48 localhost podman[14059]: 2019-11-20 07:16:48.432568595 +0000 UTC m=+0.607460217 container init 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:48 localhost podman[14059]: 2019-11-20 07:16:48.45646045 +0000 UTC m=+0.631352069 container start 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:48 localhost podman[14059]: 2019-11-20 07:16:48.456638281 +0000 UTC m=+0.631529892 container attach 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:50 localhost hyperkube[1909]: I1120 07:16:50.153521 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:50 localhost hyperkube[1909]: I1120 07:16:50.155957 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:50 localhost hyperkube[1909]: I1120 07:16:50.156057 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:50 localhost hyperkube[1909]: I1120 07:16:50.156096 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:53 localhost hyperkube[1909]: I1120 07:16:53.026094 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:53 localhost hyperkube[1909]: I1120 07:16:53.028531 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:53 localhost hyperkube[1909]: I1120 07:16:53.028575 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:53 localhost hyperkube[1909]: I1120 07:16:53.028600 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:53 localhost hyperkube[1909]: E1120 07:16:53.028820 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:53 localhost systemd[1]: Started crio-conmon-578eaa937f992975c9f13b61cc2b62212b2ef0864976a0f0aa54e2cc8f8c35cc.scope. Nov 20 07:16:53 localhost systemd[1]: Starting Cleanup of Temporary Directories... Nov 20 07:16:53 localhost systemd[1]: Created slice libcontainer_14115_systemd_test_default.slice. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/mdadm.conf:1] Line references path below legacy directory /var/run/, updating /var/run/mdadm → /run/mdadm; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/pkg-dbus-daemon.conf:1] Duplicate line for path "/var/lib/dbus", ignoring. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/pkg-mdadm.conf:1] Line references path below legacy directory /var/run/, updating /var/run/mdadm → /run/mdadm; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/pkg-pam.conf:1] Line references path below legacy directory /var/run/, updating /var/run/console → /run/console; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/pkg-pam.conf:2] Line references path below legacy directory /var/run/, updating /var/run/faillock → /run/faillock; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/pkg-pam.conf:3] Line references path below legacy directory /var/run/, updating /var/run/sepermit → /run/sepermit; please update the tmpfiles.d/ drop-in file accordingly. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/rpm-ostree-1-autovar.conf:1] Duplicate line for path "/var/lib/alternatives", ignoring. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/tmp.conf:12] Duplicate line for path "/var/tmp", ignoring. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/var.conf:19] Duplicate line for path "/var/cache", ignoring. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/var.conf:21] Duplicate line for path "/var/lib", ignoring. Nov 20 07:16:53 localhost systemd-tmpfiles[14117]: [/usr/lib/tmpfiles.d/var.conf:23] Duplicate line for path "/var/spool", ignoring. Nov 20 07:16:53 localhost systemd[1]: Removed slice libcontainer_14115_systemd_test_default.slice. Nov 20 07:16:53 localhost systemd[1]: Started Cleanup of Temporary Directories. Nov 20 07:16:53 localhost systemd[1]: Started libcontainer container 578eaa937f992975c9f13b61cc2b62212b2ef0864976a0f0aa54e2cc8f8c35cc. Nov 20 07:16:53 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:53 localhost systemd[1]: Stopped libcontainer container 578eaa937f992975c9f13b61cc2b62212b2ef0864976a0f0aa54e2cc8f8c35cc. Nov 20 07:16:53 localhost systemd[1]: crio-578eaa937f992975c9f13b61cc2b62212b2ef0864976a0f0aa54e2cc8f8c35cc.scope: Consumed 36ms CPU time Nov 20 07:16:53 localhost crio[1857]: time="2019-11-20 07:16:53.250168375Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:53 localhost hyperkube[1909]: E1120 07:16:53.316390 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:53 localhost hyperkube[1909]: E1120 07:16:53.316541 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:53 localhost hyperkube[1909]: E1120 07:16:53.316603 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:53.468Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5089216f-0701-408a-bb13-1371b24710c8/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:53.468Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d121a1ab-7f83-4022-b1e7-8212f65fae3e/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:16:53.468Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c03480fd-feb8-4b07-ae29-735c70907c9e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:16:53 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:53 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:53 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:16:53 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:16:53 localhost systemd[1]: libpod-784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43.scope: Consumed 351ms CPU time Nov 20 07:16:53 localhost podman[14059]: 2019-11-20 07:16:53.518910436 +0000 UTC m=+5.693802124 container died 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:53 localhost podman[14059]: 2019-11-20 07:16:53.594615015 +0000 UTC m=+5.769506693 container remove 784075b3fc2af0f9ea9641ef37432986e30a06f900130be4c14e8bbabe4c5d43 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:53 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.025956 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.026797 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.028417 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.028458 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.028478 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:54 localhost hyperkube[1909]: E1120 07:16:54.028669 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.029751 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.029783 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:16:54 localhost hyperkube[1909]: I1120 07:16:54.029802 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:16:54 localhost hyperkube[1909]: E1120 07:16:54.030142 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:16:54 localhost systemd[1]: Started crio-conmon-eb286fcb9b89cccfb400a163e0b966fe6da14adb0859a7f4110f72d896767f8b.scope. Nov 20 07:16:54 localhost systemd[1]: Created slice libcontainer_14167_systemd_test_default.slice. Nov 20 07:16:54 localhost systemd[1]: Removed slice libcontainer_14167_systemd_test_default.slice. Nov 20 07:16:54 localhost systemd[1]: Started libcontainer container eb286fcb9b89cccfb400a163e0b966fe6da14adb0859a7f4110f72d896767f8b. Nov 20 07:16:54 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:54 localhost systemd[1]: Stopped libcontainer container eb286fcb9b89cccfb400a163e0b966fe6da14adb0859a7f4110f72d896767f8b. Nov 20 07:16:54 localhost systemd[1]: crio-eb286fcb9b89cccfb400a163e0b966fe6da14adb0859a7f4110f72d896767f8b.scope: Consumed 34ms CPU time Nov 20 07:16:54 localhost crio[1857]: time="2019-11-20 07:16:54.244534848Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:54 localhost hyperkube[1909]: E1120 07:16:54.295567 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:54 localhost hyperkube[1909]: E1120 07:16:54.295720 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:16:54 localhost hyperkube[1909]: E1120 07:16:54.295773 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:16:58 localhost podman[14196]: 2019-11-20 07:16:58.790502505 +0000 UTC m=+0.160765664 container create 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:58 localhost systemd[1]: Started libpod-conmon-6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264.scope. Nov 20 07:16:58 localhost systemd[1]: Created slice libcontainer_14210_systemd_test_default.slice. Nov 20 07:16:58 localhost systemd[1]: Removed slice libcontainer_14210_systemd_test_default.slice. Nov 20 07:16:58 localhost systemd[1]: Started libcontainer container 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264. Nov 20 07:16:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:16:59 localhost podman[14196]: 2019-11-20 07:16:59.222410158 +0000 UTC m=+0.592673339 container init 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:59 localhost podman[14196]: 2019-11-20 07:16:59.242206937 +0000 UTC m=+0.612470088 container start 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:16:59 localhost podman[14196]: 2019-11-20 07:16:59.242427662 +0000 UTC m=+0.612690840 container attach 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:00 localhost hyperkube[1909]: I1120 07:17:00.171229 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:00 localhost hyperkube[1909]: I1120 07:17:00.173924 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:00 localhost hyperkube[1909]: I1120 07:17:00.173996 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:00 localhost hyperkube[1909]: I1120 07:17:00.174066 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:04 localhost hyperkube[1909]: I1120 07:17:04.026165 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:04 localhost hyperkube[1909]: I1120 07:17:04.028496 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:04 localhost hyperkube[1909]: I1120 07:17:04.028565 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:04 localhost hyperkube[1909]: I1120 07:17:04.028603 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:04 localhost hyperkube[1909]: E1120 07:17:04.028909 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:04 localhost systemd[1]: Started crio-conmon-2048aec9c39ec4c61b3333c91cecd8a25d6a1d06afbbd293cac24e733b20df93.scope. Nov 20 07:17:04 localhost systemd[1]: Created slice libcontainer_14250_systemd_test_default.slice. Nov 20 07:17:04 localhost systemd[1]: Removed slice libcontainer_14250_systemd_test_default.slice. Nov 20 07:17:04 localhost systemd[1]: Started libcontainer container 2048aec9c39ec4c61b3333c91cecd8a25d6a1d06afbbd293cac24e733b20df93. Nov 20 07:17:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:04 localhost systemd[1]: Stopped libcontainer container 2048aec9c39ec4c61b3333c91cecd8a25d6a1d06afbbd293cac24e733b20df93. Nov 20 07:17:04 localhost systemd[1]: crio-2048aec9c39ec4c61b3333c91cecd8a25d6a1d06afbbd293cac24e733b20df93.scope: Consumed 36ms CPU time Nov 20 07:17:04 localhost crio[1857]: time="2019-11-20 07:17:04.232508894Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:04.256Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-026bb5b8-845b-45a4-81d2-1f8deccc1740/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:04.257Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-108ba86c-8511-47e7-854f-d187e00ca3e4/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:04.257Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-916e1e39-bf42-40d7-952e-6d5ed225dbea/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:04 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:04 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:04 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:04 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:17:04 localhost systemd[1]: libpod-6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264.scope: Consumed 368ms CPU time Nov 20 07:17:04 localhost hyperkube[1909]: E1120 07:17:04.303353 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:04 localhost hyperkube[1909]: E1120 07:17:04.303549 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:04 localhost hyperkube[1909]: E1120 07:17:04.303697 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:04 localhost podman[14196]: 2019-11-20 07:17:04.310690707 +0000 UTC m=+5.680953917 container died 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:04 localhost podman[14196]: 2019-11-20 07:17:04.38199928 +0000 UTC m=+5.752262614 container remove 6b63f870ba7f5c8fa512b425920f746696dda3f5031b258339c7d1f2bce19264 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:04 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:17:07 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:17:08 localhost hyperkube[1909]: I1120 07:17:08.026407 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:08 localhost hyperkube[1909]: I1120 07:17:08.028885 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:08 localhost hyperkube[1909]: I1120 07:17:08.028934 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:08 localhost hyperkube[1909]: I1120 07:17:08.028955 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:08 localhost hyperkube[1909]: E1120 07:17:08.029196 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:08 localhost systemd[1]: Started crio-conmon-d97734135463145360c3e5064142189cdc087d9d094041d792a0642b0d1c449b.scope. Nov 20 07:17:08 localhost systemd[1]: Created slice libcontainer_14314_systemd_test_default.slice. Nov 20 07:17:08 localhost systemd[1]: Removed slice libcontainer_14314_systemd_test_default.slice. Nov 20 07:17:08 localhost systemd[1]: Started libcontainer container d97734135463145360c3e5064142189cdc087d9d094041d792a0642b0d1c449b. Nov 20 07:17:08 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:08 localhost systemd[1]: Stopped libcontainer container d97734135463145360c3e5064142189cdc087d9d094041d792a0642b0d1c449b. Nov 20 07:17:08 localhost crio[1857]: time="2019-11-20 07:17:08.247608710Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:08 localhost hyperkube[1909]: E1120 07:17:08.333295 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:08 localhost hyperkube[1909]: E1120 07:17:08.333446 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:08 localhost hyperkube[1909]: E1120 07:17:08.333512 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:09 localhost podman[14343]: 2019-11-20 07:17:09.575234627 +0000 UTC m=+0.155916364 container create 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:09 localhost systemd[1]: Started libpod-conmon-990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5.scope. Nov 20 07:17:09 localhost systemd[1]: Created slice libcontainer_14357_systemd_test_default.slice. Nov 20 07:17:09 localhost systemd[1]: Removed slice libcontainer_14357_systemd_test_default.slice. Nov 20 07:17:09 localhost systemd[1]: Started libcontainer container 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5. Nov 20 07:17:09 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:09 localhost podman[14343]: 2019-11-20 07:17:09.987984443 +0000 UTC m=+0.568666174 container init 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:10 localhost podman[14343]: 2019-11-20 07:17:10.010499757 +0000 UTC m=+0.591181496 container start 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:10 localhost podman[14343]: 2019-11-20 07:17:10.010693862 +0000 UTC m=+0.591375610 container attach 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:10 localhost hyperkube[1909]: I1120 07:17:10.190221 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:10 localhost hyperkube[1909]: I1120 07:17:10.192693 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:10 localhost hyperkube[1909]: I1120 07:17:10.192763 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:10 localhost hyperkube[1909]: I1120 07:17:10.192786 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:15.024Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ff3dc616-10ce-4042-8d44-5e0f0c1591f8/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:15.024Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ced30999-6e43-4040-9547-a2384e6594d5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:15.024Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-07eed066-42af-44d7-b070-8e17a75b4b61/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:15 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:15 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:15 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:15 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:17:15 localhost systemd[1]: libpod-990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5.scope: Consumed 356ms CPU time Nov 20 07:17:15 localhost podman[14343]: 2019-11-20 07:17:15.074643984 +0000 UTC m=+5.655325804 container died 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:15 localhost podman[14343]: 2019-11-20 07:17:15.157360669 +0000 UTC m=+5.738042461 container remove 990d367d47104b90188458827d551670fefd85aeae8ec9bf547f52f8cfaa72e5 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:15 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:17:18 localhost hyperkube[1909]: I1120 07:17:18.026085 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:18 localhost hyperkube[1909]: I1120 07:17:18.028090 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:18 localhost hyperkube[1909]: I1120 07:17:18.028153 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:18 localhost hyperkube[1909]: I1120 07:17:18.028190 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:18 localhost hyperkube[1909]: E1120 07:17:18.028479 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:18 localhost systemd[1]: Started crio-conmon-2d19c6357b3b682ad08d3b3a8747c14334bd3745ecc3e762f246d905932f7e80.scope. Nov 20 07:17:18 localhost systemd[1]: Created slice libcontainer_14417_systemd_test_default.slice. Nov 20 07:17:18 localhost systemd[1]: Removed slice libcontainer_14417_systemd_test_default.slice. Nov 20 07:17:18 localhost systemd[1]: Started libcontainer container 2d19c6357b3b682ad08d3b3a8747c14334bd3745ecc3e762f246d905932f7e80. Nov 20 07:17:18 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:18 localhost systemd[1]: Stopped libcontainer container 2d19c6357b3b682ad08d3b3a8747c14334bd3745ecc3e762f246d905932f7e80. Nov 20 07:17:18 localhost systemd[1]: crio-2d19c6357b3b682ad08d3b3a8747c14334bd3745ecc3e762f246d905932f7e80.scope: Consumed 35ms CPU time Nov 20 07:17:18 localhost crio[1857]: time="2019-11-20 07:17:18.242238210Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:18 localhost hyperkube[1909]: E1120 07:17:18.308059 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:18 localhost hyperkube[1909]: E1120 07:17:18.308228 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:18 localhost hyperkube[1909]: E1120 07:17:18.308281 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:20 localhost hyperkube[1909]: I1120 07:17:20.208360 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:20 localhost hyperkube[1909]: I1120 07:17:20.210951 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:20 localhost hyperkube[1909]: I1120 07:17:20.211038 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:20 localhost hyperkube[1909]: I1120 07:17:20.211074 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:20 localhost podman[14446]: 2019-11-20 07:17:20.362599427 +0000 UTC m=+0.165439840 container create 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:20 localhost systemd[1]: Started libpod-conmon-4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24.scope. Nov 20 07:17:20 localhost systemd[1]: Created slice libcontainer_14460_systemd_test_default.slice. Nov 20 07:17:20 localhost systemd[1]: Removed slice libcontainer_14460_systemd_test_default.slice. Nov 20 07:17:20 localhost systemd[1]: Started libcontainer container 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24. Nov 20 07:17:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:20 localhost podman[14446]: 2019-11-20 07:17:20.77440966 +0000 UTC m=+0.577250059 container init 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:20 localhost podman[14446]: 2019-11-20 07:17:20.79488753 +0000 UTC m=+0.597727938 container start 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:20 localhost podman[14446]: 2019-11-20 07:17:20.795055893 +0000 UTC m=+0.597896306 container attach 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:22 localhost hyperkube[1909]: I1120 07:17:22.025991 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:22 localhost hyperkube[1909]: I1120 07:17:22.028455 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:22 localhost hyperkube[1909]: I1120 07:17:22.028525 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:22 localhost hyperkube[1909]: I1120 07:17:22.028555 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:22 localhost hyperkube[1909]: E1120 07:17:22.028852 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:22 localhost systemd[1]: Started crio-conmon-d79c1d1e21f2909be113cdba4522c3f7be5e22bbc2b39254210c22fc73535d9e.scope. Nov 20 07:17:22 localhost systemd[1]: Created slice libcontainer_14499_systemd_test_default.slice. Nov 20 07:17:22 localhost systemd[1]: Removed slice libcontainer_14499_systemd_test_default.slice. Nov 20 07:17:22 localhost systemd[1]: Started libcontainer container d79c1d1e21f2909be113cdba4522c3f7be5e22bbc2b39254210c22fc73535d9e. Nov 20 07:17:22 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:22 localhost systemd[1]: Stopped libcontainer container d79c1d1e21f2909be113cdba4522c3f7be5e22bbc2b39254210c22fc73535d9e. Nov 20 07:17:22 localhost systemd[1]: crio-d79c1d1e21f2909be113cdba4522c3f7be5e22bbc2b39254210c22fc73535d9e.scope: Consumed 38ms CPU time Nov 20 07:17:22 localhost crio[1857]: time="2019-11-20 07:17:22.278990669Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:22 localhost hyperkube[1909]: E1120 07:17:22.333188 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:22 localhost hyperkube[1909]: E1120 07:17:22.333331 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:22 localhost hyperkube[1909]: E1120 07:17:22.333388 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:25 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:25.807Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-655069fd-c0b6-484d-a79d-7ffdbca46846/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:25 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:25.807Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0bff1abf-4b8d-43c9-b1b7-07775cfb6e22/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:25 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:25.807Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-233dca7e-64b1-4ccf-b8a9-8e98cb49ac5b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:25 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:25 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:25 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:25 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:17:25 localhost systemd[1]: libpod-4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24.scope: Consumed 337ms CPU time Nov 20 07:17:25 localhost podman[14446]: 2019-11-20 07:17:25.84985321 +0000 UTC m=+5.652693659 container died 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:25 localhost podman[14446]: 2019-11-20 07:17:25.9158035 +0000 UTC m=+5.718643964 container remove 4ae0b3d8d744fd5849b49cef64bab741edd72ff4232dacd6af18721b254b9b24 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:25 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:17:28 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:17:30 localhost hyperkube[1909]: I1120 07:17:30.235859 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:30 localhost hyperkube[1909]: I1120 07:17:30.238534 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:30 localhost hyperkube[1909]: I1120 07:17:30.238633 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:30 localhost hyperkube[1909]: I1120 07:17:30.238672 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:31 localhost hyperkube[1909]: I1120 07:17:31.026900 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:31 localhost hyperkube[1909]: I1120 07:17:31.029605 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:31 localhost hyperkube[1909]: I1120 07:17:31.029678 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:31 localhost hyperkube[1909]: I1120 07:17:31.029712 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:31 localhost hyperkube[1909]: E1120 07:17:31.029975 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:31 localhost systemd[1]: Started crio-conmon-7ef7fc3a4214d607ebc0a740f5e264793363a3943a1a1d76dcead2883afeaffc.scope. Nov 20 07:17:31 localhost systemd[1]: Created slice libcontainer_14577_systemd_test_default.slice. Nov 20 07:17:31 localhost systemd[1]: Removed slice libcontainer_14577_systemd_test_default.slice. Nov 20 07:17:31 localhost podman[14564]: 2019-11-20 07:17:31.129267766 +0000 UTC m=+0.175039786 container create e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:31 localhost systemd[1]: Started libcontainer container 7ef7fc3a4214d607ebc0a740f5e264793363a3943a1a1d76dcead2883afeaffc. Nov 20 07:17:31 localhost systemd[1]: Started libpod-conmon-e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b.scope. Nov 20 07:17:31 localhost systemd[1]: Created slice libcontainer_14591_systemd_test_default.slice. Nov 20 07:17:31 localhost systemd[1]: Removed slice libcontainer_14591_systemd_test_default.slice. Nov 20 07:17:31 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:31 localhost systemd[1]: Started libcontainer container e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b. Nov 20 07:17:31 localhost systemd[1]: Stopped libcontainer container 7ef7fc3a4214d607ebc0a740f5e264793363a3943a1a1d76dcead2883afeaffc. Nov 20 07:17:31 localhost crio[1857]: time="2019-11-20 07:17:31.277957734Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:31 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:31 localhost hyperkube[1909]: E1120 07:17:31.342384 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:31 localhost hyperkube[1909]: E1120 07:17:31.342523 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:31 localhost hyperkube[1909]: E1120 07:17:31.342694 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:31 localhost podman[14564]: 2019-11-20 07:17:31.592193455 +0000 UTC m=+0.637965481 container init e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:31 localhost podman[14564]: 2019-11-20 07:17:31.619908868 +0000 UTC m=+0.665680913 container start e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:31 localhost podman[14564]: 2019-11-20 07:17:31.620164991 +0000 UTC m=+0.665936995 container attach e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:34 localhost hyperkube[1909]: I1120 07:17:34.026064 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:34 localhost hyperkube[1909]: I1120 07:17:34.028542 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:34 localhost hyperkube[1909]: I1120 07:17:34.028590 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:34 localhost hyperkube[1909]: I1120 07:17:34.028612 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:34 localhost hyperkube[1909]: E1120 07:17:34.028795 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:34 localhost systemd[1]: Started crio-conmon-a64222cb4bb317e3ddac46a32598f0030edae2e1a712eb1a085412b65411586f.scope. Nov 20 07:17:34 localhost systemd[1]: Created slice libcontainer_14649_systemd_test_default.slice. Nov 20 07:17:34 localhost systemd[1]: Removed slice libcontainer_14649_systemd_test_default.slice. Nov 20 07:17:34 localhost systemd[1]: Started libcontainer container a64222cb4bb317e3ddac46a32598f0030edae2e1a712eb1a085412b65411586f. Nov 20 07:17:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:34 localhost systemd[1]: Stopped libcontainer container a64222cb4bb317e3ddac46a32598f0030edae2e1a712eb1a085412b65411586f. Nov 20 07:17:34 localhost systemd[1]: crio-a64222cb4bb317e3ddac46a32598f0030edae2e1a712eb1a085412b65411586f.scope: Consumed 42ms CPU time Nov 20 07:17:34 localhost crio[1857]: time="2019-11-20 07:17:34.268027171Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:34 localhost hyperkube[1909]: E1120 07:17:34.330438 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:34 localhost hyperkube[1909]: E1120 07:17:34.330853 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:34 localhost hyperkube[1909]: E1120 07:17:34.330914 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:36 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:36.636Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3a4c4f2b-2ca5-4034-9879-2e4b70efba7d/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:36 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:36.636Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9033d8da-be96-46f3-99df-9228ff41e96b/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:36 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:36.637Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b86161b1-84df-478a-b46d-4b51c45a6ec9/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:36 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:36 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:36 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:36 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:17:36 localhost systemd[1]: libpod-e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b.scope: Consumed 352ms CPU time Nov 20 07:17:36 localhost podman[14564]: 2019-11-20 07:17:36.682500567 +0000 UTC m=+5.728272622 container died e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:36 localhost podman[14564]: 2019-11-20 07:17:36.748284976 +0000 UTC m=+5.794057006 container remove e1ac39d2cc49ca8c15223b7de622feb30ae7d76699d9fac6a1bfbc158300cb4b (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:36 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:17:38 localhost hyperkube[1909]: E1120 07:17:38.217613 1909 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service Nov 20 07:17:40 localhost hyperkube[1909]: I1120 07:17:40.256582 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:40 localhost hyperkube[1909]: I1120 07:17:40.259275 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:40 localhost hyperkube[1909]: I1120 07:17:40.259352 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:40 localhost hyperkube[1909]: I1120 07:17:40.259403 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:41 localhost podman[14712]: 2019-11-20 07:17:41.933552053 +0000 UTC m=+0.152057288 container create c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:41 localhost systemd[1]: Started libpod-conmon-c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56.scope. Nov 20 07:17:42 localhost systemd[1]: Created slice libcontainer_14726_systemd_test_default.slice. Nov 20 07:17:42 localhost systemd[1]: Removed slice libcontainer_14726_systemd_test_default.slice. Nov 20 07:17:42 localhost systemd[1]: Started libcontainer container c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56. Nov 20 07:17:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:42 localhost podman[14712]: 2019-11-20 07:17:42.379554368 +0000 UTC m=+0.598059618 container init c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:42 localhost podman[14712]: 2019-11-20 07:17:42.401063677 +0000 UTC m=+0.619568910 container start c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:42 localhost podman[14712]: 2019-11-20 07:17:42.401258253 +0000 UTC m=+0.619763533 container attach c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:43 localhost hyperkube[1909]: I1120 07:17:43.026161 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:43 localhost hyperkube[1909]: I1120 07:17:43.028694 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:43 localhost hyperkube[1909]: I1120 07:17:43.028754 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:43 localhost hyperkube[1909]: I1120 07:17:43.028781 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:43 localhost hyperkube[1909]: E1120 07:17:43.029033 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:43 localhost systemd[1]: Started crio-conmon-efaafca00b8849f3185bcd5ae9dd18a26a18a6b059a78e4eb34d8aa289c0ab97.scope. Nov 20 07:17:43 localhost systemd[1]: Created slice libcontainer_14762_systemd_test_default.slice. Nov 20 07:17:43 localhost systemd[1]: Removed slice libcontainer_14762_systemd_test_default.slice. Nov 20 07:17:43 localhost systemd[1]: Started libcontainer container efaafca00b8849f3185bcd5ae9dd18a26a18a6b059a78e4eb34d8aa289c0ab97. Nov 20 07:17:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:43 localhost systemd[1]: Stopped libcontainer container efaafca00b8849f3185bcd5ae9dd18a26a18a6b059a78e4eb34d8aa289c0ab97. Nov 20 07:17:43 localhost systemd[1]: crio-efaafca00b8849f3185bcd5ae9dd18a26a18a6b059a78e4eb34d8aa289c0ab97.scope: Consumed 38ms CPU time Nov 20 07:17:43 localhost crio[1857]: time="2019-11-20 07:17:43.228583380Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:43 localhost hyperkube[1909]: E1120 07:17:43.273805 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:43 localhost hyperkube[1909]: E1120 07:17:43.273970 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:43 localhost hyperkube[1909]: E1120 07:17:43.274050 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:47.414Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fb7fb80c-bd26-490b-ab4b-46d85ae59400/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:47.415Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8ffdbb67-aff3-44e0-8f6b-d60ead04be14/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:47.415Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-aa88aa98-7506-4877-ba95-6d8d0b28c0a6/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:47 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:47 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:47 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:47 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:17:47 localhost systemd[1]: libpod-c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56.scope: Consumed 369ms CPU time Nov 20 07:17:47 localhost podman[14712]: 2019-11-20 07:17:47.466647742 +0000 UTC m=+5.685153002 container died c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:47 localhost podman[14712]: 2019-11-20 07:17:47.541523466 +0000 UTC m=+5.760028722 container remove c84d22ab81fe4b8fa56d22a8942f9fadcc20bc08e982a085a4bfb4ac34716f56 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:47 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:17:48 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:17:49 localhost hyperkube[1909]: I1120 07:17:49.025959 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:49 localhost hyperkube[1909]: I1120 07:17:49.028466 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:49 localhost hyperkube[1909]: I1120 07:17:49.028539 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:49 localhost hyperkube[1909]: I1120 07:17:49.028577 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:49 localhost hyperkube[1909]: E1120 07:17:49.028908 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:49 localhost systemd[1]: Started crio-conmon-9a2336491c1a96b7593e846ed575497beca882957cf6e307b7b36965fd221786.scope. Nov 20 07:17:49 localhost systemd[1]: Created slice libcontainer_14833_systemd_test_default.slice. Nov 20 07:17:49 localhost systemd[1]: Removed slice libcontainer_14833_systemd_test_default.slice. Nov 20 07:17:49 localhost systemd[1]: Started libcontainer container 9a2336491c1a96b7593e846ed575497beca882957cf6e307b7b36965fd221786. Nov 20 07:17:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:49 localhost systemd[1]: Stopped libcontainer container 9a2336491c1a96b7593e846ed575497beca882957cf6e307b7b36965fd221786. Nov 20 07:17:49 localhost systemd[1]: crio-9a2336491c1a96b7593e846ed575497beca882957cf6e307b7b36965fd221786.scope: Consumed 35ms CPU time Nov 20 07:17:49 localhost crio[1857]: time="2019-11-20 07:17:49.243676475Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:49 localhost hyperkube[1909]: E1120 07:17:49.292712 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:49 localhost hyperkube[1909]: E1120 07:17:49.292891 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:49 localhost hyperkube[1909]: E1120 07:17:49.292966 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:50 localhost hyperkube[1909]: I1120 07:17:50.281572 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:50 localhost hyperkube[1909]: I1120 07:17:50.284049 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:50 localhost hyperkube[1909]: I1120 07:17:50.284106 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:50 localhost hyperkube[1909]: I1120 07:17:50.284129 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:52 localhost podman[14860]: 2019-11-20 07:17:52.74016806 +0000 UTC m=+0.157390759 container create 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:52 localhost systemd[1]: Started libpod-conmon-2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a.scope. Nov 20 07:17:52 localhost systemd[1]: Created slice libcontainer_14874_systemd_test_default.slice. Nov 20 07:17:52 localhost systemd[1]: Removed slice libcontainer_14874_systemd_test_default.slice. Nov 20 07:17:52 localhost systemd[1]: Started libcontainer container 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a. Nov 20 07:17:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:53 localhost podman[14860]: 2019-11-20 07:17:53.144789479 +0000 UTC m=+0.562012200 container init 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:53 localhost podman[14860]: 2019-11-20 07:17:53.165190288 +0000 UTC m=+0.582413008 container start 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:53 localhost podman[14860]: 2019-11-20 07:17:53.165706639 +0000 UTC m=+0.582929360 container attach 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:56 localhost hyperkube[1909]: I1120 07:17:56.025911 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:17:56 localhost hyperkube[1909]: I1120 07:17:56.027888 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:17:56 localhost hyperkube[1909]: I1120 07:17:56.027939 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:17:56 localhost hyperkube[1909]: I1120 07:17:56.027964 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:17:56 localhost hyperkube[1909]: E1120 07:17:56.028252 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:17:56 localhost systemd[1]: Started crio-conmon-fe804d86617352e6596b33543fd66af59f64fb404600f46c45c4947d1f7f3c3e.scope. Nov 20 07:17:56 localhost systemd[1]: Created slice libcontainer_14916_systemd_test_default.slice. Nov 20 07:17:56 localhost systemd[1]: Removed slice libcontainer_14916_systemd_test_default.slice. Nov 20 07:17:56 localhost systemd[1]: Started libcontainer container fe804d86617352e6596b33543fd66af59f64fb404600f46c45c4947d1f7f3c3e. Nov 20 07:17:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:17:56 localhost systemd[1]: Stopped libcontainer container fe804d86617352e6596b33543fd66af59f64fb404600f46c45c4947d1f7f3c3e. Nov 20 07:17:56 localhost systemd[1]: crio-fe804d86617352e6596b33543fd66af59f64fb404600f46c45c4947d1f7f3c3e.scope: Consumed 38ms CPU time Nov 20 07:17:56 localhost crio[1857]: time="2019-11-20 07:17:56.245723288Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:56 localhost hyperkube[1909]: E1120 07:17:56.308587 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:56 localhost hyperkube[1909]: E1120 07:17:56.308745 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:17:56 localhost hyperkube[1909]: E1120 07:17:56.308799 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:17:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:58.184Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b85ac6f8-ec7c-4b08-8f7b-4a1851436e3a/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:58.184Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-55e0952b-bc23-4b18-97c0-d9d57e4450a9/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:17:58.185Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-dfd271ad-c9d4-44aa-ace0-8f16f8c67ca5/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:17:58 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:58 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:58 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:17:58 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:17:58 localhost systemd[1]: libpod-2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a.scope: Consumed 329ms CPU time Nov 20 07:17:58 localhost podman[14860]: 2019-11-20 07:17:58.234719804 +0000 UTC m=+5.651942547 container died 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:58 localhost podman[14860]: 2019-11-20 07:17:58.296507056 +0000 UTC m=+5.713729776 container remove 2b08431379a311e25890c4eafaefad84bf651ea71dd121972bec6cd29cd4f12a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:17:58 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:18:00 localhost hyperkube[1909]: I1120 07:18:00.299265 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:00 localhost hyperkube[1909]: I1120 07:18:00.301753 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:00 localhost hyperkube[1909]: I1120 07:18:00.301825 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:00 localhost hyperkube[1909]: I1120 07:18:00.301857 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:01 localhost hyperkube[1909]: I1120 07:18:01.026263 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:01 localhost hyperkube[1909]: I1120 07:18:01.035530 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:01 localhost hyperkube[1909]: I1120 07:18:01.035625 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:01 localhost hyperkube[1909]: I1120 07:18:01.035664 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:01 localhost hyperkube[1909]: E1120 07:18:01.036072 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:01 localhost systemd[1]: Started crio-conmon-090202b47a19ea93a9887d618d90cbde568d750734d346a1939b15641168557e.scope. Nov 20 07:18:01 localhost systemd[1]: Created slice libcontainer_14967_systemd_test_default.slice. Nov 20 07:18:01 localhost systemd[1]: Removed slice libcontainer_14967_systemd_test_default.slice. Nov 20 07:18:01 localhost systemd[1]: Started libcontainer container 090202b47a19ea93a9887d618d90cbde568d750734d346a1939b15641168557e. Nov 20 07:18:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:01 localhost systemd[1]: Stopped libcontainer container 090202b47a19ea93a9887d618d90cbde568d750734d346a1939b15641168557e. Nov 20 07:18:01 localhost systemd[1]: crio-090202b47a19ea93a9887d618d90cbde568d750734d346a1939b15641168557e.scope: Consumed 33ms CPU time Nov 20 07:18:01 localhost crio[1857]: time="2019-11-20 07:18:01.245726260Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:01 localhost hyperkube[1909]: E1120 07:18:01.297605 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:01 localhost hyperkube[1909]: E1120 07:18:01.297786 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:01 localhost hyperkube[1909]: E1120 07:18:01.297861 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:03 localhost podman[14996]: 2019-11-20 07:18:03.481499791 +0000 UTC m=+0.150693658 container create 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:03 localhost systemd[1]: Started libpod-conmon-7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937.scope. Nov 20 07:18:03 localhost systemd[1]: Created slice libcontainer_15013_systemd_test_default.slice. Nov 20 07:18:03 localhost systemd[1]: Removed slice libcontainer_15013_systemd_test_default.slice. Nov 20 07:18:03 localhost systemd[1]: Started libcontainer container 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937. Nov 20 07:18:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:03 localhost podman[14996]: 2019-11-20 07:18:03.952843044 +0000 UTC m=+0.622036900 container init 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:03 localhost podman[14996]: 2019-11-20 07:18:03.976199545 +0000 UTC m=+0.645393409 container start 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:03 localhost podman[14996]: 2019-11-20 07:18:03.976434978 +0000 UTC m=+0.645628846 container attach 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:08 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:18:08 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:08.993Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c88c948e-4019-48ba-9af3-956776268de6/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:08 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:08.994Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3b9c8647-049e-480d-94ab-7d178adfc891/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:08 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:08.995Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c678c42f-244a-421f-9af4-1240668e2eb4/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:08 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:08 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:08 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:08 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:18:09 localhost systemd[1]: libpod-7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937.scope: Consumed 400ms CPU time Nov 20 07:18:09 localhost hyperkube[1909]: I1120 07:18:09.025954 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:09 localhost hyperkube[1909]: I1120 07:18:09.028595 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:09 localhost hyperkube[1909]: I1120 07:18:09.028674 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:09 localhost hyperkube[1909]: I1120 07:18:09.028706 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:09 localhost hyperkube[1909]: E1120 07:18:09.028951 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:09 localhost podman[14996]: 2019-11-20 07:18:09.041621134 +0000 UTC m=+5.710815053 container died 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:09 localhost systemd[1]: Started crio-conmon-863b4d56ab9dc3fbdb6d397680c6beacbfd50f2dcba2fb598134d0fae1d5ef4f.scope. Nov 20 07:18:09 localhost podman[14996]: 2019-11-20 07:18:09.125321959 +0000 UTC m=+5.794515816 container remove 7cd37f2b118e10e9745656806346ce89e6f938ffee050aacf9ee326e3735e937 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:09 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:18:09 localhost systemd[1]: Created slice libcontainer_15086_systemd_test_default.slice. Nov 20 07:18:09 localhost systemd[1]: Removed slice libcontainer_15086_systemd_test_default.slice. Nov 20 07:18:09 localhost systemd[1]: Started libcontainer container 863b4d56ab9dc3fbdb6d397680c6beacbfd50f2dcba2fb598134d0fae1d5ef4f. Nov 20 07:18:09 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:09 localhost systemd[1]: Stopped libcontainer container 863b4d56ab9dc3fbdb6d397680c6beacbfd50f2dcba2fb598134d0fae1d5ef4f. Nov 20 07:18:09 localhost systemd[1]: crio-863b4d56ab9dc3fbdb6d397680c6beacbfd50f2dcba2fb598134d0fae1d5ef4f.scope: Consumed 35ms CPU time Nov 20 07:18:09 localhost crio[1857]: time="2019-11-20 07:18:09.275379649Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:09 localhost hyperkube[1909]: E1120 07:18:09.336061 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:09 localhost hyperkube[1909]: E1120 07:18:09.336211 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:09 localhost hyperkube[1909]: E1120 07:18:09.336266 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:10 localhost hyperkube[1909]: I1120 07:18:10.317331 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:10 localhost hyperkube[1909]: I1120 07:18:10.319585 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:10 localhost hyperkube[1909]: I1120 07:18:10.319645 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:10 localhost hyperkube[1909]: I1120 07:18:10.319683 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:11 localhost hyperkube[1909]: I1120 07:18:11.026351 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:11 localhost hyperkube[1909]: I1120 07:18:11.028747 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:11 localhost hyperkube[1909]: I1120 07:18:11.028829 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:11 localhost hyperkube[1909]: I1120 07:18:11.028867 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:11 localhost hyperkube[1909]: E1120 07:18:11.029400 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:14 localhost podman[15122]: 2019-11-20 07:18:14.313996864 +0000 UTC m=+0.155434363 container create e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:14 localhost systemd[1]: Started libpod-conmon-e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8.scope. Nov 20 07:18:14 localhost systemd[1]: Created slice libcontainer_15135_systemd_test_default.slice. Nov 20 07:18:14 localhost systemd[1]: Removed slice libcontainer_15135_systemd_test_default.slice. Nov 20 07:18:14 localhost systemd[1]: Started libcontainer container e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8. Nov 20 07:18:14 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:14 localhost podman[15122]: 2019-11-20 07:18:14.729844691 +0000 UTC m=+0.571282151 container init e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:14 localhost podman[15122]: 2019-11-20 07:18:14.751094216 +0000 UTC m=+0.592531698 container start e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:14 localhost podman[15122]: 2019-11-20 07:18:14.751233589 +0000 UTC m=+0.592671051 container attach e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:16 localhost hyperkube[1909]: I1120 07:18:16.026110 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:16 localhost hyperkube[1909]: I1120 07:18:16.028302 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:16 localhost hyperkube[1909]: I1120 07:18:16.028343 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:16 localhost hyperkube[1909]: I1120 07:18:16.028363 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:16 localhost hyperkube[1909]: E1120 07:18:16.028547 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:16 localhost systemd[1]: Started crio-conmon-079059cb5f646f9c8c6d4c3b9ab3815751400f378b80cf2d44e3e6fe418372eb.scope. Nov 20 07:18:16 localhost systemd[1]: Created slice libcontainer_15175_systemd_test_default.slice. Nov 20 07:18:16 localhost systemd[1]: Removed slice libcontainer_15175_systemd_test_default.slice. Nov 20 07:18:16 localhost systemd[1]: Started libcontainer container 079059cb5f646f9c8c6d4c3b9ab3815751400f378b80cf2d44e3e6fe418372eb. Nov 20 07:18:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:16 localhost systemd[1]: Stopped libcontainer container 079059cb5f646f9c8c6d4c3b9ab3815751400f378b80cf2d44e3e6fe418372eb. Nov 20 07:18:16 localhost systemd[1]: crio-079059cb5f646f9c8c6d4c3b9ab3815751400f378b80cf2d44e3e6fe418372eb.scope: Consumed 41ms CPU time Nov 20 07:18:16 localhost crio[1857]: time="2019-11-20 07:18:16.247180074Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:16 localhost hyperkube[1909]: E1120 07:18:16.306992 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:16 localhost hyperkube[1909]: E1120 07:18:16.307182 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:16 localhost hyperkube[1909]: E1120 07:18:16.307255 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:19 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:19.768Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-faad3c4c-24af-4a7c-ac3b-a6e921f70efb/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:19 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:19.768Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-28599f57-2498-42ef-8cd1-49814a0ffa04/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:19 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:19.768Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e78cccc9-258b-4100-bf6c-9f230daac6c1/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:19 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:19 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:19 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:19 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:18:19 localhost systemd[1]: libpod-e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8.scope: Consumed 343ms CPU time Nov 20 07:18:19 localhost podman[15122]: 2019-11-20 07:18:19.814669118 +0000 UTC m=+5.656106654 container died e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:19 localhost podman[15122]: 2019-11-20 07:18:19.885130227 +0000 UTC m=+5.726567782 container remove e4587a948a5b0594b9974982e1eeb9c6dfc97332bb1cd1007e5770c5df9deef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:19 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.026115 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.028309 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.028381 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.028413 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:20 localhost hyperkube[1909]: E1120 07:18:20.028664 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:20 localhost systemd[1]: Started crio-conmon-2a20f69905a5af0b13851e42c01943acf6a39d9f4acb7410d0df7a67cf72836a.scope. Nov 20 07:18:20 localhost systemd[1]: Created slice libcontainer_15224_systemd_test_default.slice. Nov 20 07:18:20 localhost systemd[1]: Removed slice libcontainer_15224_systemd_test_default.slice. Nov 20 07:18:20 localhost systemd[1]: Started libcontainer container 2a20f69905a5af0b13851e42c01943acf6a39d9f4acb7410d0df7a67cf72836a. Nov 20 07:18:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:20 localhost systemd[1]: Stopped libcontainer container 2a20f69905a5af0b13851e42c01943acf6a39d9f4acb7410d0df7a67cf72836a. Nov 20 07:18:20 localhost crio[1857]: time="2019-11-20 07:18:20.244027431Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:20 localhost hyperkube[1909]: E1120 07:18:20.295359 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:20 localhost hyperkube[1909]: E1120 07:18:20.295504 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:20 localhost hyperkube[1909]: E1120 07:18:20.295560 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.336721 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.343837 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.343924 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:20 localhost hyperkube[1909]: I1120 07:18:20.343963 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:25 localhost podman[15252]: 2019-11-20 07:18:25.066695318 +0000 UTC m=+0.142339749 container create 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:25 localhost systemd[1]: Started libpod-conmon-6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714.scope. Nov 20 07:18:25 localhost systemd[1]: Created slice libcontainer_15266_systemd_test_default.slice. Nov 20 07:18:25 localhost systemd[1]: Removed slice libcontainer_15266_systemd_test_default.slice. Nov 20 07:18:25 localhost systemd[1]: Started libcontainer container 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714. Nov 20 07:18:25 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:25 localhost podman[15252]: 2019-11-20 07:18:25.458828174 +0000 UTC m=+0.534472578 container init 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:25 localhost podman[15252]: 2019-11-20 07:18:25.479575333 +0000 UTC m=+0.555219745 container start 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:25 localhost podman[15252]: 2019-11-20 07:18:25.479716404 +0000 UTC m=+0.555360842 container attach 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:28 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:18:29 localhost hyperkube[1909]: I1120 07:18:29.026089 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:29 localhost hyperkube[1909]: I1120 07:18:29.028748 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:29 localhost hyperkube[1909]: I1120 07:18:29.028807 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:29 localhost hyperkube[1909]: I1120 07:18:29.028844 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:29 localhost hyperkube[1909]: E1120 07:18:29.029169 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:29 localhost systemd[1]: Started crio-conmon-fb080e81a37a8bebe9960477cbb457b40a8b620a737c37c7b4c1124dfad1eae8.scope. Nov 20 07:18:29 localhost systemd[1]: Created slice libcontainer_15322_systemd_test_default.slice. Nov 20 07:18:29 localhost systemd[1]: Removed slice libcontainer_15322_systemd_test_default.slice. Nov 20 07:18:29 localhost systemd[1]: Started libcontainer container fb080e81a37a8bebe9960477cbb457b40a8b620a737c37c7b4c1124dfad1eae8. Nov 20 07:18:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:29 localhost systemd[1]: Stopped libcontainer container fb080e81a37a8bebe9960477cbb457b40a8b620a737c37c7b4c1124dfad1eae8. Nov 20 07:18:29 localhost systemd[1]: crio-fb080e81a37a8bebe9960477cbb457b40a8b620a737c37c7b4c1124dfad1eae8.scope: Consumed 38ms CPU time Nov 20 07:18:29 localhost crio[1857]: time="2019-11-20 07:18:29.238327543Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:29 localhost hyperkube[1909]: E1120 07:18:29.298587 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:29 localhost hyperkube[1909]: E1120 07:18:29.298749 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:29 localhost hyperkube[1909]: E1120 07:18:29.298809 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:30 localhost hyperkube[1909]: I1120 07:18:30.361739 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:30 localhost hyperkube[1909]: I1120 07:18:30.363915 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:30 localhost hyperkube[1909]: I1120 07:18:30.363978 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:30 localhost hyperkube[1909]: I1120 07:18:30.364029 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:30 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:30.491Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6983f794-c52a-4685-b36b-5ff819dfdada/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:30 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:30.491Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2cd4744c-6e78-4fa7-a9aa-39ce113933b7/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:30 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:30.491Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-53111864-3340-4f14-a678-a6659a960221/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:30 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:30 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:30 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:30 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:18:30 localhost systemd[1]: libpod-6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714.scope: Consumed 327ms CPU time Nov 20 07:18:30 localhost podman[15252]: 2019-11-20 07:18:30.541696475 +0000 UTC m=+5.617340950 container died 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:30 localhost podman[15252]: 2019-11-20 07:18:30.625586198 +0000 UTC m=+5.701230651 container remove 6aec10d3959c2ce895b8c9cb318b639235524a7c2c536ab53d4279aabac9f714 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:30 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:18:34 localhost hyperkube[1909]: I1120 07:18:34.026113 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:34 localhost hyperkube[1909]: I1120 07:18:34.028607 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:34 localhost hyperkube[1909]: I1120 07:18:34.028665 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:34 localhost hyperkube[1909]: I1120 07:18:34.028700 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:34 localhost hyperkube[1909]: E1120 07:18:34.028983 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:34 localhost systemd[1]: Started crio-conmon-ac8c55e95906f79ae01f5a73727f483011c2c30a3587154e651f92f4aa20f36f.scope. Nov 20 07:18:34 localhost systemd[1]: Created slice libcontainer_15373_systemd_test_default.slice. Nov 20 07:18:34 localhost systemd[1]: Removed slice libcontainer_15373_systemd_test_default.slice. Nov 20 07:18:34 localhost systemd[1]: Started libcontainer container ac8c55e95906f79ae01f5a73727f483011c2c30a3587154e651f92f4aa20f36f. Nov 20 07:18:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:34 localhost systemd[1]: Stopped libcontainer container ac8c55e95906f79ae01f5a73727f483011c2c30a3587154e651f92f4aa20f36f. Nov 20 07:18:34 localhost systemd[1]: crio-ac8c55e95906f79ae01f5a73727f483011c2c30a3587154e651f92f4aa20f36f.scope: Consumed 39ms CPU time Nov 20 07:18:34 localhost crio[1857]: time="2019-11-20 07:18:34.242391042Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:34 localhost hyperkube[1909]: E1120 07:18:34.295872 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:34 localhost hyperkube[1909]: E1120 07:18:34.296041 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:34 localhost hyperkube[1909]: E1120 07:18:34.296106 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:35 localhost podman[15401]: 2019-11-20 07:18:35.807429922 +0000 UTC m=+0.147185098 container create e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:35 localhost systemd[1]: Started libpod-conmon-e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa.scope. Nov 20 07:18:35 localhost systemd[1]: Created slice libcontainer_15414_systemd_test_default.slice. Nov 20 07:18:35 localhost systemd[1]: Removed slice libcontainer_15414_systemd_test_default.slice. Nov 20 07:18:35 localhost systemd[1]: Started libcontainer container e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa. Nov 20 07:18:35 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:36 localhost podman[15401]: 2019-11-20 07:18:36.218766241 +0000 UTC m=+0.558521437 container init e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:36 localhost podman[15401]: 2019-11-20 07:18:36.24382105 +0000 UTC m=+0.583576261 container start e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:36 localhost podman[15401]: 2019-11-20 07:18:36.243989368 +0000 UTC m=+0.583744549 container attach e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:40 localhost hyperkube[1909]: I1120 07:18:40.380136 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:40 localhost hyperkube[1909]: I1120 07:18:40.384318 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:40 localhost hyperkube[1909]: I1120 07:18:40.384377 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:40 localhost hyperkube[1909]: I1120 07:18:40.384412 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:41 localhost hyperkube[1909]: I1120 07:18:41.026329 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:41 localhost hyperkube[1909]: I1120 07:18:41.029275 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:41 localhost hyperkube[1909]: I1120 07:18:41.029327 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:41 localhost hyperkube[1909]: I1120 07:18:41.029350 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:41 localhost hyperkube[1909]: E1120 07:18:41.029541 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:41 localhost systemd[1]: Started crio-conmon-bdd1314988ef3b10b4c136618008fd33636a9a53369305dee117d1471d5dea3f.scope. Nov 20 07:18:41 localhost systemd[1]: Created slice libcontainer_15465_systemd_test_default.slice. Nov 20 07:18:41 localhost systemd[1]: Removed slice libcontainer_15465_systemd_test_default.slice. Nov 20 07:18:41 localhost systemd[1]: Started libcontainer container bdd1314988ef3b10b4c136618008fd33636a9a53369305dee117d1471d5dea3f. Nov 20 07:18:41 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:41 localhost systemd[1]: Stopped libcontainer container bdd1314988ef3b10b4c136618008fd33636a9a53369305dee117d1471d5dea3f. Nov 20 07:18:41 localhost systemd[1]: crio-bdd1314988ef3b10b4c136618008fd33636a9a53369305dee117d1471d5dea3f.scope: Consumed 36ms CPU time Nov 20 07:18:41 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:41.258Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ae8b4261-b731-48aa-b4c6-ff2cbf77adf0/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:41 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:41.258Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-13fe7a81-56bc-41c4-802d-62c71b6d07f5/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:41 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:41.258Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-635600ab-6fdd-4777-98a5-3f93b34841ea/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:41 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:41 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:41 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:41 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:18:41 localhost crio[1857]: time="2019-11-20 07:18:41.260192721Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:41 localhost systemd[1]: libpod-e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa.scope: Consumed 342ms CPU time Nov 20 07:18:41 localhost podman[15401]: 2019-11-20 07:18:41.29845726 +0000 UTC m=+5.638212490 container died e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:41 localhost hyperkube[1909]: E1120 07:18:41.324171 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:41 localhost hyperkube[1909]: E1120 07:18:41.324300 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:41 localhost hyperkube[1909]: E1120 07:18:41.324350 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:41 localhost podman[15401]: 2019-11-20 07:18:41.375514676 +0000 UTC m=+5.715269891 container remove e442138f031008b95f0ee43df14f3df73195bce7677f9d4f6907eb8fbebb2afa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:41 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:18:46 localhost podman[15517]: 2019-11-20 07:18:46.563364484 +0000 UTC m=+0.154656802 container create 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:46 localhost systemd[1]: Started libpod-conmon-5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa.scope. Nov 20 07:18:46 localhost systemd[1]: Created slice libcontainer_15531_systemd_test_default.slice. Nov 20 07:18:46 localhost systemd[1]: Removed slice libcontainer_15531_systemd_test_default.slice. Nov 20 07:18:46 localhost systemd[1]: Started libcontainer container 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa. Nov 20 07:18:46 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:47 localhost podman[15517]: 2019-11-20 07:18:47.023563951 +0000 UTC m=+0.614856286 container init 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:47 localhost podman[15517]: 2019-11-20 07:18:47.045639286 +0000 UTC m=+0.636931591 container start 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:47 localhost podman[15517]: 2019-11-20 07:18:47.045784442 +0000 UTC m=+0.637076794 container attach 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:48 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:18:49 localhost hyperkube[1909]: I1120 07:18:49.026181 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:49 localhost hyperkube[1909]: I1120 07:18:49.028507 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:49 localhost hyperkube[1909]: I1120 07:18:49.028573 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:49 localhost hyperkube[1909]: I1120 07:18:49.028610 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:49 localhost hyperkube[1909]: E1120 07:18:49.028887 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:49 localhost systemd[1]: Started crio-conmon-25873bc576537cc5c0d6f4f9a9551817a471f5b1e7cea9ab90f104c505cda793.scope. Nov 20 07:18:49 localhost systemd[1]: Created slice libcontainer_15586_systemd_test_default.slice. Nov 20 07:18:49 localhost systemd[1]: Removed slice libcontainer_15586_systemd_test_default.slice. Nov 20 07:18:49 localhost systemd[1]: Started libcontainer container 25873bc576537cc5c0d6f4f9a9551817a471f5b1e7cea9ab90f104c505cda793. Nov 20 07:18:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:49 localhost systemd[1]: Stopped libcontainer container 25873bc576537cc5c0d6f4f9a9551817a471f5b1e7cea9ab90f104c505cda793. Nov 20 07:18:49 localhost systemd[1]: crio-25873bc576537cc5c0d6f4f9a9551817a471f5b1e7cea9ab90f104c505cda793.scope: Consumed 33ms CPU time Nov 20 07:18:49 localhost crio[1857]: time="2019-11-20 07:18:49.236353519Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:49 localhost hyperkube[1909]: E1120 07:18:49.291539 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:49 localhost hyperkube[1909]: E1120 07:18:49.291684 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:49 localhost hyperkube[1909]: E1120 07:18:49.291736 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:50 localhost hyperkube[1909]: I1120 07:18:50.407140 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:50 localhost hyperkube[1909]: I1120 07:18:50.409323 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:50 localhost hyperkube[1909]: I1120 07:18:50.409376 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:50 localhost hyperkube[1909]: I1120 07:18:50.409399 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:52 localhost hyperkube[1909]: I1120 07:18:52.026272 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:18:52 localhost hyperkube[1909]: I1120 07:18:52.028840 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:18:52 localhost hyperkube[1909]: I1120 07:18:52.029111 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:18:52 localhost hyperkube[1909]: I1120 07:18:52.029352 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:18:52 localhost hyperkube[1909]: E1120 07:18:52.029853 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:18:52 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:52.064Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-35aacf7a-fe49-43c0-b92f-af7abed0ca2a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:52 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:52.066Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a425871b-8439-4b3d-a32c-50334a7a2d19/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:52 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:18:52.066Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-aadd8e37-8be5-45b4-af08-73097d3056d8/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:18:52 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:52 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:52 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:18:52 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:18:52 localhost systemd[1]: Started crio-conmon-b436d65728c26ddd2760ce6d825221edc7434bb0821d23be43745e3f2bc524a8.scope. Nov 20 07:18:52 localhost systemd[1]: libpod-5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa.scope: Consumed 397ms CPU time Nov 20 07:18:52 localhost systemd[1]: Created slice libcontainer_15617_systemd_test_default.slice. Nov 20 07:18:52 localhost podman[15517]: 2019-11-20 07:18:52.123740569 +0000 UTC m=+5.715033030 container died 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:52 localhost systemd[1]: Removed slice libcontainer_15617_systemd_test_default.slice. Nov 20 07:18:52 localhost systemd[1]: Started libcontainer container b436d65728c26ddd2760ce6d825221edc7434bb0821d23be43745e3f2bc524a8. Nov 20 07:18:52 localhost podman[15517]: 2019-11-20 07:18:52.222788133 +0000 UTC m=+5.814080515 container remove 5f8b6e1c145119d4d86e64060cdc80b0e8a41d2fde18585325169fff3eb49eaa (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:52 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:18:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:52 localhost systemd[1]: Stopped libcontainer container b436d65728c26ddd2760ce6d825221edc7434bb0821d23be43745e3f2bc524a8. Nov 20 07:18:52 localhost systemd[1]: crio-b436d65728c26ddd2760ce6d825221edc7434bb0821d23be43745e3f2bc524a8.scope: Consumed 30ms CPU time Nov 20 07:18:52 localhost crio[1857]: time="2019-11-20 07:18:52.295178591Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:52 localhost hyperkube[1909]: E1120 07:18:52.347518 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:52 localhost hyperkube[1909]: E1120 07:18:52.347664 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:18:52 localhost hyperkube[1909]: E1120 07:18:52.347716 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:18:57 localhost podman[15670]: 2019-11-20 07:18:57.422674871 +0000 UTC m=+0.157611255 container create c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:57 localhost systemd[1]: Started libpod-conmon-c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864.scope. Nov 20 07:18:57 localhost systemd[1]: Created slice libcontainer_15684_systemd_test_default.slice. Nov 20 07:18:57 localhost systemd[1]: Removed slice libcontainer_15684_systemd_test_default.slice. Nov 20 07:18:57 localhost systemd[1]: Started libcontainer container c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864. Nov 20 07:18:57 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:18:57 localhost podman[15670]: 2019-11-20 07:18:57.834748247 +0000 UTC m=+0.569684663 container init c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:57 localhost podman[15670]: 2019-11-20 07:18:57.855387827 +0000 UTC m=+0.590324233 container start c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:18:57 localhost podman[15670]: 2019-11-20 07:18:57.855559901 +0000 UTC m=+0.590496301 container attach c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:00 localhost hyperkube[1909]: I1120 07:19:00.425569 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:00 localhost hyperkube[1909]: I1120 07:19:00.427757 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:00 localhost hyperkube[1909]: I1120 07:19:00.427809 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:00 localhost hyperkube[1909]: I1120 07:19:00.427849 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:01 localhost hyperkube[1909]: I1120 07:19:01.026209 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:01 localhost hyperkube[1909]: I1120 07:19:01.028569 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:01 localhost hyperkube[1909]: I1120 07:19:01.028645 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:01 localhost hyperkube[1909]: I1120 07:19:01.028681 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:01 localhost hyperkube[1909]: E1120 07:19:01.028964 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:01 localhost systemd[1]: Started crio-conmon-108ab76bf00bbc7bce560024d935d8715f02a60d8a70ef6d9b3b8e2666a6a514.scope. Nov 20 07:19:01 localhost systemd[1]: Created slice libcontainer_15725_systemd_test_default.slice. Nov 20 07:19:01 localhost systemd[1]: Removed slice libcontainer_15725_systemd_test_default.slice. Nov 20 07:19:01 localhost systemd[1]: Started libcontainer container 108ab76bf00bbc7bce560024d935d8715f02a60d8a70ef6d9b3b8e2666a6a514. Nov 20 07:19:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:01 localhost systemd[1]: Stopped libcontainer container 108ab76bf00bbc7bce560024d935d8715f02a60d8a70ef6d9b3b8e2666a6a514. Nov 20 07:19:01 localhost systemd[1]: crio-108ab76bf00bbc7bce560024d935d8715f02a60d8a70ef6d9b3b8e2666a6a514.scope: Consumed 39ms CPU time Nov 20 07:19:01 localhost crio[1857]: time="2019-11-20 07:19:01.247321735Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:01 localhost hyperkube[1909]: E1120 07:19:01.305237 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:01 localhost hyperkube[1909]: E1120 07:19:01.305405 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:01 localhost hyperkube[1909]: E1120 07:19:01.305478 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:02 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:02.870Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-4fb6cd71-0113-4afb-b2a2-ab78891d9d07/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:02 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:02.870Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9c28f899-b6e1-4b96-8477-2d3907dda8c6/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:02 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:02.870Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9a31f288-ffd0-4087-a745-0a33963361c3/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:02 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:02 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:02 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:02 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:19:02 localhost systemd[1]: libpod-c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864.scope: Consumed 345ms CPU time Nov 20 07:19:02 localhost podman[15670]: 2019-11-20 07:19:02.917774244 +0000 UTC m=+5.652710705 container died c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:03 localhost podman[15670]: 2019-11-20 07:19:03.024654913 +0000 UTC m=+5.759591325 container remove c711b839cfcb63a0367e23a71b6bcbf7169816b06f488a8ffa876b594dc52864 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:03 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:19:04 localhost hyperkube[1909]: I1120 07:19:04.025950 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:04 localhost hyperkube[1909]: I1120 07:19:04.028864 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:04 localhost hyperkube[1909]: I1120 07:19:04.028920 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:04 localhost hyperkube[1909]: I1120 07:19:04.028968 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:04 localhost hyperkube[1909]: E1120 07:19:04.029643 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:04 localhost systemd[1]: Started crio-conmon-d039f59da3910c57dd294661ababe3d8ce6a6101da6b49a5cefccf232f82c9bc.scope. Nov 20 07:19:04 localhost systemd[1]: Created slice libcontainer_15777_systemd_test_default.slice. Nov 20 07:19:04 localhost systemd[1]: Removed slice libcontainer_15777_systemd_test_default.slice. Nov 20 07:19:04 localhost systemd[1]: Started libcontainer container d039f59da3910c57dd294661ababe3d8ce6a6101da6b49a5cefccf232f82c9bc. Nov 20 07:19:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:04 localhost systemd[1]: Stopped libcontainer container d039f59da3910c57dd294661ababe3d8ce6a6101da6b49a5cefccf232f82c9bc. Nov 20 07:19:04 localhost systemd[1]: crio-d039f59da3910c57dd294661ababe3d8ce6a6101da6b49a5cefccf232f82c9bc.scope: Consumed 36ms CPU time Nov 20 07:19:04 localhost crio[1857]: time="2019-11-20 07:19:04.245103229Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:04 localhost hyperkube[1909]: E1120 07:19:04.298275 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:04 localhost hyperkube[1909]: E1120 07:19:04.298467 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:04 localhost hyperkube[1909]: E1120 07:19:04.298542 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:08 localhost podman[15806]: 2019-11-20 07:19:08.221166904 +0000 UTC m=+0.160453075 container create 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:08 localhost systemd[1]: Started libpod-conmon-6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8.scope. Nov 20 07:19:08 localhost systemd[1]: Created slice libcontainer_15820_systemd_test_default.slice. Nov 20 07:19:08 localhost systemd[1]: Removed slice libcontainer_15820_systemd_test_default.slice. Nov 20 07:19:08 localhost systemd[1]: Started libcontainer container 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8. Nov 20 07:19:08 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:08 localhost podman[15806]: 2019-11-20 07:19:08.694610989 +0000 UTC m=+0.633897189 container init 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:08 localhost podman[15806]: 2019-11-20 07:19:08.721329198 +0000 UTC m=+0.660615422 container start 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:08 localhost podman[15806]: 2019-11-20 07:19:08.721497262 +0000 UTC m=+0.660783458 container attach 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:09 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:19:10 localhost hyperkube[1909]: I1120 07:19:10.447885 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:10 localhost hyperkube[1909]: I1120 07:19:10.450570 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:10 localhost hyperkube[1909]: I1120 07:19:10.450627 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:10 localhost hyperkube[1909]: I1120 07:19:10.450659 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:13 localhost hyperkube[1909]: I1120 07:19:13.026043 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:13 localhost hyperkube[1909]: I1120 07:19:13.028329 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:13 localhost hyperkube[1909]: I1120 07:19:13.028512 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:13 localhost hyperkube[1909]: I1120 07:19:13.028558 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:13 localhost hyperkube[1909]: E1120 07:19:13.028868 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:13 localhost systemd[1]: Started crio-conmon-eb55096d81054e5e980975197d2f789ed81388964b776e2de03a55c24ac1f280.scope. Nov 20 07:19:13 localhost systemd[1]: Created slice libcontainer_15875_systemd_test_default.slice. Nov 20 07:19:13 localhost systemd[1]: Removed slice libcontainer_15875_systemd_test_default.slice. Nov 20 07:19:13 localhost systemd[1]: Started libcontainer container eb55096d81054e5e980975197d2f789ed81388964b776e2de03a55c24ac1f280. Nov 20 07:19:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:13 localhost systemd[1]: Stopped libcontainer container eb55096d81054e5e980975197d2f789ed81388964b776e2de03a55c24ac1f280. Nov 20 07:19:13 localhost systemd[1]: crio-eb55096d81054e5e980975197d2f789ed81388964b776e2de03a55c24ac1f280.scope: Consumed 41ms CPU time Nov 20 07:19:13 localhost crio[1857]: time="2019-11-20 07:19:13.247555307Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:13 localhost hyperkube[1909]: E1120 07:19:13.309814 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:13 localhost hyperkube[1909]: E1120 07:19:13.309956 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:13 localhost hyperkube[1909]: E1120 07:19:13.310006 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:13 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:13.738Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2ed9b1ab-c627-47ae-8728-743c049756e6/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:13 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:13.739Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-4ef8b50c-a77b-4778-b8e5-be961f1ccde7/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:13 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:13.739Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6aac7adc-3436-4d42-9ee1-b8dcb4209f85/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:13 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:13 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:13 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:13 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:19:13 localhost systemd[1]: libpod-6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8.scope: Consumed 399ms CPU time Nov 20 07:19:13 localhost podman[15806]: 2019-11-20 07:19:13.783553854 +0000 UTC m=+5.722840096 container died 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:13 localhost podman[15806]: 2019-11-20 07:19:13.837705453 +0000 UTC m=+5.776991675 container remove 6f0f1e918d995cd19974bfec2be3d401029854c8f9a3cd91cba192c2229a68c8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:13 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:19:18 localhost hyperkube[1909]: I1120 07:19:18.026153 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:18 localhost hyperkube[1909]: I1120 07:19:18.028168 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:18 localhost hyperkube[1909]: I1120 07:19:18.028199 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:18 localhost hyperkube[1909]: I1120 07:19:18.028218 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:18 localhost hyperkube[1909]: E1120 07:19:18.028394 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:18 localhost systemd[1]: Started crio-conmon-2ab82baa6763048fabe85c119c5267008184f9ec43d0dd96b60c5a0f592dae6d.scope. Nov 20 07:19:18 localhost systemd[1]: Created slice libcontainer_15927_systemd_test_default.slice. Nov 20 07:19:18 localhost systemd[1]: Removed slice libcontainer_15927_systemd_test_default.slice. Nov 20 07:19:18 localhost systemd[1]: Started libcontainer container 2ab82baa6763048fabe85c119c5267008184f9ec43d0dd96b60c5a0f592dae6d. Nov 20 07:19:18 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:18 localhost systemd[1]: Stopped libcontainer container 2ab82baa6763048fabe85c119c5267008184f9ec43d0dd96b60c5a0f592dae6d. Nov 20 07:19:18 localhost systemd[1]: crio-2ab82baa6763048fabe85c119c5267008184f9ec43d0dd96b60c5a0f592dae6d.scope: Consumed 40ms CPU time Nov 20 07:19:18 localhost crio[1857]: time="2019-11-20 07:19:18.249196559Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:18 localhost hyperkube[1909]: E1120 07:19:18.318589 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:18 localhost hyperkube[1909]: E1120 07:19:18.318747 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:18 localhost hyperkube[1909]: E1120 07:19:18.318802 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:19 localhost podman[15956]: 2019-11-20 07:19:19.016245046 +0000 UTC m=+0.145000887 container create 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:19 localhost systemd[1]: Started libpod-conmon-920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813.scope. Nov 20 07:19:19 localhost systemd[1]: Created slice libcontainer_15971_systemd_test_default.slice. Nov 20 07:19:19 localhost systemd[1]: Removed slice libcontainer_15971_systemd_test_default.slice. Nov 20 07:19:19 localhost systemd[1]: Started libcontainer container 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813. Nov 20 07:19:19 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:19 localhost podman[15956]: 2019-11-20 07:19:19.421546209 +0000 UTC m=+0.550302049 container init 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:19 localhost podman[15956]: 2019-11-20 07:19:19.441957818 +0000 UTC m=+0.570713692 container start 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:19 localhost podman[15956]: 2019-11-20 07:19:19.442150612 +0000 UTC m=+0.570906458 container attach 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:20 localhost hyperkube[1909]: I1120 07:19:20.466290 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:20 localhost hyperkube[1909]: I1120 07:19:20.468888 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:20 localhost hyperkube[1909]: I1120 07:19:20.468961 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:20 localhost hyperkube[1909]: I1120 07:19:20.468998 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:24 localhost hyperkube[1909]: I1120 07:19:24.026071 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:24 localhost hyperkube[1909]: I1120 07:19:24.028154 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:24 localhost hyperkube[1909]: I1120 07:19:24.028212 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:24 localhost hyperkube[1909]: I1120 07:19:24.028237 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:24 localhost hyperkube[1909]: E1120 07:19:24.028464 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:24 localhost systemd[1]: Started crio-conmon-5659208942c35cfe5a0cdc86d4c5d6d25ef77b49bc3c7f2f931e05c6b7c7be11.scope. Nov 20 07:19:24 localhost systemd[1]: Created slice libcontainer_16012_systemd_test_default.slice. Nov 20 07:19:24 localhost systemd[1]: Removed slice libcontainer_16012_systemd_test_default.slice. Nov 20 07:19:24 localhost systemd[1]: Started libcontainer container 5659208942c35cfe5a0cdc86d4c5d6d25ef77b49bc3c7f2f931e05c6b7c7be11. Nov 20 07:19:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:24 localhost systemd[1]: Stopped libcontainer container 5659208942c35cfe5a0cdc86d4c5d6d25ef77b49bc3c7f2f931e05c6b7c7be11. Nov 20 07:19:24 localhost crio[1857]: time="2019-11-20 07:19:24.242328857Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:24 localhost hyperkube[1909]: E1120 07:19:24.304076 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:24 localhost hyperkube[1909]: E1120 07:19:24.304216 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:24 localhost hyperkube[1909]: E1120 07:19:24.304269 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:24 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:24.455Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a303d0fb-693d-453f-a543-b36f21ae25e2/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:24 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:24.455Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fc371cf1-08c1-4fd4-a31d-60c67552d7f8/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:24 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:24.455Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-1f8298d1-53f0-4963-80a7-f6aad2608b5e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:24 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:24 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:24 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:24 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:19:24 localhost systemd[1]: libpod-920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813.scope: Consumed 341ms CPU time Nov 20 07:19:24 localhost podman[15956]: 2019-11-20 07:19:24.503654251 +0000 UTC m=+5.632410150 container died 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:24 localhost podman[15956]: 2019-11-20 07:19:24.585660497 +0000 UTC m=+5.714416400 container remove 920893f9b4867498ae535b38a05ae4e84319dae0a4196a74b7bc2e554834a813 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:24 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:19:29 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:19:29 localhost podman[16080]: 2019-11-20 07:19:29.779458462 +0000 UTC m=+0.157509993 container create e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:29 localhost systemd[1]: Started libpod-conmon-e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588.scope. Nov 20 07:19:29 localhost systemd[1]: Created slice libcontainer_16094_systemd_test_default.slice. Nov 20 07:19:29 localhost systemd[1]: Removed slice libcontainer_16094_systemd_test_default.slice. Nov 20 07:19:29 localhost systemd[1]: Started libcontainer container e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588. Nov 20 07:19:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:30 localhost podman[16080]: 2019-11-20 07:19:30.196399629 +0000 UTC m=+0.574451181 container init e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:30 localhost podman[16080]: 2019-11-20 07:19:30.216577259 +0000 UTC m=+0.594628794 container start e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:30 localhost podman[16080]: 2019-11-20 07:19:30.216737185 +0000 UTC m=+0.594788738 container attach e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:30 localhost hyperkube[1909]: I1120 07:19:30.492779 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:30 localhost hyperkube[1909]: I1120 07:19:30.495873 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:30 localhost hyperkube[1909]: I1120 07:19:30.495962 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:30 localhost hyperkube[1909]: I1120 07:19:30.495984 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:33 localhost hyperkube[1909]: I1120 07:19:33.026059 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:33 localhost hyperkube[1909]: I1120 07:19:33.028286 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:33 localhost hyperkube[1909]: I1120 07:19:33.028356 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:33 localhost hyperkube[1909]: I1120 07:19:33.028392 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:33 localhost hyperkube[1909]: E1120 07:19:33.028622 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:33 localhost systemd[1]: Started crio-conmon-cdbec6741737b4e8723a84a0c3d9379af89a2bef9743a25e25f979ab093cf4f2.scope. Nov 20 07:19:33 localhost systemd[1]: Created slice libcontainer_16136_systemd_test_default.slice. Nov 20 07:19:33 localhost systemd[1]: Removed slice libcontainer_16136_systemd_test_default.slice. Nov 20 07:19:33 localhost systemd[1]: Started libcontainer container cdbec6741737b4e8723a84a0c3d9379af89a2bef9743a25e25f979ab093cf4f2. Nov 20 07:19:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:33 localhost systemd[1]: Stopped libcontainer container cdbec6741737b4e8723a84a0c3d9379af89a2bef9743a25e25f979ab093cf4f2. Nov 20 07:19:33 localhost systemd[1]: crio-cdbec6741737b4e8723a84a0c3d9379af89a2bef9743a25e25f979ab093cf4f2.scope: Consumed 40ms CPU time Nov 20 07:19:33 localhost crio[1857]: time="2019-11-20 07:19:33.264672719Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:33 localhost hyperkube[1909]: E1120 07:19:33.324485 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:33 localhost hyperkube[1909]: E1120 07:19:33.324634 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:33 localhost hyperkube[1909]: E1120 07:19:33.324746 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:35.229Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-90adfb7f-b17c-42b0-911c-d5bd5a29f5db/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:35.229Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6f7e985e-a5aa-43f9-a7b6-afb03fd1a817/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:35.229Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9246e40a-00ab-4fa5-ac65-f118bd326e2f/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:35 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:35 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:35 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:35 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:19:35 localhost systemd[1]: libpod-e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588.scope: Consumed 336ms CPU time Nov 20 07:19:35 localhost podman[16080]: 2019-11-20 07:19:35.274445838 +0000 UTC m=+5.652497401 container died e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:35 localhost podman[16080]: 2019-11-20 07:19:35.340418117 +0000 UTC m=+5.718469687 container remove e60e53ffb94d665ad21d983c5eab264abd191d0ebd3e3dd841a1b160c4b2e588 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:35 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:19:36 localhost hyperkube[1909]: I1120 07:19:36.026184 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:36 localhost hyperkube[1909]: I1120 07:19:36.028545 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:36 localhost hyperkube[1909]: I1120 07:19:36.028599 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:36 localhost hyperkube[1909]: I1120 07:19:36.028619 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:36 localhost hyperkube[1909]: E1120 07:19:36.029055 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:39 localhost hyperkube[1909]: I1120 07:19:39.026032 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:39 localhost hyperkube[1909]: I1120 07:19:39.028376 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:39 localhost hyperkube[1909]: I1120 07:19:39.028445 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:39 localhost hyperkube[1909]: I1120 07:19:39.028484 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:39 localhost hyperkube[1909]: E1120 07:19:39.028882 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:39 localhost systemd[1]: Started crio-conmon-cf2511ca289710d9fda1243312174b5ad25d964ced8083acc08c37aa484039c1.scope. Nov 20 07:19:39 localhost systemd[1]: Created slice libcontainer_16200_systemd_test_default.slice. Nov 20 07:19:39 localhost systemd[1]: Removed slice libcontainer_16200_systemd_test_default.slice. Nov 20 07:19:39 localhost systemd[1]: Started libcontainer container cf2511ca289710d9fda1243312174b5ad25d964ced8083acc08c37aa484039c1. Nov 20 07:19:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:39 localhost systemd[1]: Stopped libcontainer container cf2511ca289710d9fda1243312174b5ad25d964ced8083acc08c37aa484039c1. Nov 20 07:19:39 localhost crio[1857]: time="2019-11-20 07:19:39.246238624Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:39 localhost hyperkube[1909]: E1120 07:19:39.302518 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:39 localhost hyperkube[1909]: E1120 07:19:39.302711 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:39 localhost hyperkube[1909]: E1120 07:19:39.302786 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:40 localhost hyperkube[1909]: I1120 07:19:40.512358 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:40 localhost hyperkube[1909]: I1120 07:19:40.515165 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:40 localhost hyperkube[1909]: I1120 07:19:40.515215 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:40 localhost hyperkube[1909]: I1120 07:19:40.515249 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:40 localhost podman[16229]: 2019-11-20 07:19:40.538776453 +0000 UTC m=+0.155849723 container create 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:40 localhost systemd[1]: Started libpod-conmon-927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282.scope. Nov 20 07:19:40 localhost systemd[1]: Created slice libcontainer_16243_systemd_test_default.slice. Nov 20 07:19:40 localhost systemd[1]: Removed slice libcontainer_16243_systemd_test_default.slice. Nov 20 07:19:40 localhost systemd[1]: Started libcontainer container 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282. Nov 20 07:19:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:40 localhost podman[16229]: 2019-11-20 07:19:40.982249401 +0000 UTC m=+0.599322596 container init 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:41 localhost podman[16229]: 2019-11-20 07:19:41.004097717 +0000 UTC m=+0.621170950 container start 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:41 localhost podman[16229]: 2019-11-20 07:19:41.004258821 +0000 UTC m=+0.621332009 container attach 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:45 localhost hyperkube[1909]: I1120 07:19:45.025925 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:45 localhost hyperkube[1909]: I1120 07:19:45.028092 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:45 localhost hyperkube[1909]: I1120 07:19:45.028150 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:45 localhost hyperkube[1909]: I1120 07:19:45.028173 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:45 localhost hyperkube[1909]: E1120 07:19:45.028353 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:45 localhost systemd[1]: Started crio-conmon-ee43b4de967727395ba3c31eaeb523bf67e0eaf2f156a69e846aacbccf6fb621.scope. Nov 20 07:19:45 localhost systemd[1]: Created slice libcontainer_16284_systemd_test_default.slice. Nov 20 07:19:45 localhost systemd[1]: Removed slice libcontainer_16284_systemd_test_default.slice. Nov 20 07:19:45 localhost systemd[1]: Started libcontainer container ee43b4de967727395ba3c31eaeb523bf67e0eaf2f156a69e846aacbccf6fb621. Nov 20 07:19:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:45 localhost systemd[1]: Stopped libcontainer container ee43b4de967727395ba3c31eaeb523bf67e0eaf2f156a69e846aacbccf6fb621. Nov 20 07:19:45 localhost systemd[1]: crio-ee43b4de967727395ba3c31eaeb523bf67e0eaf2f156a69e846aacbccf6fb621.scope: Consumed 33ms CPU time Nov 20 07:19:45 localhost crio[1857]: time="2019-11-20 07:19:45.230090437Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:45 localhost hyperkube[1909]: E1120 07:19:45.294654 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:45 localhost hyperkube[1909]: E1120 07:19:45.294841 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:45 localhost hyperkube[1909]: E1120 07:19:45.294899 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:46.025Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0ba193f6-5566-4689-ac70-b45d202ec6c2/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:46.025Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-505b74ac-5ab9-4dde-963b-ece69b9e7d40/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:46.025Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-fc853cfb-4ee9-4a75-8473-023ec71be491/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:46 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:46 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:46 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:46 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:19:46 localhost systemd[1]: libpod-927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282.scope: Consumed 388ms CPU time Nov 20 07:19:46 localhost podman[16229]: 2019-11-20 07:19:46.055763962 +0000 UTC m=+5.672837229 container died 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:46 localhost podman[16229]: 2019-11-20 07:19:46.121777332 +0000 UTC m=+5.738850573 container remove 927cdbe6e7dd97675ee136ae09da51222114c4dfb9f8324e580418e2aa23c282 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:46 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:19:49 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.026046 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.028161 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.028230 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.028254 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:50 localhost hyperkube[1909]: E1120 07:19:50.028533 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:19:50 localhost systemd[1]: Started crio-conmon-790cce4de0434649c9032bfe01b74c8d01133dce697dbb1acd1dc0d476bf4902.scope. Nov 20 07:19:50 localhost systemd[1]: Created slice libcontainer_16349_systemd_test_default.slice. Nov 20 07:19:50 localhost systemd[1]: Removed slice libcontainer_16349_systemd_test_default.slice. Nov 20 07:19:50 localhost systemd[1]: Started libcontainer container 790cce4de0434649c9032bfe01b74c8d01133dce697dbb1acd1dc0d476bf4902. Nov 20 07:19:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:50 localhost systemd[1]: Stopped libcontainer container 790cce4de0434649c9032bfe01b74c8d01133dce697dbb1acd1dc0d476bf4902. Nov 20 07:19:50 localhost systemd[1]: crio-790cce4de0434649c9032bfe01b74c8d01133dce697dbb1acd1dc0d476bf4902.scope: Consumed 34ms CPU time Nov 20 07:19:50 localhost crio[1857]: time="2019-11-20 07:19:50.239204903Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:50 localhost hyperkube[1909]: E1120 07:19:50.300019 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:50 localhost hyperkube[1909]: E1120 07:19:50.300181 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:19:50 localhost hyperkube[1909]: E1120 07:19:50.300235 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.537144 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.539492 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.539553 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:19:50 localhost hyperkube[1909]: I1120 07:19:50.539577 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:19:51 localhost podman[16378]: 2019-11-20 07:19:51.314160168 +0000 UTC m=+0.159203348 container create 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:51 localhost systemd[1]: Started libpod-conmon-365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc.scope. Nov 20 07:19:51 localhost systemd[1]: Created slice libcontainer_16391_systemd_test_default.slice. Nov 20 07:19:51 localhost systemd[1]: Removed slice libcontainer_16391_systemd_test_default.slice. Nov 20 07:19:51 localhost systemd[1]: Started libcontainer container 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc. Nov 20 07:19:51 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:19:51 localhost podman[16378]: 2019-11-20 07:19:51.750319934 +0000 UTC m=+0.595363124 container init 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:51 localhost podman[16378]: 2019-11-20 07:19:51.771625405 +0000 UTC m=+0.616668578 container start 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:51 localhost podman[16378]: 2019-11-20 07:19:51.77177471 +0000 UTC m=+0.616817889 container attach 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:56 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:56.786Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-af55255e-ab6a-4b7c-9614-744ee4903892/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:56 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:56.786Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ee8ce54e-cffc-4522-9fab-16858a9067bb/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:56 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:19:56.786Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-50089bb0-329e-4cae-8590-4dce93c3e607/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:19:56 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:56 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:56 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:19:56 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:19:56 localhost systemd[1]: libpod-365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc.scope: Consumed 369ms CPU time Nov 20 07:19:56 localhost podman[16378]: 2019-11-20 07:19:56.839690577 +0000 UTC m=+5.684733773 container died 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:56 localhost podman[16378]: 2019-11-20 07:19:56.925153759 +0000 UTC m=+5.770196963 container remove 365194886dac18311b163224f51c9cd58c5a7b01278bebb95589ac5c0df61ebc (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:19:56 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:20:00 localhost hyperkube[1909]: I1120 07:20:00.554865 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:00 localhost hyperkube[1909]: I1120 07:20:00.557666 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:00 localhost hyperkube[1909]: I1120 07:20:00.557758 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:00 localhost hyperkube[1909]: I1120 07:20:00.557796 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:01 localhost hyperkube[1909]: I1120 07:20:01.026084 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:01 localhost hyperkube[1909]: I1120 07:20:01.028569 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:01 localhost hyperkube[1909]: I1120 07:20:01.028805 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:01 localhost hyperkube[1909]: I1120 07:20:01.028847 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:01 localhost hyperkube[1909]: E1120 07:20:01.029152 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:01 localhost systemd[1]: Started crio-conmon-5bebf93b31de442ebd98a423b20798d28bb43478aa66fec83eb08aa60581db5f.scope. Nov 20 07:20:01 localhost systemd[1]: Created slice libcontainer_16453_systemd_test_default.slice. Nov 20 07:20:01 localhost systemd[1]: Removed slice libcontainer_16453_systemd_test_default.slice. Nov 20 07:20:01 localhost systemd[1]: Started libcontainer container 5bebf93b31de442ebd98a423b20798d28bb43478aa66fec83eb08aa60581db5f. Nov 20 07:20:01 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:01 localhost systemd[1]: Stopped libcontainer container 5bebf93b31de442ebd98a423b20798d28bb43478aa66fec83eb08aa60581db5f. Nov 20 07:20:01 localhost systemd[1]: crio-5bebf93b31de442ebd98a423b20798d28bb43478aa66fec83eb08aa60581db5f.scope: Consumed 36ms CPU time Nov 20 07:20:01 localhost crio[1857]: time="2019-11-20 07:20:01.244168799Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:01 localhost hyperkube[1909]: E1120 07:20:01.297925 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:01 localhost hyperkube[1909]: E1120 07:20:01.298159 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:01 localhost hyperkube[1909]: E1120 07:20:01.298243 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:02 localhost hyperkube[1909]: I1120 07:20:02.025781 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:02 localhost hyperkube[1909]: I1120 07:20:02.028311 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:02 localhost hyperkube[1909]: I1120 07:20:02.028380 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:02 localhost hyperkube[1909]: I1120 07:20:02.028418 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:02 localhost hyperkube[1909]: E1120 07:20:02.028762 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:02 localhost systemd[1]: Started crio-conmon-7c3773548793c9ec2ff4db51fece2fe2903245f4b261fe4cdeb1cf58524ffb90.scope. Nov 20 07:20:02 localhost systemd[1]: Created slice libcontainer_16492_systemd_test_default.slice. Nov 20 07:20:02 localhost systemd[1]: Removed slice libcontainer_16492_systemd_test_default.slice. Nov 20 07:20:02 localhost podman[16481]: 2019-11-20 07:20:02.155597692 +0000 UTC m=+0.192809320 container create 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:02 localhost systemd[1]: Started libpod-conmon-689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6.scope. Nov 20 07:20:02 localhost systemd[1]: Started libcontainer container 7c3773548793c9ec2ff4db51fece2fe2903245f4b261fe4cdeb1cf58524ffb90. Nov 20 07:20:02 localhost systemd[1]: Created slice libcontainer_16509_systemd_test_default.slice. Nov 20 07:20:02 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:02 localhost systemd[1]: Removed slice libcontainer_16509_systemd_test_default.slice. Nov 20 07:20:02 localhost systemd[1]: Started libcontainer container 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6. Nov 20 07:20:02 localhost systemd[1]: Stopped libcontainer container 7c3773548793c9ec2ff4db51fece2fe2903245f4b261fe4cdeb1cf58524ffb90. Nov 20 07:20:02 localhost systemd[1]: crio-7c3773548793c9ec2ff4db51fece2fe2903245f4b261fe4cdeb1cf58524ffb90.scope: Consumed 31ms CPU time Nov 20 07:20:02 localhost crio[1857]: time="2019-11-20 07:20:02.305670866Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:02 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:02 localhost hyperkube[1909]: E1120 07:20:02.366088 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:02 localhost hyperkube[1909]: E1120 07:20:02.366277 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:02 localhost hyperkube[1909]: E1120 07:20:02.366353 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:02 localhost podman[16481]: 2019-11-20 07:20:02.653566717 +0000 UTC m=+0.690778319 container init 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:02 localhost podman[16481]: 2019-11-20 07:20:02.67588742 +0000 UTC m=+0.713099025 container start 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:02 localhost podman[16481]: 2019-11-20 07:20:02.676071249 +0000 UTC m=+0.713282869 container attach 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:07 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:07.694Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-201b4353-dc68-4bc9-9192-8c0dac1a5cb7/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:07 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:07.694Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-42adbc41-5cd5-47a4-96cb-dbd943f2fa55/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:07 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:07.694Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-da860652-e5fa-4841-9675-dbe9350fce25/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:07 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:07 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:07 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:07 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:20:07 localhost systemd[1]: libpod-689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6.scope: Consumed 368ms CPU time Nov 20 07:20:07 localhost podman[16481]: 2019-11-20 07:20:07.74263008 +0000 UTC m=+5.779841726 container died 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:07 localhost podman[16481]: 2019-11-20 07:20:07.820594738 +0000 UTC m=+5.857806403 container remove 689a713b338a1035319423033341a8ab56e6dea5076b26ac022355b18da748c6 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:07 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:20:09 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:20:10 localhost hyperkube[1909]: I1120 07:20:10.574972 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:10 localhost hyperkube[1909]: I1120 07:20:10.577545 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:10 localhost hyperkube[1909]: I1120 07:20:10.577607 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:10 localhost hyperkube[1909]: I1120 07:20:10.577631 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:13 localhost hyperkube[1909]: I1120 07:20:13.025969 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:13 localhost hyperkube[1909]: I1120 07:20:13.028617 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:13 localhost hyperkube[1909]: I1120 07:20:13.028679 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:13 localhost hyperkube[1909]: I1120 07:20:13.028715 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:13 localhost podman[16605]: 2019-11-20 07:20:13.028559008 +0000 UTC m=+0.170506867 container create 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:13 localhost hyperkube[1909]: E1120 07:20:13.028978 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:13 localhost systemd[1]: Started libpod-conmon-3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11.scope. Nov 20 07:20:13 localhost systemd[1]: Started crio-conmon-21c020acc34a6686cbf8a684f45e6b0c0d829af52fca0b2a74120435fb827741.scope. Nov 20 07:20:13 localhost systemd[1]: Created slice libcontainer_16618_systemd_test_default.slice. Nov 20 07:20:13 localhost systemd[1]: Removed slice libcontainer_16618_systemd_test_default.slice. Nov 20 07:20:13 localhost systemd[1]: Started libcontainer container 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11. Nov 20 07:20:13 localhost systemd[1]: Started libcontainer container 21c020acc34a6686cbf8a684f45e6b0c0d829af52fca0b2a74120435fb827741. Nov 20 07:20:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:13 localhost systemd[1]: Stopped libcontainer container 21c020acc34a6686cbf8a684f45e6b0c0d829af52fca0b2a74120435fb827741. Nov 20 07:20:13 localhost systemd[1]: crio-21c020acc34a6686cbf8a684f45e6b0c0d829af52fca0b2a74120435fb827741.scope: Consumed 34ms CPU time Nov 20 07:20:13 localhost crio[1857]: time="2019-11-20 07:20:13.309902623Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:13 localhost hyperkube[1909]: E1120 07:20:13.374441 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:13 localhost hyperkube[1909]: E1120 07:20:13.374596 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:13 localhost hyperkube[1909]: E1120 07:20:13.374651 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:13 localhost podman[16605]: 2019-11-20 07:20:13.524679335 +0000 UTC m=+0.666627176 container init 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:13 localhost podman[16605]: 2019-11-20 07:20:13.550064217 +0000 UTC m=+0.692012055 container start 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:13 localhost podman[16605]: 2019-11-20 07:20:13.550265397 +0000 UTC m=+0.692213255 container attach 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:16 localhost hyperkube[1909]: I1120 07:20:16.026382 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:16 localhost hyperkube[1909]: I1120 07:20:16.029557 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:16 localhost hyperkube[1909]: I1120 07:20:16.029608 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:16 localhost hyperkube[1909]: I1120 07:20:16.029630 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:16 localhost hyperkube[1909]: E1120 07:20:16.029869 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:16 localhost systemd[1]: Started crio-conmon-0520ed57b0964b737a3114d9cf0a93fb72bc2a148fb01401f2732260b3515b86.scope. Nov 20 07:20:16 localhost systemd[1]: Created slice libcontainer_16688_systemd_test_default.slice. Nov 20 07:20:16 localhost systemd[1]: Removed slice libcontainer_16688_systemd_test_default.slice. Nov 20 07:20:16 localhost systemd[1]: Started libcontainer container 0520ed57b0964b737a3114d9cf0a93fb72bc2a148fb01401f2732260b3515b86. Nov 20 07:20:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:16 localhost systemd[1]: Stopped libcontainer container 0520ed57b0964b737a3114d9cf0a93fb72bc2a148fb01401f2732260b3515b86. Nov 20 07:20:16 localhost systemd[1]: crio-0520ed57b0964b737a3114d9cf0a93fb72bc2a148fb01401f2732260b3515b86.scope: Consumed 41ms CPU time Nov 20 07:20:16 localhost crio[1857]: time="2019-11-20 07:20:16.247737737Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:16 localhost hyperkube[1909]: E1120 07:20:16.318598 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:16 localhost hyperkube[1909]: E1120 07:20:16.318743 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:16 localhost hyperkube[1909]: E1120 07:20:16.318799 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:18 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:18.564Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-6f29548b-47a1-41f5-9d57-22817a37cfef/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:18 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:18.564Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e4ca55d2-a15b-4ee5-a3c2-8ef63efc1296/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:18 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:18.564Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-04bd5495-4992-48cb-817f-a167a05c10dc/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:18 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:18 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:18 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:18 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:20:18 localhost systemd[1]: libpod-3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11.scope: Consumed 358ms CPU time Nov 20 07:20:18 localhost podman[16605]: 2019-11-20 07:20:18.611654495 +0000 UTC m=+5.753602391 container died 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:18 localhost podman[16605]: 2019-11-20 07:20:18.688151222 +0000 UTC m=+5.830099106 container remove 3cf2675b443339686800afb9d24db1a332d396a6bce625232e6d28dad70e0d11 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:18 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:20:20 localhost hyperkube[1909]: I1120 07:20:20.592254 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:20 localhost hyperkube[1909]: I1120 07:20:20.594742 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:20 localhost hyperkube[1909]: I1120 07:20:20.594819 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:20 localhost hyperkube[1909]: I1120 07:20:20.594856 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:23 localhost podman[16739]: 2019-11-20 07:20:23.877241033 +0000 UTC m=+0.154562336 container create cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:23 localhost systemd[1]: Started libpod-conmon-cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae.scope. Nov 20 07:20:23 localhost systemd[1]: Created slice libcontainer_16752_systemd_test_default.slice. Nov 20 07:20:23 localhost systemd[1]: Removed slice libcontainer_16752_systemd_test_default.slice. Nov 20 07:20:23 localhost systemd[1]: Started libcontainer container cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae. Nov 20 07:20:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:24 localhost podman[16739]: 2019-11-20 07:20:24.293373048 +0000 UTC m=+0.570694381 container init cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:24 localhost podman[16739]: 2019-11-20 07:20:24.314072478 +0000 UTC m=+0.591393802 container start cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:24 localhost podman[16739]: 2019-11-20 07:20:24.314207495 +0000 UTC m=+0.591528832 container attach cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:26 localhost hyperkube[1909]: I1120 07:20:26.026297 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:26 localhost hyperkube[1909]: I1120 07:20:26.028780 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:26 localhost hyperkube[1909]: I1120 07:20:26.028841 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:26 localhost hyperkube[1909]: I1120 07:20:26.028877 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:26 localhost hyperkube[1909]: E1120 07:20:26.029156 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:26 localhost systemd[1]: Started crio-conmon-19f30bdac139dda65fe3db410e1d5271b0219575112c6d16c2f99c67750376f0.scope. Nov 20 07:20:26 localhost systemd[1]: Created slice libcontainer_16789_systemd_test_default.slice. Nov 20 07:20:26 localhost systemd[1]: Removed slice libcontainer_16789_systemd_test_default.slice. Nov 20 07:20:26 localhost systemd[1]: Started libcontainer container 19f30bdac139dda65fe3db410e1d5271b0219575112c6d16c2f99c67750376f0. Nov 20 07:20:26 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:26 localhost systemd[1]: Stopped libcontainer container 19f30bdac139dda65fe3db410e1d5271b0219575112c6d16c2f99c67750376f0. Nov 20 07:20:26 localhost systemd[1]: crio-19f30bdac139dda65fe3db410e1d5271b0219575112c6d16c2f99c67750376f0.scope: Consumed 37ms CPU time Nov 20 07:20:26 localhost crio[1857]: time="2019-11-20 07:20:26.245843809Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:26 localhost hyperkube[1909]: E1120 07:20:26.303423 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:26 localhost hyperkube[1909]: E1120 07:20:26.303626 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:26 localhost hyperkube[1909]: E1120 07:20:26.303709 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:29 localhost hyperkube[1909]: I1120 07:20:29.025797 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:29 localhost hyperkube[1909]: I1120 07:20:29.028669 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:29 localhost hyperkube[1909]: I1120 07:20:29.028743 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:29 localhost hyperkube[1909]: I1120 07:20:29.028777 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:29 localhost hyperkube[1909]: E1120 07:20:29.029127 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:29 localhost systemd[1]: Started crio-conmon-01bc3527fa3a07d2a7a57ae57f188804513a60548a75edc51fb611d72de9d367.scope. Nov 20 07:20:29 localhost systemd[1]: Created slice libcontainer_16820_systemd_test_default.slice. Nov 20 07:20:29 localhost systemd[1]: Removed slice libcontainer_16820_systemd_test_default.slice. Nov 20 07:20:29 localhost systemd[1]: Started libcontainer container 01bc3527fa3a07d2a7a57ae57f188804513a60548a75edc51fb611d72de9d367. Nov 20 07:20:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:29 localhost systemd[1]: Stopped libcontainer container 01bc3527fa3a07d2a7a57ae57f188804513a60548a75edc51fb611d72de9d367. Nov 20 07:20:29 localhost systemd[1]: crio-01bc3527fa3a07d2a7a57ae57f188804513a60548a75edc51fb611d72de9d367.scope: Consumed 40ms CPU time Nov 20 07:20:29 localhost crio[1857]: time="2019-11-20 07:20:29.249789963Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:29 localhost hyperkube[1909]: E1120 07:20:29.302444 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:29 localhost hyperkube[1909]: E1120 07:20:29.302583 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:29 localhost hyperkube[1909]: E1120 07:20:29.302638 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:29 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:29.330Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3499fcfe-2b46-4671-b823-867c70caaa53/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:29 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:29.330Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-236d382b-c770-4bc9-b5ee-fbdfae44b2a1/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:29 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:29.331Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-18edf917-8fd6-414b-8382-e66c30ec3f2b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:29 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:29 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:29 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:29 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:20:29 localhost systemd[1]: libpod-cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae.scope: Consumed 354ms CPU time Nov 20 07:20:29 localhost podman[16739]: 2019-11-20 07:20:29.377866126 +0000 UTC m=+5.655187522 container died cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:29 localhost podman[16739]: 2019-11-20 07:20:29.457364815 +0000 UTC m=+5.734686184 container remove cecb251927d7ac3f72c5de4dcd38ca3b8aecca4a53facb33a791ca5689ba73ae (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:29 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:20:29 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:20:30 localhost hyperkube[1909]: I1120 07:20:30.613914 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:30 localhost hyperkube[1909]: I1120 07:20:30.616474 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:30 localhost hyperkube[1909]: I1120 07:20:30.616534 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:30 localhost hyperkube[1909]: I1120 07:20:30.616557 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:34 localhost podman[16887]: 2019-11-20 07:20:34.634169774 +0000 UTC m=+0.144569714 container create 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:34 localhost systemd[1]: Started libpod-conmon-8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279.scope. Nov 20 07:20:34 localhost systemd[1]: Created slice libcontainer_16901_systemd_test_default.slice. Nov 20 07:20:34 localhost systemd[1]: Removed slice libcontainer_16901_systemd_test_default.slice. Nov 20 07:20:34 localhost systemd[1]: Started libcontainer container 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279. Nov 20 07:20:34 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:35 localhost podman[16887]: 2019-11-20 07:20:35.050096637 +0000 UTC m=+0.560496525 container init 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:35 localhost podman[16887]: 2019-11-20 07:20:35.071196748 +0000 UTC m=+0.581596655 container start 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:35 localhost podman[16887]: 2019-11-20 07:20:35.071672635 +0000 UTC m=+0.582072550 container attach 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:38 localhost hyperkube[1909]: I1120 07:20:38.026231 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:38 localhost hyperkube[1909]: I1120 07:20:38.029715 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:38 localhost hyperkube[1909]: I1120 07:20:38.029790 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:38 localhost hyperkube[1909]: I1120 07:20:38.029839 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:38 localhost hyperkube[1909]: E1120 07:20:38.030338 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:38 localhost systemd[1]: Started crio-conmon-0f122370e2c389dac19dcccd0cf5b9706f868ec27a627183acd8265b1dc4584f.scope. Nov 20 07:20:38 localhost systemd[1]: Created slice libcontainer_16941_systemd_test_default.slice. Nov 20 07:20:38 localhost systemd[1]: Removed slice libcontainer_16941_systemd_test_default.slice. Nov 20 07:20:38 localhost systemd[1]: Started libcontainer container 0f122370e2c389dac19dcccd0cf5b9706f868ec27a627183acd8265b1dc4584f. Nov 20 07:20:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:38 localhost systemd[1]: Stopped libcontainer container 0f122370e2c389dac19dcccd0cf5b9706f868ec27a627183acd8265b1dc4584f. Nov 20 07:20:38 localhost systemd[1]: crio-0f122370e2c389dac19dcccd0cf5b9706f868ec27a627183acd8265b1dc4584f.scope: Consumed 50ms CPU time Nov 20 07:20:38 localhost crio[1857]: time="2019-11-20 07:20:38.282072089Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:38 localhost hyperkube[1909]: E1120 07:20:38.345065 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:38 localhost hyperkube[1909]: E1120 07:20:38.345247 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:38 localhost hyperkube[1909]: E1120 07:20:38.345322 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:40 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:40.086Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3f846c42-ad42-42b7-a9d0-b92d0d742c8c/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:40 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:40.086Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3e0193d8-cde4-45c5-a1a5-bb6bd1aa366c/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:40 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:40.085Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-224512cd-22ad-41f8-ae9c-2f2a88fc5c69/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:40 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:40 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:40 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:40 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:20:40 localhost systemd[1]: libpod-8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279.scope: Consumed 344ms CPU time Nov 20 07:20:40 localhost podman[16887]: 2019-11-20 07:20:40.133425417 +0000 UTC m=+5.643825350 container died 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:40 localhost podman[16887]: 2019-11-20 07:20:40.201995389 +0000 UTC m=+5.712395319 container remove 8c9b9a5ab50552798f857eb8b9e7959798951c3ede81f984ebc5d251f59ed279 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:40 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:20:40 localhost hyperkube[1909]: I1120 07:20:40.631273 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:40 localhost hyperkube[1909]: I1120 07:20:40.633823 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:40 localhost hyperkube[1909]: I1120 07:20:40.633884 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:40 localhost hyperkube[1909]: I1120 07:20:40.633939 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:42 localhost hyperkube[1909]: I1120 07:20:42.026240 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:42 localhost hyperkube[1909]: I1120 07:20:42.028670 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:42 localhost hyperkube[1909]: I1120 07:20:42.028743 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:42 localhost hyperkube[1909]: I1120 07:20:42.028783 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:42 localhost hyperkube[1909]: E1120 07:20:42.029102 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:42 localhost systemd[1]: Started crio-conmon-5ad52a0504ff5bae6934f6848d90199a76c471dff42df9e82b34b5130192b4e7.scope. Nov 20 07:20:42 localhost systemd[1]: Created slice libcontainer_17003_systemd_test_default.slice. Nov 20 07:20:42 localhost systemd[1]: Removed slice libcontainer_17003_systemd_test_default.slice. Nov 20 07:20:42 localhost systemd[1]: Started libcontainer container 5ad52a0504ff5bae6934f6848d90199a76c471dff42df9e82b34b5130192b4e7. Nov 20 07:20:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:42 localhost systemd[1]: Stopped libcontainer container 5ad52a0504ff5bae6934f6848d90199a76c471dff42df9e82b34b5130192b4e7. Nov 20 07:20:42 localhost crio[1857]: time="2019-11-20 07:20:42.254603824Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:42 localhost hyperkube[1909]: E1120 07:20:42.303126 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:42 localhost hyperkube[1909]: E1120 07:20:42.303318 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:42 localhost hyperkube[1909]: E1120 07:20:42.303390 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:45 localhost podman[17033]: 2019-11-20 07:20:45.38960501 +0000 UTC m=+0.154447793 container create 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:45 localhost systemd[1]: Started libpod-conmon-206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894.scope. Nov 20 07:20:45 localhost systemd[1]: Created slice libcontainer_17047_systemd_test_default.slice. Nov 20 07:20:45 localhost systemd[1]: Removed slice libcontainer_17047_systemd_test_default.slice. Nov 20 07:20:45 localhost systemd[1]: Started libcontainer container 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894. Nov 20 07:20:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:45 localhost podman[17033]: 2019-11-20 07:20:45.817165605 +0000 UTC m=+0.582008388 container init 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:45 localhost podman[17033]: 2019-11-20 07:20:45.838360589 +0000 UTC m=+0.603203375 container start 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:45 localhost podman[17033]: 2019-11-20 07:20:45.838522464 +0000 UTC m=+0.603365250 container attach 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:49 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:20:50 localhost hyperkube[1909]: I1120 07:20:50.649816 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:50 localhost hyperkube[1909]: I1120 07:20:50.652237 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:50 localhost hyperkube[1909]: I1120 07:20:50.652302 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:50 localhost hyperkube[1909]: I1120 07:20:50.652340 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:50 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:50.856Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d03a6968-4930-4263-9586-5fadf3fc68d8/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:50 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:50.856Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-51a76049-d5b5-4b57-a9c7-6f2eb9632ca7/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:50 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:20:50.856Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-549044cf-6389-49f6-8012-c48b19352a40/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:20:50 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:50 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:50 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:20:50 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:20:50 localhost systemd[1]: libpod-206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894.scope: Consumed 351ms CPU time Nov 20 07:20:50 localhost podman[17033]: 2019-11-20 07:20:50.899611629 +0000 UTC m=+5.664454431 container died 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:50 localhost podman[17033]: 2019-11-20 07:20:50.982365607 +0000 UTC m=+5.747208517 container remove 206de4665c96abc6b613f24ced1213bd387bde9044a5d34fd6acae732b514894 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:50 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:20:52 localhost hyperkube[1909]: I1120 07:20:52.026336 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:52 localhost hyperkube[1909]: I1120 07:20:52.029460 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:52 localhost hyperkube[1909]: I1120 07:20:52.029510 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:52 localhost hyperkube[1909]: I1120 07:20:52.029537 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:52 localhost hyperkube[1909]: E1120 07:20:52.029790 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:52 localhost systemd[1]: Started crio-conmon-b8725cdeb436b901b2e48ca70431269dda10ca418483b386622d27f3979231d8.scope. Nov 20 07:20:52 localhost systemd[1]: Created slice libcontainer_17123_systemd_test_default.slice. Nov 20 07:20:52 localhost systemd[1]: Removed slice libcontainer_17123_systemd_test_default.slice. Nov 20 07:20:52 localhost systemd[1]: Started libcontainer container b8725cdeb436b901b2e48ca70431269dda10ca418483b386622d27f3979231d8. Nov 20 07:20:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:52 localhost systemd[1]: Stopped libcontainer container b8725cdeb436b901b2e48ca70431269dda10ca418483b386622d27f3979231d8. Nov 20 07:20:52 localhost systemd[1]: crio-b8725cdeb436b901b2e48ca70431269dda10ca418483b386622d27f3979231d8.scope: Consumed 38ms CPU time Nov 20 07:20:52 localhost crio[1857]: time="2019-11-20 07:20:52.238550092Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:52 localhost hyperkube[1909]: E1120 07:20:52.287658 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:52 localhost hyperkube[1909]: E1120 07:20:52.287813 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:52 localhost hyperkube[1909]: E1120 07:20:52.287867 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:54 localhost hyperkube[1909]: I1120 07:20:54.026302 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:20:54 localhost hyperkube[1909]: I1120 07:20:54.028788 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:20:54 localhost hyperkube[1909]: I1120 07:20:54.028843 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:20:54 localhost hyperkube[1909]: I1120 07:20:54.028889 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:20:54 localhost hyperkube[1909]: E1120 07:20:54.029166 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:20:54 localhost systemd[1]: Started crio-conmon-7c7de83cdfe0a47b71a0cb331379d00f3ceef1d604154426385de3268cfcfbbf.scope. Nov 20 07:20:54 localhost systemd[1]: Created slice libcontainer_17153_systemd_test_default.slice. Nov 20 07:20:54 localhost systemd[1]: Removed slice libcontainer_17153_systemd_test_default.slice. Nov 20 07:20:54 localhost systemd[1]: Started libcontainer container 7c7de83cdfe0a47b71a0cb331379d00f3ceef1d604154426385de3268cfcfbbf. Nov 20 07:20:54 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:54 localhost systemd[1]: Stopped libcontainer container 7c7de83cdfe0a47b71a0cb331379d00f3ceef1d604154426385de3268cfcfbbf. Nov 20 07:20:54 localhost systemd[1]: crio-7c7de83cdfe0a47b71a0cb331379d00f3ceef1d604154426385de3268cfcfbbf.scope: Consumed 34ms CPU time Nov 20 07:20:54 localhost crio[1857]: time="2019-11-20 07:20:54.249160281Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:54 localhost hyperkube[1909]: E1120 07:20:54.299839 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:54 localhost hyperkube[1909]: E1120 07:20:54.300053 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:20:54 localhost hyperkube[1909]: E1120 07:20:54.300126 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:20:56 localhost podman[17185]: 2019-11-20 07:20:56.165286491 +0000 UTC m=+0.148601735 container create 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:56 localhost systemd[1]: Started libpod-conmon-4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25.scope. Nov 20 07:20:56 localhost systemd[1]: Created slice libcontainer_17199_systemd_test_default.slice. Nov 20 07:20:56 localhost systemd[1]: Removed slice libcontainer_17199_systemd_test_default.slice. Nov 20 07:20:56 localhost systemd[1]: Started libcontainer container 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25. Nov 20 07:20:56 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:20:56 localhost podman[17185]: 2019-11-20 07:20:56.576445882 +0000 UTC m=+0.559761168 container init 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:56 localhost podman[17185]: 2019-11-20 07:20:56.597585951 +0000 UTC m=+0.580901243 container start 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:20:56 localhost podman[17185]: 2019-11-20 07:20:56.597737658 +0000 UTC m=+0.581052925 container attach 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:00 localhost hyperkube[1909]: I1120 07:21:00.668813 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:00 localhost hyperkube[1909]: I1120 07:21:00.671147 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:00 localhost hyperkube[1909]: I1120 07:21:00.671203 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:00 localhost hyperkube[1909]: I1120 07:21:00.671226 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:01 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:01.613Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f90dc0dd-e90e-421b-bec1-4036a5108880/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:01 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:01.613Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ab404ee7-cf07-4669-b4b2-b4893197eed9/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:01 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:01.613Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f0d2d2b1-33fa-4bf1-b893-73cb39299345/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:01 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:01 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:01 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:01 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:21:01 localhost systemd[1]: libpod-4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25.scope: Consumed 361ms CPU time Nov 20 07:21:01 localhost podman[17185]: 2019-11-20 07:21:01.661636648 +0000 UTC m=+5.644951950 container died 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:01 localhost podman[17185]: 2019-11-20 07:21:01.741255354 +0000 UTC m=+5.724570638 container remove 4db880eb056b33d29a0307c34fd687d59882353dded23e4386f386d6e0b7ae25 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:01 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:21:03 localhost hyperkube[1909]: I1120 07:21:03.026488 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:03 localhost hyperkube[1909]: I1120 07:21:03.029217 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:03 localhost hyperkube[1909]: I1120 07:21:03.029281 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:03 localhost hyperkube[1909]: I1120 07:21:03.029318 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:03 localhost hyperkube[1909]: E1120 07:21:03.029655 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:03 localhost systemd[1]: Started crio-conmon-16988364c2bb6b5ba847462e41f1c586b82a33993c3c17163ef7294fb5c310da.scope. Nov 20 07:21:03 localhost systemd[1]: Created slice libcontainer_17262_systemd_test_default.slice. Nov 20 07:21:03 localhost systemd[1]: Removed slice libcontainer_17262_systemd_test_default.slice. Nov 20 07:21:03 localhost systemd[1]: Started libcontainer container 16988364c2bb6b5ba847462e41f1c586b82a33993c3c17163ef7294fb5c310da. Nov 20 07:21:03 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:03 localhost systemd[1]: Stopped libcontainer container 16988364c2bb6b5ba847462e41f1c586b82a33993c3c17163ef7294fb5c310da. Nov 20 07:21:03 localhost systemd[1]: crio-16988364c2bb6b5ba847462e41f1c586b82a33993c3c17163ef7294fb5c310da.scope: Consumed 48ms CPU time Nov 20 07:21:03 localhost crio[1857]: time="2019-11-20 07:21:03.285471531Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:03 localhost hyperkube[1909]: E1120 07:21:03.336745 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:03 localhost hyperkube[1909]: E1120 07:21:03.336888 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:03 localhost hyperkube[1909]: E1120 07:21:03.336941 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:05 localhost hyperkube[1909]: I1120 07:21:05.025881 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:05 localhost hyperkube[1909]: I1120 07:21:05.028052 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:05 localhost hyperkube[1909]: I1120 07:21:05.028119 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:05 localhost hyperkube[1909]: I1120 07:21:05.028193 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:05 localhost hyperkube[1909]: E1120 07:21:05.028674 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:06 localhost podman[17292]: 2019-11-20 07:21:06.929274268 +0000 UTC m=+0.152286801 container create 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:06 localhost systemd[1]: Started libpod-conmon-32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2.scope. Nov 20 07:21:06 localhost systemd[1]: Created slice libcontainer_17307_systemd_test_default.slice. Nov 20 07:21:06 localhost systemd[1]: Removed slice libcontainer_17307_systemd_test_default.slice. Nov 20 07:21:07 localhost systemd[1]: Started libcontainer container 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2. Nov 20 07:21:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:07 localhost podman[17292]: 2019-11-20 07:21:07.333152208 +0000 UTC m=+0.556164705 container init 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:07 localhost podman[17292]: 2019-11-20 07:21:07.353549176 +0000 UTC m=+0.576561685 container start 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:07 localhost podman[17292]: 2019-11-20 07:21:07.353771287 +0000 UTC m=+0.576783825 container attach 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.025830 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.027803 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.027854 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.027875 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:10 localhost hyperkube[1909]: E1120 07:21:10.028090 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:10 localhost systemd[1]: Started crio-conmon-eaea99b41c707896afb46d0240635a2bffc4e827adc0f2c4cfbf78b7c3babc5d.scope. Nov 20 07:21:10 localhost systemd[1]: Created slice libcontainer_17359_systemd_test_default.slice. Nov 20 07:21:10 localhost systemd[1]: Removed slice libcontainer_17359_systemd_test_default.slice. Nov 20 07:21:10 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:21:10 localhost systemd[1]: Started libcontainer container eaea99b41c707896afb46d0240635a2bffc4e827adc0f2c4cfbf78b7c3babc5d. Nov 20 07:21:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:10 localhost systemd[1]: Stopped libcontainer container eaea99b41c707896afb46d0240635a2bffc4e827adc0f2c4cfbf78b7c3babc5d. Nov 20 07:21:10 localhost systemd[1]: crio-eaea99b41c707896afb46d0240635a2bffc4e827adc0f2c4cfbf78b7c3babc5d.scope: Consumed 35ms CPU time Nov 20 07:21:10 localhost crio[1857]: time="2019-11-20 07:21:10.279274297Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:10 localhost hyperkube[1909]: E1120 07:21:10.337093 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:10 localhost hyperkube[1909]: E1120 07:21:10.337255 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:10 localhost hyperkube[1909]: E1120 07:21:10.337324 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.686792 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.689176 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.689244 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:10 localhost hyperkube[1909]: I1120 07:21:10.689282 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:12.365Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9a323cad-ffed-4add-8639-e7c0cc35fe6d/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:12.365Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-402389f9-7564-4843-bef0-f2d20684f764/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:12 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:12.365Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-42f287de-9541-4879-b48b-54a5c0ddc9f3/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:12 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:12 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:12 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:12 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:21:12 localhost systemd[1]: libpod-32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2.scope: Consumed 344ms CPU time Nov 20 07:21:12 localhost podman[17292]: 2019-11-20 07:21:12.412557994 +0000 UTC m=+5.635570545 container died 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:12 localhost podman[17292]: 2019-11-20 07:21:12.476508252 +0000 UTC m=+5.699520803 container remove 32b86d64e8e9ddd1df49d02663cb853434a39847e74da9947be4336a4ed582e2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:12 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:21:15 localhost hyperkube[1909]: I1120 07:21:15.025764 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:15 localhost hyperkube[1909]: I1120 07:21:15.027648 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:15 localhost hyperkube[1909]: I1120 07:21:15.027711 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:15 localhost hyperkube[1909]: I1120 07:21:15.027746 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:15 localhost hyperkube[1909]: E1120 07:21:15.027982 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:15 localhost systemd[1]: Started crio-conmon-330d5d79875e0c50c95a1e3c3496c034b331a5d9d4ce3529b613542e0db95cda.scope. Nov 20 07:21:15 localhost systemd[1]: Created slice libcontainer_17412_systemd_test_default.slice. Nov 20 07:21:15 localhost systemd[1]: Removed slice libcontainer_17412_systemd_test_default.slice. Nov 20 07:21:15 localhost systemd[1]: Started libcontainer container 330d5d79875e0c50c95a1e3c3496c034b331a5d9d4ce3529b613542e0db95cda. Nov 20 07:21:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:15 localhost systemd[1]: Stopped libcontainer container 330d5d79875e0c50c95a1e3c3496c034b331a5d9d4ce3529b613542e0db95cda. Nov 20 07:21:15 localhost systemd[1]: crio-330d5d79875e0c50c95a1e3c3496c034b331a5d9d4ce3529b613542e0db95cda.scope: Consumed 32ms CPU time Nov 20 07:21:15 localhost crio[1857]: time="2019-11-20 07:21:15.235859959Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:15 localhost hyperkube[1909]: E1120 07:21:15.286974 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:15 localhost hyperkube[1909]: E1120 07:21:15.287135 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:15 localhost hyperkube[1909]: E1120 07:21:15.287188 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:17 localhost podman[17441]: 2019-11-20 07:21:17.66668692 +0000 UTC m=+0.143788355 container create 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:17 localhost systemd[1]: Started libpod-conmon-09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011.scope. Nov 20 07:21:17 localhost systemd[1]: Created slice libcontainer_17455_systemd_test_default.slice. Nov 20 07:21:17 localhost systemd[1]: Removed slice libcontainer_17455_systemd_test_default.slice. Nov 20 07:21:17 localhost systemd[1]: Started libcontainer container 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011. Nov 20 07:21:17 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:18 localhost podman[17441]: 2019-11-20 07:21:18.073785884 +0000 UTC m=+0.550887315 container init 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:18 localhost podman[17441]: 2019-11-20 07:21:18.099647887 +0000 UTC m=+0.576749355 container start 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:18 localhost podman[17441]: 2019-11-20 07:21:18.099843074 +0000 UTC m=+0.576944559 container attach 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:20 localhost hyperkube[1909]: I1120 07:21:20.709533 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:20 localhost hyperkube[1909]: I1120 07:21:20.711965 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:20 localhost hyperkube[1909]: I1120 07:21:20.712039 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:20 localhost hyperkube[1909]: I1120 07:21:20.712069 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:23.119Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e8335bd1-4198-4660-aa0d-367b64ca6a93/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:23.119Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-18cd367f-c617-415a-9c6c-1df583582426/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:23 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:23.119Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-59e08b6d-42df-4d06-a987-9717fe0c4aa6/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:23 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:23 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:23 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:23 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:21:23 localhost systemd[1]: libpod-09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011.scope: Consumed 357ms CPU time Nov 20 07:21:23 localhost podman[17441]: 2019-11-20 07:21:23.165605277 +0000 UTC m=+5.642706768 container died 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:23 localhost podman[17441]: 2019-11-20 07:21:23.247443551 +0000 UTC m=+5.724545057 container remove 09f4f6c5013b3a9cb81ff9f79ed316e7337944cba99516d970414eb8428d0011 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:23 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:21:24 localhost hyperkube[1909]: I1120 07:21:24.026225 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:24 localhost hyperkube[1909]: I1120 07:21:24.028277 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:24 localhost hyperkube[1909]: I1120 07:21:24.028338 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:24 localhost hyperkube[1909]: I1120 07:21:24.028363 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:24 localhost hyperkube[1909]: E1120 07:21:24.028557 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:24 localhost systemd[1]: Started crio-conmon-9b0443ba59e0b585864069a757f3a6f64372a26c1aed8e22f3ed98e10508dc95.scope. Nov 20 07:21:24 localhost systemd[1]: Created slice libcontainer_17518_systemd_test_default.slice. Nov 20 07:21:24 localhost systemd[1]: Removed slice libcontainer_17518_systemd_test_default.slice. Nov 20 07:21:24 localhost systemd[1]: Started libcontainer container 9b0443ba59e0b585864069a757f3a6f64372a26c1aed8e22f3ed98e10508dc95. Nov 20 07:21:24 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:24 localhost systemd[1]: Stopped libcontainer container 9b0443ba59e0b585864069a757f3a6f64372a26c1aed8e22f3ed98e10508dc95. Nov 20 07:21:24 localhost systemd[1]: crio-9b0443ba59e0b585864069a757f3a6f64372a26c1aed8e22f3ed98e10508dc95.scope: Consumed 37ms CPU time Nov 20 07:21:24 localhost crio[1857]: time="2019-11-20 07:21:24.240366627Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:24 localhost hyperkube[1909]: E1120 07:21:24.294581 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:24 localhost hyperkube[1909]: E1120 07:21:24.294730 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:24 localhost hyperkube[1909]: E1120 07:21:24.294781 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:28 localhost podman[17545]: 2019-11-20 07:21:28.456593662 +0000 UTC m=+0.176027844 container create ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:28 localhost systemd[1]: Started libpod-conmon-ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a.scope. Nov 20 07:21:28 localhost systemd[1]: Created slice libcontainer_17559_systemd_test_default.slice. Nov 20 07:21:28 localhost systemd[1]: Removed slice libcontainer_17559_systemd_test_default.slice. Nov 20 07:21:28 localhost systemd[1]: Started libcontainer container ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a. Nov 20 07:21:28 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:28 localhost podman[17545]: 2019-11-20 07:21:28.872991205 +0000 UTC m=+0.592425360 container init ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:28 localhost podman[17545]: 2019-11-20 07:21:28.895297568 +0000 UTC m=+0.614731745 container start ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:28 localhost podman[17545]: 2019-11-20 07:21:28.895456526 +0000 UTC m=+0.614890708 container attach ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.025875 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.027982 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.028085 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.028107 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:30 localhost hyperkube[1909]: E1120 07:21:30.028291 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:30 localhost systemd[1]: Started crio-conmon-b9730f920f40494c5eda4badd205f5b1267f1d8f786cf3bcfec09e52488ae9ad.scope. Nov 20 07:21:30 localhost systemd[1]: Created slice libcontainer_17600_systemd_test_default.slice. Nov 20 07:21:30 localhost systemd[1]: Removed slice libcontainer_17600_systemd_test_default.slice. Nov 20 07:21:30 localhost systemd[1]: Started libcontainer container b9730f920f40494c5eda4badd205f5b1267f1d8f786cf3bcfec09e52488ae9ad. Nov 20 07:21:30 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:30 localhost systemd[1]: Stopped libcontainer container b9730f920f40494c5eda4badd205f5b1267f1d8f786cf3bcfec09e52488ae9ad. Nov 20 07:21:30 localhost systemd[1]: crio-b9730f920f40494c5eda4badd205f5b1267f1d8f786cf3bcfec09e52488ae9ad.scope: Consumed 40ms CPU time Nov 20 07:21:30 localhost crio[1857]: time="2019-11-20 07:21:30.265136416Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:30 localhost hyperkube[1909]: E1120 07:21:30.320825 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:30 localhost hyperkube[1909]: E1120 07:21:30.320971 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:30 localhost hyperkube[1909]: E1120 07:21:30.321061 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:30 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.728629 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.730804 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.730856 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:30 localhost hyperkube[1909]: I1120 07:21:30.730879 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:33.907Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c962e2f4-6a3d-4199-adc4-2e47fc865c1a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:33.907Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5c6ea43e-9ce3-4bb5-80b7-c2745becf4f9/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:33 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:33.907Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a3d2dbb8-54c7-4d7e-ade1-1f4beb275962/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:33 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:33 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:33 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:33 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:21:33 localhost systemd[1]: libpod-ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a.scope: Consumed 335ms CPU time Nov 20 07:21:33 localhost podman[17545]: 2019-11-20 07:21:33.957511949 +0000 UTC m=+5.676946177 container died ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:34 localhost podman[17545]: 2019-11-20 07:21:34.027619393 +0000 UTC m=+5.747053639 container remove ce13eeac51499d55b78f482683ca7e445229294a9ebc278ae5473b1730f5064a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:34 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:21:39 localhost podman[17680]: 2019-11-20 07:21:39.230036226 +0000 UTC m=+0.153773225 container create 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:39 localhost systemd[1]: Started libpod-conmon-168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4.scope. Nov 20 07:21:39 localhost systemd[1]: Created slice libcontainer_17694_systemd_test_default.slice. Nov 20 07:21:39 localhost systemd[1]: Removed slice libcontainer_17694_systemd_test_default.slice. Nov 20 07:21:39 localhost systemd[1]: Started libcontainer container 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4. Nov 20 07:21:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:39 localhost podman[17680]: 2019-11-20 07:21:39.639215773 +0000 UTC m=+0.562952781 container init 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:39 localhost podman[17680]: 2019-11-20 07:21:39.660822566 +0000 UTC m=+0.584559588 container start 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:39 localhost podman[17680]: 2019-11-20 07:21:39.661312747 +0000 UTC m=+0.585049756 container attach 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.026058 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.028634 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.028684 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.028706 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:40 localhost hyperkube[1909]: E1120 07:21:40.028913 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:40 localhost systemd[1]: Started crio-conmon-a7a53860df60c7a163e307bd14bf37b12b6124655512daa96a37b0553a28759d.scope. Nov 20 07:21:40 localhost systemd[1]: Created slice libcontainer_17732_systemd_test_default.slice. Nov 20 07:21:40 localhost systemd[1]: Removed slice libcontainer_17732_systemd_test_default.slice. Nov 20 07:21:40 localhost systemd[1]: Started libcontainer container a7a53860df60c7a163e307bd14bf37b12b6124655512daa96a37b0553a28759d. Nov 20 07:21:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:40 localhost systemd[1]: Stopped libcontainer container a7a53860df60c7a163e307bd14bf37b12b6124655512daa96a37b0553a28759d. Nov 20 07:21:40 localhost systemd[1]: crio-a7a53860df60c7a163e307bd14bf37b12b6124655512daa96a37b0553a28759d.scope: Consumed 35ms CPU time Nov 20 07:21:40 localhost crio[1857]: time="2019-11-20 07:21:40.234358082Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:40 localhost hyperkube[1909]: E1120 07:21:40.277996 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:40 localhost hyperkube[1909]: E1120 07:21:40.278184 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:40 localhost hyperkube[1909]: E1120 07:21:40.278238 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.753672 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.756334 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.756407 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:40 localhost hyperkube[1909]: I1120 07:21:40.756440 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:44 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:44.676Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-7131f829-719b-44ce-9837-50856c08a5f8/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:44 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:44.676Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e586489b-c192-4f28-98c3-dd764857d835/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:44 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:44.676Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-24a8d4ef-d8dc-4a14-be2b-d550378514ee/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:44 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:44 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:44 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:44 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:21:44 localhost systemd[1]: libpod-168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4.scope: Consumed 304ms CPU time Nov 20 07:21:44 localhost podman[17680]: 2019-11-20 07:21:44.724511596 +0000 UTC m=+5.648248632 container died 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:44 localhost podman[17680]: 2019-11-20 07:21:44.797505194 +0000 UTC m=+5.721242243 container remove 168b243f9694ca1cf12616a5931c103049af97322f621efe27e0b07770d018d4 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:44 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:21:45 localhost hyperkube[1909]: I1120 07:21:45.025862 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:45 localhost hyperkube[1909]: I1120 07:21:45.028082 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:45 localhost hyperkube[1909]: I1120 07:21:45.028132 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:45 localhost hyperkube[1909]: I1120 07:21:45.028154 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:45 localhost hyperkube[1909]: E1120 07:21:45.028360 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:45 localhost systemd[1]: Started crio-conmon-e740834a915e812474f048e5cee32ebd773a7295c27d9244d85efb6771df3427.scope. Nov 20 07:21:45 localhost systemd[1]: Created slice libcontainer_17785_systemd_test_default.slice. Nov 20 07:21:45 localhost systemd[1]: Removed slice libcontainer_17785_systemd_test_default.slice. Nov 20 07:21:45 localhost systemd[1]: Started libcontainer container e740834a915e812474f048e5cee32ebd773a7295c27d9244d85efb6771df3427. Nov 20 07:21:45 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:45 localhost systemd[1]: Stopped libcontainer container e740834a915e812474f048e5cee32ebd773a7295c27d9244d85efb6771df3427. Nov 20 07:21:45 localhost systemd[1]: crio-e740834a915e812474f048e5cee32ebd773a7295c27d9244d85efb6771df3427.scope: Consumed 35ms CPU time Nov 20 07:21:45 localhost crio[1857]: time="2019-11-20 07:21:45.232557375Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:45 localhost hyperkube[1909]: E1120 07:21:45.279611 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:45 localhost hyperkube[1909]: E1120 07:21:45.280081 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:45 localhost hyperkube[1909]: E1120 07:21:45.280155 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:49 localhost podman[17815]: 2019-11-20 07:21:49.988292108 +0000 UTC m=+0.153914221 container create 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:50 localhost systemd[1]: Started libpod-conmon-46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88.scope. Nov 20 07:21:50 localhost systemd[1]: Created slice libcontainer_17828_systemd_test_default.slice. Nov 20 07:21:50 localhost systemd[1]: Removed slice libcontainer_17828_systemd_test_default.slice. Nov 20 07:21:50 localhost systemd[1]: Started libcontainer container 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88. Nov 20 07:21:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:50 localhost podman[17815]: 2019-11-20 07:21:50.405369192 +0000 UTC m=+0.570991310 container init 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:50 localhost podman[17815]: 2019-11-20 07:21:50.426234178 +0000 UTC m=+0.591856266 container start 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:50 localhost podman[17815]: 2019-11-20 07:21:50.42636082 +0000 UTC m=+0.591982896 container attach 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:50 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:21:50 localhost hyperkube[1909]: I1120 07:21:50.772714 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:50 localhost hyperkube[1909]: I1120 07:21:50.775414 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:50 localhost hyperkube[1909]: I1120 07:21:50.775473 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:50 localhost hyperkube[1909]: I1120 07:21:50.775498 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:53 localhost hyperkube[1909]: I1120 07:21:53.025913 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:53 localhost hyperkube[1909]: I1120 07:21:53.028354 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:53 localhost hyperkube[1909]: I1120 07:21:53.028415 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:53 localhost hyperkube[1909]: I1120 07:21:53.028447 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:53 localhost hyperkube[1909]: E1120 07:21:53.028742 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:53 localhost systemd[1]: Started crio-conmon-f13619fe424a1d117c1f7232e07e08bebc8b2390ca3ec33d94a96b28653a6d8a.scope. Nov 20 07:21:53 localhost systemd[1]: Created slice libcontainer_17883_systemd_test_default.slice. Nov 20 07:21:53 localhost systemd[1]: Removed slice libcontainer_17883_systemd_test_default.slice. Nov 20 07:21:53 localhost systemd[1]: Started libcontainer container f13619fe424a1d117c1f7232e07e08bebc8b2390ca3ec33d94a96b28653a6d8a. Nov 20 07:21:53 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:53 localhost systemd[1]: Stopped libcontainer container f13619fe424a1d117c1f7232e07e08bebc8b2390ca3ec33d94a96b28653a6d8a. Nov 20 07:21:53 localhost systemd[1]: crio-f13619fe424a1d117c1f7232e07e08bebc8b2390ca3ec33d94a96b28653a6d8a.scope: Consumed 40ms CPU time Nov 20 07:21:53 localhost crio[1857]: time="2019-11-20 07:21:53.269889772Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:53 localhost hyperkube[1909]: E1120 07:21:53.324212 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:53 localhost hyperkube[1909]: E1120 07:21:53.324377 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:53 localhost hyperkube[1909]: E1120 07:21:53.324449 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:55 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:55.438Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-68eb4937-ab7e-48a8-ac1a-5b613a010967/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:55 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:55.438Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-d3803351-1ff5-491a-999e-c365d2c62dee/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:55 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:21:55.439Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-046ff013-00fc-44b6-8442-ce69de84926e/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:21:55 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:55 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:55 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:21:55 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:21:55 localhost systemd[1]: libpod-46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88.scope: Consumed 337ms CPU time Nov 20 07:21:55 localhost podman[17815]: 2019-11-20 07:21:55.482640936 +0000 UTC m=+5.648263082 container died 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:55 localhost podman[17815]: 2019-11-20 07:21:55.560059434 +0000 UTC m=+5.725681596 container remove 46e0fac584467416df1c8c0627c6156e982400f9619619b770bf36502b5a1c88 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:21:55 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:21:57 localhost hyperkube[1909]: I1120 07:21:57.026253 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:21:57 localhost hyperkube[1909]: I1120 07:21:57.029465 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:21:57 localhost hyperkube[1909]: I1120 07:21:57.029532 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:21:57 localhost hyperkube[1909]: I1120 07:21:57.029554 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:21:57 localhost hyperkube[1909]: E1120 07:21:57.029778 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:21:57 localhost systemd[1]: Started crio-conmon-b1f6c329ef33e1c48248f2278aeea6c101234eec264767639881dc5ff708766c.scope. Nov 20 07:21:57 localhost systemd[1]: Created slice libcontainer_17934_systemd_test_default.slice. Nov 20 07:21:57 localhost systemd[1]: Removed slice libcontainer_17934_systemd_test_default.slice. Nov 20 07:21:57 localhost systemd[1]: Started libcontainer container b1f6c329ef33e1c48248f2278aeea6c101234eec264767639881dc5ff708766c. Nov 20 07:21:57 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:21:57 localhost systemd[1]: Stopped libcontainer container b1f6c329ef33e1c48248f2278aeea6c101234eec264767639881dc5ff708766c. Nov 20 07:21:57 localhost systemd[1]: crio-b1f6c329ef33e1c48248f2278aeea6c101234eec264767639881dc5ff708766c.scope: Consumed 40ms CPU time Nov 20 07:21:57 localhost crio[1857]: time="2019-11-20 07:21:57.252828287Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:21:57 localhost hyperkube[1909]: E1120 07:21:57.307355 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:57 localhost hyperkube[1909]: E1120 07:21:57.307519 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:21:57 localhost hyperkube[1909]: E1120 07:21:57.307574 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:00 localhost podman[17964]: 2019-11-20 07:22:00.745128254 +0000 UTC m=+0.151219027 container create 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:00 localhost systemd[1]: Started libpod-conmon-801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0.scope. Nov 20 07:22:00 localhost hyperkube[1909]: I1120 07:22:00.796092 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:00 localhost hyperkube[1909]: I1120 07:22:00.798632 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:00 localhost hyperkube[1909]: I1120 07:22:00.798702 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:00 localhost hyperkube[1909]: I1120 07:22:00.798733 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:00 localhost systemd[1]: Created slice libcontainer_17979_systemd_test_default.slice. Nov 20 07:22:00 localhost systemd[1]: Removed slice libcontainer_17979_systemd_test_default.slice. Nov 20 07:22:00 localhost systemd[1]: Started libcontainer container 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0. Nov 20 07:22:00 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:01 localhost podman[17964]: 2019-11-20 07:22:01.155158541 +0000 UTC m=+0.561249332 container init 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:01 localhost podman[17964]: 2019-11-20 07:22:01.175667263 +0000 UTC m=+0.581758058 container start 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:01 localhost podman[17964]: 2019-11-20 07:22:01.175831187 +0000 UTC m=+0.581922017 container attach 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:06 localhost hyperkube[1909]: I1120 07:22:06.026044 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:06 localhost hyperkube[1909]: I1120 07:22:06.028345 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:06 localhost hyperkube[1909]: I1120 07:22:06.028399 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:06 localhost hyperkube[1909]: I1120 07:22:06.028426 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:06 localhost hyperkube[1909]: E1120 07:22:06.028605 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:06 localhost systemd[1]: Started crio-conmon-aeea66aba9527e62df3609f51214df7d4e740e3182d330c1d62a3ffb8ba7ee57.scope. Nov 20 07:22:06 localhost systemd[1]: Created slice libcontainer_18018_systemd_test_default.slice. Nov 20 07:22:06 localhost systemd[1]: Removed slice libcontainer_18018_systemd_test_default.slice. Nov 20 07:22:06 localhost systemd[1]: Started libcontainer container aeea66aba9527e62df3609f51214df7d4e740e3182d330c1d62a3ffb8ba7ee57. Nov 20 07:22:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:06.191Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ceb52aee-0d7e-46cb-8c2e-230764902397/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:06.191Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3aefb85e-ba31-4681-b8c6-c62cede43413/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:06 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:06.193Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-be86e61d-c035-4657-8d58-832c30755f09/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:06 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:06 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:06 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:06 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:22:06 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:06 localhost podman[17964]: 2019-11-20 07:22:06.220529537 +0000 UTC m=+5.626620397 container died 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:06 localhost systemd[1]: libpod-801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0.scope: Consumed 349ms CPU time Nov 20 07:22:06 localhost systemd[1]: Stopped libcontainer container aeea66aba9527e62df3609f51214df7d4e740e3182d330c1d62a3ffb8ba7ee57. Nov 20 07:22:06 localhost crio[1857]: time="2019-11-20 07:22:06.274361642Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:06 localhost podman[17964]: 2019-11-20 07:22:06.301507773 +0000 UTC m=+5.707598690 container remove 801d7da9a7b69ee067d8852707b90d5b485fafdf1dcdd14366980794d1aaeeb0 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:06 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:22:06 localhost hyperkube[1909]: E1120 07:22:06.338568 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:06 localhost hyperkube[1909]: E1120 07:22:06.338751 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:06 localhost hyperkube[1909]: E1120 07:22:06.338838 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:10 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:22:10 localhost hyperkube[1909]: I1120 07:22:10.822636 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:10 localhost hyperkube[1909]: I1120 07:22:10.824892 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:10 localhost hyperkube[1909]: I1120 07:22:10.824931 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:10 localhost hyperkube[1909]: I1120 07:22:10.824952 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:11 localhost hyperkube[1909]: I1120 07:22:11.026190 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:11 localhost hyperkube[1909]: I1120 07:22:11.028839 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:11 localhost hyperkube[1909]: I1120 07:22:11.028907 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:11 localhost hyperkube[1909]: I1120 07:22:11.028948 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:11 localhost hyperkube[1909]: E1120 07:22:11.029344 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:11 localhost systemd[1]: Started crio-conmon-e52d19b7997619028bfeda4ddb307d6513b9bba4ab6e823171105f8ac1f40a19.scope. Nov 20 07:22:11 localhost systemd[1]: Created slice libcontainer_18086_systemd_test_default.slice. Nov 20 07:22:11 localhost systemd[1]: Removed slice libcontainer_18086_systemd_test_default.slice. Nov 20 07:22:11 localhost systemd[1]: Started libcontainer container e52d19b7997619028bfeda4ddb307d6513b9bba4ab6e823171105f8ac1f40a19. Nov 20 07:22:11 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:11 localhost systemd[1]: Stopped libcontainer container e52d19b7997619028bfeda4ddb307d6513b9bba4ab6e823171105f8ac1f40a19. Nov 20 07:22:11 localhost systemd[1]: crio-e52d19b7997619028bfeda4ddb307d6513b9bba4ab6e823171105f8ac1f40a19.scope: Consumed 39ms CPU time Nov 20 07:22:11 localhost crio[1857]: time="2019-11-20 07:22:11.239698447Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:11 localhost hyperkube[1909]: E1120 07:22:11.293747 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:11 localhost hyperkube[1909]: E1120 07:22:11.293898 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:11 localhost hyperkube[1909]: E1120 07:22:11.293999 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:11 localhost podman[18115]: 2019-11-20 07:22:11.502523381 +0000 UTC m=+0.158285650 container create a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:11 localhost systemd[1]: Started libpod-conmon-a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681.scope. Nov 20 07:22:11 localhost systemd[1]: Created slice libcontainer_18129_systemd_test_default.slice. Nov 20 07:22:11 localhost systemd[1]: Removed slice libcontainer_18129_systemd_test_default.slice. Nov 20 07:22:11 localhost systemd[1]: Started libcontainer container a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681. Nov 20 07:22:11 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:11 localhost podman[18115]: 2019-11-20 07:22:11.926091202 +0000 UTC m=+0.581853430 container init a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:11 localhost podman[18115]: 2019-11-20 07:22:11.946624722 +0000 UTC m=+0.602387066 container start a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:11 localhost podman[18115]: 2019-11-20 07:22:11.946829405 +0000 UTC m=+0.602591638 container attach a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:16.962Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b8145085-e71c-40e0-8677-c30c776817ac/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:16.963Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-76897437-b04c-46f7-bcee-957a4adbbce3/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:16 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:16.963Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-af1988ee-d67e-472c-8855-770c688a72fa/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:16 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:16 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:16 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:16 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:22:16 localhost podman[18115]: 2019-11-20 07:22:16.985550887 +0000 UTC m=+5.641313154 container died a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:16 localhost systemd[1]: libpod-a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681.scope: Consumed 360ms CPU time Nov 20 07:22:17 localhost podman[18115]: 2019-11-20 07:22:17.059582765 +0000 UTC m=+5.715344999 container remove a8526496fd6981541ac9475326df0970649fc68e28e9d444fd4a46b6b8ffc681 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:17 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:22:20 localhost hyperkube[1909]: I1120 07:22:20.846827 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:20 localhost hyperkube[1909]: I1120 07:22:20.849456 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:20 localhost hyperkube[1909]: I1120 07:22:20.849497 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:20 localhost hyperkube[1909]: I1120 07:22:20.849518 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:21 localhost hyperkube[1909]: I1120 07:22:21.026123 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:21 localhost hyperkube[1909]: I1120 07:22:21.028473 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:21 localhost hyperkube[1909]: I1120 07:22:21.028539 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:21 localhost hyperkube[1909]: I1120 07:22:21.028561 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:21 localhost hyperkube[1909]: E1120 07:22:21.028806 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:21 localhost systemd[1]: Started crio-conmon-497e940eba4f666734949ee0dda0757f5af2a9ffeff682a287f02e2e4f05628c.scope. Nov 20 07:22:21 localhost systemd[1]: Created slice libcontainer_18191_systemd_test_default.slice. Nov 20 07:22:21 localhost systemd[1]: Removed slice libcontainer_18191_systemd_test_default.slice. Nov 20 07:22:21 localhost systemd[1]: Started libcontainer container 497e940eba4f666734949ee0dda0757f5af2a9ffeff682a287f02e2e4f05628c. Nov 20 07:22:21 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:21 localhost systemd[1]: Stopped libcontainer container 497e940eba4f666734949ee0dda0757f5af2a9ffeff682a287f02e2e4f05628c. Nov 20 07:22:21 localhost crio[1857]: time="2019-11-20 07:22:21.247720300Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:21 localhost hyperkube[1909]: E1120 07:22:21.305812 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:21 localhost hyperkube[1909]: E1120 07:22:21.306172 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:21 localhost hyperkube[1909]: E1120 07:22:21.306250 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:22 localhost podman[18219]: 2019-11-20 07:22:22.263077862 +0000 UTC m=+0.170555906 container create bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:22 localhost systemd[1]: Started libpod-conmon-bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331.scope. Nov 20 07:22:22 localhost systemd[1]: Created slice libcontainer_18233_systemd_test_default.slice. Nov 20 07:22:22 localhost systemd[1]: Removed slice libcontainer_18233_systemd_test_default.slice. Nov 20 07:22:22 localhost systemd[1]: Started libcontainer container bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331. Nov 20 07:22:22 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:22 localhost podman[18219]: 2019-11-20 07:22:22.68265416 +0000 UTC m=+0.590132151 container init bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:22 localhost podman[18219]: 2019-11-20 07:22:22.7029143 +0000 UTC m=+0.610392316 container start bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:22 localhost podman[18219]: 2019-11-20 07:22:22.703617819 +0000 UTC m=+0.611095918 container attach bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.026091 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.026380 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.028506 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.028543 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.028562 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.028603 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.028636 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:25 localhost hyperkube[1909]: I1120 07:22:25.028564 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:25 localhost hyperkube[1909]: E1120 07:22:25.028911 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:25 localhost hyperkube[1909]: E1120 07:22:25.029214 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:25 localhost systemd[1]: Started crio-conmon-73d6cb92c7e926b839caa509e4767f690d7b5dfc67035d2543ad71e4764fe212.scope. Nov 20 07:22:25 localhost systemd[1]: Created slice libcontainer_18274_systemd_test_default.slice. Nov 20 07:22:25 localhost systemd[1]: Removed slice libcontainer_18274_systemd_test_default.slice. Nov 20 07:22:25 localhost systemd[1]: Started libcontainer container 73d6cb92c7e926b839caa509e4767f690d7b5dfc67035d2543ad71e4764fe212. Nov 20 07:22:25 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:25 localhost systemd[1]: Stopped libcontainer container 73d6cb92c7e926b839caa509e4767f690d7b5dfc67035d2543ad71e4764fe212. Nov 20 07:22:25 localhost systemd[1]: crio-73d6cb92c7e926b839caa509e4767f690d7b5dfc67035d2543ad71e4764fe212.scope: Consumed 40ms CPU time Nov 20 07:22:25 localhost crio[1857]: time="2019-11-20 07:22:25.248786160Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:25 localhost hyperkube[1909]: E1120 07:22:25.304189 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:25 localhost hyperkube[1909]: E1120 07:22:25.304338 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:25 localhost hyperkube[1909]: E1120 07:22:25.304406 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:27.719Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e01f4652-d817-4719-b6a6-86d1fb3fc70f/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:27.719Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-c9dc5b06-e6e9-4e4d-8fdd-b8a94b2f0d40/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:27 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:27.720Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a1839298-34b3-4559-96c7-30d6053eea9f/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:27 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:27 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:27 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:27 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:22:27 localhost systemd[1]: libpod-bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331.scope: Consumed 346ms CPU time Nov 20 07:22:27 localhost podman[18219]: 2019-11-20 07:22:27.765711227 +0000 UTC m=+5.673189295 container died bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:27 localhost podman[18219]: 2019-11-20 07:22:27.858127333 +0000 UTC m=+5.765605377 container remove bca4446f497f6b2c85c0f3c1fc63d111a46216e81cd3a3fd08c7cc1a7a9a3331 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:27 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:22:30 localhost hyperkube[1909]: I1120 07:22:30.867022 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:30 localhost hyperkube[1909]: I1120 07:22:30.869388 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:30 localhost hyperkube[1909]: I1120 07:22:30.869464 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:30 localhost hyperkube[1909]: I1120 07:22:30.869504 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:30 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:22:33 localhost podman[18336]: 2019-11-20 07:22:33.064694377 +0000 UTC m=+0.171997386 container create 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:33 localhost systemd[1]: Started libpod-conmon-17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865.scope. Nov 20 07:22:33 localhost systemd[1]: Created slice libcontainer_18349_systemd_test_default.slice. Nov 20 07:22:33 localhost systemd[1]: Removed slice libcontainer_18349_systemd_test_default.slice. Nov 20 07:22:33 localhost systemd[1]: Started libcontainer container 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865. Nov 20 07:22:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:33 localhost podman[18336]: 2019-11-20 07:22:33.453378181 +0000 UTC m=+0.560681234 container init 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:33 localhost podman[18336]: 2019-11-20 07:22:33.474797565 +0000 UTC m=+0.582100638 container start 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:33 localhost podman[18336]: 2019-11-20 07:22:33.474959704 +0000 UTC m=+0.582262730 container attach 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:35 localhost hyperkube[1909]: I1120 07:22:35.026351 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:35 localhost hyperkube[1909]: I1120 07:22:35.029400 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:35 localhost hyperkube[1909]: I1120 07:22:35.029485 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:35 localhost hyperkube[1909]: I1120 07:22:35.029522 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:35 localhost hyperkube[1909]: E1120 07:22:35.029949 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:35 localhost systemd[1]: Started crio-conmon-597f43c74fcf03b445b4906b29c2e4b2bad5aca2e34c1621a596db5b4e90c0b1.scope. Nov 20 07:22:35 localhost systemd[1]: Created slice libcontainer_18392_systemd_test_default.slice. Nov 20 07:22:35 localhost systemd[1]: Removed slice libcontainer_18392_systemd_test_default.slice. Nov 20 07:22:35 localhost systemd[1]: Started libcontainer container 597f43c74fcf03b445b4906b29c2e4b2bad5aca2e34c1621a596db5b4e90c0b1. Nov 20 07:22:35 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:35 localhost systemd[1]: Stopped libcontainer container 597f43c74fcf03b445b4906b29c2e4b2bad5aca2e34c1621a596db5b4e90c0b1. Nov 20 07:22:35 localhost systemd[1]: crio-597f43c74fcf03b445b4906b29c2e4b2bad5aca2e34c1621a596db5b4e90c0b1.scope: Consumed 34ms CPU time Nov 20 07:22:35 localhost crio[1857]: time="2019-11-20 07:22:35.238455148Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:35 localhost hyperkube[1909]: E1120 07:22:35.292552 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:35 localhost hyperkube[1909]: E1120 07:22:35.292702 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:35 localhost hyperkube[1909]: E1120 07:22:35.292780 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:38 localhost hyperkube[1909]: E1120 07:22:38.220627 1909 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service Nov 20 07:22:38 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:38.492Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8220c3cd-3045-42e8-bf6a-b49b0d2905e8/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:38 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:38.492Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e7463254-658d-4fe3-b816-dab019838c8e/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:38 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:38.492Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ecaa533f-85cc-460d-ad76-21b3afd6cad5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:38 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:38 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:38 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:38 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:22:38 localhost systemd[1]: libpod-17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865.scope: Consumed 349ms CPU time Nov 20 07:22:38 localhost podman[18336]: 2019-11-20 07:22:38.537584694 +0000 UTC m=+5.644887778 container died 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:38 localhost podman[18336]: 2019-11-20 07:22:38.636832095 +0000 UTC m=+5.744135189 container remove 17f60bb17f72e46af117364375ef9671c30d22df37a242db10a5ee5d12402865 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:38 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:22:39 localhost hyperkube[1909]: I1120 07:22:39.026145 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:39 localhost hyperkube[1909]: I1120 07:22:39.028478 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:39 localhost hyperkube[1909]: I1120 07:22:39.028548 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:39 localhost hyperkube[1909]: I1120 07:22:39.028586 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:39 localhost hyperkube[1909]: E1120 07:22:39.028901 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:39 localhost systemd[1]: Started crio-conmon-10d5200849104908de05ce3ecffb4649ab20aff123a1b695acefb9d0d87fd54d.scope. Nov 20 07:22:39 localhost systemd[1]: Created slice libcontainer_18455_systemd_test_default.slice. Nov 20 07:22:39 localhost systemd[1]: Removed slice libcontainer_18455_systemd_test_default.slice. Nov 20 07:22:39 localhost systemd[1]: Started libcontainer container 10d5200849104908de05ce3ecffb4649ab20aff123a1b695acefb9d0d87fd54d. Nov 20 07:22:39 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:39 localhost systemd[1]: Stopped libcontainer container 10d5200849104908de05ce3ecffb4649ab20aff123a1b695acefb9d0d87fd54d. Nov 20 07:22:39 localhost systemd[1]: crio-10d5200849104908de05ce3ecffb4649ab20aff123a1b695acefb9d0d87fd54d.scope: Consumed 37ms CPU time Nov 20 07:22:39 localhost crio[1857]: time="2019-11-20 07:22:39.226646559Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:39 localhost hyperkube[1909]: E1120 07:22:39.272351 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:39 localhost hyperkube[1909]: E1120 07:22:39.272553 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:39 localhost hyperkube[1909]: E1120 07:22:39.272626 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:40 localhost hyperkube[1909]: I1120 07:22:40.888113 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:40 localhost hyperkube[1909]: I1120 07:22:40.890806 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:40 localhost hyperkube[1909]: I1120 07:22:40.890867 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:40 localhost hyperkube[1909]: I1120 07:22:40.890888 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:43 localhost podman[18482]: 2019-11-20 07:22:43.830309742 +0000 UTC m=+0.159808055 container create 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:43 localhost systemd[1]: Started libpod-conmon-3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f.scope. Nov 20 07:22:43 localhost systemd[1]: Created slice libcontainer_18495_systemd_test_default.slice. Nov 20 07:22:43 localhost systemd[1]: Removed slice libcontainer_18495_systemd_test_default.slice. Nov 20 07:22:43 localhost systemd[1]: Started libcontainer container 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f. Nov 20 07:22:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:44 localhost podman[18482]: 2019-11-20 07:22:44.275749584 +0000 UTC m=+0.605247918 container init 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:44 localhost podman[18482]: 2019-11-20 07:22:44.296110013 +0000 UTC m=+0.625608336 container start 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:44 localhost podman[18482]: 2019-11-20 07:22:44.296298155 +0000 UTC m=+0.625796467 container attach 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:49 localhost hyperkube[1909]: I1120 07:22:49.025867 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:49 localhost hyperkube[1909]: I1120 07:22:49.028477 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:49 localhost hyperkube[1909]: I1120 07:22:49.028572 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:49 localhost hyperkube[1909]: I1120 07:22:49.028609 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:49 localhost hyperkube[1909]: E1120 07:22:49.028894 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:49 localhost systemd[1]: Started crio-conmon-53d6d1b0688d100a2b87dc73ee2ec8067c14c293925d767212ded229d78b2fa1.scope. Nov 20 07:22:49 localhost systemd[1]: Created slice libcontainer_18538_systemd_test_default.slice. Nov 20 07:22:49 localhost systemd[1]: Removed slice libcontainer_18538_systemd_test_default.slice. Nov 20 07:22:49 localhost systemd[1]: Started libcontainer container 53d6d1b0688d100a2b87dc73ee2ec8067c14c293925d767212ded229d78b2fa1. Nov 20 07:22:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:49 localhost systemd[1]: Stopped libcontainer container 53d6d1b0688d100a2b87dc73ee2ec8067c14c293925d767212ded229d78b2fa1. Nov 20 07:22:49 localhost systemd[1]: crio-53d6d1b0688d100a2b87dc73ee2ec8067c14c293925d767212ded229d78b2fa1.scope: Consumed 35ms CPU time Nov 20 07:22:49 localhost crio[1857]: time="2019-11-20 07:22:49.236744528Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:49 localhost hyperkube[1909]: E1120 07:22:49.289999 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:49 localhost hyperkube[1909]: E1120 07:22:49.290184 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:49 localhost hyperkube[1909]: E1120 07:22:49.290266 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:49.308Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-908f836d-0679-45d8-abf5-5f4dddfcf2fd/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:49.308Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-eabe9217-684e-4e96-9cd9-240491e5e8e9/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:49 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:22:49.309Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-46f3dc65-e02d-4017-aa53-47df5bdbdf37/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:22:49 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:49 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:49 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:22:49 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:22:49 localhost systemd[1]: libpod-3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f.scope: Consumed 368ms CPU time Nov 20 07:22:49 localhost podman[18482]: 2019-11-20 07:22:49.356725922 +0000 UTC m=+5.686224278 container died 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:49 localhost podman[18482]: 2019-11-20 07:22:49.436882395 +0000 UTC m=+5.766380770 container remove 3dfe4a26078b48bd35113cbfc56d880633b02dd8f5e6a29b367bab46dbe88f9f (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:49 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:22:50 localhost hyperkube[1909]: I1120 07:22:50.907458 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:50 localhost hyperkube[1909]: I1120 07:22:50.909830 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:50 localhost hyperkube[1909]: I1120 07:22:50.909878 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:50 localhost hyperkube[1909]: I1120 07:22:50.909900 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:51 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:22:52 localhost hyperkube[1909]: I1120 07:22:52.026487 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:22:52 localhost hyperkube[1909]: I1120 07:22:52.030586 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:22:52 localhost hyperkube[1909]: I1120 07:22:52.030654 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:22:52 localhost hyperkube[1909]: I1120 07:22:52.030691 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:22:52 localhost hyperkube[1909]: E1120 07:22:52.030965 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:22:52 localhost systemd[1]: Started crio-conmon-cf39ae219097163144bdaeaf38d999c66c085babb6ee6d27443e5324db16b5ff.scope. Nov 20 07:22:52 localhost systemd[1]: Created slice libcontainer_18602_systemd_test_default.slice. Nov 20 07:22:52 localhost systemd[1]: Removed slice libcontainer_18602_systemd_test_default.slice. Nov 20 07:22:52 localhost systemd[1]: Started libcontainer container cf39ae219097163144bdaeaf38d999c66c085babb6ee6d27443e5324db16b5ff. Nov 20 07:22:52 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:52 localhost systemd[1]: Stopped libcontainer container cf39ae219097163144bdaeaf38d999c66c085babb6ee6d27443e5324db16b5ff. Nov 20 07:22:52 localhost systemd[1]: crio-cf39ae219097163144bdaeaf38d999c66c085babb6ee6d27443e5324db16b5ff.scope: Consumed 38ms CPU time Nov 20 07:22:52 localhost crio[1857]: time="2019-11-20 07:22:52.308369623Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:52 localhost hyperkube[1909]: E1120 07:22:52.366496 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:52 localhost hyperkube[1909]: E1120 07:22:52.366680 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:22:52 localhost hyperkube[1909]: E1120 07:22:52.366758 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:22:54 localhost podman[18632]: 2019-11-20 07:22:54.612241436 +0000 UTC m=+0.141788343 container create ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:54 localhost systemd[1]: Started libpod-conmon-ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2.scope. Nov 20 07:22:54 localhost systemd[1]: Created slice libcontainer_18646_systemd_test_default.slice. Nov 20 07:22:54 localhost systemd[1]: Removed slice libcontainer_18646_systemd_test_default.slice. Nov 20 07:22:54 localhost systemd[1]: Started libcontainer container ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2. Nov 20 07:22:54 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:22:55 localhost podman[18632]: 2019-11-20 07:22:55.009174101 +0000 UTC m=+0.538721022 container init ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:55 localhost podman[18632]: 2019-11-20 07:22:55.029227195 +0000 UTC m=+0.558774085 container start ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:22:55 localhost podman[18632]: 2019-11-20 07:22:55.029454345 +0000 UTC m=+0.559001271 container attach ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:00.041Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3211d091-2b62-4ecb-868b-23f57f5f23d3/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:00.041Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b6a5723e-8424-450b-89bf-7cf7903ac1c9/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:00 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:00.041Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-62ac76ef-95c8-4d9a-a7e4-a9d3ef5cf7cc/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:00 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:00 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:00 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:00 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:23:00 localhost systemd[1]: libpod-ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2.scope: Consumed 335ms CPU time Nov 20 07:23:00 localhost podman[18632]: 2019-11-20 07:23:00.084662106 +0000 UTC m=+5.614209072 container died ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:00 localhost podman[18632]: 2019-11-20 07:23:00.160441195 +0000 UTC m=+5.689988143 container remove ac02bdc87e86211995e3dcf207f82bd94e890d5410f21cf6f4b8ddcb495f2ef2 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:00 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:23:00 localhost hyperkube[1909]: I1120 07:23:00.925554 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:00 localhost hyperkube[1909]: I1120 07:23:00.928161 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:00 localhost hyperkube[1909]: I1120 07:23:00.928228 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:00 localhost hyperkube[1909]: I1120 07:23:00.928294 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:04 localhost hyperkube[1909]: I1120 07:23:04.026134 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:04 localhost hyperkube[1909]: I1120 07:23:04.028372 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:04 localhost hyperkube[1909]: I1120 07:23:04.028441 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:04 localhost hyperkube[1909]: I1120 07:23:04.028480 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:04 localhost hyperkube[1909]: E1120 07:23:04.028729 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:04 localhost systemd[1]: Started crio-conmon-b78280f2b6dfab3e721be661a33842194912977059a279ff0103e1b6e564012f.scope. Nov 20 07:23:04 localhost systemd[1]: Created slice libcontainer_18708_systemd_test_default.slice. Nov 20 07:23:04 localhost systemd[1]: Removed slice libcontainer_18708_systemd_test_default.slice. Nov 20 07:23:04 localhost systemd[1]: Started libcontainer container b78280f2b6dfab3e721be661a33842194912977059a279ff0103e1b6e564012f. Nov 20 07:23:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:04 localhost systemd[1]: crio-b78280f2b6dfab3e721be661a33842194912977059a279ff0103e1b6e564012f.scope: Failed to kill control group /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6772eabec456c65362c0b66ae75ba039.slice/crio-b78280f2b6dfab3e721be661a33842194912977059a279ff0103e1b6e564012f.scope, ignoring: No such device Nov 20 07:23:04 localhost systemd[1]: Stopped libcontainer container b78280f2b6dfab3e721be661a33842194912977059a279ff0103e1b6e564012f. Nov 20 07:23:04 localhost crio[1857]: time="2019-11-20 07:23:04.225255204Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:04 localhost hyperkube[1909]: E1120 07:23:04.277205 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:04 localhost hyperkube[1909]: E1120 07:23:04.277354 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:04 localhost hyperkube[1909]: E1120 07:23:04.277406 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:05 localhost podman[18737]: 2019-11-20 07:23:05.379718001 +0000 UTC m=+0.171637192 container create 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:05 localhost systemd[1]: Started libpod-conmon-538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57.scope. Nov 20 07:23:05 localhost systemd[1]: Created slice libcontainer_18751_systemd_test_default.slice. Nov 20 07:23:05 localhost systemd[1]: Removed slice libcontainer_18751_systemd_test_default.slice. Nov 20 07:23:05 localhost systemd[1]: Started libcontainer container 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57. Nov 20 07:23:05 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:05 localhost podman[18737]: 2019-11-20 07:23:05.797420138 +0000 UTC m=+0.589339336 container init 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:05 localhost podman[18737]: 2019-11-20 07:23:05.81899845 +0000 UTC m=+0.610917661 container start 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:05 localhost podman[18737]: 2019-11-20 07:23:05.819226407 +0000 UTC m=+0.611145625 container attach 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:07 localhost hyperkube[1909]: I1120 07:23:07.025988 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:07 localhost hyperkube[1909]: I1120 07:23:07.028514 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:07 localhost hyperkube[1909]: I1120 07:23:07.028564 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:07 localhost hyperkube[1909]: I1120 07:23:07.028587 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:07 localhost hyperkube[1909]: E1120 07:23:07.028792 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:07 localhost systemd[1]: Started crio-conmon-cd78f52b297e34c1713e151cfb493a3cfdba895e5838dd3ebb28518c592a7aa4.scope. Nov 20 07:23:07 localhost systemd[1]: Created slice libcontainer_18789_systemd_test_default.slice. Nov 20 07:23:07 localhost systemd[1]: Removed slice libcontainer_18789_systemd_test_default.slice. Nov 20 07:23:07 localhost systemd[1]: Started libcontainer container cd78f52b297e34c1713e151cfb493a3cfdba895e5838dd3ebb28518c592a7aa4. Nov 20 07:23:07 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:07 localhost systemd[1]: Stopped libcontainer container cd78f52b297e34c1713e151cfb493a3cfdba895e5838dd3ebb28518c592a7aa4. Nov 20 07:23:07 localhost crio[1857]: time="2019-11-20 07:23:07.229612370Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:07 localhost hyperkube[1909]: E1120 07:23:07.272067 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:07 localhost hyperkube[1909]: E1120 07:23:07.272271 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:07 localhost hyperkube[1909]: E1120 07:23:07.272351 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:10.832Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-26184080-d7bd-4c31-8a03-1d0a3261a633/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:10.833Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-893b913a-3a32-4ed6-a149-13e6ff5da57f/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:10 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:10.833Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e3933edb-b028-412f-b800-2940bc1a3076/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:10 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:10 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:10 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:10 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:23:10 localhost systemd[1]: libpod-538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57.scope: Consumed 351ms CPU time Nov 20 07:23:10 localhost podman[18737]: 2019-11-20 07:23:10.880725687 +0000 UTC m=+5.672644920 container died 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:10 localhost hyperkube[1909]: I1120 07:23:10.947363 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:10 localhost hyperkube[1909]: I1120 07:23:10.950823 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:10 localhost hyperkube[1909]: I1120 07:23:10.950866 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:10 localhost hyperkube[1909]: I1120 07:23:10.950886 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:10 localhost podman[18737]: 2019-11-20 07:23:10.951927825 +0000 UTC m=+5.743847051 container remove 538db2743453e37b0eb43eaaec4c9c23f0baa0c7cd3f8f0165057a652d36fb57 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:10 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:23:11 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:23:16 localhost podman[18853]: 2019-11-20 07:23:16.134646737 +0000 UTC m=+0.146360053 container create bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:16 localhost systemd[1]: Started libpod-conmon-bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645.scope. Nov 20 07:23:16 localhost systemd[1]: Created slice libcontainer_18867_systemd_test_default.slice. Nov 20 07:23:16 localhost systemd[1]: Removed slice libcontainer_18867_systemd_test_default.slice. Nov 20 07:23:16 localhost systemd[1]: Started libcontainer container bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645. Nov 20 07:23:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:16 localhost podman[18853]: 2019-11-20 07:23:16.535367374 +0000 UTC m=+0.547080692 container init bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:16 localhost podman[18853]: 2019-11-20 07:23:16.556390916 +0000 UTC m=+0.568104233 container start bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:16 localhost podman[18853]: 2019-11-20 07:23:16.556665065 +0000 UTC m=+0.568378423 container attach bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:18 localhost hyperkube[1909]: I1120 07:23:18.026622 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:18 localhost hyperkube[1909]: I1120 07:23:18.029580 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:18 localhost hyperkube[1909]: I1120 07:23:18.029654 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:18 localhost hyperkube[1909]: I1120 07:23:18.029692 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:18 localhost hyperkube[1909]: E1120 07:23:18.029981 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:18 localhost systemd[1]: Started crio-conmon-5f5b2723491e3f5827d94317d09f073fa69916b0bb9b5d0b1c9db56713865c10.scope. Nov 20 07:23:18 localhost systemd[1]: Created slice libcontainer_18907_systemd_test_default.slice. Nov 20 07:23:18 localhost systemd[1]: Removed slice libcontainer_18907_systemd_test_default.slice. Nov 20 07:23:18 localhost systemd[1]: Started libcontainer container 5f5b2723491e3f5827d94317d09f073fa69916b0bb9b5d0b1c9db56713865c10. Nov 20 07:23:18 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:18 localhost systemd[1]: Stopped libcontainer container 5f5b2723491e3f5827d94317d09f073fa69916b0bb9b5d0b1c9db56713865c10. Nov 20 07:23:18 localhost systemd[1]: crio-5f5b2723491e3f5827d94317d09f073fa69916b0bb9b5d0b1c9db56713865c10.scope: Consumed 36ms CPU time Nov 20 07:23:18 localhost crio[1857]: time="2019-11-20 07:23:18.245977772Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:18 localhost hyperkube[1909]: E1120 07:23:18.315843 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:18 localhost hyperkube[1909]: E1120 07:23:18.316026 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:18 localhost hyperkube[1909]: E1120 07:23:18.316080 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:19 localhost hyperkube[1909]: I1120 07:23:19.026113 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:19 localhost hyperkube[1909]: I1120 07:23:19.028127 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:19 localhost hyperkube[1909]: I1120 07:23:19.028179 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:19 localhost hyperkube[1909]: I1120 07:23:19.028201 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:19 localhost hyperkube[1909]: E1120 07:23:19.028395 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:19 localhost systemd[1]: Started crio-conmon-56a3038eb743303ffa3e9a1941fadf6a6e62d4aadf777504ef2fdde490c2e172.scope. Nov 20 07:23:19 localhost systemd[1]: Created slice libcontainer_18938_systemd_test_default.slice. Nov 20 07:23:19 localhost systemd[1]: Removed slice libcontainer_18938_systemd_test_default.slice. Nov 20 07:23:19 localhost systemd[1]: Started libcontainer container 56a3038eb743303ffa3e9a1941fadf6a6e62d4aadf777504ef2fdde490c2e172. Nov 20 07:23:19 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:19 localhost systemd[1]: Stopped libcontainer container 56a3038eb743303ffa3e9a1941fadf6a6e62d4aadf777504ef2fdde490c2e172. Nov 20 07:23:19 localhost systemd[1]: crio-56a3038eb743303ffa3e9a1941fadf6a6e62d4aadf777504ef2fdde490c2e172.scope: Consumed 33ms CPU time Nov 20 07:23:19 localhost crio[1857]: time="2019-11-20 07:23:19.226431159Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:19 localhost hyperkube[1909]: E1120 07:23:19.274512 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:19 localhost hyperkube[1909]: E1120 07:23:19.274703 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:19 localhost hyperkube[1909]: E1120 07:23:19.274776 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:20 localhost hyperkube[1909]: I1120 07:23:20.969608 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:20 localhost hyperkube[1909]: I1120 07:23:20.972169 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:20 localhost hyperkube[1909]: I1120 07:23:20.972233 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:20 localhost hyperkube[1909]: I1120 07:23:20.972254 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:21.572Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-95c81bb2-6704-47a4-9474-22c8bd5890c4/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:21.572Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b35afb23-649a-4c32-9ba3-18dca8d1b79b/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:21.572Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0fd12b0a-04d8-4ed5-895f-2804353854c8/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:21 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:21 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:21 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:21 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:23:21 localhost systemd[1]: libpod-bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645.scope: Consumed 346ms CPU time Nov 20 07:23:21 localhost podman[18853]: 2019-11-20 07:23:21.618476083 +0000 UTC m=+5.630189445 container died bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:21 localhost podman[18853]: 2019-11-20 07:23:21.685084858 +0000 UTC m=+5.696798224 container remove bb9354935aed23f0d71a900b8cc608537eeedfef9a27bad92e4c254eb66c5645 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:21 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:23:26 localhost podman[18988]: 2019-11-20 07:23:26.86520123 +0000 UTC m=+0.147784617 container create cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:26 localhost systemd[1]: Started libpod-conmon-cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313.scope. Nov 20 07:23:26 localhost systemd[1]: Created slice libcontainer_19002_systemd_test_default.slice. Nov 20 07:23:26 localhost systemd[1]: Removed slice libcontainer_19002_systemd_test_default.slice. Nov 20 07:23:26 localhost systemd[1]: Started libcontainer container cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313. Nov 20 07:23:27 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:27 localhost podman[18988]: 2019-11-20 07:23:27.315357196 +0000 UTC m=+0.597940581 container init cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:27 localhost podman[18988]: 2019-11-20 07:23:27.336428787 +0000 UTC m=+0.619012270 container start cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:27 localhost podman[18988]: 2019-11-20 07:23:27.336622012 +0000 UTC m=+0.619205374 container attach cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:30 localhost hyperkube[1909]: I1120 07:23:30.989949 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:30 localhost hyperkube[1909]: I1120 07:23:30.992903 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:30 localhost hyperkube[1909]: I1120 07:23:30.992957 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:30 localhost hyperkube[1909]: I1120 07:23:30.992981 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:31 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:23:32 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:32.351Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-35d23dcb-929e-48d4-bb25-e414adf7e458/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:32 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:32.352Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-cc33ebe1-5abb-44c2-a4f9-387ad5aa7acc/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:32 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:32.352Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-08c96092-bae8-4c08-b582-0130cb900840/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:32 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:32 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:32 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:32 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:23:32 localhost podman[18988]: 2019-11-20 07:23:32.373530656 +0000 UTC m=+5.656114099 container died cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:32 localhost systemd[1]: libpod-cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313.scope: Consumed 390ms CPU time Nov 20 07:23:32 localhost podman[18988]: 2019-11-20 07:23:32.464854189 +0000 UTC m=+5.747437622 container remove cd0ce6d31a89dd5003e2e593ee4dfa8555a6f11382804a7f807f8d4418f0e313 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:32 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.026276 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.026400 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.029091 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.029168 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.029199 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.029472 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.038958 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.039059 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:33 localhost hyperkube[1909]: I1120 07:23:33.039091 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.039385 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:33 localhost systemd[1]: Started crio-conmon-50ed1cf1a1cca7adf009df0c2aec5e31c9645de24ae37fb09121ec1386eae255.scope. Nov 20 07:23:33 localhost systemd[1]: Started crio-conmon-6743c06ccab5a721cd6d0b9a26335326decf1a701726e430c273e32b16c4b272.scope. Nov 20 07:23:33 localhost systemd[1]: Created slice libcontainer_19078_systemd_test_default.slice. Nov 20 07:23:33 localhost systemd[1]: Removed slice libcontainer_19078_systemd_test_default.slice. Nov 20 07:23:33 localhost systemd[1]: Started libcontainer container 50ed1cf1a1cca7adf009df0c2aec5e31c9645de24ae37fb09121ec1386eae255. Nov 20 07:23:33 localhost systemd[1]: Started libcontainer container 6743c06ccab5a721cd6d0b9a26335326decf1a701726e430c273e32b16c4b272. Nov 20 07:23:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:33 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:33 localhost systemd[1]: Stopped libcontainer container 50ed1cf1a1cca7adf009df0c2aec5e31c9645de24ae37fb09121ec1386eae255. Nov 20 07:23:33 localhost systemd[1]: crio-50ed1cf1a1cca7adf009df0c2aec5e31c9645de24ae37fb09121ec1386eae255.scope: Consumed 34ms CPU time Nov 20 07:23:33 localhost crio[1857]: time="2019-11-20 07:23:33.287036477Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:33 localhost systemd[1]: Stopped libcontainer container 6743c06ccab5a721cd6d0b9a26335326decf1a701726e430c273e32b16c4b272. Nov 20 07:23:33 localhost systemd[1]: crio-6743c06ccab5a721cd6d0b9a26335326decf1a701726e430c273e32b16c4b272.scope: Consumed 34ms CPU time Nov 20 07:23:33 localhost crio[1857]: time="2019-11-20 07:23:33.323804937Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.352092 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.352237 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.352294 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.384185 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.384313 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:33 localhost hyperkube[1909]: E1120 07:23:33.384369 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:37 localhost hyperkube[1909]: I1120 07:23:37.025907 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:37 localhost hyperkube[1909]: I1120 07:23:37.028270 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:37 localhost hyperkube[1909]: I1120 07:23:37.028340 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:37 localhost hyperkube[1909]: I1120 07:23:37.028380 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:37 localhost hyperkube[1909]: E1120 07:23:37.028873 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:37 localhost podman[19143]: 2019-11-20 07:23:37.658701044 +0000 UTC m=+0.154276679 container create 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:37 localhost systemd[1]: Started libpod-conmon-349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047.scope. Nov 20 07:23:37 localhost systemd[1]: Created slice libcontainer_19157_systemd_test_default.slice. Nov 20 07:23:37 localhost systemd[1]: Removed slice libcontainer_19157_systemd_test_default.slice. Nov 20 07:23:37 localhost systemd[1]: Started libcontainer container 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047. Nov 20 07:23:37 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:38 localhost podman[19143]: 2019-11-20 07:23:38.077697199 +0000 UTC m=+0.573272865 container init 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:38 localhost podman[19143]: 2019-11-20 07:23:38.104091403 +0000 UTC m=+0.599667076 container start 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:38 localhost podman[19143]: 2019-11-20 07:23:38.104277803 +0000 UTC m=+0.599853528 container attach 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:41 localhost hyperkube[1909]: I1120 07:23:41.011377 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:41 localhost hyperkube[1909]: I1120 07:23:41.014535 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:41 localhost hyperkube[1909]: I1120 07:23:41.014599 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:41 localhost hyperkube[1909]: I1120 07:23:41.014636 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:43.125Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-78d9d5c5-b3a5-4dca-b5cb-7438c6b59acc/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:43.125Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-7926dbce-512d-48a4-a87f-bae75cc9259d/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:43 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:43.125Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-679949ed-f3fa-49ad-b9bb-27ef1d5c4403/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:43 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:43 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:43 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:43 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:23:43 localhost systemd[1]: libpod-349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047.scope: Consumed 369ms CPU time Nov 20 07:23:43 localhost podman[19143]: 2019-11-20 07:23:43.176694797 +0000 UTC m=+5.672270468 container died 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:43 localhost podman[19143]: 2019-11-20 07:23:43.2519808 +0000 UTC m=+5.747556521 container remove 349aaf1381bd1ba569f32a24e63bd8f20e5db294c3f9de97821e54f1849d0047 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:43 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.025994 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.026220 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.028318 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.028366 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.028399 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.028454 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.028482 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:47 localhost hyperkube[1909]: I1120 07:23:47.028513 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.028697 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.028709 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:47 localhost systemd[1]: Started crio-conmon-fada67a4a509c793b4eab23d5a2d5eb2a24bbc9c1c26bd8eaf053f1fb9d9e9da.scope. Nov 20 07:23:47 localhost systemd[1]: Started crio-conmon-b5fe4b7d85d0581a469372daada24bd85071e81181c97a205c79bee0ffbd9230.scope. Nov 20 07:23:47 localhost systemd[1]: Created slice libcontainer_19229_systemd_test_default.slice. Nov 20 07:23:47 localhost systemd[1]: Removed slice libcontainer_19229_systemd_test_default.slice. Nov 20 07:23:47 localhost systemd[1]: Started libcontainer container fada67a4a509c793b4eab23d5a2d5eb2a24bbc9c1c26bd8eaf053f1fb9d9e9da. Nov 20 07:23:47 localhost systemd[1]: Started libcontainer container b5fe4b7d85d0581a469372daada24bd85071e81181c97a205c79bee0ffbd9230. Nov 20 07:23:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:47 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:47 localhost systemd[1]: Stopped libcontainer container fada67a4a509c793b4eab23d5a2d5eb2a24bbc9c1c26bd8eaf053f1fb9d9e9da. Nov 20 07:23:47 localhost systemd[1]: crio-fada67a4a509c793b4eab23d5a2d5eb2a24bbc9c1c26bd8eaf053f1fb9d9e9da.scope: Consumed 34ms CPU time Nov 20 07:23:47 localhost systemd[1]: Stopped libcontainer container b5fe4b7d85d0581a469372daada24bd85071e81181c97a205c79bee0ffbd9230. Nov 20 07:23:47 localhost crio[1857]: time="2019-11-20 07:23:47.300551469Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:47 localhost crio[1857]: time="2019-11-20 07:23:47.302312292Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.364579 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.364738 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.364794 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.394348 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.394525 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:47 localhost hyperkube[1909]: E1120 07:23:47.394580 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:48 localhost podman[19289]: 2019-11-20 07:23:48.42959954 +0000 UTC m=+0.141893515 container create fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:48 localhost systemd[1]: Started libpod-conmon-fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8.scope. Nov 20 07:23:48 localhost systemd[1]: Created slice libcontainer_19302_systemd_test_default.slice. Nov 20 07:23:48 localhost systemd[1]: Removed slice libcontainer_19302_systemd_test_default.slice. Nov 20 07:23:48 localhost systemd[1]: Started libcontainer container fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8. Nov 20 07:23:48 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:48 localhost podman[19289]: 2019-11-20 07:23:48.868592158 +0000 UTC m=+0.580886119 container init fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:48 localhost podman[19289]: 2019-11-20 07:23:48.888660154 +0000 UTC m=+0.600954096 container start fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:48 localhost podman[19289]: 2019-11-20 07:23:48.889034015 +0000 UTC m=+0.601327997 container attach fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:51 localhost hyperkube[1909]: I1120 07:23:51.035320 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:51 localhost hyperkube[1909]: I1120 07:23:51.037996 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:51 localhost hyperkube[1909]: I1120 07:23:51.038075 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:51 localhost hyperkube[1909]: I1120 07:23:51.038099 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:51 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:23:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:53.902Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-eaa4139d-2577-41e6-8f3a-9c21c124516a/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:53.902Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-61735009-4a08-4244-a663-2652f20313d7/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:53 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:23:53.902Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a506a722-bef3-4396-8e5d-b73d1e79ea43/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:23:53 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:53 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:53 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:23:53 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:23:53 localhost systemd[1]: libpod-fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8.scope: Consumed 371ms CPU time Nov 20 07:23:53 localhost podman[19289]: 2019-11-20 07:23:53.951899788 +0000 UTC m=+5.664193782 container died fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:54 localhost podman[19289]: 2019-11-20 07:23:54.037456276 +0000 UTC m=+5.749750285 container remove fb128742ff12a6d8b113cf22864c925d62205fc74d39ed07c60140edcd9b0ef8 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:54 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:23:58 localhost hyperkube[1909]: I1120 07:23:58.025962 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:58 localhost hyperkube[1909]: I1120 07:23:58.028055 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:58 localhost hyperkube[1909]: I1120 07:23:58.028097 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:58 localhost hyperkube[1909]: I1120 07:23:58.028119 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:58 localhost hyperkube[1909]: E1120 07:23:58.028317 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:58 localhost systemd[1]: Started crio-conmon-59acc0ae253c96a09c93a849237b4a2a70c7f8dfb748c9d871cccfa5d55c76de.scope. Nov 20 07:23:58 localhost systemd[1]: Created slice libcontainer_19377_systemd_test_default.slice. Nov 20 07:23:58 localhost systemd[1]: Removed slice libcontainer_19377_systemd_test_default.slice. Nov 20 07:23:58 localhost systemd[1]: Started libcontainer container 59acc0ae253c96a09c93a849237b4a2a70c7f8dfb748c9d871cccfa5d55c76de. Nov 20 07:23:58 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:58 localhost systemd[1]: Stopped libcontainer container 59acc0ae253c96a09c93a849237b4a2a70c7f8dfb748c9d871cccfa5d55c76de. Nov 20 07:23:58 localhost systemd[1]: crio-59acc0ae253c96a09c93a849237b4a2a70c7f8dfb748c9d871cccfa5d55c76de.scope: Consumed 37ms CPU time Nov 20 07:23:58 localhost crio[1857]: time="2019-11-20 07:23:58.247857292Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:58 localhost hyperkube[1909]: E1120 07:23:58.299061 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:58 localhost hyperkube[1909]: E1120 07:23:58.299197 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:58 localhost hyperkube[1909]: E1120 07:23:58.299248 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:59 localhost hyperkube[1909]: I1120 07:23:59.025989 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:23:59 localhost hyperkube[1909]: I1120 07:23:59.028199 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:23:59 localhost hyperkube[1909]: I1120 07:23:59.028252 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:23:59 localhost hyperkube[1909]: I1120 07:23:59.028275 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:23:59 localhost hyperkube[1909]: E1120 07:23:59.028455 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:23:59 localhost systemd[1]: Started crio-conmon-dbdcc6948e9d0039847a7971ea1de365a5a0a78d82c1b62c3f633b610a07a79c.scope. Nov 20 07:23:59 localhost systemd[1]: Created slice libcontainer_19416_systemd_test_default.slice. Nov 20 07:23:59 localhost systemd[1]: Removed slice libcontainer_19416_systemd_test_default.slice. Nov 20 07:23:59 localhost systemd[1]: Started libcontainer container dbdcc6948e9d0039847a7971ea1de365a5a0a78d82c1b62c3f633b610a07a79c. Nov 20 07:23:59 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:59 localhost systemd[1]: Stopped libcontainer container dbdcc6948e9d0039847a7971ea1de365a5a0a78d82c1b62c3f633b610a07a79c. Nov 20 07:23:59 localhost systemd[1]: crio-dbdcc6948e9d0039847a7971ea1de365a5a0a78d82c1b62c3f633b610a07a79c.scope: Consumed 33ms CPU time Nov 20 07:23:59 localhost crio[1857]: time="2019-11-20 07:23:59.239712746Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:59 localhost podman[19409]: 2019-11-20 07:23:59.259818342 +0000 UTC m=+0.184997944 container create af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:59 localhost hyperkube[1909]: E1120 07:23:59.310549 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:59 localhost hyperkube[1909]: E1120 07:23:59.310770 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:23:59 localhost hyperkube[1909]: E1120 07:23:59.310850 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:23:59 localhost systemd[1]: Started libpod-conmon-af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733.scope. Nov 20 07:23:59 localhost systemd[1]: Created slice libcontainer_19455_systemd_test_default.slice. Nov 20 07:23:59 localhost systemd[1]: Removed slice libcontainer_19455_systemd_test_default.slice. Nov 20 07:23:59 localhost systemd[1]: Started libcontainer container af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733. Nov 20 07:23:59 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:23:59 localhost podman[19409]: 2019-11-20 07:23:59.738101932 +0000 UTC m=+0.663281567 container init af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:59 localhost podman[19409]: 2019-11-20 07:23:59.760418479 +0000 UTC m=+0.685598123 container start af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:23:59 localhost podman[19409]: 2019-11-20 07:23:59.760557268 +0000 UTC m=+0.685736862 container attach af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:01 localhost hyperkube[1909]: I1120 07:24:01.053155 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:01 localhost hyperkube[1909]: I1120 07:24:01.055630 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:01 localhost hyperkube[1909]: I1120 07:24:01.055700 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:01 localhost hyperkube[1909]: I1120 07:24:01.055734 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:04.774Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-52c07423-1b0a-45c0-8ffd-1d47bc710a53/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:04.774Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9e5aa2f9-a365-40ff-b657-488283a71ec5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:04 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:04.774Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ba42fa48-9f16-445a-967b-df9e06e36da6/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:04 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:04 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:04 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:04 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:24:04 localhost systemd[1]: libpod-af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733.scope: Consumed 345ms CPU time Nov 20 07:24:04 localhost podman[19409]: 2019-11-20 07:24:04.825727476 +0000 UTC m=+5.750907139 container died af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:04 localhost podman[19409]: 2019-11-20 07:24:04.903865085 +0000 UTC m=+5.829044757 container remove af9ef65fd13f86936de8ae1a71b3ad31bd009ffb6f30263dc9b0f3e1d4651733 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:04 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:24:10 localhost hyperkube[1909]: I1120 07:24:10.025800 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:10 localhost hyperkube[1909]: I1120 07:24:10.028107 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:10 localhost hyperkube[1909]: I1120 07:24:10.028146 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:10 localhost hyperkube[1909]: I1120 07:24:10.028166 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:10 localhost hyperkube[1909]: E1120 07:24:10.028364 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:10 localhost systemd[1]: Started crio-conmon-49d39c9895f45a911dabbdbb30f541915710536945723852ca6fc60eae7bba4b.scope. Nov 20 07:24:10 localhost systemd[1]: Created slice libcontainer_19529_systemd_test_default.slice. Nov 20 07:24:10 localhost systemd[1]: Removed slice libcontainer_19529_systemd_test_default.slice. Nov 20 07:24:10 localhost podman[19516]: 2019-11-20 07:24:10.124200808 +0000 UTC m=+0.178713660 container create 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:10 localhost systemd[1]: Started libcontainer container 49d39c9895f45a911dabbdbb30f541915710536945723852ca6fc60eae7bba4b. Nov 20 07:24:10 localhost systemd[1]: Started libpod-conmon-81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a.scope. Nov 20 07:24:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:10 localhost systemd[1]: Created slice libcontainer_19545_systemd_test_default.slice. Nov 20 07:24:10 localhost systemd[1]: Removed slice libcontainer_19545_systemd_test_default.slice. Nov 20 07:24:10 localhost systemd[1]: Started libcontainer container 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a. Nov 20 07:24:10 localhost systemd[1]: Stopped libcontainer container 49d39c9895f45a911dabbdbb30f541915710536945723852ca6fc60eae7bba4b. Nov 20 07:24:10 localhost crio[1857]: time="2019-11-20 07:24:10.264452236Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:10 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:10 localhost hyperkube[1909]: E1120 07:24:10.342041 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:10 localhost hyperkube[1909]: E1120 07:24:10.342193 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:10 localhost hyperkube[1909]: E1120 07:24:10.342246 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:10 localhost podman[19516]: 2019-11-20 07:24:10.582394666 +0000 UTC m=+0.636907492 container init 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:10 localhost podman[19516]: 2019-11-20 07:24:10.602962543 +0000 UTC m=+0.657475394 container start 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:10 localhost podman[19516]: 2019-11-20 07:24:10.603164213 +0000 UTC m=+0.657677077 container attach 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:11 localhost hyperkube[1909]: I1120 07:24:11.070999 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:11 localhost hyperkube[1909]: I1120 07:24:11.073352 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:11 localhost hyperkube[1909]: I1120 07:24:11.073399 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:11 localhost hyperkube[1909]: I1120 07:24:11.073421 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:11 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:24:13 localhost hyperkube[1909]: I1120 07:24:13.026052 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:13 localhost hyperkube[1909]: I1120 07:24:13.028452 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:13 localhost hyperkube[1909]: I1120 07:24:13.028507 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:13 localhost hyperkube[1909]: I1120 07:24:13.028528 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:13 localhost hyperkube[1909]: E1120 07:24:13.028732 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:13 localhost systemd[1]: Started crio-conmon-005092736f056b22debcebea071c63c0bbd3128ea6864a49f4e974253d95c666.scope. Nov 20 07:24:13 localhost systemd[1]: Created slice libcontainer_19620_systemd_test_default.slice. Nov 20 07:24:13 localhost systemd[1]: Removed slice libcontainer_19620_systemd_test_default.slice. Nov 20 07:24:13 localhost systemd[1]: Started libcontainer container 005092736f056b22debcebea071c63c0bbd3128ea6864a49f4e974253d95c666. Nov 20 07:24:13 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:13 localhost systemd[1]: Stopped libcontainer container 005092736f056b22debcebea071c63c0bbd3128ea6864a49f4e974253d95c666. Nov 20 07:24:13 localhost systemd[1]: crio-005092736f056b22debcebea071c63c0bbd3128ea6864a49f4e974253d95c666.scope: Consumed 36ms CPU time Nov 20 07:24:13 localhost crio[1857]: time="2019-11-20 07:24:13.247641875Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:13 localhost hyperkube[1909]: E1120 07:24:13.301147 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:13 localhost hyperkube[1909]: E1120 07:24:13.301331 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:13 localhost hyperkube[1909]: E1120 07:24:13.301401 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:15.618Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-694dbacb-ef00-452c-9067-f08f7d47407e/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:15.618Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-bc0085de-57aa-4ead-8255-c51809d31658/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:15 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:15.619Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ff841f7a-faa0-42df-a3cc-29d1b4b19b42/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:15 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:15 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:15 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:15 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:24:15 localhost systemd[1]: libpod-81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a.scope: Consumed 347ms CPU time Nov 20 07:24:15 localhost podman[19516]: 2019-11-20 07:24:15.663697125 +0000 UTC m=+5.718209997 container died 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:15 localhost podman[19516]: 2019-11-20 07:24:15.731067276 +0000 UTC m=+5.785580267 container remove 81f72a586e3d25e12b07f3f677cc966ec7f72acf0e471802f7bf44eec2b8d23a (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:15 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:24:20 localhost podman[19676]: 2019-11-20 07:24:20.932152244 +0000 UTC m=+0.166779495 container create 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:20 localhost systemd[1]: Started libpod-conmon-0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db.scope. Nov 20 07:24:21 localhost systemd[1]: Created slice libcontainer_19690_systemd_test_default.slice. Nov 20 07:24:21 localhost systemd[1]: Removed slice libcontainer_19690_systemd_test_default.slice. Nov 20 07:24:21 localhost systemd[1]: Started libcontainer container 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db. Nov 20 07:24:21 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:21 localhost hyperkube[1909]: I1120 07:24:21.092782 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:21 localhost hyperkube[1909]: I1120 07:24:21.094780 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:21 localhost hyperkube[1909]: I1120 07:24:21.095075 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:21 localhost hyperkube[1909]: I1120 07:24:21.095122 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:21 localhost podman[19676]: 2019-11-20 07:24:21.374446198 +0000 UTC m=+0.609073447 container init 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:21 localhost podman[19676]: 2019-11-20 07:24:21.403478365 +0000 UTC m=+0.638105608 container start 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:21 localhost podman[19676]: 2019-11-20 07:24:21.403662227 +0000 UTC m=+0.638289480 container attach 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:23 localhost hyperkube[1909]: I1120 07:24:23.025900 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:23 localhost hyperkube[1909]: I1120 07:24:23.028491 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:23 localhost hyperkube[1909]: I1120 07:24:23.028557 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:23 localhost hyperkube[1909]: I1120 07:24:23.028590 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:23 localhost hyperkube[1909]: E1120 07:24:23.028845 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:23 localhost systemd[1]: Started crio-conmon-37fc8c7f763e2c8ef82a4a17d80ddf51226bbc512af872b1b2f19d1065d231ab.scope. Nov 20 07:24:23 localhost systemd[1]: Created slice libcontainer_19728_systemd_test_default.slice. Nov 20 07:24:23 localhost systemd[1]: Removed slice libcontainer_19728_systemd_test_default.slice. Nov 20 07:24:23 localhost systemd[1]: Started libcontainer container 37fc8c7f763e2c8ef82a4a17d80ddf51226bbc512af872b1b2f19d1065d231ab. Nov 20 07:24:23 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:23 localhost systemd[1]: Stopped libcontainer container 37fc8c7f763e2c8ef82a4a17d80ddf51226bbc512af872b1b2f19d1065d231ab. Nov 20 07:24:23 localhost systemd[1]: crio-37fc8c7f763e2c8ef82a4a17d80ddf51226bbc512af872b1b2f19d1065d231ab.scope: Consumed 33ms CPU time Nov 20 07:24:23 localhost crio[1857]: time="2019-11-20 07:24:23.247435226Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:23 localhost hyperkube[1909]: E1120 07:24:23.311249 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:23 localhost hyperkube[1909]: E1120 07:24:23.311395 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:23 localhost hyperkube[1909]: E1120 07:24:23.311450 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:26 localhost hyperkube[1909]: I1120 07:24:26.026149 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:26 localhost hyperkube[1909]: I1120 07:24:26.028535 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:26 localhost hyperkube[1909]: I1120 07:24:26.028588 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:26 localhost hyperkube[1909]: I1120 07:24:26.028617 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:26 localhost hyperkube[1909]: E1120 07:24:26.028856 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:26 localhost systemd[1]: Started crio-conmon-c296ce598aa863b099620b444c7c4e26e201e9ff78d73d612add8f58114c10c5.scope. Nov 20 07:24:26 localhost systemd[1]: Created slice libcontainer_19758_systemd_test_default.slice. Nov 20 07:24:26 localhost systemd[1]: Removed slice libcontainer_19758_systemd_test_default.slice. Nov 20 07:24:26 localhost systemd[1]: Started libcontainer container c296ce598aa863b099620b444c7c4e26e201e9ff78d73d612add8f58114c10c5. Nov 20 07:24:26 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:26 localhost systemd[1]: Stopped libcontainer container c296ce598aa863b099620b444c7c4e26e201e9ff78d73d612add8f58114c10c5. Nov 20 07:24:26 localhost crio[1857]: time="2019-11-20 07:24:26.219022355Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:26 localhost hyperkube[1909]: E1120 07:24:26.276062 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:26 localhost hyperkube[1909]: E1120 07:24:26.276246 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:26 localhost hyperkube[1909]: E1120 07:24:26.276330 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:26 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:26.411Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9e557b08-3a7e-4eb8-8260-32af274128a6/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:26 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:26.411Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-f7084e3e-4e7f-4efd-8699-37c1ba64bea5/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:26 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:26.412Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-615cf55d-cdf4-4452-9091-37975c355125/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:26 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:26 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:26 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:26 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:24:26 localhost systemd[1]: libpod-0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db.scope: Consumed 361ms CPU time Nov 20 07:24:26 localhost podman[19676]: 2019-11-20 07:24:26.456549822 +0000 UTC m=+5.691177095 container died 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:26 localhost podman[19676]: 2019-11-20 07:24:26.519362409 +0000 UTC m=+5.753989698 container remove 0f3d395fcf6db980e567eef21a9c81b57897b781006890f601771a8cadae22db (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:26 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:24:31 localhost hyperkube[1909]: I1120 07:24:31.112867 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:31 localhost hyperkube[1909]: I1120 07:24:31.114941 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:31 localhost hyperkube[1909]: I1120 07:24:31.114997 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:31 localhost hyperkube[1909]: I1120 07:24:31.115044 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:31 localhost podman[19810]: 2019-11-20 07:24:31.707748018 +0000 UTC m=+0.154716713 container create 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:31 localhost systemd[1]: Started libpod-conmon-7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3.scope. Nov 20 07:24:31 localhost systemd[1]: Created slice libcontainer_19834_systemd_test_default.slice. Nov 20 07:24:31 localhost systemd[1]: Removed slice libcontainer_19834_systemd_test_default.slice. Nov 20 07:24:31 localhost systemd[1]: Started libcontainer container 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3. Nov 20 07:24:31 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:31 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:24:32 localhost podman[19810]: 2019-11-20 07:24:32.16711904 +0000 UTC m=+0.614087703 container init 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:32 localhost podman[19810]: 2019-11-20 07:24:32.187812646 +0000 UTC m=+0.634781309 container start 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:32 localhost podman[19810]: 2019-11-20 07:24:32.188154739 +0000 UTC m=+0.635123427 container attach 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:37 localhost hyperkube[1909]: I1120 07:24:37.025984 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:37 localhost hyperkube[1909]: I1120 07:24:37.028675 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:37 localhost hyperkube[1909]: I1120 07:24:37.028746 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:37 localhost hyperkube[1909]: I1120 07:24:37.028787 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:37 localhost hyperkube[1909]: E1120 07:24:37.029162 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:37 localhost systemd[1]: Started crio-conmon-3f5941cb282df325992d83c3f494d6497ee708879e137b17ca7148a5208e325d.scope. Nov 20 07:24:37 localhost systemd[1]: Created slice libcontainer_19881_systemd_test_default.slice. Nov 20 07:24:37 localhost systemd[1]: Removed slice libcontainer_19881_systemd_test_default.slice. Nov 20 07:24:37 localhost systemd[1]: Started libcontainer container 3f5941cb282df325992d83c3f494d6497ee708879e137b17ca7148a5208e325d. Nov 20 07:24:37 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:37.203Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-22f3de07-75ce-4085-a72e-075977e69c4d/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:37.204Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b3e01f78-a401-4432-9803-233f2b265afc/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:37 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:37.204Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-8090e5c9-159e-4a98-9b73-4ecfbf1f1100/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:37 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:37 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:37 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:37 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:24:37 localhost systemd[1]: libpod-7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3.scope: Consumed 353ms CPU time Nov 20 07:24:37 localhost systemd[1]: Stopped libcontainer container 3f5941cb282df325992d83c3f494d6497ee708879e137b17ca7148a5208e325d. Nov 20 07:24:37 localhost systemd[1]: crio-3f5941cb282df325992d83c3f494d6497ee708879e137b17ca7148a5208e325d.scope: Consumed 42ms CPU time Nov 20 07:24:37 localhost podman[19810]: 2019-11-20 07:24:37.257648408 +0000 UTC m=+5.704617140 container died 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:37 localhost crio[1857]: time="2019-11-20 07:24:37.262295128Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:37 localhost hyperkube[1909]: E1120 07:24:37.328799 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:37 localhost hyperkube[1909]: E1120 07:24:37.328954 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:37 localhost hyperkube[1909]: E1120 07:24:37.329119 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:37 localhost podman[19810]: 2019-11-20 07:24:37.34752124 +0000 UTC m=+5.794489929 container remove 7c30340a5733398d92a066d9a98859f51a9856e8697bdc921b41aed94ae26ff3 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:37 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:24:38 localhost hyperkube[1909]: I1120 07:24:38.026112 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:38 localhost hyperkube[1909]: I1120 07:24:38.028492 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:38 localhost hyperkube[1909]: I1120 07:24:38.028545 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:38 localhost hyperkube[1909]: I1120 07:24:38.028567 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:38 localhost hyperkube[1909]: E1120 07:24:38.028760 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:38 localhost systemd[1]: Started crio-conmon-5ad3e30417f8b60c95dc0a026184101ff7f272612cd6281eb030627e52ad93c0.scope. Nov 20 07:24:38 localhost systemd[1]: Created slice libcontainer_19930_systemd_test_default.slice. Nov 20 07:24:38 localhost systemd[1]: Removed slice libcontainer_19930_systemd_test_default.slice. Nov 20 07:24:38 localhost systemd[1]: Started libcontainer container 5ad3e30417f8b60c95dc0a026184101ff7f272612cd6281eb030627e52ad93c0. Nov 20 07:24:38 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:38 localhost systemd[1]: Stopped libcontainer container 5ad3e30417f8b60c95dc0a026184101ff7f272612cd6281eb030627e52ad93c0. Nov 20 07:24:38 localhost systemd[1]: crio-5ad3e30417f8b60c95dc0a026184101ff7f272612cd6281eb030627e52ad93c0.scope: Consumed 38ms CPU time Nov 20 07:24:38 localhost crio[1857]: time="2019-11-20 07:24:38.257454609Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:38 localhost hyperkube[1909]: E1120 07:24:38.304186 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:38 localhost hyperkube[1909]: E1120 07:24:38.304384 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:38 localhost hyperkube[1909]: E1120 07:24:38.304473 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:41 localhost hyperkube[1909]: I1120 07:24:41.132702 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:41 localhost hyperkube[1909]: I1120 07:24:41.135194 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:41 localhost hyperkube[1909]: I1120 07:24:41.135262 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:41 localhost hyperkube[1909]: I1120 07:24:41.135308 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:42 localhost podman[19970]: 2019-11-20 07:24:42.541852981 +0000 UTC m=+0.155095424 container create 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:42 localhost systemd[1]: Started libpod-conmon-01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08.scope. Nov 20 07:24:42 localhost systemd[1]: Created slice libcontainer_19984_systemd_test_default.slice. Nov 20 07:24:42 localhost systemd[1]: Removed slice libcontainer_19984_systemd_test_default.slice. Nov 20 07:24:42 localhost systemd[1]: Started libcontainer container 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08. Nov 20 07:24:42 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:42 localhost podman[19970]: 2019-11-20 07:24:42.962530146 +0000 UTC m=+0.575772640 container init 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:42 localhost podman[19970]: 2019-11-20 07:24:42.984223625 +0000 UTC m=+0.597466074 container start 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:42 localhost podman[19970]: 2019-11-20 07:24:42.984420485 +0000 UTC m=+0.597662935 container attach 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:47.996Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-50d28a61-41af-4c66-91d8-f910ce6114ce/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:47.996Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b835dbb2-f2cd-4d91-a22f-0b125f28c578/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:47 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:47.996Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-64f64faf-1b58-4efd-9db0-df43645912fe/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:47 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:47 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:47 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:47 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:24:48 localhost systemd[1]: libpod-01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08.scope: Consumed 369ms CPU time Nov 20 07:24:48 localhost podman[19970]: 2019-11-20 07:24:48.045896596 +0000 UTC m=+5.659139073 container died 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:48 localhost podman[19970]: 2019-11-20 07:24:48.111584022 +0000 UTC m=+5.724826497 container remove 01e89bc6798e204340fc1e534fbc1dbb647a229197520f7e64a01447da6e2a08 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:48 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:24:49 localhost hyperkube[1909]: I1120 07:24:49.025921 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:49 localhost hyperkube[1909]: I1120 07:24:49.028342 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:49 localhost hyperkube[1909]: I1120 07:24:49.028411 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:49 localhost hyperkube[1909]: I1120 07:24:49.028452 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:49 localhost hyperkube[1909]: E1120 07:24:49.028744 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:49 localhost systemd[1]: Started crio-conmon-e96fa9f77e3f55c2b690dcf977ecaf7702339858fd61d7bf4cda5482510ba990.scope. Nov 20 07:24:49 localhost systemd[1]: Created slice libcontainer_20045_systemd_test_default.slice. Nov 20 07:24:49 localhost systemd[1]: Removed slice libcontainer_20045_systemd_test_default.slice. Nov 20 07:24:49 localhost systemd[1]: Started libcontainer container e96fa9f77e3f55c2b690dcf977ecaf7702339858fd61d7bf4cda5482510ba990. Nov 20 07:24:49 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:49 localhost systemd[1]: Stopped libcontainer container e96fa9f77e3f55c2b690dcf977ecaf7702339858fd61d7bf4cda5482510ba990. Nov 20 07:24:49 localhost systemd[1]: crio-e96fa9f77e3f55c2b690dcf977ecaf7702339858fd61d7bf4cda5482510ba990.scope: Consumed 34ms CPU time Nov 20 07:24:49 localhost crio[1857]: time="2019-11-20 07:24:49.242302536Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:49 localhost hyperkube[1909]: E1120 07:24:49.296051 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:49 localhost hyperkube[1909]: E1120 07:24:49.296203 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:49 localhost hyperkube[1909]: E1120 07:24:49.296256 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.026090 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.026521 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.028146 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.028191 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.028213 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:50 localhost hyperkube[1909]: E1120 07:24:50.028395 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.029083 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.029130 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:50 localhost hyperkube[1909]: I1120 07:24:50.029164 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:50 localhost hyperkube[1909]: E1120 07:24:50.029698 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:24:50 localhost systemd[1]: Started crio-conmon-523a2b7bf5b0cc39b7f8b4f5a48cd9cc7accbcf40826d4385fe7a75c3413107c.scope. Nov 20 07:24:50 localhost systemd[1]: Created slice libcontainer_20075_systemd_test_default.slice. Nov 20 07:24:50 localhost systemd[1]: Removed slice libcontainer_20075_systemd_test_default.slice. Nov 20 07:24:50 localhost systemd[1]: Started libcontainer container 523a2b7bf5b0cc39b7f8b4f5a48cd9cc7accbcf40826d4385fe7a75c3413107c. Nov 20 07:24:50 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:50 localhost systemd[1]: Stopped libcontainer container 523a2b7bf5b0cc39b7f8b4f5a48cd9cc7accbcf40826d4385fe7a75c3413107c. Nov 20 07:24:50 localhost crio[1857]: time="2019-11-20 07:24:50.260602276Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:50 localhost hyperkube[1909]: E1120 07:24:50.306412 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:50 localhost hyperkube[1909]: E1120 07:24:50.306568 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:24:50 localhost hyperkube[1909]: E1120 07:24:50.306622 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:24:51 localhost hyperkube[1909]: I1120 07:24:51.153359 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:24:51 localhost hyperkube[1909]: I1120 07:24:51.155978 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:24:51 localhost hyperkube[1909]: I1120 07:24:51.156074 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:24:51 localhost hyperkube[1909]: I1120 07:24:51.156116 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:24:52 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:24:53 localhost podman[20118]: 2019-11-20 07:24:53.304581206 +0000 UTC m=+0.158732553 container create 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:53 localhost systemd[1]: Started libpod-conmon-47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7.scope. Nov 20 07:24:53 localhost systemd[1]: Created slice libcontainer_20132_systemd_test_default.slice. Nov 20 07:24:53 localhost systemd[1]: Removed slice libcontainer_20132_systemd_test_default.slice. Nov 20 07:24:53 localhost systemd[1]: Started libcontainer container 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7. Nov 20 07:24:53 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:24:53 localhost podman[20118]: 2019-11-20 07:24:53.721203738 +0000 UTC m=+0.575355075 container init 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:53 localhost podman[20118]: 2019-11-20 07:24:53.74035805 +0000 UTC m=+0.594509384 container start 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:53 localhost podman[20118]: 2019-11-20 07:24:53.740497084 +0000 UTC m=+0.594648407 container attach 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:58.755Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-bbb2f5e3-553d-4375-a4f0-2eefada73612/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:58.755Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ecd9dcf8-b705-4261-b085-cd819805a7ed/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:58 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:24:58.755Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-3c9d8779-fbf3-45af-b0ee-a0af3e88f8eb/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:24:58 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:58 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:58 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:24:58 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:24:58 localhost systemd[1]: libpod-47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7.scope: Consumed 349ms CPU time Nov 20 07:24:58 localhost podman[20118]: 2019-11-20 07:24:58.801790533 +0000 UTC m=+5.655941952 container died 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:58 localhost podman[20118]: 2019-11-20 07:24:58.882286937 +0000 UTC m=+5.736438314 container remove 47966853985c097a8ccc970bb7adce142c636a21a3142475f42de0f9e21858e7 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:24:58 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:25:01 localhost hyperkube[1909]: I1120 07:25:01.173437 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:01 localhost hyperkube[1909]: I1120 07:25:01.176116 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:01 localhost hyperkube[1909]: I1120 07:25:01.176199 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:01 localhost hyperkube[1909]: I1120 07:25:01.176247 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:02 localhost hyperkube[1909]: I1120 07:25:02.026386 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:02 localhost hyperkube[1909]: I1120 07:25:02.028875 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:02 localhost hyperkube[1909]: I1120 07:25:02.029080 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:02 localhost hyperkube[1909]: I1120 07:25:02.029113 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:02 localhost hyperkube[1909]: E1120 07:25:02.029319 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:02 localhost systemd[1]: Started crio-conmon-28e0162d91c2fa733cc718cfd23dea6f244446637203e64625e9916ae72f47d8.scope. Nov 20 07:25:02 localhost systemd[1]: Created slice libcontainer_20196_systemd_test_default.slice. Nov 20 07:25:02 localhost systemd[1]: Removed slice libcontainer_20196_systemd_test_default.slice. Nov 20 07:25:02 localhost systemd[1]: Started libcontainer container 28e0162d91c2fa733cc718cfd23dea6f244446637203e64625e9916ae72f47d8. Nov 20 07:25:02 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:02 localhost systemd[1]: Stopped libcontainer container 28e0162d91c2fa733cc718cfd23dea6f244446637203e64625e9916ae72f47d8. Nov 20 07:25:02 localhost systemd[1]: crio-28e0162d91c2fa733cc718cfd23dea6f244446637203e64625e9916ae72f47d8.scope: Consumed 43ms CPU time Nov 20 07:25:02 localhost crio[1857]: time="2019-11-20 07:25:02.258517162Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:02 localhost hyperkube[1909]: E1120 07:25:02.308508 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:02 localhost hyperkube[1909]: E1120 07:25:02.308674 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:02 localhost hyperkube[1909]: E1120 07:25:02.308731 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:04 localhost hyperkube[1909]: I1120 07:25:04.026271 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:04 localhost hyperkube[1909]: I1120 07:25:04.028564 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:04 localhost hyperkube[1909]: I1120 07:25:04.028601 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:04 localhost hyperkube[1909]: I1120 07:25:04.028621 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:04 localhost hyperkube[1909]: E1120 07:25:04.028823 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:04 localhost podman[20224]: 2019-11-20 07:25:04.089377532 +0000 UTC m=+0.168606940 container create 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:04 localhost systemd[1]: Started libpod-conmon-824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed.scope. Nov 20 07:25:04 localhost systemd[1]: Started crio-conmon-e56fada4218ceb757d1940202d7eb65584249847bf42730868d109ed5d8bd5c9.scope. Nov 20 07:25:04 localhost systemd[1]: Started libcontainer container e56fada4218ceb757d1940202d7eb65584249847bf42730868d109ed5d8bd5c9. Nov 20 07:25:04 localhost systemd[1]: Started libcontainer container 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed. Nov 20 07:25:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:04 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:04 localhost systemd[1]: Stopped libcontainer container e56fada4218ceb757d1940202d7eb65584249847bf42730868d109ed5d8bd5c9. Nov 20 07:25:04 localhost crio[1857]: time="2019-11-20 07:25:04.304262335Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:04 localhost hyperkube[1909]: E1120 07:25:04.357964 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:04 localhost hyperkube[1909]: E1120 07:25:04.358120 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:04 localhost hyperkube[1909]: E1120 07:25:04.358174 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:04 localhost podman[20224]: 2019-11-20 07:25:04.550274309 +0000 UTC m=+0.629503642 container init 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:04 localhost podman[20224]: 2019-11-20 07:25:04.572505465 +0000 UTC m=+0.651734806 container start 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:04 localhost podman[20224]: 2019-11-20 07:25:04.573410406 +0000 UTC m=+0.652639762 container attach 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:09 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:09.587Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-47471dd6-c850-4a8c-95ae-a2e8f5fad661/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:09 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:09.588Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e2ee7d08-839d-4c66-8a3f-b31290db5abe/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:09 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:09.588Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-596523d4-fd86-440c-9bdd-4e0687e691f9/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:09 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:09 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:09 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:09 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:25:10 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:10 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:10 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:10 localhost systemd[1]: libpod-824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed.scope: Consumed 348ms CPU time Nov 20 07:25:10 localhost podman[20224]: 2019-11-20 07:25:10.457843727 +0000 UTC m=+6.537073081 container died 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:10 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:10 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:11 localhost podman[20224]: 2019-11-20 07:25:11.12236128 +0000 UTC m=+7.201590636 container remove 824f64cc0da77ca4f4ff2b1b0f4b386fa54d674a8b8a6e4a4c9ce8fae84bb4ed (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:11 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:25:11 localhost hyperkube[1909]: I1120 07:25:11.191483 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:11 localhost hyperkube[1909]: I1120 07:25:11.194353 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:11 localhost hyperkube[1909]: I1120 07:25:11.194764 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:11 localhost hyperkube[1909]: I1120 07:25:11.194816 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:12 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:25:15 localhost hyperkube[1909]: I1120 07:25:15.025970 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:15 localhost hyperkube[1909]: I1120 07:25:15.028687 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:15 localhost hyperkube[1909]: I1120 07:25:15.028746 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:15 localhost hyperkube[1909]: I1120 07:25:15.028767 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:15 localhost hyperkube[1909]: E1120 07:25:15.028984 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:15 localhost systemd[1]: Started crio-conmon-673b6ff126aacf64a2682ce863dbf04a0e25a92bef80c115060d9aa82ce03c95.scope. Nov 20 07:25:15 localhost systemd[1]: Created slice libcontainer_20347_systemd_test_default.slice. Nov 20 07:25:15 localhost systemd[1]: Removed slice libcontainer_20347_systemd_test_default.slice. Nov 20 07:25:15 localhost systemd[1]: Started libcontainer container 673b6ff126aacf64a2682ce863dbf04a0e25a92bef80c115060d9aa82ce03c95. Nov 20 07:25:15 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:15 localhost systemd[1]: crio-673b6ff126aacf64a2682ce863dbf04a0e25a92bef80c115060d9aa82ce03c95.scope: Consumed 37ms CPU time Nov 20 07:25:15 localhost crio[1857]: time="2019-11-20 07:25:15.283428173Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:15 localhost hyperkube[1909]: E1120 07:25:15.365783 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:15 localhost hyperkube[1909]: E1120 07:25:15.365934 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:15 localhost hyperkube[1909]: E1120 07:25:15.365985 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:16 localhost podman[20375]: 2019-11-20 07:25:16.374225019 +0000 UTC m=+0.158400751 container create c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:16 localhost systemd[1]: Started libpod-conmon-c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d.scope. Nov 20 07:25:16 localhost systemd[1]: Created slice libcontainer_20389_systemd_test_default.slice. Nov 20 07:25:16 localhost systemd[1]: Removed slice libcontainer_20389_systemd_test_default.slice. Nov 20 07:25:16 localhost systemd[1]: Started libcontainer container c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d. Nov 20 07:25:16 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:16 localhost podman[20375]: 2019-11-20 07:25:16.959194014 +0000 UTC m=+0.743369746 container init c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:16 localhost podman[20375]: 2019-11-20 07:25:16.979904834 +0000 UTC m=+0.764080574 container start c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:16 localhost podman[20375]: 2019-11-20 07:25:16.98006511 +0000 UTC m=+0.764240854 container attach c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:20 localhost hyperkube[1909]: I1120 07:25:20.026476 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:20 localhost hyperkube[1909]: I1120 07:25:20.029719 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:20 localhost hyperkube[1909]: I1120 07:25:20.029875 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:20 localhost hyperkube[1909]: I1120 07:25:20.029911 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:20 localhost hyperkube[1909]: E1120 07:25:20.030138 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:20 localhost systemd[1]: Started crio-conmon-de3fadbad1d280d095ba16b3a5eec9a7c49d0d8ce45e3a7ea088b2b4cce5a3ec.scope. Nov 20 07:25:20 localhost systemd[1]: Created slice libcontainer_20428_systemd_test_default.slice. Nov 20 07:25:20 localhost systemd[1]: Removed slice libcontainer_20428_systemd_test_default.slice. Nov 20 07:25:20 localhost systemd[1]: Started libcontainer container de3fadbad1d280d095ba16b3a5eec9a7c49d0d8ce45e3a7ea088b2b4cce5a3ec. Nov 20 07:25:20 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:20 localhost systemd[1]: Stopped libcontainer container de3fadbad1d280d095ba16b3a5eec9a7c49d0d8ce45e3a7ea088b2b4cce5a3ec. Nov 20 07:25:20 localhost systemd[1]: crio-de3fadbad1d280d095ba16b3a5eec9a7c49d0d8ce45e3a7ea088b2b4cce5a3ec.scope: Consumed 35ms CPU time Nov 20 07:25:20 localhost crio[1857]: time="2019-11-20 07:25:20.231350452Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:20 localhost hyperkube[1909]: E1120 07:25:20.286369 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:20 localhost hyperkube[1909]: E1120 07:25:20.286520 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:20 localhost hyperkube[1909]: E1120 07:25:20.286572 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:21 localhost hyperkube[1909]: I1120 07:25:21.210827 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:21 localhost hyperkube[1909]: I1120 07:25:21.213699 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:21 localhost hyperkube[1909]: I1120 07:25:21.213752 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:21 localhost hyperkube[1909]: I1120 07:25:21.213775 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:21.997Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-e2108dab-acd5-464b-997c-0b8e454d5131/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:21.997Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-a039b5d0-a309-4c31-bd25-b02ad1e19e07/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:21 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:21.997Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-b6278493-0ca6-4500-985b-541dfa2840b8/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:21 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:21 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:21 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:21 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:25:22 localhost systemd[1]: libpod-c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d.scope: Consumed 365ms CPU time Nov 20 07:25:22 localhost podman[20375]: 2019-11-20 07:25:22.041874394 +0000 UTC m=+5.826050201 container died c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:22 localhost podman[20375]: 2019-11-20 07:25:22.13169688 +0000 UTC m=+5.915872664 container remove c29deaf45acbeaebe05933929594f3d5a95eb0db43ccb14f8852e05d3f6e3c6d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:22 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:25:25 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:26 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:26 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:26 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:26 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:26 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:27 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:27 localhost podman[20476]: 2019-11-20 07:25:27.317928161 +0000 UTC m=+0.145353180 container create ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:27 localhost systemd[1]: Started libpod-conmon-ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51.scope. Nov 20 07:25:27 localhost systemd[1]: Created slice libcontainer_20490_systemd_test_default.slice. Nov 20 07:25:27 localhost systemd[1]: Removed slice libcontainer_20490_systemd_test_default.slice. Nov 20 07:25:27 localhost systemd[1]: Started libcontainer container ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51. Nov 20 07:25:27 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:27 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:27 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:29 localhost hyperkube[1909]: I1120 07:25:29.025894 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:29 localhost hyperkube[1909]: I1120 07:25:29.028411 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:29 localhost hyperkube[1909]: I1120 07:25:29.028491 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:29 localhost hyperkube[1909]: I1120 07:25:29.028528 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:29 localhost hyperkube[1909]: E1120 07:25:29.028782 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:29 localhost systemd[1]: Started crio-conmon-5f395f663b2bb4e84ac817a95693aded66f3233424d5dff57b8a8c7900db0efe.scope. Nov 20 07:25:29 localhost systemd[1]: Created slice libcontainer_20504_systemd_test_default.slice. Nov 20 07:25:29 localhost systemd[1]: Removed slice libcontainer_20504_systemd_test_default.slice. Nov 20 07:25:29 localhost systemd[1]: Started libcontainer container 5f395f663b2bb4e84ac817a95693aded66f3233424d5dff57b8a8c7900db0efe. Nov 20 07:25:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:29 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:29 localhost systemd[1]: Stopped libcontainer container 5f395f663b2bb4e84ac817a95693aded66f3233424d5dff57b8a8c7900db0efe. Nov 20 07:25:29 localhost systemd[1]: crio-5f395f663b2bb4e84ac817a95693aded66f3233424d5dff57b8a8c7900db0efe.scope: Consumed 34ms CPU time Nov 20 07:25:29 localhost crio[1857]: time="2019-11-20 07:25:29.742789224Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:29 localhost hyperkube[1909]: E1120 07:25:29.827872 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:29 localhost hyperkube[1909]: E1120 07:25:29.828068 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:29 localhost hyperkube[1909]: E1120 07:25:29.828141 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:30 localhost podman[20476]: 2019-11-20 07:25:30.012233342 +0000 UTC m=+2.839658392 container init ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:30 localhost podman[20476]: 2019-11-20 07:25:30.032279442 +0000 UTC m=+2.859704472 container start ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:30 localhost podman[20476]: 2019-11-20 07:25:30.0324091 +0000 UTC m=+2.859834106 container attach ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.025952 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.028596 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.028668 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.028692 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:31 localhost hyperkube[1909]: E1120 07:25:31.028890 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:31 localhost systemd[1]: Started crio-conmon-7dc9157a582c1bb3d5d3a97855b622751521034c708b95f5a47a2764457c58fa.scope. Nov 20 07:25:31 localhost systemd[1]: Created slice libcontainer_20559_systemd_test_default.slice. Nov 20 07:25:31 localhost systemd[1]: Removed slice libcontainer_20559_systemd_test_default.slice. Nov 20 07:25:31 localhost systemd[1]: Started libcontainer container 7dc9157a582c1bb3d5d3a97855b622751521034c708b95f5a47a2764457c58fa. Nov 20 07:25:31 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.231925 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.235090 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.235139 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:31 localhost hyperkube[1909]: I1120 07:25:31.235164 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:31 localhost systemd[1]: Stopped libcontainer container 7dc9157a582c1bb3d5d3a97855b622751521034c708b95f5a47a2764457c58fa. Nov 20 07:25:31 localhost crio[1857]: time="2019-11-20 07:25:31.257951493Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:31 localhost hyperkube[1909]: E1120 07:25:31.313103 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:31 localhost hyperkube[1909]: E1120 07:25:31.313279 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:31 localhost hyperkube[1909]: E1120 07:25:31.313350 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:32 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:25:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:35.045Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-9e3a560f-445b-456b-9539-6b1f581aa8db/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:35.046Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-0da0904f-8ee5-4bdf-bdab-0532c80ab464/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:35 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:35.046Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-02819244-3831-48a4-a800-d04737148a2a/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:35 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:35 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:35 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:35 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:25:35 localhost systemd[1]: libpod-ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51.scope: Consumed 353ms CPU time Nov 20 07:25:35 localhost podman[20476]: 2019-11-20 07:25:35.093683188 +0000 UTC m=+7.921108258 container died ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:35 localhost podman[20476]: 2019-11-20 07:25:35.175887704 +0000 UTC m=+8.003312795 container remove ea9879cc9a03b4ba5e3b11009189ac6f05de3b6e80f0a965478a0ea91641ca51 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:35 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:25:38 localhost kernel: serial8250_interrupt: 8 callbacks suppressed Nov 20 07:25:38 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:38 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:38 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:38 localhost kernel: serial8250: too much work for irq4 Nov 20 07:25:40 localhost podman[20636]: 2019-11-20 07:25:40.458176093 +0000 UTC m=+0.207034797 container create 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:40 localhost systemd[1]: Started libpod-conmon-1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d.scope. Nov 20 07:25:40 localhost systemd[1]: Created slice libcontainer_20649_systemd_test_default.slice. Nov 20 07:25:40 localhost systemd[1]: Removed slice libcontainer_20649_systemd_test_default.slice. Nov 20 07:25:40 localhost systemd[1]: Started libcontainer container 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d. Nov 20 07:25:40 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:40 localhost podman[20636]: 2019-11-20 07:25:40.932879539 +0000 UTC m=+0.681738221 container init 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:40 localhost podman[20636]: 2019-11-20 07:25:40.954412613 +0000 UTC m=+0.703271357 container start 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:40 localhost podman[20636]: 2019-11-20 07:25:40.954613916 +0000 UTC m=+0.703472646 container attach 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:41 localhost hyperkube[1909]: I1120 07:25:41.250311 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:41 localhost hyperkube[1909]: I1120 07:25:41.252781 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:41 localhost hyperkube[1909]: I1120 07:25:41.252834 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:41 localhost hyperkube[1909]: I1120 07:25:41.252856 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:43 localhost hyperkube[1909]: I1120 07:25:43.026305 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:43 localhost hyperkube[1909]: I1120 07:25:43.029151 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:43 localhost hyperkube[1909]: I1120 07:25:43.029231 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:43 localhost hyperkube[1909]: I1120 07:25:43.029268 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:43 localhost hyperkube[1909]: E1120 07:25:43.029550 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:43 localhost systemd[1]: Started crio-conmon-92f50c9a313b4f9bf69a7c1bba87e1210df9b45f951b6e3fa86b64e31c7e3ac4.scope. Nov 20 07:25:43 localhost systemd[1]: Created slice libcontainer_20689_systemd_test_default.slice. Nov 20 07:25:43 localhost systemd[1]: Removed slice libcontainer_20689_systemd_test_default.slice. Nov 20 07:25:43 localhost systemd[1]: Started libcontainer container 92f50c9a313b4f9bf69a7c1bba87e1210df9b45f951b6e3fa86b64e31c7e3ac4. Nov 20 07:25:43 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:43 localhost systemd[1]: Stopped libcontainer container 92f50c9a313b4f9bf69a7c1bba87e1210df9b45f951b6e3fa86b64e31c7e3ac4. Nov 20 07:25:43 localhost systemd[1]: crio-92f50c9a313b4f9bf69a7c1bba87e1210df9b45f951b6e3fa86b64e31c7e3ac4.scope: Consumed 40ms CPU time Nov 20 07:25:43 localhost crio[1857]: time="2019-11-20 07:25:43.264296716Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:43 localhost hyperkube[1909]: E1120 07:25:43.323109 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:43 localhost hyperkube[1909]: E1120 07:25:43.323276 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:43 localhost hyperkube[1909]: E1120 07:25:43.323341 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:44 localhost hyperkube[1909]: I1120 07:25:44.025928 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:44 localhost hyperkube[1909]: I1120 07:25:44.028312 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:44 localhost hyperkube[1909]: I1120 07:25:44.028377 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:44 localhost hyperkube[1909]: I1120 07:25:44.028417 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:44 localhost hyperkube[1909]: E1120 07:25:44.028690 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:44 localhost systemd[1]: Started crio-conmon-1672604361af9a17160c7531750f28a80bd20c129296d53345c04dc40722faa4.scope. Nov 20 07:25:44 localhost systemd[1]: Created slice libcontainer_20720_systemd_test_default.slice. Nov 20 07:25:44 localhost systemd[1]: Removed slice libcontainer_20720_systemd_test_default.slice. Nov 20 07:25:44 localhost systemd[1]: Started libcontainer container 1672604361af9a17160c7531750f28a80bd20c129296d53345c04dc40722faa4. Nov 20 07:25:44 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:44 localhost systemd[1]: Stopped libcontainer container 1672604361af9a17160c7531750f28a80bd20c129296d53345c04dc40722faa4. Nov 20 07:25:44 localhost systemd[1]: crio-1672604361af9a17160c7531750f28a80bd20c129296d53345c04dc40722faa4.scope: Consumed 33ms CPU time Nov 20 07:25:44 localhost crio[1857]: time="2019-11-20 07:25:44.227061786Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:44 localhost hyperkube[1909]: E1120 07:25:44.270543 1909 remote_runtime.go:200] CreateContainer in sandbox "58f2062aa7b6a5b2bdd6b9cf7b41a9f94ca2b30ad5a20e4fa4dec8a9b82f05e5" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:44 localhost hyperkube[1909]: E1120 07:25:44.270693 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:44 localhost hyperkube[1909]: E1120 07:25:44.270749 1909 pod_workers.go:191] Error syncing pod a3183db06e25bd66e7f8f564bad04b82 ("coredns-localhost_openshift-kni-infra(a3183db06e25bd66e7f8f564bad04b82)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:46.044Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-2bf6ad29-eabc-4128-875f-15851f402084/etcd-0.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-0.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:46.044Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-4356f17f-50b2-4a22-9853-f9f3cc4cd840/etcd-2.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-2.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:46 localhost bootkube.sh[2095]: {"level":"warn","ts":"2019-11-20T07:25:46.045Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-993ad3b6-c5f5-47cf-9a60-f46fa3ef79af/etcd-1.test.v212.abes.fr:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp: lookup etcd-1.test.v212.abes.fr on 10.34.212.100:53: no such host\""} Nov 20 07:25:46 localhost bootkube.sh[2095]: https://etcd-2.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:46 localhost bootkube.sh[2095]: https://etcd-0.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:46 localhost bootkube.sh[2095]: https://etcd-1.test.v212.abes.fr:2379 is unhealthy: failed to commit proposal: context deadline exceeded Nov 20 07:25:46 localhost bootkube.sh[2095]: Error: unhealthy cluster Nov 20 07:25:46 localhost systemd[1]: libpod-1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d.scope: Consumed 405ms CPU time Nov 20 07:25:46 localhost podman[20636]: 2019-11-20 07:25:46.090511891 +0000 UTC m=+5.839370616 container died 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:46 localhost podman[20636]: 2019-11-20 07:25:46.166453302 +0000 UTC m=+5.915312053 container remove 1c567c96fa94d9cd22a19739f0180ab4f7dba4fb9ce50f2a1fbb3a3eba878f1d (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:46 localhost bootkube.sh[2095]: etcdctl failed. Retrying in 5 seconds... Nov 20 07:25:51 localhost hyperkube[1909]: I1120 07:25:51.268760 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:51 localhost hyperkube[1909]: I1120 07:25:51.271742 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:51 localhost hyperkube[1909]: I1120 07:25:51.271789 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:51 localhost hyperkube[1909]: I1120 07:25:51.271811 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:51 localhost podman[20769]: 2019-11-20 07:25:51.365144823 +0000 UTC m=+0.165270602 container create 893ad941cf208d5a56711e507568c48d4254040bc4e12e4440540656cb71c394 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:51 localhost systemd[1]: Started libpod-conmon-893ad941cf208d5a56711e507568c48d4254040bc4e12e4440540656cb71c394.scope. Nov 20 07:25:51 localhost systemd[1]: Created slice libcontainer_20783_systemd_test_default.slice. Nov 20 07:25:51 localhost systemd[1]: Removed slice libcontainer_20783_systemd_test_default.slice. Nov 20 07:25:51 localhost systemd[1]: Started libcontainer container 893ad941cf208d5a56711e507568c48d4254040bc4e12e4440540656cb71c394. Nov 20 07:25:51 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:51 localhost podman[20769]: 2019-11-20 07:25:51.793071986 +0000 UTC m=+0.593197792 container init 893ad941cf208d5a56711e507568c48d4254040bc4e12e4440540656cb71c394 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:51 localhost podman[20769]: 2019-11-20 07:25:51.826423876 +0000 UTC m=+0.626549661 container start 893ad941cf208d5a56711e507568c48d4254040bc4e12e4440540656cb71c394 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:51 localhost podman[20769]: 2019-11-20 07:25:51.826623545 +0000 UTC m=+0.626749324 container attach 893ad941cf208d5a56711e507568c48d4254040bc4e12e4440540656cb71c394 (image=registry.svc.ci.openshift.org/origin/4.3-2019-11-19-160737@sha256:696a0ba7d344e625ec71d915d74d387fc2a951b879d4d54bdc69d460724c01ae, name=etcdctl) Nov 20 07:25:52 localhost approve-csr.sh[2096]: error: the server doesn't have a resource type "csr" Nov 20 07:25:55 localhost hyperkube[1909]: I1120 07:25:55.025773 1909 kubelet_node_status.go:286] Setting node annotation to enable volume controller attach/detach Nov 20 07:25:55 localhost hyperkube[1909]: I1120 07:25:55.028506 1909 kubelet_node_status.go:472] Recording NodeHasSufficientMemory event message for node localhost Nov 20 07:25:55 localhost hyperkube[1909]: I1120 07:25:55.028556 1909 kubelet_node_status.go:472] Recording NodeHasNoDiskPressure event message for node localhost Nov 20 07:25:55 localhost hyperkube[1909]: I1120 07:25:55.028581 1909 kubelet_node_status.go:472] Recording NodeHasSufficientPID event message for node localhost Nov 20 07:25:55 localhost hyperkube[1909]: E1120 07:25:55.028772 1909 dns.go:135] Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 127.0.0.1 10.34.212.100 10.34.106.100 Nov 20 07:25:55 localhost systemd[1]: Started crio-conmon-661ab17825747f91c7ffbb46ad0cd8a97dde90115450df4df26185dd294b449a.scope. Nov 20 07:25:55 localhost systemd[1]: Created slice libcontainer_20839_systemd_test_default.slice. Nov 20 07:25:55 localhost systemd[1]: Removed slice libcontainer_20839_systemd_test_default.slice. Nov 20 07:25:55 localhost systemd[1]: Started libcontainer container 661ab17825747f91c7ffbb46ad0cd8a97dde90115450df4df26185dd294b449a. Nov 20 07:25:55 localhost kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) Nov 20 07:25:55 localhost systemd[1]: Stopped libcontainer container 661ab17825747f91c7ffbb46ad0cd8a97dde90115450df4df26185dd294b449a. Nov 20 07:25:55 localhost systemd[1]: crio-661ab17825747f91c7ffbb46ad0cd8a97dde90115450df4df26185dd294b449a.scope: Consumed 35ms CPU time Nov 20 07:25:55 localhost crio[1857]: time="2019-11-20 07:25:55.243705696Z" level=error msg="Container creation error: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n" Nov 20 07:25:55 localhost hyperkube[1909]: E1120 07:25:55.301176 1909 remote_runtime.go:200] CreateContainer in sandbox "e00a59212becbe0903a65aa075e04eed4a35f3d1ba0fd8b3128e8f4f94077cf1" from runtime service failed: rpc error: code = Unknown desc = container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:55 localhost hyperkube[1909]: E1120 07:25:55.301350 1909 kuberuntime_manager.go:783] init container start failed: CreateContainerError: container create failed: container_linux.go:345: starting container process caused "exec: \"runtimecfg\": executable file not found in $PATH" Nov 20 07:25:55 localhost hyperkube[1909]: E1120 07:25:55.301425 1909 pod_workers.go:191] Error syncing pod 6772eabec456c65362c0b66ae75ba039 ("keepalived-localhost_openshift-kni-infra(6772eabec456c65362c0b66ae75ba039)"), skipping: failed to "StartContainer" for "render-config" with CreateContainerError: "container create failed: container_linux.go:345: starting container process caused \"exec: \\\"runtimecfg\\\": executable file not found in $PATH\"\n"