This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 2 failed / 1257 succeeded
Started2023-03-13 19:29
Elapsed14h10m
Revision
Builder5e48b0f4-c1d5-11ed-9d91-c209e83e3776
control_plane_node_os_imagecos-85-13310-1308-1
infra-commitd6acd1068
job-versionv1.24.12-rc.0.26+5c76b515b703c0
kubetest-versionv20230222-b5208facd4
revisionv1.24.12-rc.0.26+5c76b515b703c0
worker_node_os_imagecos-85-13310-1308-1

Test Failures


Kubernetes e2e suite [sig-node] NodeProblemDetector should run without error 2m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-node\]\sNodeProblemDetector\sshould\srun\swithout\serror$'
test/e2e/node/node_problem_detector.go:62
Mar 13 20:22:00.131: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc0040912c0>: {
        s: "expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-15tq.174c13286f1cf0e2  default  b5a4e463-e5fe-4873-9a84-bd5376ec39df 125025 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c13286fb41930  default  5087c6ef-67d3-4828-9025-2e94f1b6d01a 125026 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c13287697b7f3  default  d53f2e23-3c99-49cd-a6bc-ad0e81e327b9 125027 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-15tq status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c13287699483e  default  882921fd-8133-4983-87bf-08dfe68c7ee9 125028 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-15tq status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c1328769a9e04  default  04d2b8fc-a06a-443e-a03b-0ffb8f4e310e 125029 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-15tq status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132878ef203a  default  0bd24f95-7f33-48ed-8d48-bd4debe4b4be 125030 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132898ae3c9a  default  cb5a312c-fbb2-48db-96d9-5129bb038436 125035 0 2023-03-13 20:03:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:03:46 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb v1  } RegisteredNode Node bootstrap-e2e-minion-group-15tq event: Registered Node bootstrap-e2e-minion-group-15tq in Controller {node-controller } 2023-03-13 20:03:46 +0000 UTC 2023-03-13 20:03:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c1328e792b7c1  default  745e9d37-a547-48da-b596-3f893c1a1f43 125037 0 2023-03-13 20:03:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update events.k8s.io/v1 2023-03-13 20:03:46 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } Starting  { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2023-03-13 20:03:47.507123 +0000 UTC nil StartKubeProxy nil kube-proxy kube-proxy-bootstrap-e2e-minion-group-15tq} {{ } {bootstrap-e2e-minion-group-15tq.174c132972d49ac3  default  325f0963-1c15-4e58-acaa-bc68372497c6 125048 0 2023-03-13 20:03:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:03:48 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:49 +0000 UTC 2023-03-13 20:03:49 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132974a35b80  default  93ade4f4-61e7-4e69-87c7-cf539174ada4 125045 0 2023-03-13 20:03:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:03:48 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:49 +0000 UTC 2023-03-13 20:03:49 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132976fbe2ad  default  76734d51-4168-4964-b858-c685df91749f 125047 0 2023-03-13 20:03:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:03:48 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:49 +0000 UTC 2023-03-13 20:03:49 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132adb876bdf  default  ad9cdd3a-1c36-4d4c-91c1-119e66006533 125057 0 2023-03-13 20:03:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeReady Node bootstrap-e2e-minion-group-15tq status is now: NodeReady {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:55 +0000 UTC 2023-03-13 20:03:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c133a11e94081  default  627b86e7-2def-4d50-bf35-c5d9dc0b9afd 125068 0 2023-03-13 20:05:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:05:01 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb v1  } NodeNotReady Node bootstrap-e2e-minion-group-15tq status is now: NodeNotReady {node-controller } 2023-03-13 20:05:01 +0000 UTC 2023-03-13 20:05:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c1349632caf10  default  0f3c9e1e-d525-4363-b80c-cdd12b46be18 125072 0 2023-03-13 20:06:07 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:06:07 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb   } DeletingNode Deleting node bootstrap-e2e-minion-group-15tq because it does not exist in the cloud provider {cloud-node-lifecycle-controller } 2023-03-13 20:06:07 +0000 UTC 2023-03-13 20:06:07 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c134a633a1665  default  5deb37ec-069c-4d4d-8e37-59ba301de114 125077 0 2023-03-13 20:06:11 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:06:11 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb v1  } RemovingNode Node bootstrap-e2e-minion-group-15tq event: Removing Node bootstrap-e2e-minion-group-15tq from Controller {node-controller } 2023-03-13 20:06:11 +0000 UTC 2023-03-13 20:06:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p9bc.174b92156c3d738a  default  cbf16d03-bcc2-45f8-ae35-959af3c1093b 126375 0 2023-03-13 20:20:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:20:53 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-p9bc bootstrap-e2e-minion-group-p9bc   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-p9bc} 2023-03-12 04:38:26 +0000 UTC 2023-03-13 20:20:53 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-t9fm.174c1418978da849  default  63df5f42-5803-4839-8f16-0fd0767822a8 126377 0 2023-03-13 20:20:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:20:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-t9fm bootstrap-e2e-minion-group-t9fm   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-t9fm} 2023-03-13 20:20:56 +0000 UTC 2023-03-13 20:20:56 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-t9fm.174c1418978dd1e1  default  8713411d-3c1d-4d3e-a56c-a36eca34cb56 126376 0 2023-03-13 20:20:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:20:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-t9fm bootstrap-e2e-minion-group-t9fm   } DockerHung Node condition KernelDeadlock is now: True, reason: DockerHung {kernel-monitor bootstrap-e2e-minion-group-t9fm} 2023-03-13 20:20:56 +0000 UTC 2023-03-13 20:20:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-thxm.174b9216275f4e11  default  1e5b6d91-37fa-4276-ae01-9c3882fab456 126378 0 2023-03-13 20:21:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:21:00 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-thxm bootstrap-e2e-minion-group-thxm   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-thxm} 2023-03-12 04:38:29 +0000 UTC 2023-03-13 20:21:00 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-15tq.174c13286f1cf0e2  default  b5a4e463-e5fe-4873-9a84-bd5376ec39df 125025 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c13286fb41930  default  5087c6ef-67d3-4828-9025-2e94f1b6d01a 125026 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c13287697b7f3  default  d53f2e23-3c99-49cd-a6bc-ad0e81e327b9 125027 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-15tq status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c13287699483e  default  882921fd-8133-4983-87bf-08dfe68c7ee9 125028 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-15tq status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c1328769a9e04  default  04d2b8fc-a06a-443e-a03b-0ffb8f4e310e 125029 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-15tq status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132878ef203a  default  0bd24f95-7f33-48ed-8d48-bd4debe4b4be 125030 0 2023-03-13 20:03:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:44 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:45 +0000 UTC 2023-03-13 20:03:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132898ae3c9a  default  cb5a312c-fbb2-48db-96d9-5129bb038436 125035 0 2023-03-13 20:03:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:03:46 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb v1  } RegisteredNode Node bootstrap-e2e-minion-group-15tq event: Registered Node bootstrap-e2e-minion-group-15tq in Controller {node-controller } 2023-03-13 20:03:46 +0000 UTC 2023-03-13 20:03:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c1328e792b7c1  default  745e9d37-a547-48da-b596-3f893c1a1f43 125037 0 2023-03-13 20:03:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update events.k8s.io/v1 2023-03-13 20:03:46 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } Starting  { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2023-03-13 20:03:47.507123 +0000 UTC nil StartKubeProxy nil kube-proxy kube-proxy-bootstrap-e2e-minion-group-15tq} {{ } {bootstrap-e2e-minion-group-15tq.174c132972d49ac3  default  325f0963-1c15-4e58-acaa-bc68372497c6 125048 0 2023-03-13 20:03:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:03:48 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:49 +0000 UTC 2023-03-13 20:03:49 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132974a35b80  default  93ade4f4-61e7-4e69-87c7-cf539174ada4 125045 0 2023-03-13 20:03:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:03:48 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:49 +0000 UTC 2023-03-13 20:03:49 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132976fbe2ad  default  76734d51-4168-4964-b858-c685df91749f 125047 0 2023-03-13 20:03:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:03:48 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:49 +0000 UTC 2023-03-13 20:03:49 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c132adb876bdf  default  ad9cdd3a-1c36-4d4c-91c1-119e66006533 125057 0 2023-03-13 20:03:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2023-03-13 20:03:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq bootstrap-e2e-minion-group-15tq   } NodeReady Node bootstrap-e2e-minion-group-15tq status is now: NodeReady {kubelet bootstrap-e2e-minion-group-15tq} 2023-03-13 20:03:55 +0000 UTC 2023-03-13 20:03:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c133a11e94081  default  627b86e7-2def-4d50-bf35-c5d9dc0b9afd 125068 0 2023-03-13 20:05:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:05:01 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb v1  } NodeNotReady Node bootstrap-e2e-minion-group-15tq status is now: NodeNotReady {node-controller } 2023-03-13 20:05:01 +0000 UTC 2023-03-13 20:05:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c1349632caf10  default  0f3c9e1e-d525-4363-b80c-cdd12b46be18 125072 0 2023-03-13 20:06:07 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:06:07 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb   } DeletingNode Deleting node bootstrap-e2e-minion-group-15tq because it does not exist in the cloud provider {cloud-node-lifecycle-controller } 2023-03-13 20:06:07 +0000 UTC 2023-03-13 20:06:07 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-15tq.174c134a633a1665  default  5deb37ec-069c-4d4d-8e37-59ba301de114 125077 0 2023-03-13 20:06:11 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2023-03-13 20:06:11 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-15tq 327d4924-57aa-4d7c-8ec9-0af67a1015cb v1  } RemovingNode Node bootstrap-e2e-minion-group-15tq event: Removing Node bootstrap-e2e-minion-group-15tq from Controller {node-controller } 2023-03-13 20:06:11 +0000 UTC 2023-03-13 20:06:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p9bc.174b92156c3d738a  default  cbf16d03-bcc2-45f8-ae35-959af3c1093b 126375 0 2023-03-13 20:20:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:20:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-p9bc bootstrap-e2e-minion-group-p9bc   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-p9bc} 2023-03-12 04:38:26 +0000 UTC 2023-03-13 20:20:53 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-t9fm.174c1418978da849  default  63df5f42-5803-4839-8f16-0fd0767822a8 126377 0 2023-03-13 20:20:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:20:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-t9fm bootstrap-e2e-minion-group-t9fm   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-t9fm} 2023-03-13 20:20:56 +0000 UTC 2023-03-13 20:20:56 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-t9fm.174c1418978dd1e1  default  8713411d-3c1d-4d3e-a56c-a36eca34cb56 126376 0 2023-03-13 20:20:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:20:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-t9fm bootstrap-e2e-minion-group-t9fm   } DockerHung Node condition KernelDeadlock is now: True, reason: DockerHung {kernel-monitor bootstrap-e2e-minion-group-t9fm} 2023-03-13 20:20:56 +0000 UTC 2023-03-13 20:20:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-thxm.174b9216275f4e11  default  1e5b6d91-37fa-4276-ae01-9c3882fab456 126378 0 2023-03-13 20:21:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2023-03-13 20:21:00 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-thxm bootstrap-e2e-minion-group-thxm   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-thxm} 2023-03-12 04:38:29 +0000 UTC 2023-03-13 20:21:00 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
test/e2e/node/node_problem_detector.go:153
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


kubetest Test 13h52m

error during ./hack/ginkgo-e2e.sh --ginkgo.skip=\[Driver:.gcepd\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --clean-start=true --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 1257 Passed Tests

Show 5723 Skipped Tests