This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 34 failed / 1209 succeeded
Started2022-06-23 07:59
Elapsed15h1m
Revision
Builder70e72295-f2ca-11ec-8dfe-daa417708791
control_plane_node_os_imagecos-85-13310-1308-1
infra-commit3ef0bc3b8
job-versionv1.23.9-rc.0.1+938a3203c609d4
kubetest-version
revisionv1.23.9-rc.0.1+938a3203c609d4
worker_node_os_imagecos-85-13310-1308-1

Test Failures


Kubernetes e2e suite [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance] 36s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\scustom\sresource\screation\,\supdate\sand\sdeletion\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633
Jun 23 22:49:43.703: waiting for webhook configuration to be ready
Unexpected error:
    <*errors.errorString | 0xc00024c2b0>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1727
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-api-machinery] Namespaces [Serial] should ensure that all pods are removed when a namespace is deleted [Conformance] 1m33s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sNamespaces\s\[Serial\]\sshould\sensure\sthat\sall\spods\sare\sremoved\swhen\sa\snamespace\sis\sdeleted\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633
Jun 23 21:37:41.419: Unexpected error:
    <*errors.errorString | 0xc00024c2b0>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/namespace.go:123
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-network] DNS should provide DNS for pods for Hostname [LinuxOnly] [Conformance] 10m3s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\spods\sfor\sHostname\s\[LinuxOnly\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633
Jun 23 22:05:11.964: Unexpected error:
    <*errors.errorString | 0xc00024c2b0>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/dns_common.go:447
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-network] LoadBalancers ESIPP [Slow] should work from pods 10m55s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sLoadBalancers\sESIPP\s\[Slow\]\sshould\swork\sfrom\spods$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/loadbalancer.go:1036
Jun 23 21:48:43.369: Source IP not preserved from pause-pod-deployment-6849fd989b-mkdbb, expected '10.64.5.193' got ''
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance] 2m5s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633
Jun 23 21:14:14.906: Timed out after 120.000s.
Expected
    <*errors.errorString | 0xc00d94f5b0>: {
        s: "failed to get output for container \"agnhost-container\" of pod \"pod-handle-http-request\"",
    }
to be nil
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/lifecycle_hook.go:78
				
				Click to see stdout/stderrfrom junit_01.xml

Find pod-handle-http-request, mentions in log files | View test history on testgrid


Kubernetes e2e suite [sig-node] NodeProblemDetector should run without error 2m11s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-node\]\sNodeProblemDetector\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:60
Jun 23 15:19:34.256: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc00e575870>: {
        s: "expect event number 1, got 0: [{{ } {bootstrap-e2e-master.16fb34ec7077e444  default  f7ecec1e-2b05-4923-81da-b9728ef9e5f4 212815 0 2022-06-23 09:11:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 09:11:18 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } FreeDiskSpaceFailed (combined from similar events): failed to garbage collect required amount of images. Wanted to free 2220604620 bytes, but freed 0 bytes {kubelet bootstrap-e2e-master} 2022-06-23 09:11:18 +0000 UTC 2022-06-23 15:16:21 +0000 UTC 74 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-master.16fb3d89ce81413c  default  f64c270e-97e2-4f4a-a900-2b29862fd2df 210631 0 2022-06-23 12:51:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 12:51:18 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } EvictionThresholdMet Attempting to reclaim ephemeral-storage {kubelet bootstrap-e2e-master} 2022-06-23 11:49:10 +0000 UTC 2022-06-23 15:06:18 +0000 UTC 871 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbc67f9e2a  default  a8a2645b-7327-41fd-bf56-c6dab4712546 210294 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbc7b5a208  default  3cdd80c2-616c-4fd5-bc35-ab3af0072c57 210295 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbcdb78c81  default  3bbabd90-30cc-4a24-8a24-51a4f908c8fb 210299 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-61xw status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbcdb806cb  default  2d4d5bf5-5954-4de6-942d-12b0cc379d1d 210300 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-61xw status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbcdb90bd9  default  f29e9346-d978-46c7-ad57-93353464e112 210301 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-61xw status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbced6e9d4  default  ea126dff-555a-4a08-bf2e-c589f0bd25f3 210302 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bc409b1119  default  bc2b26d8-4cc0-48d4-98eb-38cadc5c209e 210314 0 2022-06-23 14:56:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update events.k8s.io/v1 2022-06-23 14:56:01 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } Starting  { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-06-23 14:56:01.852116472 +0000 UTC nil StartKubeProxy nil kube-proxy kube-proxy-bootstrap-e2e-minion-group-61xw} {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcacfe3670  default  17ea3dd2-982f-4530-951d-68acf6effd79 210318 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220 v1  } RegisteredNode Node bootstrap-e2e-minion-group-61xw event: Registered Node bootstrap-e2e-minion-group-61xw in Controller {node-controller } 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcbd0c889f  default  a2897231-363c-467a-ac7d-8b7cb1d6c501 210325 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcbf816a5c  default  e2aa40c2-8961-4118-9c2e-d8381458b7ab 210323 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcbf865578  default  9d39632e-53fa-4c4d-92ae-391bbd44b753 210324 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47be3acbc8d5  default  ae2e9ff7-de35-477b-bb57-b1446a5f6364 210329 0 2022-06-23 14:56:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:56:10 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeReady Node bootstrap-e2e-minion-group-61xw status is now: NodeReady {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:10 +0000 UTC 2022-06-23 14:56:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47ccfbc5c64d  default  cc799f9d-dd49-4e6a-b203-da6b213ac774 210341 0 2022-06-23 14:57:13 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:57:13 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220 v1  } NodeNotReady Node bootstrap-e2e-minion-group-61xw status is now: NodeNotReady {node-controller } 2022-06-23 14:57:13 +0000 UTC 2022-06-23 14:57:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47de9ceb0155  default  a2e9ef3c-f607-4d0f-b644-6b2f5f128fda 210345 0 2022-06-23 14:58:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:58:29 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220   } DeletingNode Deleting node bootstrap-e2e-minion-group-61xw because it does not exist in the cloud provider {cloud-node-lifecycle-controller } 2022-06-23 14:58:29 +0000 UTC 2022-06-23 14:58:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47dfa293364f  default  648b3670-0d34-48c2-b689-4327cbe94e83 210350 0 2022-06-23 14:58:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:58:33 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220 v1  } RemovingNode Node bootstrap-e2e-minion-group-61xw event: Removing Node bootstrap-e2e-minion-group-61xw from Controller {node-controller } 2022-06-23 14:58:33 +0000 UTC 2022-06-23 14:58:33 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d5r6.16fa9bba58de2bcb  default  b105a83e-a8e7-4c4b-9b26-58dd634c8094 212927 0 2022-06-23 15:18:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 15:18:28 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-d5r6 bootstrap-e2e-minion-group-d5r6   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-d5r6} 2022-06-21 10:23:57 +0000 UTC 2022-06-23 15:18:28 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-g70s.16fa9bbafdcfb6ec  default  1a9bfdc7-e720-4f63-a91b-47cb832460a6 212928 0 2022-06-23 15:18:31 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 15:18:31 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-g70s bootstrap-e2e-minion-group-g70s   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-g70s} 2022-06-21 10:24:00 +0000 UTC 2022-06-23 15:18:31 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-l58c.16fb0c58f222d31b  default  b3c60fe5-0329-461f-b243-6a12ab331c4b 212929 0 2022-06-23 15:18:34 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 15:18:34 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-l58c bootstrap-e2e-minion-group-l58c   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-l58c} 2022-06-22 20:47:44 +0000 UTC 2022-06-23 15:18:34 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    expect event number 1, got 0: [{{ } {bootstrap-e2e-master.16fb34ec7077e444  default  f7ecec1e-2b05-4923-81da-b9728ef9e5f4 212815 0 2022-06-23 09:11:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 09:11:18 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } FreeDiskSpaceFailed (combined from similar events): failed to garbage collect required amount of images. Wanted to free 2220604620 bytes, but freed 0 bytes {kubelet bootstrap-e2e-master} 2022-06-23 09:11:18 +0000 UTC 2022-06-23 15:16:21 +0000 UTC 74 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-master.16fb3d89ce81413c  default  f64c270e-97e2-4f4a-a900-2b29862fd2df 210631 0 2022-06-23 12:51:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 12:51:18 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } EvictionThresholdMet Attempting to reclaim ephemeral-storage {kubelet bootstrap-e2e-master} 2022-06-23 11:49:10 +0000 UTC 2022-06-23 15:06:18 +0000 UTC 871 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbc67f9e2a  default  a8a2645b-7327-41fd-bf56-c6dab4712546 210294 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbc7b5a208  default  3cdd80c2-616c-4fd5-bc35-ab3af0072c57 210295 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbcdb78c81  default  3bbabd90-30cc-4a24-8a24-51a4f908c8fb 210299 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-61xw status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbcdb806cb  default  2d4d5bf5-5954-4de6-942d-12b0cc379d1d 210300 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-61xw status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbcdb90bd9  default  f29e9346-d978-46c7-ad57-93353464e112 210301 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-61xw status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bbced6e9d4  default  ea126dff-555a-4a08-bf2e-c589f0bd25f3 210302 0 2022-06-23 14:55:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:55:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:55:59 +0000 UTC 2022-06-23 14:55:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bc409b1119  default  bc2b26d8-4cc0-48d4-98eb-38cadc5c209e 210314 0 2022-06-23 14:56:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update events.k8s.io/v1 2022-06-23 14:56:01 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } Starting  { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-06-23 14:56:01.852116472 +0000 UTC nil StartKubeProxy nil kube-proxy kube-proxy-bootstrap-e2e-minion-group-61xw} {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcacfe3670  default  17ea3dd2-982f-4530-951d-68acf6effd79 210318 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220 v1  } RegisteredNode Node bootstrap-e2e-minion-group-61xw event: Registered Node bootstrap-e2e-minion-group-61xw in Controller {node-controller } 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcbd0c889f  default  a2897231-363c-467a-ac7d-8b7cb1d6c501 210325 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcbf816a5c  default  e2aa40c2-8961-4118-9c2e-d8381458b7ab 210323 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47bcbf865578  default  9d39632e-53fa-4c4d-92ae-391bbd44b753 210324 0 2022-06-23 14:56:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 14:56:03 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:03 +0000 UTC 2022-06-23 14:56:03 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47be3acbc8d5  default  ae2e9ff7-de35-477b-bb57-b1446a5f6364 210329 0 2022-06-23 14:56:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-06-23 14:56:10 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw bootstrap-e2e-minion-group-61xw   } NodeReady Node bootstrap-e2e-minion-group-61xw status is now: NodeReady {kubelet bootstrap-e2e-minion-group-61xw} 2022-06-23 14:56:10 +0000 UTC 2022-06-23 14:56:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47ccfbc5c64d  default  cc799f9d-dd49-4e6a-b203-da6b213ac774 210341 0 2022-06-23 14:57:13 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:57:13 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220 v1  } NodeNotReady Node bootstrap-e2e-minion-group-61xw status is now: NodeNotReady {node-controller } 2022-06-23 14:57:13 +0000 UTC 2022-06-23 14:57:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47de9ceb0155  default  a2e9ef3c-f607-4d0f-b644-6b2f5f128fda 210345 0 2022-06-23 14:58:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:58:29 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220   } DeletingNode Deleting node bootstrap-e2e-minion-group-61xw because it does not exist in the cloud provider {cloud-node-lifecycle-controller } 2022-06-23 14:58:29 +0000 UTC 2022-06-23 14:58:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-61xw.16fb47dfa293364f  default  648b3670-0d34-48c2-b689-4327cbe94e83 210350 0 2022-06-23 14:58:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-06-23 14:58:33 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-61xw f4ded5d3-f7af-4f94-b027-075a5dc86220 v1  } RemovingNode Node bootstrap-e2e-minion-group-61xw event: Removing Node bootstrap-e2e-minion-group-61xw from Controller {node-controller } 2022-06-23 14:58:33 +0000 UTC 2022-06-23 14:58:33 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d5r6.16fa9bba58de2bcb  default  b105a83e-a8e7-4c4b-9b26-58dd634c8094 212927 0 2022-06-23 15:18:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 15:18:28 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-d5r6 bootstrap-e2e-minion-group-d5r6   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-d5r6} 2022-06-21 10:23:57 +0000 UTC 2022-06-23 15:18:28 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-g70s.16fa9bbafdcfb6ec  default  1a9bfdc7-e720-4f63-a91b-47cb832460a6 212928 0 2022-06-23 15:18:31 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 15:18:31 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-g70s bootstrap-e2e-minion-group-g70s   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-g70s} 2022-06-21 10:24:00 +0000 UTC 2022-06-23 15:18:31 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-l58c.16fb0c58f222d31b  default  b3c60fe5-0329-461f-b243-6a12ab331c4b 212929 0 2022-06-23 15:18:34 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-06-23 15:18:34 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-l58c bootstrap-e2e-minion-group-l58c   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-l58c} 2022-06-22 20:47:44 +0000 UTC 2022-06-23 15:18:34 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:151