e2e-kops-warm-pool #1619348155453673472 Results

Test Failures

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] 5m13s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sa\sconfigured\shandler\s\[NodeFeature\:RuntimeHandler\]$'

[FAILED] timed out while waiting for pod runtimeclass-605/test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/28/23 15:18:46.226

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 15:13:37.85
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/28/23 15:13:37.85
Jan 28 15:13:37.850: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/28/23 15:13:37.851
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/28/23 15:13:38.148
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/28/23 15:13:38.342
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 15:13:38.536 (686ms)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 15:13:38.536
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 15:13:38.536 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/28/23 15:13:38.536
Jan 28 15:13:38.740: INFO: Waiting up to 5m0s for pod "hostexec-i-0c33ecedcb182e846-pnk7p" in namespace "runtimeclass-605" to be "running"
Jan 28 15:13:38.837: INFO: Pod "hostexec-i-0c33ecedcb182e846-pnk7p": Phase="Pending", Reason="", readiness=false. Elapsed: 97.548833ms
Jan 28 15:13:40.936: INFO: Pod "hostexec-i-0c33ecedcb182e846-pnk7p": Phase="Pending", Reason="", readiness=false. Elapsed: 2.196199761s
Jan 28 15:13:42.937: INFO: Pod "hostexec-i-0c33ecedcb182e846-pnk7p": Phase="Pending", Reason="", readiness=false. Elapsed: 4.19694536s
Jan 28 15:13:44.935: INFO: Pod "hostexec-i-0c33ecedcb182e846-pnk7p": Phase="Running", Reason="", readiness=true. Elapsed: 6.195430891s
Jan 28 15:13:44.935: INFO: Pod "hostexec-i-0c33ecedcb182e846-pnk7p" satisfied condition "running"
Jan 28 15:13:44.935: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-605 PodName:hostexec-i-0c33ecedcb182e846-pnk7p ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 28 15:13:44.935: INFO: >>> kubeConfig: /root/.kube/config
Jan 28 15:13:44.936: INFO: ExecWithOptions: Clientset creation
Jan 28 15:13:44.936: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-cf44e50dabf4d019.elb.eu-west-2.amazonaws.com/api/v1/namespaces/runtimeclass-605/pods/hostexec-i-0c33ecedcb182e846-pnk7p/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
Jan 28 15:13:45.933: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g" in namespace "runtimeclass-605" to be "Succeeded or Failed"
Jan 28 15:13:46.031: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 97.772236ms
Jan 28 15:13:48.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2.19553506s
Jan 28 15:13:50.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4.196411863s
Jan 28 15:13:52.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 6.195898781s
Jan 28 15:13:54.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 8.197339087s
Jan 28 15:13:56.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 10.197101608s
Jan 28 15:13:58.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 12.196208911s
Jan 28 15:14:00.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 14.196302568s
Jan 28 15:14:02.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 16.196025591s
Jan 28 15:14:04.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 18.196409556s
Jan 28 15:14:06.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 20.195759083s
Jan 28 15:14:08.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 22.196903784s
Jan 28 15:14:10.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 24.196527949s
Jan 28 15:14:12.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 26.195901834s
Jan 28 15:14:14.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 28.196429383s
Jan 28 15:14:16.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 30.195574545s
Jan 28 15:14:18.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 32.196090371s
Jan 28 15:14:20.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 34.198200492s
Jan 28 15:14:22.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 36.19606622s
Jan 28 15:14:24.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 38.196779047s
Jan 28 15:14:26.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 40.195677047s
Jan 28 15:14:28.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 42.196058186s
Jan 28 15:14:30.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 44.196302016s
Jan 28 15:14:32.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 46.19572066s
Jan 28 15:14:34.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 48.196362567s
Jan 28 15:14:36.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 50.19577917s
Jan 28 15:14:38.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 52.196052869s
Jan 28 15:14:40.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 54.1974824s
Jan 28 15:14:42.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 56.195856243s
Jan 28 15:14:44.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 58.195819485s
Jan 28 15:14:46.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.195988897s
Jan 28 15:14:48.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.196114268s
Jan 28 15:14:50.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.196615204s
Jan 28 15:14:52.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.196256232s
Jan 28 15:14:54.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.196279448s
Jan 28 15:14:56.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.195513909s
Jan 28 15:14:58.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.196428061s
Jan 28 15:15:00.134: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.200997414s
Jan 28 15:15:02.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.196802315s
Jan 28 15:15:04.142: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.208697553s
Jan 28 15:15:06.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.197357313s
Jan 28 15:15:08.134: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.201469071s
Jan 28 15:15:10.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.196570238s
Jan 28 15:15:12.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.196791195s
Jan 28 15:15:14.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.196199313s
Jan 28 15:15:16.134: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.201195852s
Jan 28 15:15:18.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.19641021s
Jan 28 15:15:20.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.196662326s
Jan 28 15:15:22.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.196058292s
Jan 28 15:15:24.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.196108509s
Jan 28 15:15:26.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.198150658s
Jan 28 15:15:28.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.196054169s
Jan 28 15:15:30.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.195985098s
Jan 28 15:15:32.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.197478774s
Jan 28 15:15:34.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.196186141s
Jan 28 15:15:36.133: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.200252374s
Jan 28 15:15:38.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.196311223s
Jan 28 15:15:40.137: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.203836499s
Jan 28 15:15:42.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.195408789s
Jan 28 15:15:44.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.196458958s
Jan 28 15:15:46.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.196055572s
Jan 28 15:15:48.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.196113615s
Jan 28 15:15:50.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.196774358s
Jan 28 15:15:52.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.195746524s
Jan 28 15:15:54.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.197763015s
Jan 28 15:15:56.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.195895874s
Jan 28 15:15:58.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.195671081s
Jan 28 15:16:00.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.195137486s
Jan 28 15:16:02.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.196029599s
Jan 28 15:16:04.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.196196684s
Jan 28 15:16:06.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.195448708s
Jan 28 15:16:08.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.196729818s
Jan 28 15:16:10.132: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.199016424s
Jan 28 15:16:12.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.195815535s
Jan 28 15:16:14.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.195886464s
Jan 28 15:16:16.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.198103946s
Jan 28 15:16:18.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.196325288s
Jan 28 15:16:20.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.19654066s
Jan 28 15:16:22.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.1958864s
Jan 28 15:16:24.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.196611938s
Jan 28 15:16:26.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.19683575s
Jan 28 15:16:28.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.195939355s
Jan 28 15:16:30.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.195856904s
Jan 28 15:16:32.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.196253092s
Jan 28 15:16:34.135: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.201718381s
Jan 28 15:16:36.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.195682786s
Jan 28 15:16:38.132: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.199037518s
Jan 28 15:16:40.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.196243702s
Jan 28 15:16:42.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.196430249s
Jan 28 15:16:44.134: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.201068424s
Jan 28 15:16:46.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.196994835s
Jan 28 15:16:48.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.196701379s
Jan 28 15:16:50.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.197056953s
Jan 28 15:16:52.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.196449105s
Jan 28 15:16:54.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.195778495s
Jan 28 15:16:56.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.195964817s
Jan 28 15:16:58.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.196304562s
Jan 28 15:17:00.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.19599655s
Jan 28 15:17:02.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.196554525s
Jan 28 15:17:04.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.198620659s
Jan 28 15:17:06.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.196007443s
Jan 28 15:17:08.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.198644301s
Jan 28 15:17:10.135: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.201751586s
Jan 28 15:17:12.136: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.20309224s
Jan 28 15:17:14.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.196202448s
Jan 28 15:17:16.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.195896068s
Jan 28 15:17:18.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.196844864s
Jan 28 15:17:20.132: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.198861291s
Jan 28 15:17:22.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.196513159s
Jan 28 15:17:24.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.196290968s
Jan 28 15:17:26.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.196207831s
Jan 28 15:17:28.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.196133697s
Jan 28 15:17:30.136: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.203458452s
Jan 28 15:17:32.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.196539033s
Jan 28 15:17:34.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.19645344s
Jan 28 15:17:36.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.198604114s
Jan 28 15:17:38.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.195742444s
Jan 28 15:17:40.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.196512607s
Jan 28 15:17:42.140: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.207091556s
Jan 28 15:17:44.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.196345887s
Jan 28 15:17:46.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.196186032s
Jan 28 15:17:48.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.196201939s
Jan 28 15:17:50.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.196097233s
Jan 28 15:17:52.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.196359644s
Jan 28 15:17:54.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.19660091s
Jan 28 15:17:56.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.195783512s
Jan 28 15:17:58.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.196282171s
Jan 28 15:18:00.134: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.201307162s
Jan 28 15:18:02.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.197109433s
Jan 28 15:18:04.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.196291394s
Jan 28 15:18:06.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.196149592s
Jan 28 15:18:08.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.195839179s
Jan 28 15:18:10.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.196422986s
Jan 28 15:18:12.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.1973842s
Jan 28 15:18:14.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.196363431s
Jan 28 15:18:16.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.19625889s
Jan 28 15:18:18.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.196681899s
Jan 28 15:18:20.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.195632196s
Jan 28 15:18:22.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.19694389s
Jan 28 15:18:24.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.196107469s
Jan 28 15:18:26.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.195463404s
Jan 28 15:18:28.130: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.197235228s
Jan 28 15:18:30.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.196422493s
Jan 28 15:18:32.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.196199722s
Jan 28 15:18:34.129: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.195671474s
Jan 28 15:18:36.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.195260426s
Jan 28 15:18:38.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.195659669s
Jan 28 15:18:40.133: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.200532064s
Jan 28 15:18:42.131: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.198332118s
Jan 28 15:18:44.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.195452007s
Jan 28 15:18:46.128: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.195069376s
Jan 28 15:18:46.225: INFO: Pod "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.291811905s
Jan 28 15:18:46.226: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc001e12450>: {
        msg: "timed out while waiting for pod runtimeclass-605/test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g to be Succeeded or Failed",
        observedObjects: [
            <*v1.Pod | 0xc002009200>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g",
                    GenerateName: "test-runtimeclass-runtimeclass-605-preconfigured-handler-",
                    Namespace: "runtimeclass-605",
                    SelfLink: "",
                    UID: "467c6291-8777-461f-86bc-a7d55db80b84",
                    ResourceVersion: "22700",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810515625,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810515625,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810515625,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: nil,
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0fe295a079018be45",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
                        SupplementalGroups: nil,
                        FSGroup: nil,
                        Sysctls: nil,
                        FSGroupChangePolicy: nil,
                    ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-605/test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/28/23 15:18:46.226
< Exit [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/28/23 15:18:46.226 (5m7.69s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 15:18:46.226
Jan 28 15:18:46.226: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 15:18:46.331 (106ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/28/23 15:18:46.332
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/28/23 15:18:46.43 (99ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 15:18:46.43
STEP: Deleting pod hostexec-i-0c33ecedcb182e846-pnk7p in namespace runtimeclass-605 - test/e2e/framework/pod/delete.go:41 @ 01/28/23 15:18:46.43
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 15:18:46.534 (104ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 15:18:46.534
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 15:18:46.534 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 15:18:46.534
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 15:18:46.534
STEP: Collecting events from namespace "runtimeclass-605". - test/e2e/framework/debug/dump.go:42 @ 01/28/23 15:18:46.534
STEP: Found 6 events. - test/e2e/framework/debug/dump.go:46 @ 01/28/23 15:18:46.633
Jan 28 15:18:46.633: INFO: At 2023-01-28 15:13:38 +0000 UTC - event for hostexec-i-0c33ecedcb182e846-pnk7p: {default-scheduler } Scheduled: Successfully assigned runtimeclass-605/hostexec-i-0c33ecedcb182e846-pnk7p to i-0c33ecedcb182e846
Jan 28 15:18:46.633: INFO: At 2023-01-28 15:13:39 +0000 UTC - event for hostexec-i-0c33ecedcb182e846-pnk7p: {kubelet i-0c33ecedcb182e846} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 28 15:18:46.633: INFO: At 2023-01-28 15:13:39 +0000 UTC - event for hostexec-i-0c33ecedcb182e846-pnk7p: {kubelet i-0c33ecedcb182e846} Created: Created container agnhost-container
Jan 28 15:18:46.633: INFO: At 2023-01-28 15:13:39 +0000 UTC - event for hostexec-i-0c33ecedcb182e846-pnk7p: {kubelet i-0c33ecedcb182e846} Started: Started container agnhost-container
Jan 28 15:18:46.633: INFO: At 2023-01-28 15:13:45 +0000 UTC - event for test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g: {default-scheduler } Scheduled: Successfully assigned runtimeclass-605/test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g to i-0fe295a079018be45
Jan 28 15:18:46.633: INFO: At 2023-01-28 15:13:45 +0000 UTC - event for test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g: {kubelet i-0fe295a079018be45} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 28 15:18:46.731: INFO: POD                                                             NODE                 PHASE    GRACE  CONDITIONS
Jan 28 15:18:46.731: INFO: test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g  i-0fe295a079018be45  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:13:45 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:13:45 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:13:45 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:13:45 +0000 UTC  }]
Jan 28 15:18:46.731: INFO: 
Jan 28 15:18:46.829: INFO: Unable to fetch runtimeclass-605/test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g)
Jan 28 15:18:46.927: INFO: 
Logging node info for node i-090e4849bc17a4dcb
Jan 28 15:18:47.024: INFO: Node Info: &Node{ObjectMeta:{i-090e4849bc17a4dcb    8e7f8e02-01a8-4c6b-b433-e34bb482077e 32832 0 2023-01-28 15:02:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-090e4849bc17a4dcb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-090e4849bc17a4dcb topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-fsgroup-policy-2193":"i-090e4849bc17a4dcb","ebs.csi.aws.com":"i-090e4849bc17a4dcb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-28 15:18:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-090e4849bc17a4dcb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:05 +0000 UTC,LastTransitionTime:2023-01-28 15:02:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:05 +0000 UTC,LastTransitionTime:2023-01-28 15:02:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:05 +0000 UTC,LastTransitionTime:2023-01-28 15:02:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:18:05 +0000 UTC,LastTransitionTime:2023-01-28 15:03:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.179,},NodeAddress{Type:ExternalIP,Address:3.8.173.76,},NodeAddress{Type:InternalDNS,Address:i-090e4849bc17a4dcb.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-090e4849bc17a4dcb.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-8-173-76.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f2336fc00535ab72a4ad2995af2f0,SystemUUID:ec2f2336-fc00-535a-b72a-4ad2995af2f0,BootID:e133a2b3-0d66-4aa9-aad0-46abf361391b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 15:18:47.024: INFO: 
Logging kubelet events for node i-090e4849bc17a4dcb
Jan 28 15:18:47.124: INFO: 
Logging pods the kubelet thinks is on node i-090e4849bc17a4dcb
Jan 28 15:18:47.235: INFO: simpletest.rc-2g89z started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.235: INFO: pod-sharedvolume-7edf21a3-c408-475d-871e-faa7dc389f83 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.235: INFO: simpletest.rc-khrh9 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.235: INFO: pod-service-account-mountsa-mountspec started at 2023-01-28 15:17:18 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.235: INFO: 	Container token-test ready: false, restart count 0
Jan 28 15:18:47.235: INFO: deployment-shared-unset-7cf876c5d4-2j6dc started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.235: INFO: inline-volume-wxl7q started at 2023-01-28 15:18:22 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.235: INFO: 	Container volume-tester ready: false, restart count 0
Jan 28 15:18:47.235: INFO: simpletest.rc-w5t86 started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.235: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:47.235: INFO: simpletest.rc-8qnws started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-xhvmw started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-54pds started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: agnhost-primary-clz4r started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-vbg7k started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: pod-49090f13-cad8-4c29-93bb-04f83b107469 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: pvc-volume-tester-fthz4 started at 2023-01-28 15:18:12 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container volume-tester ready: true, restart count 0
Jan 28 15:18:47.236: INFO: pod-675c8830-274f-4090-a772-35d0c8749d36 started at 2023-01-28 15:18:35 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container write-pod ready: true, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-7ptrn started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-rs462 started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-8495f started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: hostexec-i-090e4849bc17a4dcb-kd5b5 started at 2023-01-28 15:18:13 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-j6tn5 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-bpjvw started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-fz5nv started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-ghmq9 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-jthl8 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: pod-terminate-status-0-3 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: ebs-csi-node-dt6sf started at 2023-01-28 15:02:56 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:47.236: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:47.236: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-s76rt started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-dwcwl started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: adopt-release-vwk2w started at 2023-01-28 15:17:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container c ready: true, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-rwcqn started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-jtj7l started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: hostexec-i-090e4849bc17a4dcb-7rldb started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-tkz8j started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: cilium-zjqvc started at 2023-01-28 15:02:56 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:18:47.236: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:18:47.236: INFO: adopt-release-2dmfc started at 2023-01-28 15:18:28 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container c ready: true, restart count 0
Jan 28 15:18:47.236: INFO: hostexec-i-090e4849bc17a4dcb-tfnr7 started at 2023-01-28 15:18:31 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-xh929 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: hostexec-i-090e4849bc17a4dcb-7d4fk started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-btps2 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: csi-mockplugin-0 started at 2023-01-28 15:18:01 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:47.236: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:47.236: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 15:18:47.236: INFO: 	Container mock ready: true, restart count 0
Jan 28 15:18:47.236: INFO: simpletest.rc-bmzr8 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.236: INFO: simpletest.rc-gfvs5 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:47.893: INFO: 
Latency metrics for node i-090e4849bc17a4dcb
Jan 28 15:18:47.893: INFO: 
Logging node info for node i-0c33ecedcb182e846
Jan 28 15:18:47.990: INFO: Node Info: &Node{ObjectMeta:{i-0c33ecedcb182e846    d13a3e9f-6a4c-4f5f-bf0f-92101c30b10d 34521 0 2023-01-28 15:02:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0c33ecedcb182e846 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0c33ecedcb182e846 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6568":"i-0c33ecedcb182e846","ebs.csi.aws.com":"i-0c33ecedcb182e846"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:18:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 15:18:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0c33ecedcb182e846,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:11 +0000 UTC,LastTransitionTime:2023-01-28 15:02:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:11 +0000 UTC,LastTransitionTime:2023-01-28 15:02:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:11 +0000 UTC,LastTransitionTime:2023-01-28 15:02:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:18:11 +0000 UTC,LastTransitionTime:2023-01-28 15:03:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.45.213,},NodeAddress{Type:ExternalIP,Address:18.135.27.112,},NodeAddress{Type:InternalDNS,Address:i-0c33ecedcb182e846.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c33ecedcb182e846.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-135-27-112.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2adf731f7611bdd0bab1596dff43f3,SystemUUID:ec2adf73-1f76-11bd-d0ba-b1596dff43f3,BootID:a75d8321-e66c-473b-be35-413aaa0ff41e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-6568^f91b494d-9f1e-11ed-9d5c-d2a7185d4da8],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6568^f91b494d-9f1e-11ed-9d5c-d2a7185d4da8,DevicePath:,},},Config:nil,},}
Jan 28 15:18:47.991: INFO: 
Logging kubelet events for node i-0c33ecedcb182e846
Jan 28 15:18:48.092: INFO: 
Logging pods the kubelet thinks is on node i-0c33ecedcb182e846
Jan 28 15:18:48.205: INFO: simpletest.rc-f2lfg started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: ebs-csi-node-22mmt started at 2023-01-28 15:02:53 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:48.205: INFO: pod-1 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: pod-subpath-test-secret-khj9 started at 2023-01-28 15:18:19 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container test-container-subpath-secret-khj9 ready: true, restart count 0
Jan 28 15:18:48.205: INFO: simpletest.rc-xprkq started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: pod-terminate-status-2-3 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: csi-hostpathplugin-0 started at 2023-01-28 15:17:20 +0000 UTC (0+7 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:48.205: INFO: deployment-shared-unset-7cf876c5d4-phj6l started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-lzpmg started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: test-webserver-c54d0c98-43aa-4896-b71e-1c47c8d99bcb started at 2023-01-28 15:16:17 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container test-webserver ready: true, restart count 0
Jan 28 15:18:48.205: INFO: simpletest.rc-45cpx started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-ndl8p started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: ebs-csi-controller-555658678f-gfjzq started at 2023-01-28 15:03:04 +0000 UTC (0+5 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:48.205: INFO: hostpath-client started at 2023-01-28 15:18:09 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container hostpath-client ready: true, restart count 0
Jan 28 15:18:48.205: INFO: csi-hostpathplugin-0 started at 2023-01-28 15:17:26 +0000 UTC (0+7 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:48.205: INFO: simpletest.rc-47pmm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-d4rsq started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-fq27t started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: tester started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: adopt-release-h7spn started at 2023-01-28 15:17:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container c ready: true, restart count 0
Jan 28 15:18:48.205: INFO: cilium-75jdq started at 2023-01-28 15:02:53 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:18:48.205: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:18:48.205: INFO: simpletest.rc-qg6tq started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-kcwm5 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-75jfs started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-xjch8 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: httpd started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: pod-0 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: deployment-6c94ddcb9f-svqhc started at 2023-01-28 15:18:11 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:48.205: INFO: deployment-74d7dd69db-s76ws started at 2023-01-28 15:18:11 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:48.205: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:48.205: INFO: simpletest.rc-ws4rm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-7lrcm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-wjl9x started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.205: INFO: simpletest.rc-jhmjc started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:48.958: INFO: 
Latency metrics for node i-0c33ecedcb182e846
Jan 28 15:18:48.958: INFO: 
Logging node info for node i-0db7f364fb385f093
Jan 28 15:18:49.056: INFO: Node Info: &Node{ObjectMeta:{i-0db7f364fb385f093    1c64e0ac-e151-4b43-a745-26860a60c98e 34358 0 2023-01-28 15:02:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0db7f364fb385f093 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0db7f364fb385f093 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9271":"i-0db7f364fb385f093","csi-mock-csi-mock-volumes-workload-6545":"i-0db7f364fb385f093","ebs.csi.aws.com":"i-0db7f364fb385f093"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:18:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 15:18:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0db7f364fb385f093,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:40 +0000 UTC,LastTransitionTime:2023-01-28 15:02:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:40 +0000 UTC,LastTransitionTime:2023-01-28 15:02:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:40 +0000 UTC,LastTransitionTime:2023-01-28 15:02:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:18:40 +0000 UTC,LastTransitionTime:2023-01-28 15:03:02 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.74,},NodeAddress{Type:ExternalIP,Address:13.40.45.254,},NodeAddress{Type:InternalDNS,Address:i-0db7f364fb385f093.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0db7f364fb385f093.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-40-45-254.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb74910856eb4e9dc32cd8c13ab7,SystemUUID:ec2dcb74-9108-56eb-4e9d-c32cd8c13ab7,BootID:8aef2dc5-3af2-4fbf-b2f9-b28d0adf9c59,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-9271^096fc1c1-9f1f-11ed-bc31-26e61325b363 kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-6545^fb65fc30-9f1e-11ed-b4df-c6248c78aa57],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-6545^fb65fc30-9f1e-11ed-b4df-c6248c78aa57,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-9271^096fc1c1-9f1f-11ed-bc31-26e61325b363,DevicePath:,},},Config:nil,},}
Jan 28 15:18:49.057: INFO: 
Logging kubelet events for node i-0db7f364fb385f093
Jan 28 15:18:49.157: INFO: 
Logging pods the kubelet thinks is on node i-0db7f364fb385f093
Jan 28 15:18:49.265: INFO: csi-mockplugin-attacher-0 started at 2023-01-28 15:18:10 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:18:49.265: INFO: coredns-559769c974-7tb5n started at 2023-01-28 15:03:02 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container coredns ready: true, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-l4d99 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-xqh69 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: pod-5a762780-3ee1-4009-9ae0-720567b27005 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-gcvs2 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: cilium-44xdm started at 2023-01-28 15:02:51 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:18:49.265: INFO: csi-hostpathplugin-0 started at 2023-01-28 15:18:34 +0000 UTC (0+7 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:49.265: INFO: pod-subpath-test-dynamicpv-45k6 started at 2023-01-28 15:18:39 +0000 UTC (2+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Init container init-volume-dynamicpv-45k6 ready: false, restart count 0
Jan 28 15:18:49.265: INFO: 	Init container test-init-subpath-dynamicpv-45k6 ready: false, restart count 0
Jan 28 15:18:49.265: INFO: 	Container test-container-subpath-dynamicpv-45k6 ready: false, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-zfscs started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: deployment-shared-unset-7cf876c5d4-8g6h7 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: ebs-csi-controller-555658678f-2bwj9 started at 2023-01-28 15:03:02 +0000 UTC (0+5 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-xjsfd started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-lxgxq started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: csi-mockplugin-0 started at 2023-01-28 15:18:10 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container mock ready: true, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-hssn2 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-ff6pf started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-qlcgc started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: coredns-autoscaler-7cb5c5b969-vzlgv started at 2023-01-28 15:03:02 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container autoscaler ready: true, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-b5kk8 started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-gt2zd started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-vtrqn started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: ebs-csi-node-xcm7s started at 2023-01-28 15:02:51 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:49.265: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-4bbx7 started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container nginx ready: false, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-f6s5k started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:49.265: INFO: hostexec-i-0db7f364fb385f093-4ndgg started at 2023-01-28 15:18:37 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:18:49.265: INFO: pvc-volume-tester-gthmf started at 2023-01-28 15:18:13 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:49.265: INFO: 	Container volume-tester ready: true, restart count 0
Jan 28 15:18:49.265: INFO: simpletest.rc-n4pdr started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.265: INFO: simpletest.rc-9rdpf started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:49.915: INFO: 
Latency metrics for node i-0db7f364fb385f093
Jan 28 15:18:49.915: INFO: 
Logging node info for node i-0f616ec509cf9f485
Jan 28 15:18:50.015: INFO: Node Info: &Node{ObjectMeta:{i-0f616ec509cf9f485    d645e179-cb42-4b06-91d4-29d5340ecbd4 32796 0 2023-01-28 15:00:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0f616ec509cf9f485 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-west-2a topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f616ec509cf9f485"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-28 15:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-28 15:00:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:01:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:01:12 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-28 15:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-28 15:18:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0f616ec509cf9f485,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002136064 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897278464 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:09 +0000 UTC,LastTransitionTime:2023-01-28 14:59:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:09 +0000 UTC,LastTransitionTime:2023-01-28 14:59:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:09 +0000 UTC,LastTransitionTime:2023-01-28 14:59:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:18:09 +0000 UTC,LastTransitionTime:2023-01-28 15:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.69,},NodeAddress{Type:ExternalIP,Address:35.178.176.116,},NodeAddress{Type:InternalDNS,Address:i-0f616ec509cf9f485.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f616ec509cf9f485.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-178-176-116.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e630082df1392683fe382a5c35f,SystemUUID:ec244e63-0082-df13-9268-3fe382a5c35f,BootID:d79d958c-542d-42b7-9243-e9804d0b5206,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:56048433,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41190270,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39793987,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691073,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 15:18:50.015: INFO: 
Logging kubelet events for node i-0f616ec509cf9f485
Jan 28 15:18:50.115: INFO: 
Logging pods the kubelet thinks is on node i-0f616ec509cf9f485
Jan 28 15:18:50.222: INFO: aws-cloud-controller-manager-4sppk started at 2023-01-28 15:01:05 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.222: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 28 15:18:50.222: INFO: cilium-operator-6f7d7f696f-lqr79 started at 2023-01-28 15:01:06 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.222: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 28 15:18:50.223: INFO: kube-apiserver-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (0+2 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Container healthcheck ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Container kube-apiserver ready: true, restart count 2
Jan 28 15:18:50.223: INFO: kube-scheduler-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 28 15:18:50.223: INFO: etcd-manager-events-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (10+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 15:18:50.223: INFO: ebs-csi-node-pgxlx started at 2023-01-28 15:01:05 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:50.223: INFO: kops-controller-v55qz started at 2023-01-28 15:01:05 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Container kops-controller ready: true, restart count 0
Jan 28 15:18:50.223: INFO: dns-controller-85d56fc6db-8wvnc started at 2023-01-28 15:01:06 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Container dns-controller ready: true, restart count 0
Jan 28 15:18:50.223: INFO: kube-controller-manager-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 28 15:18:50.223: INFO: etcd-manager-main-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (10+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 15:18:50.223: INFO: cilium-nq9gc started at 2023-01-28 15:01:05 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:18:50.223: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:18:50.223: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:18:50.568: INFO: 
Latency metrics for node i-0f616ec509cf9f485
Jan 28 15:18:50.568: INFO: 
Logging node info for node i-0fe295a079018be45
Jan 28 15:18:50.665: INFO: Node Info: &Node{ObjectMeta:{i-0fe295a079018be45    5d6b77cd-0f97-410b-83fc-4e3b4ec3b3ee 33011 0 2023-01-28 15:02:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0fe295a079018be45 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0fe295a079018be45 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe295a079018be45"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-28 15:18:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0fe295a079018be45,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:13 +0000 UTC,LastTransitionTime:2023-01-28 15:02:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:13 +0000 UTC,LastTransitionTime:2023-01-28 15:02:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:18:13 +0000 UTC,LastTransitionTime:2023-01-28 15:02:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:18:13 +0000 UTC,LastTransitionTime:2023-01-28 15:03:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.162,},NodeAddress{Type:ExternalIP,Address:18.135.6.107,},NodeAddress{Type:InternalDNS,Address:i-0fe295a079018be45.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fe295a079018be45.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-135-6-107.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec268acacfc07b6f718f591a201822cf,SystemUUID:ec268aca-cfc0-7b6f-718f-591a201822cf,BootID:7b418cfb-0602-442b-8f63-f0867ea10d16,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 15:18:50.665: INFO: 
Logging kubelet events for node i-0fe295a079018be45
Jan 28 15:18:50.766: INFO: 
Logging pods the kubelet thinks is on node i-0fe295a079018be45
Jan 28 15:18:50.869: INFO: server started at 2023-01-28 15:18:30 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.869: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:18:50.869: INFO: test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g started at 2023-01-28 15:13:45 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container test ready: false, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-p2675 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: test-grpc-9cabec0b-103f-47a7-8ef0-cfe7b79c205b started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container etcd ready: false, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-rgdgt started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-4f6sk started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: ebs-csi-node-9szrl started at 2023-01-28 15:02:54 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:18:50.870: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:18:50.870: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:18:50.870: INFO: image-pull-test5e6f5e2b-2b2f-4075-981b-96645db2a549 started at 2023-01-28 15:18:33 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container image-pull-test ready: false, restart count 0
Jan 28 15:18:50.870: INFO: pod-terminate-status-1-2 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-6rjgz started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-d8x2l started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-nwzrn started at 2023-01-28 15:18:39 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-r69zm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-md5ql started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: coredns-559769c974-7tsms started at 2023-01-28 15:03:32 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container coredns ready: true, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-lgwgm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-xxfhm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-scn75 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-248vm started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-jq4wr started at 2023-01-28 15:18:40 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-799hw started at 2023-01-28 15:18:40 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:50.870: INFO: cilium-44s2c started at 2023-01-28 15:02:54 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:18:50.870: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-2kxqd started at 2023-01-28 15:18:41 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:50.870: INFO: security-context-007663e7-7c36-4a3d-800f-d55b11fc4ba0 started at 2023-01-28 15:18:32 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container test-container ready: false, restart count 0
Jan 28 15:18:50.870: INFO: probe-test-f3b741ab-93e7-477b-b871-a795c0341400 started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-66k6m started at <nil> (0+0 container statuses recorded)
Jan 28 15:18:50.870: INFO: simpletest.rc-pnn5n started at 2023-01-28 15:18:40 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:50.870: INFO: simpletest.rc-ldx2g started at 2023-01-28 15:18:42 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:18:50.870: INFO: 	Container nginx ready: true, restart count 0
Jan 28 15:18:51.339: INFO: 
Latency metrics for node i-0fe295a079018be45
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 15:18:51.339 (4.805s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 15:18:51.339 (4.805s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 15:18:51.339
STEP: Destroying namespace "runtimeclass-605" for this suite. - test/e2e/framework/framework.go:347 @ 01/28/23 15:18:51.339
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 15:18:51.438 (99ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 15:18:51.438
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 15:18:51.438 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-605/test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g mentions in log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints 5m11s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sscheduling\swithout\staints$'

[FAILED] timed out while waiting for pod runtimeclass-7769/test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/28/23 15:17:15.44

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 15:12:08.255
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/28/23 15:12:08.255
Jan 28 15:12:08.255: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/28/23 15:12:08.256
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/28/23 15:12:08.548
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/28/23 15:12:08.741
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 15:12:08.934 (679ms)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 15:12:08.934
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 15:12:08.934 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/28/23 15:12:08.934
Jan 28 15:12:09.134: INFO: Waiting up to 5m0s for pod "hostexec-i-090e4849bc17a4dcb-vlp97" in namespace "runtimeclass-7769" to be "running"
Jan 28 15:12:09.236: INFO: Pod "hostexec-i-090e4849bc17a4dcb-vlp97": Phase="Pending", Reason="", readiness=false. Elapsed: 102.236692ms
Jan 28 15:12:11.334: INFO: Pod "hostexec-i-090e4849bc17a4dcb-vlp97": Phase="Running", Reason="", readiness=true. Elapsed: 2.200361082s
Jan 28 15:12:11.334: INFO: Pod "hostexec-i-090e4849bc17a4dcb-vlp97" satisfied condition "running"
Jan 28 15:12:11.334: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-7769 PodName:hostexec-i-090e4849bc17a4dcb-vlp97 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 28 15:12:11.334: INFO: >>> kubeConfig: /root/.kube/config
Jan 28 15:12:11.335: INFO: ExecWithOptions: Clientset creation
Jan 28 15:12:11.335: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-cf44e50dabf4d019.elb.eu-west-2.amazonaws.com/api/v1/namespaces/runtimeclass-7769/pods/hostexec-i-090e4849bc17a4dcb-vlp97/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
STEP: Trying to launch a pod without a label to get a node which can launch it. - test/e2e/scheduling/predicates.go:1042 @ 01/28/23 15:12:12.04
Jan 28 15:12:12.139: INFO: Waiting up to 1m0s for pod "without-label" in namespace "runtimeclass-7769" to be "running"
Jan 28 15:12:12.237: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 97.536399ms
Jan 28 15:12:14.334: INFO: Pod "without-label": Phase="Running", Reason="", readiness=true. Elapsed: 2.194708296s
Jan 28 15:12:14.334: INFO: Pod "without-label" satisfied condition "running"
STEP: Explicitly delete pod here to free the resource it takes. - test/e2e/scheduling/predicates.go:973 @ 01/28/23 15:12:14.435
STEP: Trying to apply a label on the found node. - test/e2e/node/runtimeclass.go:148 @ 01/28/23 15:12:14.538
STEP: verifying the node has the label foo-44766b62-b1b1-46a2-80d0-439cfec855e0 bar - test/e2e/framework/node/helper.go:63 @ 01/28/23 15:12:14.642
STEP: verifying the node has the label fizz-9f74c685-231d-4f77-98f5-ec6f3925b85f buzz - test/e2e/framework/node/helper.go:63 @ 01/28/23 15:12:14.844
STEP: Trying to create runtimeclass and pod - test/e2e/node/runtimeclass.go:155 @ 01/28/23 15:12:14.942
Jan 28 15:12:15.148: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg" in namespace "runtimeclass-7769" to be "not pending"
Jan 28 15:12:15.245: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 96.832897ms
Jan 28 15:12:17.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.194747871s
Jan 28 15:12:19.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.194560767s
Jan 28 15:12:21.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.194997982s
Jan 28 15:12:23.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.19590188s
Jan 28 15:12:25.354: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.206318121s
Jan 28 15:12:27.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 12.194431095s
Jan 28 15:12:29.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 14.194424978s
Jan 28 15:12:31.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 16.196183042s
Jan 28 15:12:33.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 18.194383778s
Jan 28 15:12:35.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 20.194330991s
Jan 28 15:12:37.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 22.194959529s
Jan 28 15:12:39.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 24.193959079s
Jan 28 15:12:41.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 26.194460359s
Jan 28 15:12:43.355: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 28.207132208s
Jan 28 15:12:45.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 30.194578335s
Jan 28 15:12:47.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 32.194712611s
Jan 28 15:12:49.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 34.195880683s
Jan 28 15:12:51.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 36.194632922s
Jan 28 15:12:53.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 38.194934596s
Jan 28 15:12:55.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 40.194696524s
Jan 28 15:12:57.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 42.194219808s
Jan 28 15:12:59.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 44.19492069s
Jan 28 15:13:01.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 46.195324228s
Jan 28 15:13:03.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 48.194966484s
Jan 28 15:13:05.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 50.195803215s
Jan 28 15:13:07.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 52.194950663s
Jan 28 15:13:09.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 54.194409246s
Jan 28 15:13:11.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 56.196148066s
Jan 28 15:13:13.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 58.194646932s
Jan 28 15:13:15.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.195099632s
Jan 28 15:13:17.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.194314695s
Jan 28 15:13:19.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.194265747s
Jan 28 15:13:21.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.194317641s
Jan 28 15:13:23.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.194882226s
Jan 28 15:13:25.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.195918629s
Jan 28 15:13:27.346: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.19831129s
Jan 28 15:13:29.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.19441438s
Jan 28 15:13:31.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.194144729s
Jan 28 15:13:33.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.194633846s
Jan 28 15:13:35.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.195955569s
Jan 28 15:13:37.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.194674923s
Jan 28 15:13:39.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.193986807s
Jan 28 15:13:41.349: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.201311304s
Jan 28 15:13:43.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.194408495s
Jan 28 15:13:45.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.194644381s
Jan 28 15:13:47.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.1945251s
Jan 28 15:13:49.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.194690524s
Jan 28 15:13:51.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.194897159s
Jan 28 15:13:53.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.194555262s
Jan 28 15:13:55.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.194877968s
Jan 28 15:13:57.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.196526338s
Jan 28 15:13:59.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.197004844s
Jan 28 15:14:01.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.194374547s
Jan 28 15:14:03.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.194650258s
Jan 28 15:14:05.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.194069214s
Jan 28 15:14:07.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.194472527s
Jan 28 15:14:09.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.193966204s
Jan 28 15:14:11.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.194949584s
Jan 28 15:14:13.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.194842996s
Jan 28 15:14:15.346: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.198118773s
Jan 28 15:14:17.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.195230429s
Jan 28 15:14:19.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.194710636s
Jan 28 15:14:21.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.194425995s
Jan 28 15:14:23.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.195104038s
Jan 28 15:14:25.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.195060017s
Jan 28 15:14:27.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.194684049s
Jan 28 15:14:29.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.195212491s
Jan 28 15:14:31.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.194993877s
Jan 28 15:14:33.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.194868301s
Jan 28 15:14:35.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.195262629s
Jan 28 15:14:37.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.195627764s
Jan 28 15:14:39.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.195420216s
Jan 28 15:14:41.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.195424759s
Jan 28 15:14:43.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.195063078s
Jan 28 15:14:45.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.194817652s
Jan 28 15:14:47.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.194393684s
Jan 28 15:14:49.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.195020111s
Jan 28 15:14:51.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.194536013s
Jan 28 15:14:53.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.194697139s
Jan 28 15:14:55.353: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.204924168s
Jan 28 15:14:57.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.194720408s
Jan 28 15:14:59.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.194310934s
Jan 28 15:15:01.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.194811659s
Jan 28 15:15:03.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.194568569s
Jan 28 15:15:05.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.196134923s
Jan 28 15:15:07.349: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.201128332s
Jan 28 15:15:09.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.194787983s
Jan 28 15:15:11.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.196818114s
Jan 28 15:15:13.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.194801782s
Jan 28 15:15:15.348: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.1998054s
Jan 28 15:15:17.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.196539225s
Jan 28 15:15:19.348: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.200418784s
Jan 28 15:15:21.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.195010624s
Jan 28 15:15:23.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.195756604s
Jan 28 15:15:25.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.196921792s
Jan 28 15:15:27.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.194436381s
Jan 28 15:15:29.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.194379648s
Jan 28 15:15:31.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.195833062s
Jan 28 15:15:33.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.194574236s
Jan 28 15:15:35.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.197183199s
Jan 28 15:15:37.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.194155869s
Jan 28 15:15:39.346: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.197980117s
Jan 28 15:15:41.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.196894769s
Jan 28 15:15:43.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.196919162s
Jan 28 15:15:45.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.194208569s
Jan 28 15:15:47.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.194949265s
Jan 28 15:15:49.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.194198783s
Jan 28 15:15:51.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.19505784s
Jan 28 15:15:53.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.194866404s
Jan 28 15:15:55.347: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.19911553s
Jan 28 15:15:57.346: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.197605157s
Jan 28 15:15:59.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.194622536s
Jan 28 15:16:01.375: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.226763148s
Jan 28 15:16:03.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.194924713s
Jan 28 15:16:05.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.195538578s
Jan 28 15:16:07.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.196848114s
Jan 28 15:16:09.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.195849297s
Jan 28 15:16:11.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.194690124s
Jan 28 15:16:13.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.194394558s
Jan 28 15:16:15.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.194168328s
Jan 28 15:16:17.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.195528269s
Jan 28 15:16:19.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.193944118s
Jan 28 15:16:21.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.196470328s
Jan 28 15:16:23.349: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.201254706s
Jan 28 15:16:25.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.196997477s
Jan 28 15:16:27.346: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.197949459s
Jan 28 15:16:29.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.194857753s
Jan 28 15:16:31.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.194739177s
Jan 28 15:16:33.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.194196022s
Jan 28 15:16:35.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.194971099s
Jan 28 15:16:37.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.194947693s
Jan 28 15:16:39.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.194749634s
Jan 28 15:16:41.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.19475231s
Jan 28 15:16:43.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.194032199s
Jan 28 15:16:45.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.194722998s
Jan 28 15:16:47.346: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.197705874s
Jan 28 15:16:49.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.194898481s
Jan 28 15:16:51.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.195014321s
Jan 28 15:16:53.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.194560549s
Jan 28 15:16:55.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.194560973s
Jan 28 15:16:57.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.19472718s
Jan 28 15:16:59.345: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.197114455s
Jan 28 15:17:01.344: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.195518084s
Jan 28 15:17:03.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.195054422s
Jan 28 15:17:05.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.194461191s
Jan 28 15:17:07.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.194504289s
Jan 28 15:17:09.343: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.19446395s
Jan 28 15:17:11.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.194149535s
Jan 28 15:17:13.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.194378656s
Jan 28 15:17:15.342: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.194288941s
Jan 28 15:17:15.439: INFO: Pod "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.291303011s
Jan 28 15:17:15.440: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc00359cf60>: {
        msg: "timed out while waiting for pod runtimeclass-7769/test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc003090480>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg",
                    GenerateName: "test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclass-",
                    Namespace: "runtimeclass-7769",
                    SelfLink: "",
                    UID: "a76fb05d-cc89-4a55-9460-348e4bdd4b34",
                    ResourceVersion: "18964",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810515535,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810515535,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810515536,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: {
                        "fizz-9f74c685-231d-4f77-98f5-ec6f3925b85f": "buzz",
                        "foo-44766b62-b1b1-46a2-80d0-439cfec855e0": "bar",
                    },
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0db7f364fb385f093",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-7769/test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/28/23 15:17:15.44
< Exit [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/28/23 15:17:15.44 (5m6.506s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 15:17:15.44
Jan 28 15:17:15.440: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 15:17:15.541 (100ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 15:17:15.541
STEP: removing the label fizz-9f74c685-231d-4f77-98f5-ec6f3925b85f off the node i-0db7f364fb385f093 - test/e2e/framework/node/helper.go:72 @ 01/28/23 15:17:15.541
STEP: verifying the node doesn't have the label fizz-9f74c685-231d-4f77-98f5-ec6f3925b85f - test/e2e/framework/node/helper.go:75 @ 01/28/23 15:17:15.744
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 15:17:15.841 (300ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 15:17:15.841
STEP: removing the label foo-44766b62-b1b1-46a2-80d0-439cfec855e0 off the node i-0db7f364fb385f093 - test/e2e/framework/node/helper.go:72 @ 01/28/23 15:17:15.841
STEP: verifying the node doesn't have the label foo-44766b62-b1b1-46a2-80d0-439cfec855e0 - test/e2e/framework/node/helper.go:75 @ 01/28/23 15:17:16.045
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 15:17:16.147 (306ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 15:17:16.147
STEP: Deleting pod hostexec-i-090e4849bc17a4dcb-vlp97 in namespace runtimeclass-7769 - test/e2e/framework/pod/delete.go:41 @ 01/28/23 15:17:16.147
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 15:17:16.254 (107ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 15:17:16.254
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 15:17:16.254 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 15:17:16.254
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 15:17:16.254
STEP: Collecting events from namespace "runtimeclass-7769". - test/e2e/framework/debug/dump.go:42 @ 01/28/23 15:17:16.254
STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 01/28/23 15:17:16.355
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:09 +0000 UTC - event for hostexec-i-090e4849bc17a4dcb-vlp97: {default-scheduler } Scheduled: Successfully assigned runtimeclass-7769/hostexec-i-090e4849bc17a4dcb-vlp97 to i-090e4849bc17a4dcb
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:10 +0000 UTC - event for hostexec-i-090e4849bc17a4dcb-vlp97: {kubelet i-090e4849bc17a4dcb} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:10 +0000 UTC - event for hostexec-i-090e4849bc17a4dcb-vlp97: {kubelet i-090e4849bc17a4dcb} Created: Created container agnhost-container
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:10 +0000 UTC - event for hostexec-i-090e4849bc17a4dcb-vlp97: {kubelet i-090e4849bc17a4dcb} Started: Started container agnhost-container
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:12 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned runtimeclass-7769/without-label to i-0db7f364fb385f093
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:12 +0000 UTC - event for without-label: {kubelet i-0db7f364fb385f093} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:12 +0000 UTC - event for without-label: {kubelet i-0db7f364fb385f093} Created: Created container without-label
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:12 +0000 UTC - event for without-label: {kubelet i-0db7f364fb385f093} Started: Started container without-label
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:15 +0000 UTC - event for test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg: {default-scheduler } Scheduled: Successfully assigned runtimeclass-7769/test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg to i-0db7f364fb385f093
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:15 +0000 UTC - event for test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg: {kubelet i-0db7f364fb385f093} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:12:15 +0000 UTC - event for without-label: {kubelet i-0db7f364fb385f093} Killing: Stopping container without-label
Jan 28 15:17:16.355: INFO: At 2023-01-28 15:17:16 +0000 UTC - event for hostexec-i-090e4849bc17a4dcb-vlp97: {kubelet i-090e4849bc17a4dcb} Killing: Stopping container agnhost-container
Jan 28 15:17:16.452: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 28 15:17:16.452: INFO: test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg  i-0db7f364fb385f093  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:12:15 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:12:15 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:12:15 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 15:12:15 +0000 UTC  }]
Jan 28 15:17:16.452: INFO: 
Jan 28 15:17:16.551: INFO: Unable to fetch runtimeclass-7769/test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg)
Jan 28 15:17:16.649: INFO: 
Logging node info for node i-090e4849bc17a4dcb
Jan 28 15:17:16.746: INFO: Node Info: &Node{ObjectMeta:{i-090e4849bc17a4dcb    8e7f8e02-01a8-4c6b-b433-e34bb482077e 30462 0 2023-01-28 15:02:56 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-090e4849bc17a4dcb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-090e4849bc17a4dcb topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-090e4849bc17a4dcb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-28 15:17:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-090e4849bc17a4dcb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:03 +0000 UTC,LastTransitionTime:2023-01-28 15:02:56 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:03 +0000 UTC,LastTransitionTime:2023-01-28 15:02:56 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:03 +0000 UTC,LastTransitionTime:2023-01-28 15:02:56 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:17:03 +0000 UTC,LastTransitionTime:2023-01-28 15:03:07 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.179,},NodeAddress{Type:ExternalIP,Address:3.8.173.76,},NodeAddress{Type:InternalDNS,Address:i-090e4849bc17a4dcb.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-090e4849bc17a4dcb.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-8-173-76.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2f2336fc00535ab72a4ad2995af2f0,SystemUUID:ec2f2336-fc00-535a-b72a-4ad2995af2f0,BootID:e133a2b3-0d66-4aa9-aad0-46abf361391b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 15:17:16.747: INFO: 
Logging kubelet events for node i-090e4849bc17a4dcb
Jan 28 15:17:16.847: INFO: 
Logging pods the kubelet thinks is on node i-090e4849bc17a4dcb
Jan 28 15:17:16.963: INFO: replace-27915316-s7xkp started at 2023-01-28 15:16:00 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:16.963: INFO: 	Container c ready: false, restart count 0
Jan 28 15:17:16.963: INFO: dns-test-4b98db69-8dda-4464-ae58-fc2c59b8a528 started at 2023-01-28 15:17:12 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:16.963: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 28 15:17:16.963: INFO: 	Container querier ready: true, restart count 0
Jan 28 15:17:16.963: INFO: 	Container webserver ready: true, restart count 0
Jan 28 15:17:16.963: INFO: ebs-csi-node-dt6sf started at 2023-01-28 15:02:56 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:16.963: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:16.963: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:16.963: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:17:16.963: INFO: httpd started at 2023-01-28 15:17:14 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:16.963: INFO: 	Container httpd ready: false, restart count 0
Jan 28 15:17:16.963: INFO: concurrent-27915316-672qd started at 2023-01-28 15:16:00 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:16.963: INFO: 	Container c ready: false, restart count 0
Jan 28 15:17:16.963: INFO: cilium-zjqvc started at 2023-01-28 15:02:56 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:17:16.963: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:17:16.963: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:17:17.347: INFO: 
Latency metrics for node i-090e4849bc17a4dcb
Jan 28 15:17:17.347: INFO: 
Logging node info for node i-0c33ecedcb182e846
Jan 28 15:17:17.444: INFO: Node Info: &Node{ObjectMeta:{i-0c33ecedcb182e846    d13a3e9f-6a4c-4f5f-bf0f-92101c30b10d 30601 0 2023-01-28 15:02:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0c33ecedcb182e846 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0c33ecedcb182e846 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c33ecedcb182e846"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-28 15:17:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-28 15:17:16 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0c33ecedcb182e846,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:09 +0000 UTC,LastTransitionTime:2023-01-28 15:02:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:09 +0000 UTC,LastTransitionTime:2023-01-28 15:02:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:09 +0000 UTC,LastTransitionTime:2023-01-28 15:02:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:17:09 +0000 UTC,LastTransitionTime:2023-01-28 15:03:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.45.213,},NodeAddress{Type:ExternalIP,Address:18.135.27.112,},NodeAddress{Type:InternalDNS,Address:i-0c33ecedcb182e846.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c33ecedcb182e846.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-135-27-112.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2adf731f7611bdd0bab1596dff43f3,SystemUUID:ec2adf73-1f76-11bd-d0ba-b1596dff43f3,BootID:a75d8321-e66c-473b-be35-413aaa0ff41e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0dc82c8e79fe89526],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-082ad06515f04b584,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0dc82c8e79fe89526,DevicePath:,},},Config:nil,},}
Jan 28 15:17:17.445: INFO: 
Logging kubelet events for node i-0c33ecedcb182e846
Jan 28 15:17:17.545: INFO: 
Logging pods the kubelet thinks is on node i-0c33ecedcb182e846
Jan 28 15:17:17.647: INFO: busybox-dcb38a93-923f-4917-b5b9-18d699c2ea07 started at 2023-01-28 15:16:46 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container busybox ready: false, restart count 0
Jan 28 15:17:17.647: INFO: ebs-csi-node-22mmt started at 2023-01-28 15:02:53 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:17:17.647: INFO: pod-47a5bb59-031f-4816-95aa-5f86ba049e9f started at 2023-01-28 15:17:13 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container write-pod ready: false, restart count 0
Jan 28 15:17:17.647: INFO: hostexec-i-0c33ecedcb182e846-pnk7p started at 2023-01-28 15:13:38 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:17:17.647: INFO: send-events-dff2bfb4-f1ed-4356-bda2-5c2c733c56f6 started at 2023-01-28 15:16:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container p ready: true, restart count 0
Jan 28 15:17:17.647: INFO: test-webserver-c54d0c98-43aa-4896-b71e-1c47c8d99bcb started at 2023-01-28 15:16:17 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container test-webserver ready: true, restart count 0
Jan 28 15:17:17.647: INFO: ebs-csi-controller-555658678f-gfjzq started at 2023-01-28 15:03:04 +0000 UTC (0+5 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:17.647: INFO: cilium-75jdq started at 2023-01-28 15:02:53 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:17:17.647: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:17:17.647: INFO: inline-volume-tester-7znq4 started at 2023-01-28 15:16:50 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:17.647: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 28 15:17:18.031: INFO: 
Latency metrics for node i-0c33ecedcb182e846
Jan 28 15:17:18.031: INFO: 
Logging node info for node i-0db7f364fb385f093
Jan 28 15:17:18.128: INFO: Node Info: &Node{ObjectMeta:{i-0db7f364fb385f093    1c64e0ac-e151-4b43-a745-26860a60c98e 30598 0 2023-01-28 15:02:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0db7f364fb385f093 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0db7f364fb385f093 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3169":"i-0db7f364fb385f093","ebs.csi.aws.com":"i-0db7f364fb385f093"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:16:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 15:17:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0db7f364fb385f093,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:16:48 +0000 UTC,LastTransitionTime:2023-01-28 15:02:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:16:48 +0000 UTC,LastTransitionTime:2023-01-28 15:02:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:16:48 +0000 UTC,LastTransitionTime:2023-01-28 15:02:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:16:48 +0000 UTC,LastTransitionTime:2023-01-28 15:03:02 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.74,},NodeAddress{Type:ExternalIP,Address:13.40.45.254,},NodeAddress{Type:InternalDNS,Address:i-0db7f364fb385f093.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0db7f364fb385f093.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-40-45-254.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb74910856eb4e9dc32cd8c13ab7,SystemUUID:ec2dcb74-9108-56eb-4e9d-c32cd8c13ab7,BootID:8aef2dc5-3af2-4fbf-b2f9-b28d0adf9c59,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3169^c1a9df1e-9f1e-11ed-a5a1-62a11415ac4b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3169^c1a9df1e-9f1e-11ed-a5a1-62a11415ac4b,DevicePath:,},},Config:nil,},}
Jan 28 15:17:18.129: INFO: 
Logging kubelet events for node i-0db7f364fb385f093
Jan 28 15:17:18.229: INFO: 
Logging pods the kubelet thinks is on node i-0db7f364fb385f093
Jan 28 15:17:18.334: INFO: csi-hostpathplugin-0 started at 2023-01-28 15:16:34 +0000 UTC (0+7 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:17:18.334: INFO: ebs-csi-controller-555658678f-2bwj9 started at 2023-01-28 15:03:02 +0000 UTC (0+5 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:18.334: INFO: pod-client started at 2023-01-28 15:16:42 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container pod-client ready: true, restart count 0
Jan 28 15:17:18.334: INFO: coredns-autoscaler-7cb5c5b969-vzlgv started at 2023-01-28 15:03:02 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container autoscaler ready: true, restart count 0
Jan 28 15:17:18.334: INFO: test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg started at 2023-01-28 15:12:15 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container test ready: false, restart count 0
Jan 28 15:17:18.334: INFO: ebs-csi-node-xcm7s started at 2023-01-28 15:02:51 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:17:18.334: INFO: inline-volume-tester-rpjmj started at 2023-01-28 15:16:37 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 28 15:17:18.334: INFO: coredns-559769c974-7tb5n started at 2023-01-28 15:03:02 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container coredns ready: true, restart count 0
Jan 28 15:17:18.334: INFO: pod-csi-inline-volumes started at 2023-01-28 15:15:48 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Container pod-csi-inline-volumes ready: false, restart count 0
Jan 28 15:17:18.334: INFO: cilium-44xdm started at 2023-01-28 15:02:51 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:17:18.334: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:17:18.334: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:17:18.727: INFO: 
Latency metrics for node i-0db7f364fb385f093
Jan 28 15:17:18.727: INFO: 
Logging node info for node i-0f616ec509cf9f485
Jan 28 15:17:18.825: INFO: Node Info: &Node{ObjectMeta:{i-0f616ec509cf9f485    d645e179-cb42-4b06-91d4-29d5340ecbd4 20926 0 2023-01-28 15:00:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0f616ec509cf9f485 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-west-2a topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f616ec509cf9f485"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-28 15:00:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-28 15:00:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:01:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:01:12 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-28 15:01:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-28 15:13:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0f616ec509cf9f485,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002136064 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897278464 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:13:03 +0000 UTC,LastTransitionTime:2023-01-28 14:59:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:13:03 +0000 UTC,LastTransitionTime:2023-01-28 14:59:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:13:03 +0000 UTC,LastTransitionTime:2023-01-28 14:59:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:13:03 +0000 UTC,LastTransitionTime:2023-01-28 15:01:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.69,},NodeAddress{Type:ExternalIP,Address:35.178.176.116,},NodeAddress{Type:InternalDNS,Address:i-0f616ec509cf9f485.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f616ec509cf9f485.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-178-176-116.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e630082df1392683fe382a5c35f,SystemUUID:ec244e63-0082-df13-9268-3fe382a5c35f,BootID:d79d958c-542d-42b7-9243-e9804d0b5206,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:56048433,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41190270,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39793987,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691073,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 15:17:18.825: INFO: 
Logging kubelet events for node i-0f616ec509cf9f485
Jan 28 15:17:18.926: INFO: 
Logging pods the kubelet thinks is on node i-0f616ec509cf9f485
Jan 28 15:17:19.031: INFO: kube-controller-manager-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 28 15:17:19.031: INFO: etcd-manager-main-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (10+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 15:17:19.031: INFO: cilium-nq9gc started at 2023-01-28 15:01:05 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:17:19.031: INFO: ebs-csi-node-pgxlx started at 2023-01-28 15:01:05 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:17:19.031: INFO: kops-controller-v55qz started at 2023-01-28 15:01:05 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container kops-controller ready: true, restart count 0
Jan 28 15:17:19.031: INFO: dns-controller-85d56fc6db-8wvnc started at 2023-01-28 15:01:06 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container dns-controller ready: true, restart count 0
Jan 28 15:17:19.031: INFO: kube-apiserver-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (0+2 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container healthcheck ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Container kube-apiserver ready: true, restart count 2
Jan 28 15:17:19.031: INFO: kube-scheduler-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 28 15:17:19.031: INFO: etcd-manager-events-i-0f616ec509cf9f485 started at 2023-01-28 14:58:44 +0000 UTC (10+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 15:17:19.031: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 15:17:19.031: INFO: aws-cloud-controller-manager-4sppk started at 2023-01-28 15:01:05 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 28 15:17:19.031: INFO: cilium-operator-6f7d7f696f-lqr79 started at 2023-01-28 15:01:06 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.031: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 28 15:17:19.404: INFO: 
Latency metrics for node i-0f616ec509cf9f485
Jan 28 15:17:19.404: INFO: 
Logging node info for node i-0fe295a079018be45
Jan 28 15:17:19.505: INFO: Node Info: &Node{ObjectMeta:{i-0fe295a079018be45    5d6b77cd-0f97-410b-83fc-4e3b4ec3b3ee 30667 0 2023-01-28 15:02:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0fe295a079018be45 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0fe295a079018be45 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fe295a079018be45"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 15:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-28 15:17:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-28 15:17:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0fe295a079018be45,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:11 +0000 UTC,LastTransitionTime:2023-01-28 15:02:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:11 +0000 UTC,LastTransitionTime:2023-01-28 15:02:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 15:17:11 +0000 UTC,LastTransitionTime:2023-01-28 15:02:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 15:17:11 +0000 UTC,LastTransitionTime:2023-01-28 15:03:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.162,},NodeAddress{Type:ExternalIP,Address:18.135.6.107,},NodeAddress{Type:InternalDNS,Address:i-0fe295a079018be45.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fe295a079018be45.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-135-6-107.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec268acacfc07b6f718f591a201822cf,SystemUUID:ec268aca-cfc0-7b6f-718f-591a201822cf,BootID:7b418cfb-0602-442b-8f63-f0867ea10d16,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,KubeProxyVersion:v1.27.0-alpha.1.69+d7cb1c54a540c9,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.69_d7cb1c54a540c9],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0d135da87b250d421],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d135da87b250d421,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0de037838133a5ec6,DevicePath:,},},Config:nil,},}
Jan 28 15:17:19.506: INFO: 
Logging kubelet events for node i-0fe295a079018be45
Jan 28 15:17:19.607: INFO: 
Logging pods the kubelet thinks is on node i-0fe295a079018be45
Jan 28 15:17:19.710: INFO: ebs-csi-node-9szrl started at 2023-01-28 15:02:54 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 15:17:19.710: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 15:17:19.710: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 15:17:19.710: INFO: inline-volume-tester-v4p9n started at 2023-01-28 15:17:13 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 28 15:17:19.710: INFO: coredns-559769c974-7tsms started at 2023-01-28 15:03:32 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container coredns ready: true, restart count 0
Jan 28 15:17:19.710: INFO: pod-service-account-defaultsa-nomountspec started at 2023-01-28 15:17:18 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container token-test ready: false, restart count 0
Jan 28 15:17:19.710: INFO: cilium-44s2c started at 2023-01-28 15:02:54 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 15:17:19.710: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 15:17:19.710: INFO: dns-test-0f5d25c0-c5aa-44be-8e8b-ed5c2a7e13c3 started at 2023-01-28 15:17:05 +0000 UTC (0+3 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 28 15:17:19.710: INFO: 	Container querier ready: true, restart count 0
Jan 28 15:17:19.710: INFO: 	Container webserver ready: true, restart count 0
Jan 28 15:17:19.710: INFO: pod-server-1 started at 2023-01-28 15:16:44 +0000 UTC (1+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Init container init ready: true, restart count 0
Jan 28 15:17:19.710: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:17:19.710: INFO: pod-configmaps-3be69ee6-a6b8-430d-a587-e1f3047c8218 started at 2023-01-28 15:16:17 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 15:17:19.710: INFO: concurrent-27915317-94cjt started at 2023-01-28 15:17:00 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container c ready: false, restart count 0
Jan 28 15:17:19.710: INFO: inline-volume-tester-gtf88 started at 2023-01-28 15:15:30 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 28 15:17:19.710: INFO: test-runtimeclass-runtimeclass-605-preconfigured-handler-dgn7g started at 2023-01-28 15:13:45 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container test ready: false, restart count 0
Jan 28 15:17:19.710: INFO: pod-service-account-nomountsa-mountspec started at 2023-01-28 15:17:18 +0000 UTC (0+1 container statuses recorded)
Jan 28 15:17:19.710: INFO: 	Container token-test ready: false, restart count 0
Jan 28 15:17:20.089: INFO: 
Latency metrics for node i-0fe295a079018be45
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 15:17:20.089 (3.835s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 15:17:20.089 (3.836s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 15:17:20.089
STEP: Destroying namespace "runtimeclass-7769" for this suite. - test/e2e/framework/framework.go:347 @ 01/28/23 15:17:20.09
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 15:17:20.193 (103ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 15:17:20.193
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 15:17:20.193 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-7769/test-runtimeclass-runtimeclass-7769-non-conflict-runtimeclxqttg mentions in log files | View test history on testgrid

kubetest2 Test 20m43s

exit status 255
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 895 Passed Tests

Show 6516 Skipped Tests

Result	FAILURE
Tests	3 failed / 895 succeeded
Started	2023-01-28 14:55
Elapsed	34m37s
Revision	master