e2e-kops-warm-pool #1619589750136508416 Results

Test Failures

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] 5m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sa\sconfigured\shandler\s\[NodeFeature\:RuntimeHandler\]$'

[FAILED] timed out while waiting for pod runtimeclass-8473/test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8 to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/29/23 07:25:21.689

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 07:20:13.44
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 07:20:13.44
Jan 29 07:20:13.440: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/29/23 07:20:13.441
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 07:20:13.735
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 07:20:13.926
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 07:20:14.118 (678ms)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 07:20:14.118
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 07:20:14.119 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/29/23 07:20:14.119
Jan 29 07:20:14.322: INFO: Waiting up to 5m0s for pod "hostexec-i-00c047f1af46a1f62-hjq79" in namespace "runtimeclass-8473" to be "running"
Jan 29 07:20:14.419: INFO: Pod "hostexec-i-00c047f1af46a1f62-hjq79": Phase="Pending", Reason="", readiness=false. Elapsed: 96.592788ms
Jan 29 07:20:16.537: INFO: Pod "hostexec-i-00c047f1af46a1f62-hjq79": Phase="Pending", Reason="", readiness=false. Elapsed: 2.214657435s
Jan 29 07:20:18.522: INFO: Pod "hostexec-i-00c047f1af46a1f62-hjq79": Phase="Pending", Reason="", readiness=false. Elapsed: 4.199925616s
Jan 29 07:20:20.518: INFO: Pod "hostexec-i-00c047f1af46a1f62-hjq79": Phase="Running", Reason="", readiness=true. Elapsed: 6.196012838s
Jan 29 07:20:20.518: INFO: Pod "hostexec-i-00c047f1af46a1f62-hjq79" satisfied condition "running"
Jan 29 07:20:20.518: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-8473 PodName:hostexec-i-00c047f1af46a1f62-hjq79 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 29 07:20:20.518: INFO: >>> kubeConfig: /root/.kube/config
Jan 29 07:20:20.519: INFO: ExecWithOptions: Clientset creation
Jan 29 07:20:20.519: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-b553a70509257ecd.elb.eu-west-2.amazonaws.com/api/v1/namespaces/runtimeclass-8473/pods/hostexec-i-00c047f1af46a1f62-hjq79/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
Jan 29 07:20:21.395: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8" in namespace "runtimeclass-8473" to be "Succeeded or Failed"
Jan 29 07:20:21.492: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 96.881667ms
Jan 29 07:20:23.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.195000833s
Jan 29 07:20:25.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.195247352s
Jan 29 07:20:27.595: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.200283768s
Jan 29 07:20:29.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.194478903s
Jan 29 07:20:31.592: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.197339299s
Jan 29 07:20:33.594: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.198424315s
Jan 29 07:20:35.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 14.195049405s
Jan 29 07:20:37.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 16.196015565s
Jan 29 07:20:39.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 18.195665811s
Jan 29 07:20:41.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 20.194673675s
Jan 29 07:20:43.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 22.195696304s
Jan 29 07:20:45.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 24.195106887s
Jan 29 07:20:47.595: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 26.199892955s
Jan 29 07:20:49.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 28.195782611s
Jan 29 07:20:51.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 30.194998386s
Jan 29 07:20:53.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 32.195690136s
Jan 29 07:20:55.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 34.195666737s
Jan 29 07:20:57.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 36.19588484s
Jan 29 07:20:59.613: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 38.21775112s
Jan 29 07:21:01.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 40.195352618s
Jan 29 07:21:03.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 42.195230589s
Jan 29 07:21:05.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 44.196279994s
Jan 29 07:21:07.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 46.195656919s
Jan 29 07:21:09.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 48.195774345s
Jan 29 07:21:11.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 50.195598502s
Jan 29 07:21:13.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 52.195669334s
Jan 29 07:21:15.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 54.195699831s
Jan 29 07:21:17.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 56.195725795s
Jan 29 07:21:19.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 58.195776504s
Jan 29 07:21:21.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.195164562s
Jan 29 07:21:23.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.195959415s
Jan 29 07:21:25.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.19562635s
Jan 29 07:21:27.592: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.19678022s
Jan 29 07:21:29.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.195527296s
Jan 29 07:21:31.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.195534726s
Jan 29 07:21:33.592: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.196666201s
Jan 29 07:21:35.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.195847856s
Jan 29 07:21:37.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.195634328s
Jan 29 07:21:39.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.195763318s
Jan 29 07:21:41.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.195532372s
Jan 29 07:21:43.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.194744708s
Jan 29 07:21:45.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.194455251s
Jan 29 07:21:47.594: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.198778258s
Jan 29 07:21:49.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.195473531s
Jan 29 07:21:51.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.196047251s
Jan 29 07:21:53.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.195651863s
Jan 29 07:21:55.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.196015625s
Jan 29 07:21:57.597: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.202100099s
Jan 29 07:21:59.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.195894539s
Jan 29 07:22:01.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.195737412s
Jan 29 07:22:03.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.195202389s
Jan 29 07:22:05.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.194821945s
Jan 29 07:22:07.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.195663622s
Jan 29 07:22:09.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.195613618s
Jan 29 07:22:11.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.195374449s
Jan 29 07:22:13.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.195580099s
Jan 29 07:22:15.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.196216795s
Jan 29 07:22:17.593: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.197976887s
Jan 29 07:22:19.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.19628741s
Jan 29 07:22:21.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.195977616s
Jan 29 07:22:23.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.195697609s
Jan 29 07:22:25.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.195538744s
Jan 29 07:22:27.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.195848597s
Jan 29 07:22:29.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.19588416s
Jan 29 07:22:31.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.195982536s
Jan 29 07:22:33.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.195403796s
Jan 29 07:22:35.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.195411462s
Jan 29 07:22:37.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.195697324s
Jan 29 07:22:39.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.19573536s
Jan 29 07:22:41.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.1957636s
Jan 29 07:22:43.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.195339617s
Jan 29 07:22:45.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.195554836s
Jan 29 07:22:47.592: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.197153463s
Jan 29 07:22:49.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.195285733s
Jan 29 07:22:51.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.195818238s
Jan 29 07:22:53.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.195459243s
Jan 29 07:22:55.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.195071947s
Jan 29 07:22:57.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.195771574s
Jan 29 07:22:59.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.195652739s
Jan 29 07:23:01.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.195713281s
Jan 29 07:23:03.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.195531402s
Jan 29 07:23:05.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.194702581s
Jan 29 07:23:07.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.195232043s
Jan 29 07:23:09.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.195889069s
Jan 29 07:23:11.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.195454042s
Jan 29 07:23:13.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.195687332s
Jan 29 07:23:15.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.195067818s
Jan 29 07:23:17.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.195578948s
Jan 29 07:23:19.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.195545817s
Jan 29 07:23:21.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.195860029s
Jan 29 07:23:23.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.195694791s
Jan 29 07:23:25.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.194816203s
Jan 29 07:23:27.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.195147445s
Jan 29 07:23:29.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.195905999s
Jan 29 07:23:31.599: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.203501893s
Jan 29 07:23:33.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.195106147s
Jan 29 07:23:35.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.195347595s
Jan 29 07:23:37.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.195720185s
Jan 29 07:23:39.593: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.198293967s
Jan 29 07:23:41.594: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.198905548s
Jan 29 07:23:43.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.195442347s
Jan 29 07:23:45.595: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.199658192s
Jan 29 07:23:47.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.196066322s
Jan 29 07:23:49.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.196056491s
Jan 29 07:23:51.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.195731849s
Jan 29 07:23:53.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.194716562s
Jan 29 07:23:55.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.195215808s
Jan 29 07:23:57.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.195126063s
Jan 29 07:23:59.595: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.200352374s
Jan 29 07:24:01.593: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.197968345s
Jan 29 07:24:03.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.195505425s
Jan 29 07:24:05.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.195091955s
Jan 29 07:24:07.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.195651055s
Jan 29 07:24:09.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.195753877s
Jan 29 07:24:11.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.19575749s
Jan 29 07:24:13.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.195624744s
Jan 29 07:24:15.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.195512853s
Jan 29 07:24:17.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.195735585s
Jan 29 07:24:19.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.195120721s
Jan 29 07:24:21.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.195776878s
Jan 29 07:24:23.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.195095956s
Jan 29 07:24:25.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.196113025s
Jan 29 07:24:27.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.195668902s
Jan 29 07:24:29.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.194939456s
Jan 29 07:24:31.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.196064714s
Jan 29 07:24:33.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.195093579s
Jan 29 07:24:35.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.194841445s
Jan 29 07:24:37.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.195962974s
Jan 29 07:24:39.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.196054121s
Jan 29 07:24:41.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.194641628s
Jan 29 07:24:43.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.195833585s
Jan 29 07:24:45.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.194392843s
Jan 29 07:24:47.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.195322436s
Jan 29 07:24:49.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.195523058s
Jan 29 07:24:51.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.19584875s
Jan 29 07:24:53.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.195710069s
Jan 29 07:24:55.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.195906528s
Jan 29 07:24:57.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.196061329s
Jan 29 07:24:59.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.195909894s
Jan 29 07:25:01.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.195453761s
Jan 29 07:25:03.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.195279142s
Jan 29 07:25:05.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.195747281s
Jan 29 07:25:07.592: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.196525326s
Jan 29 07:25:09.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.195879711s
Jan 29 07:25:11.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.195829162s
Jan 29 07:25:13.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.195376591s
Jan 29 07:25:15.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.19604965s
Jan 29 07:25:17.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.195887429s
Jan 29 07:25:19.591: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.195991378s
Jan 29 07:25:21.590: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.195265354s
Jan 29 07:25:21.688: INFO: Pod "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.293030516s
Jan 29 07:25:21.689: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc00243bc50>: {
        msg: "timed out while waiting for pod runtimeclass-8473/test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8 to be Succeeded or Failed",
        observedObjects: [
            <*v1.Pod | 0xc003599b00>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8",
                    GenerateName: "test-runtimeclass-runtimeclass-8473-preconfigured-handler-",
                    Namespace: "runtimeclass-8473",
                    SelfLink: "",
                    UID: "4ae5af4c-5376-4446-96e9-4605bfc056cb",
                    ResourceVersion: "39680",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810573621,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810573621,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810573622,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: nil,
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0fedaf155ff285b94",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
                        SupplementalGroups: nil,
                        FSGroup: nil,
                        Sysctls: nil,
                        FSGroupChangePolicy: nil,
               ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-8473/test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8 to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/29/23 07:25:21.689
< Exit [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/29/23 07:25:21.689 (5m7.571s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 07:25:21.689
Jan 29 07:25:21.689: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 07:25:21.788 (99ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/29/23 07:25:21.788
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/29/23 07:25:21.89 (102ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 07:25:21.89
STEP: Deleting pod hostexec-i-00c047f1af46a1f62-hjq79 in namespace runtimeclass-8473 - test/e2e/framework/pod/delete.go:41 @ 01/29/23 07:25:21.89
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 07:25:21.997 (107ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 07:25:21.997
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 07:25:21.997 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 07:25:21.997
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 07:25:21.997
STEP: Collecting events from namespace "runtimeclass-8473". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 07:25:21.997
STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 07:25:22.095
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:20:14 +0000 UTC - event for hostexec-i-00c047f1af46a1f62-hjq79: {default-scheduler } Scheduled: Successfully assigned runtimeclass-8473/hostexec-i-00c047f1af46a1f62-hjq79 to i-00c047f1af46a1f62
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:20:15 +0000 UTC - event for hostexec-i-00c047f1af46a1f62-hjq79: {kubelet i-00c047f1af46a1f62} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:20:15 +0000 UTC - event for hostexec-i-00c047f1af46a1f62-hjq79: {kubelet i-00c047f1af46a1f62} Created: Created container agnhost-container
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:20:15 +0000 UTC - event for hostexec-i-00c047f1af46a1f62-hjq79: {kubelet i-00c047f1af46a1f62} Started: Started container agnhost-container
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:20:21 +0000 UTC - event for test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8: {default-scheduler } Scheduled: Successfully assigned runtimeclass-8473/test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8 to i-0fedaf155ff285b94
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:20:21 +0000 UTC - event for test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8: {kubelet i-0fedaf155ff285b94} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 29 07:25:22.095: INFO: At 2023-01-29 07:25:21 +0000 UTC - event for hostexec-i-00c047f1af46a1f62-hjq79: {kubelet i-00c047f1af46a1f62} Killing: Stopping container agnhost-container
Jan 29 07:25:22.193: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 29 07:25:22.193: INFO: test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8  i-0fedaf155ff285b94  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:20:21 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:20:21 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:20:21 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:20:21 +0000 UTC  }]
Jan 29 07:25:22.193: INFO: 
Jan 29 07:25:22.292: INFO: Unable to fetch runtimeclass-8473/test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8)
Jan 29 07:25:22.391: INFO: 
Logging node info for node i-00c047f1af46a1f62
Jan 29 07:25:22.489: INFO: Node Info: &Node{ObjectMeta:{i-00c047f1af46a1f62    e988c056-eb98-44b7-a9ab-e097d838cb1e 49319 0 2023-01-29 07:02:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-00c047f1af46a1f62 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-00c047f1af46a1f62 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00c047f1af46a1f62"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-29 07:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-00c047f1af46a1f62,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:24:27 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:24:27 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:24:27 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:24:27 +0000 UTC,LastTransitionTime:2023-01-29 07:02:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.82,},NodeAddress{Type:ExternalIP,Address:35.178.51.242,},NodeAddress{Type:InternalDNS,Address:i-00c047f1af46a1f62.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-00c047f1af46a1f62.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-178-51-242.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2101ac8eeb771cde2a947e8a939375,SystemUUID:ec2101ac-8eeb-771c-de2a-947e8a939375,BootID:9d9adf2c-3121-466e-9f00-61f620d66f70,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 07:25:22.489: INFO: 
Logging kubelet events for node i-00c047f1af46a1f62
Jan 29 07:25:22.591: INFO: 
Logging pods the kubelet thinks is on node i-00c047f1af46a1f62
Jan 29 07:25:22.692: INFO: ebs-csi-node-g8mzr started at 2023-01-29 07:02:43 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:25:22.692: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:25:22.692: INFO: cilium-ch5v8 started at 2023-01-29 07:02:43 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:25:22.692: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:25:22.692: INFO: ebs-csi-controller-555658678f-4jqzf started at 2023-01-29 07:02:57 +0000 UTC (0+5 container statuses recorded)
Jan 29 07:25:22.692: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:22.692: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:22.692: INFO: concurrent-27916284-h22sn started at 2023-01-29 07:24:00 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:22.692: INFO: 	Container c ready: true, restart count 0
Jan 29 07:25:23.082: INFO: 
Latency metrics for node i-00c047f1af46a1f62
Jan 29 07:25:23.082: INFO: 
Logging node info for node i-00d709d8fa76f2551
Jan 29 07:25:23.180: INFO: Node Info: &Node{ObjectMeta:{i-00d709d8fa76f2551    ab8d2d7a-cbd3-468f-82eb-b7f6a40e02b6 46936 0 2023-01-29 07:00:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-00d709d8fa76f2551 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-west-2a topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d709d8fa76f2551"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 07:00:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-29 07:00:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:01:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:01:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 07:01:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 07:23:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-00d709d8fa76f2551,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002131968 0} {<nil>} 3908332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897274368 0} {<nil>} 3805932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:23:26 +0000 UTC,LastTransitionTime:2023-01-29 07:00:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:23:26 +0000 UTC,LastTransitionTime:2023-01-29 07:00:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:23:26 +0000 UTC,LastTransitionTime:2023-01-29 07:00:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:23:26 +0000 UTC,LastTransitionTime:2023-01-29 07:01:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.126,},NodeAddress{Type:ExternalIP,Address:3.10.24.208,},NodeAddress{Type:InternalDNS,Address:i-00d709d8fa76f2551.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-00d709d8fa76f2551.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-10-24-208.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2354ce541dd3ae7d3955a40cbb68b6,SystemUUID:ec2354ce-541d-d3ae-7d39-55a40cbb68b6,BootID:71d1f536-30e7-4b46-a851-35658b79289b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41194354,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39794006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691090,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 07:25:23.180: INFO: 
Logging kubelet events for node i-00d709d8fa76f2551
Jan 29 07:25:23.282: INFO: 
Logging pods the kubelet thinks is on node i-00d709d8fa76f2551
Jan 29 07:25:23.399: INFO: aws-cloud-controller-manager-2w527 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:23.399: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 29 07:25:23.399: INFO: ebs-csi-node-s28x5 started at 2023-01-29 07:00:54 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:25:23.399: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:23.399: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:23.399: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:25:23.399: INFO: kops-controller-qsv47 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:23.399: INFO: 	Container kops-controller ready: true, restart count 0
Jan 29 07:25:23.399: INFO: dns-controller-85d56fc6db-lmgc9 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Container dns-controller ready: true, restart count 0
Jan 29 07:25:23.400: INFO: cilium-operator-6f7d7f696f-rlc44 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Container cilium-operator ready: true, restart count 1
Jan 29 07:25:23.400: INFO: cilium-sshlz started at 2023-01-29 07:00:54 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Container cilium-agent ready: true, restart count 1
Jan 29 07:25:23.400: INFO: etcd-manager-events-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (10+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 07:25:23.400: INFO: etcd-manager-main-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (10+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 07:25:23.400: INFO: kube-apiserver-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (0+2 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Container healthcheck ready: true, restart count 0
Jan 29 07:25:23.400: INFO: 	Container kube-apiserver ready: true, restart count 3
Jan 29 07:25:23.400: INFO: kube-controller-manager-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 29 07:25:23.400: INFO: kube-scheduler-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:23.400: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 29 07:25:23.750: INFO: 
Latency metrics for node i-00d709d8fa76f2551
Jan 29 07:25:23.750: INFO: 
Logging node info for node i-063f79c0cb7f4f040
Jan 29 07:25:23.848: INFO: Node Info: &Node{ObjectMeta:{i-063f79c0cb7f4f040    d8ef756d-dcd1-459f-a354-e2c2bffea1c6 49795 0 2023-01-29 07:02:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-063f79c0cb7f4f040 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-063f79c0cb7f4f040 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-063f79c0cb7f4f040"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:24:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-063f79c0cb7f4f040,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:24:59 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:24:59 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:24:59 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:24:59 +0000 UTC,LastTransitionTime:2023-01-29 07:02:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.136,},NodeAddress{Type:ExternalIP,Address:3.9.115.216,},NodeAddress{Type:InternalDNS,Address:i-063f79c0cb7f4f040.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-063f79c0cb7f4f040.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-9-115-216.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec271b2402a3efafccb7bfc6be27d556,SystemUUID:ec271b24-02a3-efaf-ccb7-bfc6be27d556,BootID:a0e3ca54-a2da-417d-976d-a335529763d6,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 07:25:23.849: INFO: 
Logging kubelet events for node i-063f79c0cb7f4f040
Jan 29 07:25:23.953: INFO: 
Logging pods the kubelet thinks is on node i-063f79c0cb7f4f040
Jan 29 07:25:24.056: INFO: coredns-559769c974-fbtqn started at 2023-01-29 07:02:53 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.056: INFO: 	Container coredns ready: true, restart count 0
Jan 29 07:25:24.056: INFO: test-rolling-update-with-lb-5f94bf68d9-pzk5k started at 2023-01-29 07:24:51 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.056: INFO: 	Container agnhost ready: true, restart count 0
Jan 29 07:25:24.056: INFO: ebs-csi-node-ncd74 started at 2023-01-29 07:02:43 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:25:24.056: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:25:24.056: INFO: coredns-autoscaler-7cb5c5b969-n8w9t started at 2023-01-29 07:02:53 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.056: INFO: 	Container autoscaler ready: true, restart count 0
Jan 29 07:25:24.056: INFO: cilium-gxxwn started at 2023-01-29 07:02:43 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:25:24.056: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:25:24.056: INFO: ebs-csi-controller-555658678f-7dll7 started at 2023-01-29 07:02:53 +0000 UTC (0+5 container statuses recorded)
Jan 29 07:25:24.056: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:24.056: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:24.446: INFO: 
Latency metrics for node i-063f79c0cb7f4f040
Jan 29 07:25:24.446: INFO: 
Logging node info for node i-0ac8b87a87db3da76
Jan 29 07:25:24.544: INFO: Node Info: &Node{ObjectMeta:{i-0ac8b87a87db3da76    430e6d29-5527-44e3-b9a4-fb44207d4db2 49810 0 2023-01-29 07:02:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0ac8b87a87db3da76 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0ac8b87a87db3da76 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ac8b87a87db3da76"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 07:25:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0ac8b87a87db3da76,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.115,},NodeAddress{Type:ExternalIP,Address:13.40.101.163,},NodeAddress{Type:InternalDNS,Address:i-0ac8b87a87db3da76.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ac8b87a87db3da76.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-40-101-163.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2980fc304aaa7b60cd0ad806d67272,SystemUUID:ec2980fc-304a-aa7b-60cd-0ad806d67272,BootID:68f79d48-6f17-4b4e-9bfc-9c0132165ca9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 07:25:24.545: INFO: 
Logging kubelet events for node i-0ac8b87a87db3da76
Jan 29 07:25:24.647: INFO: 
Logging pods the kubelet thinks is on node i-0ac8b87a87db3da76
Jan 29 07:25:24.748: INFO: test-rolling-update-with-lb-5f94bf68d9-fx9vh started at 2023-01-29 07:24:49 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.748: INFO: 	Container agnhost ready: true, restart count 0
Jan 29 07:25:24.748: INFO: concurrent-27916285-j9slv started at 2023-01-29 07:25:00 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.748: INFO: 	Container c ready: true, restart count 0
Jan 29 07:25:24.748: INFO: execpodbnlhp started at 2023-01-29 07:22:53 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.748: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 07:25:24.748: INFO: funny-ip-9r8db started at 2023-01-29 07:22:43 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:24.748: INFO: 	Container funny-ip ready: true, restart count 0
Jan 29 07:25:24.748: INFO: ebs-csi-node-8jdwz started at 2023-01-29 07:02:44 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:25:24.748: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:24.748: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:24.748: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:25:24.748: INFO: cilium-kxs8k started at 2023-01-29 07:02:44 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:25:24.748: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:25:24.748: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:25:25.120: INFO: 
Latency metrics for node i-0ac8b87a87db3da76
Jan 29 07:25:25.120: INFO: 
Logging node info for node i-0fedaf155ff285b94
Jan 29 07:25:25.220: INFO: Node Info: &Node{ObjectMeta:{i-0fedaf155ff285b94    f96c7fbb-09ed-42da-aa8b-d229d367c4b2 50070 0 2023-01-29 07:02:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0fedaf155ff285b94 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0fedaf155ff285b94 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fedaf155ff285b94"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 07:25:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0fedaf155ff285b94,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:25:00 +0000 UTC,LastTransitionTime:2023-01-29 07:02:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.6,},NodeAddress{Type:ExternalIP,Address:3.8.160.228,},NodeAddress{Type:InternalDNS,Address:i-0fedaf155ff285b94.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fedaf155ff285b94.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-8-160-228.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2914ddef1a334e1af3000976d653c6,SystemUUID:ec2914dd-ef1a-334e-1af3-000976d653c6,BootID:2a4c4983-0f3c-40b2-9254-7d88d999910e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 07:25:25.220: INFO: 
Logging kubelet events for node i-0fedaf155ff285b94
Jan 29 07:25:25.325: INFO: 
Logging pods the kubelet thinks is on node i-0fedaf155ff285b94
Jan 29 07:25:25.426: INFO: ebs-csi-node-tb27f started at 2023-01-29 07:02:44 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:25:25.426: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:25:25.426: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:25:25.426: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:25:25.426: INFO: coredns-559769c974-68vjn started at 2023-01-29 07:03:20 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:25.426: INFO: 	Container coredns ready: true, restart count 0
Jan 29 07:25:25.426: INFO: httpd-deployment-7b78564759-5jw92 started at 2023-01-29 07:23:42 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:25.426: INFO: 	Container httpd ready: false, restart count 0
Jan 29 07:25:25.426: INFO: cilium-qjgkh started at 2023-01-29 07:02:44 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:25:25.426: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:25:25.426: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:25:25.426: INFO: test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8 started at 2023-01-29 07:20:21 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:25.426: INFO: 	Container test ready: false, restart count 0
Jan 29 07:25:25.426: INFO: test-rolling-update-with-lb-5f94bf68d9-fzg6p started at 2023-01-29 07:24:52 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:25:25.426: INFO: 	Container agnhost ready: true, restart count 0
Jan 29 07:25:25.827: INFO: 
Latency metrics for node i-0fedaf155ff285b94
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 07:25:25.827 (3.83s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 07:25:25.827 (3.83s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 07:25:25.827
STEP: Destroying namespace "runtimeclass-8473" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 07:25:25.827
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 07:25:25.929 (102ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 07:25:25.93
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 07:25:25.93 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-8473/test-runtimeclass-runtimeclass-8473-preconfigured-handler-255t8 mentions in log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints 5m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sscheduling\swithout\staints$'

[FAILED] timed out while waiting for pod runtimeclass-4226/test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/29/23 07:17:04.702

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 07:11:49.526
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 07:11:49.526
Jan 29 07:11:49.526: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/29/23 07:11:49.527
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 07:11:49.839
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 07:11:50.035
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 07:11:50.228 (702ms)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 07:11:50.228
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 07:11:50.228 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/29/23 07:11:50.228
Jan 29 07:11:50.430: INFO: Waiting up to 5m0s for pod "hostexec-i-0ac8b87a87db3da76-wjvp2" in namespace "runtimeclass-4226" to be "running"
Jan 29 07:11:50.530: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2": Phase="Pending", Reason="", readiness=false. Elapsed: 100.207823ms
Jan 29 07:11:52.629: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.199311936s
Jan 29 07:11:54.643: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.213612828s
Jan 29 07:11:56.629: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.198860128s
Jan 29 07:11:58.629: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.199059974s
Jan 29 07:12:00.630: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2": Phase="Running", Reason="", readiness=true. Elapsed: 10.199831399s
Jan 29 07:12:00.630: INFO: Pod "hostexec-i-0ac8b87a87db3da76-wjvp2" satisfied condition "running"
Jan 29 07:12:00.630: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-4226 PodName:hostexec-i-0ac8b87a87db3da76-wjvp2 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 29 07:12:00.630: INFO: >>> kubeConfig: /root/.kube/config
Jan 29 07:12:00.630: INFO: ExecWithOptions: Clientset creation
Jan 29 07:12:00.631: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-b553a70509257ecd.elb.eu-west-2.amazonaws.com/api/v1/namespaces/runtimeclass-4226/pods/hostexec-i-0ac8b87a87db3da76-wjvp2/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
STEP: Trying to launch a pod without a label to get a node which can launch it. - test/e2e/scheduling/predicates.go:1042 @ 01/29/23 07:12:01.294
Jan 29 07:12:01.393: INFO: Waiting up to 1m0s for pod "without-label" in namespace "runtimeclass-4226" to be "running"
Jan 29 07:12:01.494: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 101.000035ms
Jan 29 07:12:03.593: INFO: Pod "without-label": Phase="Running", Reason="", readiness=true. Elapsed: 2.200331928s
Jan 29 07:12:03.593: INFO: Pod "without-label" satisfied condition "running"
STEP: Explicitly delete pod here to free the resource it takes. - test/e2e/scheduling/predicates.go:973 @ 01/29/23 07:12:03.691
STEP: Trying to apply a label on the found node. - test/e2e/node/runtimeclass.go:148 @ 01/29/23 07:12:03.797
STEP: verifying the node has the label foo-b8e4c7fe-1dfb-4750-979d-901f2d3bf587 bar - test/e2e/framework/node/helper.go:63 @ 01/29/23 07:12:03.903
STEP: verifying the node has the label fizz-c6f728dd-1af8-41f4-8bac-77f284334c59 buzz - test/e2e/framework/node/helper.go:63 @ 01/29/23 07:12:04.108
STEP: Trying to create runtimeclass and pod - test/e2e/node/runtimeclass.go:155 @ 01/29/23 07:12:04.206
Jan 29 07:12:04.407: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz" in namespace "runtimeclass-4226" to be "not pending"
Jan 29 07:12:04.505: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 97.765425ms
Jan 29 07:12:06.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.198483243s
Jan 29 07:12:08.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.198589061s
Jan 29 07:12:10.608: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.200968143s
Jan 29 07:12:12.608: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.200914236s
Jan 29 07:12:14.613: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 10.206178805s
Jan 29 07:12:16.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 12.196277431s
Jan 29 07:12:18.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 14.196726484s
Jan 29 07:12:20.607: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 16.200498536s
Jan 29 07:12:22.624: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 18.217337944s
Jan 29 07:12:24.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 20.197456831s
Jan 29 07:12:26.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 22.196991395s
Jan 29 07:12:28.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 24.196168969s
Jan 29 07:12:30.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 26.196526565s
Jan 29 07:12:32.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 28.195762173s
Jan 29 07:12:34.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 30.197640396s
Jan 29 07:12:36.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 32.195931645s
Jan 29 07:12:38.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 34.195705389s
Jan 29 07:12:40.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 36.196113068s
Jan 29 07:12:42.602: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 38.195545548s
Jan 29 07:12:44.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 40.19872339s
Jan 29 07:12:46.602: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 42.19553431s
Jan 29 07:12:48.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 44.197147866s
Jan 29 07:12:50.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 46.196358276s
Jan 29 07:12:52.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 48.196102063s
Jan 29 07:12:54.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 50.196654006s
Jan 29 07:12:56.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 52.197176332s
Jan 29 07:12:58.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 54.196050808s
Jan 29 07:13:00.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 56.196365737s
Jan 29 07:13:02.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 58.198973661s
Jan 29 07:13:04.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.19657003s
Jan 29 07:13:06.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.19651959s
Jan 29 07:13:08.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.195730029s
Jan 29 07:13:10.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.196755596s
Jan 29 07:13:12.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.196192628s
Jan 29 07:13:14.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.196187724s
Jan 29 07:13:16.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.197105777s
Jan 29 07:13:18.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.196048966s
Jan 29 07:13:20.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.196278002s
Jan 29 07:13:22.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.195813135s
Jan 29 07:13:24.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.195813451s
Jan 29 07:13:26.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.196260838s
Jan 29 07:13:28.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.198073485s
Jan 29 07:13:30.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.196746646s
Jan 29 07:13:32.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.198137285s
Jan 29 07:13:34.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.196045217s
Jan 29 07:13:36.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.196338171s
Jan 29 07:13:38.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.195949609s
Jan 29 07:13:40.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.196566066s
Jan 29 07:13:42.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.19580246s
Jan 29 07:13:44.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.196124218s
Jan 29 07:13:46.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.199000184s
Jan 29 07:13:48.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.196384989s
Jan 29 07:13:50.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.196444455s
Jan 29 07:13:52.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.195972712s
Jan 29 07:13:54.608: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.201608525s
Jan 29 07:13:56.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.196185375s
Jan 29 07:13:58.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.196197989s
Jan 29 07:14:00.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.195910315s
Jan 29 07:14:02.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.195962215s
Jan 29 07:14:04.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.197318069s
Jan 29 07:14:06.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.196248425s
Jan 29 07:14:08.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.196203517s
Jan 29 07:14:10.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.196452358s
Jan 29 07:14:12.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.198808983s
Jan 29 07:14:14.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.195931392s
Jan 29 07:14:16.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.196236705s
Jan 29 07:14:18.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.196646826s
Jan 29 07:14:20.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.196714191s
Jan 29 07:14:22.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.195913059s
Jan 29 07:14:24.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.196364908s
Jan 29 07:14:26.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.196460048s
Jan 29 07:14:28.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.195978304s
Jan 29 07:14:30.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.196476058s
Jan 29 07:14:32.602: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.19557902s
Jan 29 07:14:34.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.197076265s
Jan 29 07:14:36.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.199324258s
Jan 29 07:14:38.614: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.206912526s
Jan 29 07:14:40.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.196258127s
Jan 29 07:14:42.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.196238636s
Jan 29 07:14:44.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.19597552s
Jan 29 07:14:46.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.195912725s
Jan 29 07:14:48.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.195979355s
Jan 29 07:14:50.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.196488767s
Jan 29 07:14:52.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.196870847s
Jan 29 07:14:54.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.196709017s
Jan 29 07:14:56.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.196510894s
Jan 29 07:14:58.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.198644683s
Jan 29 07:15:00.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.196282791s
Jan 29 07:15:02.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.19608056s
Jan 29 07:15:04.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.196562965s
Jan 29 07:15:06.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.19582307s
Jan 29 07:15:08.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.195843564s
Jan 29 07:15:10.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.197269653s
Jan 29 07:15:12.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.196199588s
Jan 29 07:15:14.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.195814706s
Jan 29 07:15:16.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.199165383s
Jan 29 07:15:18.607: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.199764164s
Jan 29 07:15:20.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.196292575s
Jan 29 07:15:22.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.196133426s
Jan 29 07:15:24.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.195904816s
Jan 29 07:15:26.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.196340765s
Jan 29 07:15:28.609: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.202592682s
Jan 29 07:15:30.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.196501003s
Jan 29 07:15:32.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.19567362s
Jan 29 07:15:34.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.198231449s
Jan 29 07:15:36.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.196016729s
Jan 29 07:15:38.613: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.205935907s
Jan 29 07:15:40.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.196095268s
Jan 29 07:15:42.609: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.20165265s
Jan 29 07:15:44.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.196528576s
Jan 29 07:15:46.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.19898351s
Jan 29 07:15:48.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.19689436s
Jan 29 07:15:50.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.196157573s
Jan 29 07:15:52.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.19604463s
Jan 29 07:15:54.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.198039526s
Jan 29 07:15:56.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.195993253s
Jan 29 07:15:58.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.19700226s
Jan 29 07:16:00.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.197729121s
Jan 29 07:16:02.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.195886042s
Jan 29 07:16:04.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.196491677s
Jan 29 07:16:06.602: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.195607844s
Jan 29 07:16:08.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.196575161s
Jan 29 07:16:10.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.196196886s
Jan 29 07:16:12.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.196002213s
Jan 29 07:16:14.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.196215171s
Jan 29 07:16:16.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.1971674s
Jan 29 07:16:18.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.19636616s
Jan 29 07:16:20.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.196496289s
Jan 29 07:16:22.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.19631319s
Jan 29 07:16:24.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.196497281s
Jan 29 07:16:26.606: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.199285516s
Jan 29 07:16:28.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.196442197s
Jan 29 07:16:30.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.197305445s
Jan 29 07:16:32.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.195923122s
Jan 29 07:16:34.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.196881866s
Jan 29 07:16:36.609: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.202016515s
Jan 29 07:16:38.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.19721146s
Jan 29 07:16:40.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.196421904s
Jan 29 07:16:42.602: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.19560858s
Jan 29 07:16:44.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.195792986s
Jan 29 07:16:46.607: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.200004184s
Jan 29 07:16:48.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.197804567s
Jan 29 07:16:50.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.196543121s
Jan 29 07:16:52.605: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.198596666s
Jan 29 07:16:54.613: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.206308908s
Jan 29 07:16:56.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.196681946s
Jan 29 07:16:58.604: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.197568964s
Jan 29 07:17:00.613: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.206058509s
Jan 29 07:17:02.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.196382919s
Jan 29 07:17:04.603: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.196196397s
Jan 29 07:17:04.701: INFO: Pod "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.293958806s
Jan 29 07:17:04.702: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc0049c2a20>: {
        msg: "timed out while waiting for pod runtimeclass-4226/test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc0008b2000>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz",
                    GenerateName: "test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclass-",
                    Namespace: "runtimeclass-4226",
                    SelfLink: "",
                    UID: "aadca89f-40da-41df-a423-6692fe7bbb23",
                    ResourceVersion: "18071",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810573124,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810573124,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810573124,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: {
                        "fizz-c6f728dd-1af8-41f4-8bac-77f284334c59": "buzz",
                        "foo-b8e4c7fe-1dfb-4750-979d-901f2d3bf587": "bar",
                    },
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-063f79c0cb7f4f040",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-4226/test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/29/23 07:17:04.702
< Exit [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/29/23 07:17:04.702 (5m14.474s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 07:17:04.702
Jan 29 07:17:04.702: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 07:17:04.802 (100ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 07:17:04.802
STEP: removing the label fizz-c6f728dd-1af8-41f4-8bac-77f284334c59 off the node i-063f79c0cb7f4f040 - test/e2e/framework/node/helper.go:72 @ 01/29/23 07:17:04.802
STEP: verifying the node doesn't have the label fizz-c6f728dd-1af8-41f4-8bac-77f284334c59 - test/e2e/framework/node/helper.go:75 @ 01/29/23 07:17:05.005
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 07:17:05.103 (302ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 07:17:05.103
STEP: removing the label foo-b8e4c7fe-1dfb-4750-979d-901f2d3bf587 off the node i-063f79c0cb7f4f040 - test/e2e/framework/node/helper.go:72 @ 01/29/23 07:17:05.103
STEP: verifying the node doesn't have the label foo-b8e4c7fe-1dfb-4750-979d-901f2d3bf587 - test/e2e/framework/node/helper.go:75 @ 01/29/23 07:17:05.306
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 07:17:05.404 (300ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 07:17:05.404
STEP: Deleting pod hostexec-i-0ac8b87a87db3da76-wjvp2 in namespace runtimeclass-4226 - test/e2e/framework/pod/delete.go:41 @ 01/29/23 07:17:05.404
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 07:17:05.509 (105ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 07:17:05.509
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 07:17:05.509 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 07:17:05.509
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 07:17:05.509
STEP: Collecting events from namespace "runtimeclass-4226". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 07:17:05.509
STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 07:17:05.607
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:11:50 +0000 UTC - event for hostexec-i-0ac8b87a87db3da76-wjvp2: {default-scheduler } Scheduled: Successfully assigned runtimeclass-4226/hostexec-i-0ac8b87a87db3da76-wjvp2 to i-0ac8b87a87db3da76
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:11:52 +0000 UTC - event for hostexec-i-0ac8b87a87db3da76-wjvp2: {kubelet i-0ac8b87a87db3da76} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:11:52 +0000 UTC - event for hostexec-i-0ac8b87a87db3da76-wjvp2: {kubelet i-0ac8b87a87db3da76} Created: Created container agnhost-container
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:11:53 +0000 UTC - event for hostexec-i-0ac8b87a87db3da76-wjvp2: {kubelet i-0ac8b87a87db3da76} Started: Started container agnhost-container
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:01 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned runtimeclass-4226/without-label to i-063f79c0cb7f4f040
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:01 +0000 UTC - event for without-label: {kubelet i-063f79c0cb7f4f040} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:01 +0000 UTC - event for without-label: {kubelet i-063f79c0cb7f4f040} Created: Created container without-label
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:02 +0000 UTC - event for without-label: {kubelet i-063f79c0cb7f4f040} Started: Started container without-label
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:04 +0000 UTC - event for test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz: {default-scheduler } Scheduled: Successfully assigned runtimeclass-4226/test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz to i-063f79c0cb7f4f040
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:04 +0000 UTC - event for test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz: {kubelet i-063f79c0cb7f4f040} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:12:04 +0000 UTC - event for without-label: {kubelet i-063f79c0cb7f4f040} Killing: Stopping container without-label
Jan 29 07:17:05.607: INFO: At 2023-01-29 07:17:05 +0000 UTC - event for hostexec-i-0ac8b87a87db3da76-wjvp2: {kubelet i-0ac8b87a87db3da76} Killing: Stopping container agnhost-container
Jan 29 07:17:05.706: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 29 07:17:05.706: INFO: test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz  i-063f79c0cb7f4f040  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:12:04 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:12:04 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:12:04 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 07:12:04 +0000 UTC  }]
Jan 29 07:17:05.706: INFO: 
Jan 29 07:17:05.804: INFO: Unable to fetch runtimeclass-4226/test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz)
Jan 29 07:17:05.903: INFO: 
Logging node info for node i-00c047f1af46a1f62
Jan 29 07:17:06.001: INFO: Node Info: &Node{ObjectMeta:{i-00c047f1af46a1f62    e988c056-eb98-44b7-a9ab-e097d838cb1e 30891 0 2023-01-29 07:02:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-00c047f1af46a1f62 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-00c047f1af46a1f62 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-2118":"i-00c047f1af46a1f62","csi-mock-csi-mock-volumes-expansion-9815":"i-00c047f1af46a1f62","ebs.csi.aws.com":"i-00c047f1af46a1f62"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:16:55 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-29 07:16:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-00c047f1af46a1f62,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:16:58 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:16:58 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:16:58 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:16:58 +0000 UTC,LastTransitionTime:2023-01-29 07:02:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.82,},NodeAddress{Type:ExternalIP,Address:35.178.51.242,},NodeAddress{Type:InternalDNS,Address:i-00c047f1af46a1f62.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-00c047f1af46a1f62.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-178-51-242.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2101ac8eeb771cde2a947e8a939375,SystemUUID:ec2101ac-8eeb-771c-de2a-947e8a939375,BootID:9d9adf2c-3121-466e-9f00-61f620d66f70,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-2118^e7a09652-9fa4-11ed-8e0f-6671482a72c7],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-2118^e7a09652-9fa4-11ed-8e0f-6671482a72c7,DevicePath:,},},Config:nil,},}
Jan 29 07:17:06.001: INFO: 
Logging kubelet events for node i-00c047f1af46a1f62
Jan 29 07:17:06.104: INFO: 
Logging pods the kubelet thinks is on node i-00c047f1af46a1f62
Jan 29 07:17:06.220: INFO: cilium-ch5v8 started at 2023-01-29 07:02:43 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:17:06.220: INFO: ebs-csi-controller-555658678f-4jqzf started at 2023-01-29 07:02:57 +0000 UTC (0+5 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:06.220: INFO: pod-subpath-test-inlinevolume-rqxp started at 2023-01-29 07:16:58 +0000 UTC (2+2 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Init container init-volume-inlinevolume-rqxp ready: false, restart count 0
Jan 29 07:17:06.220: INFO: 	Init container test-init-subpath-inlinevolume-rqxp ready: false, restart count 0
Jan 29 07:17:06.220: INFO: 	Container test-container-subpath-inlinevolume-rqxp ready: false, restart count 0
Jan 29 07:17:06.220: INFO: 	Container test-container-volume-inlinevolume-rqxp ready: false, restart count 0
Jan 29 07:17:06.220: INFO: hostexec-i-00c047f1af46a1f62-fz4jg started at 2023-01-29 07:16:48 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 07:17:06.220: INFO: csi-mockplugin-0 started at 2023-01-29 07:16:42 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container mock ready: true, restart count 0
Jan 29 07:17:06.220: INFO: test-runtimeclass-runtimeclass-7311-preconfigured-handler-rm4xt started at 2023-01-29 07:16:55 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container test ready: false, restart count 0
Jan 29 07:17:06.220: INFO: pvc-volume-tester-vz9tb started at <nil> (0+0 container statuses recorded)
Jan 29 07:17:06.220: INFO: pod-service-account-mountsa-mountspec started at 2023-01-29 07:16:13 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container token-test ready: false, restart count 0
Jan 29 07:17:06.220: INFO: csi-hostpathplugin-0 started at 2023-01-29 07:16:47 +0000 UTC (0+7 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:06.220: INFO: csi-mockplugin-resizer-0 started at 2023-01-29 07:16:42 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:06.220: INFO: pod-4bf5b566-fc3f-4ea0-b846-2479dec79a4e started at 2023-01-29 07:16:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container write-pod ready: false, restart count 0
Jan 29 07:17:06.220: INFO: pod-b216a9c0-d2cb-4207-8c3e-e78a3b5917a3 started at 2023-01-29 07:16:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container write-pod ready: false, restart count 0
Jan 29 07:17:06.220: INFO: probe-test-56fe69a3-2744-466e-9738-aa4402637f50 started at 2023-01-29 07:16:12 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container probe-test-56fe69a3-2744-466e-9738-aa4402637f50 ready: false, restart count 0
Jan 29 07:17:06.220: INFO: netserver-0 started at 2023-01-29 07:16:27 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container webserver ready: true, restart count 0
Jan 29 07:17:06.220: INFO: ebs-csi-node-g8mzr started at 2023-01-29 07:02:43 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:06.220: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:06.220: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:07.255: INFO: 
Latency metrics for node i-00c047f1af46a1f62
Jan 29 07:17:07.255: INFO: 
Logging node info for node i-00d709d8fa76f2551
Jan 29 07:17:07.353: INFO: Node Info: &Node{ObjectMeta:{i-00d709d8fa76f2551    ab8d2d7a-cbd3-468f-82eb-b7f6a40e02b6 22727 0 2023-01-29 07:00:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-00d709d8fa76f2551 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-west-2a topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00d709d8fa76f2551"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 07:00:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-29 07:00:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:01:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:01:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 07:01:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 07:13:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-00d709d8fa76f2551,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002131968 0} {<nil>} 3908332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897274368 0} {<nil>} 3805932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:13:15 +0000 UTC,LastTransitionTime:2023-01-29 07:00:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:13:15 +0000 UTC,LastTransitionTime:2023-01-29 07:00:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:13:15 +0000 UTC,LastTransitionTime:2023-01-29 07:00:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:13:15 +0000 UTC,LastTransitionTime:2023-01-29 07:01:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.126,},NodeAddress{Type:ExternalIP,Address:3.10.24.208,},NodeAddress{Type:InternalDNS,Address:i-00d709d8fa76f2551.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-00d709d8fa76f2551.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-10-24-208.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2354ce541dd3ae7d3955a40cbb68b6,SystemUUID:ec2354ce-541d-d3ae-7d39-55a40cbb68b6,BootID:71d1f536-30e7-4b46-a851-35658b79289b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41194354,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39794006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691090,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 07:17:07.354: INFO: 
Logging kubelet events for node i-00d709d8fa76f2551
Jan 29 07:17:07.455: INFO: 
Logging pods the kubelet thinks is on node i-00d709d8fa76f2551
Jan 29 07:17:07.567: INFO: kube-controller-manager-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 29 07:17:07.567: INFO: kube-scheduler-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 29 07:17:07.567: INFO: cilium-sshlz started at 2023-01-29 07:00:54 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Container cilium-agent ready: true, restart count 1
Jan 29 07:17:07.567: INFO: etcd-manager-events-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (10+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 07:17:07.567: INFO: etcd-manager-main-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (10+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 07:17:07.567: INFO: kube-apiserver-i-00d709d8fa76f2551 started at 2023-01-29 06:58:28 +0000 UTC (0+2 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container healthcheck ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Container kube-apiserver ready: true, restart count 3
Jan 29 07:17:07.567: INFO: dns-controller-85d56fc6db-lmgc9 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container dns-controller ready: true, restart count 0
Jan 29 07:17:07.567: INFO: cilium-operator-6f7d7f696f-rlc44 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container cilium-operator ready: true, restart count 1
Jan 29 07:17:07.567: INFO: aws-cloud-controller-manager-2w527 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 29 07:17:07.567: INFO: ebs-csi-node-s28x5 started at 2023-01-29 07:00:54 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:07.567: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:07.567: INFO: kops-controller-qsv47 started at 2023-01-29 07:00:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:07.567: INFO: 	Container kops-controller ready: true, restart count 0
Jan 29 07:17:07.934: INFO: 
Latency metrics for node i-00d709d8fa76f2551
Jan 29 07:17:07.934: INFO: 
Logging node info for node i-063f79c0cb7f4f040
Jan 29 07:17:08.033: INFO: Node Info: &Node{ObjectMeta:{i-063f79c0cb7f4f040    d8ef756d-dcd1-459f-a354-e2c2bffea1c6 31105 0 2023-01-29 07:02:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-063f79c0cb7f4f040 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-063f79c0cb7f4f040 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3788":"i-063f79c0cb7f4f040","csi-mock-csi-mock-volumes-fsgroup-policy-1458":"i-063f79c0cb7f4f040","ebs.csi.aws.com":"i-063f79c0cb7f4f040"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-29 07:02:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:02:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:16:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-29 07:16:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-063f79c0cb7f4f040,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:16:48 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:16:48 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:16:48 +0000 UTC,LastTransitionTime:2023-01-29 07:02:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:16:48 +0000 UTC,LastTransitionTime:2023-01-29 07:02:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.136,},NodeAddress{Type:ExternalIP,Address:3.9.115.216,},NodeAddress{Type:InternalDNS,Address:i-063f79c0cb7f4f040.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-063f79c0cb7f4f040.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-9-115-216.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec271b2402a3efafccb7bfc6be27d556,SystemUUID:ec271b24-02a3-efaf-ccb7-bfc6be27d556,BootID:a0e3ca54-a2da-417d-976d-a335529763d6,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-023cc189f616f24f0 kubernetes.io/csi/ebs.csi.aws.com^vol-048b7ba49b79a6730],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-048b7ba49b79a6730,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-023cc189f616f24f0,DevicePath:,},},Config:nil,},}
Jan 29 07:17:08.033: INFO: 
Logging kubelet events for node i-063f79c0cb7f4f040
Jan 29 07:17:08.134: INFO: 
Logging pods the kubelet thinks is on node i-063f79c0cb7f4f040
Jan 29 07:17:08.239: INFO: ebs-csi-node-ncd74 started at 2023-01-29 07:02:43 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:08.239: INFO: coredns-autoscaler-7cb5c5b969-n8w9t started at 2023-01-29 07:02:53 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container autoscaler ready: true, restart count 0
Jan 29 07:17:08.239: INFO: cilium-gxxwn started at 2023-01-29 07:02:43 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:17:08.239: INFO: inline-volume-tester-khjnv started at 2023-01-29 07:16:33 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 07:17:08.239: INFO: inline-volume-tester-65rsc started at 2023-01-29 07:16:38 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 07:17:08.239: INFO: ebs-csi-controller-555658678f-7dll7 started at 2023-01-29 07:02:53 +0000 UTC (0+5 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:08.239: INFO: inline-volume-tester-fzb72 started at 2023-01-29 07:16:46 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 07:17:08.239: INFO: coredns-559769c974-fbtqn started at 2023-01-29 07:02:53 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container coredns ready: true, restart count 0
Jan 29 07:17:08.239: INFO: csi-mockplugin-0 started at 2023-01-29 07:16:15 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container mock ready: true, restart count 0
Jan 29 07:17:08.239: INFO: test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz started at 2023-01-29 07:12:04 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container test ready: false, restart count 0
Jan 29 07:17:08.239: INFO: csi-hostpathplugin-0 started at 2023-01-29 07:16:46 +0000 UTC (0+7 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:08.239: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:08.239: INFO: hostexec-i-063f79c0cb7f4f040-cqlkl started at 2023-01-29 07:16:56 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.239: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 07:17:08.687: INFO: 
Latency metrics for node i-063f79c0cb7f4f040
Jan 29 07:17:08.687: INFO: 
Logging node info for node i-0ac8b87a87db3da76
Jan 29 07:17:08.785: INFO: Node Info: &Node{ObjectMeta:{i-0ac8b87a87db3da76    430e6d29-5527-44e3-b9a4-fb44207d4db2 30991 0 2023-01-29 07:02:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0ac8b87a87db3da76 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0ac8b87a87db3da76 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-workload-9180":"i-0ac8b87a87db3da76","ebs.csi.aws.com":"i-0ac8b87a87db3da76"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:02:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:17:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-29 07:17:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0ac8b87a87db3da76,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.115,},NodeAddress{Type:ExternalIP,Address:13.40.101.163,},NodeAddress{Type:InternalDNS,Address:i-0ac8b87a87db3da76.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ac8b87a87db3da76.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-40-101-163.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2980fc304aaa7b60cd0ad806d67272,SystemUUID:ec2980fc-304a-aa7b-60cd-0ad806d67272,BootID:68f79d48-6f17-4b4e-9bfc-9c0132165ca9,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-9180^e1874f0d-9fa4-11ed-aeb6-9254446119c6 kubernetes.io/csi/ebs.csi.aws.com^vol-00efc190226fec3c1 kubernetes.io/csi/ebs.csi.aws.com^vol-0497fbbc31b006b97 kubernetes.io/csi/ebs.csi.aws.com^vol-0669b734b7e79635e kubernetes.io/csi/ebs.csi.aws.com^vol-08a61cf41c74af7e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00efc190226fec3c1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08a61cf41c74af7e1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0669b734b7e79635e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0497fbbc31b006b97,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-9180^e1874f0d-9fa4-11ed-aeb6-9254446119c6,DevicePath:,},},Config:nil,},}
Jan 29 07:17:08.785: INFO: 
Logging kubelet events for node i-0ac8b87a87db3da76
Jan 29 07:17:08.886: INFO: 
Logging pods the kubelet thinks is on node i-0ac8b87a87db3da76
Jan 29 07:17:08.991: INFO: pod-service-account-nomountsa-mountspec started at 2023-01-29 07:16:14 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container token-test ready: false, restart count 0
Jan 29 07:17:08.991: INFO: inline-volume-mldvs started at <nil> (0+0 container statuses recorded)
Jan 29 07:17:08.991: INFO: inline-volume-tester2-xr795 started at <nil> (0+0 container statuses recorded)
Jan 29 07:17:08.991: INFO: externalsvc-mc84h started at <nil> (0+0 container statuses recorded)
Jan 29 07:17:08.991: INFO: csi-mockplugin-0 started at 2023-01-29 07:16:36 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:08.991: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 07:17:08.991: INFO: 	Container mock ready: true, restart count 0
Jan 29 07:17:08.991: INFO: pvc-volume-tester-9v588 started at 2023-01-29 07:16:42 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container volume-tester ready: true, restart count 0
Jan 29 07:17:08.991: INFO: sample-webhook-deployment-865554f4d9-g86xq started at 2023-01-29 07:16:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container sample-webhook ready: true, restart count 0
Jan 29 07:17:08.991: INFO: httpd started at <nil> (0+0 container statuses recorded)
Jan 29 07:17:08.991: INFO: netserver-2 started at 2023-01-29 07:16:27 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container webserver ready: true, restart count 0
Jan 29 07:17:08.991: INFO: inline-volume-tester-dlzpw started at 2023-01-29 07:16:55 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 29 07:17:08.991: INFO: csi-mockplugin-attacher-0 started at 2023-01-29 07:16:36 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:08.991: INFO: cilium-kxs8k started at 2023-01-29 07:02:44 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:17:08.991: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:17:08.991: INFO: test-container-pod started at 2023-01-29 07:16:50 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container webserver ready: true, restart count 0
Jan 29 07:17:08.991: INFO: inline-volume-tester-vh82p started at 2023-01-29 07:15:44 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 07:17:08.991: INFO: ebs-csi-node-8jdwz started at 2023-01-29 07:02:44 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:08.991: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:08.991: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:08.991: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:10.058: INFO: 
Latency metrics for node i-0ac8b87a87db3da76
Jan 29 07:17:10.058: INFO: 
Logging node info for node i-0fedaf155ff285b94
Jan 29 07:17:10.156: INFO: Node Info: &Node{ObjectMeta:{i-0fedaf155ff285b94    f96c7fbb-09ed-42da-aa8b-d229d367c4b2 31201 0 2023-01-29 07:02:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-2 failure-domain.beta.kubernetes.io/zone:eu-west-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0fedaf155ff285b94 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:eu-west-2a topology.hostpath.csi/node:i-0fedaf155ff285b94 topology.kubernetes.io/region:eu-west-2 topology.kubernetes.io/zone:eu-west-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2968":"i-0fedaf155ff285b94","csi-hostpath-ephemeral-3918":"i-0fedaf155ff285b94","csi-mock-csi-mock-volumes-attach-5024":"i-0fedaf155ff285b94","ebs.csi.aws.com":"i-0fedaf155ff285b94"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 07:17:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-29 07:17:08 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-2a/i-0fedaf155ff285b94,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 07:17:01 +0000 UTC,LastTransitionTime:2023-01-29 07:02:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.6,},NodeAddress{Type:ExternalIP,Address:3.8.160.228,},NodeAddress{Type:InternalDNS,Address:i-0fedaf155ff285b94.eu-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fedaf155ff285b94.eu-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-8-160-228.eu-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2914ddef1a334e1af3000976d653c6,SystemUUID:ec2914dd-ef1a-334e-1af3-000976d653c6,BootID:2a4c4983-0f3c-40b2-9254-7d88d999910e,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2968^bd5b1ac0-9fa4-11ed-a5cb-fe145a019aa3 kubernetes.io/csi/csi-mock-csi-mock-volumes-attach-5024^eb34f9ae-9fa4-11ed-8cd6-eacc1c723ffd],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-attach-5024^eb34f9ae-9fa4-11ed-8cd6-eacc1c723ffd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2968^bd5b1ac0-9fa4-11ed-a5cb-fe145a019aa3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3918^efd6d6e7-9fa4-11ed-9b8f-c66c0fc89660,DevicePath:,},},Config:nil,},}
Jan 29 07:17:10.156: INFO: 
Logging kubelet events for node i-0fedaf155ff285b94
Jan 29 07:17:10.257: INFO: 
Logging pods the kubelet thinks is on node i-0fedaf155ff285b94
Jan 29 07:17:10.372: INFO: inline-volume-tester-l7p4g started at 2023-01-29 07:15:44 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 07:17:10.372: INFO: cilium-qjgkh started at 2023-01-29 07:02:44 +0000 UTC (1+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 07:17:10.372: INFO: csi-hostpathplugin-0 started at 2023-01-29 07:15:36 +0000 UTC (0+7 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:10.372: INFO: startup-ece32fa3-cc15-4a75-8b10-3c3e87643be3 started at 2023-01-29 07:13:22 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container busybox ready: false, restart count 0
Jan 29 07:17:10.372: INFO: csi-mockplugin-attacher-0 started at 2023-01-29 07:16:53 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:10.372: INFO: inline-volume-tester-hcvfh started at 2023-01-29 07:17:07 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 29 07:17:10.372: INFO: csi-hostpathplugin-0 started at 2023-01-29 07:17:01 +0000 UTC (0+7 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:10.372: INFO: csi-mockplugin-0 started at 2023-01-29 07:16:53 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container mock ready: true, restart count 0
Jan 29 07:17:10.372: INFO: ebs-csi-node-tb27f started at 2023-01-29 07:02:44 +0000 UTC (0+3 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 07:17:10.372: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 07:17:10.372: INFO: coredns-559769c974-68vjn started at 2023-01-29 07:03:20 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container coredns ready: true, restart count 0
Jan 29 07:17:10.372: INFO: pvc-volume-tester-89wkx started at 2023-01-29 07:16:59 +0000 UTC (0+1 container statuses recorded)
Jan 29 07:17:10.372: INFO: 	Container volume-tester ready: true, restart count 0
Jan 29 07:17:11.136: INFO: 
Latency metrics for node i-0fedaf155ff285b94
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 07:17:11.136 (5.626s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 07:17:11.136 (5.626s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 07:17:11.136
STEP: Destroying namespace "runtimeclass-4226" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 07:17:11.136
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 07:17:11.235 (100ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 07:17:11.235
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 07:17:11.235 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-4226/test-runtimeclass-runtimeclass-4226-non-conflict-runtimeclkglrz mentions in log files | View test history on testgrid

kubetest2 Test 21m51s

exit status 255
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 895 Passed Tests

Show 6516 Skipped Tests

Result	FAILURE
Tests	3 failed / 895 succeeded
Started	2023-01-29 06:55
Elapsed	35m51s
Revision	master