e2e-kops-warm-pool #1619710547819761664 Results

Test Failures

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] 5m19s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sa\sconfigured\shandler\s\[NodeFeature\:RuntimeHandler\]$'

[FAILED] timed out while waiting for pod runtimeclass-5331/test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282 to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/29/23 15:26:26.106

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 15:21:13.941
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 15:21:13.941
Jan 29 15:21:13.941: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/29/23 15:21:13.942
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 15:21:14.479
E0129 15:21:14.539378    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 15:21:14.834
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 15:21:15.19 (1.248s)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 15:21:15.19
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 15:21:15.19 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/29/23 15:21:15.19
E0129 15:21:15.539852    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:15.559: INFO: Waiting up to 5m0s for pod "hostexec-i-01fdcfd760c8f6458-pr4px" in namespace "runtimeclass-5331" to be "running"
Jan 29 15:21:15.738: INFO: Pod "hostexec-i-01fdcfd760c8f6458-pr4px": Phase="Pending", Reason="", readiness=false. Elapsed: 178.836881ms
E0129 15:21:16.540111    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:17.540195    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:17.923: INFO: Pod "hostexec-i-01fdcfd760c8f6458-pr4px": Phase="Pending", Reason="", readiness=false. Elapsed: 2.363540367s
E0129 15:21:18.540847    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:19.541413    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:19.920: INFO: Pod "hostexec-i-01fdcfd760c8f6458-pr4px": Phase="Pending", Reason="", readiness=false. Elapsed: 4.360860777s
E0129 15:21:20.542282    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:21.542872    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:21.918: INFO: Pod "hostexec-i-01fdcfd760c8f6458-pr4px": Phase="Pending", Reason="", readiness=false. Elapsed: 6.358615147s
E0129 15:21:22.542920    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:23.543032    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:23.920: INFO: Pod "hostexec-i-01fdcfd760c8f6458-pr4px": Phase="Running", Reason="", readiness=true. Elapsed: 8.360767824s
Jan 29 15:21:23.920: INFO: Pod "hostexec-i-01fdcfd760c8f6458-pr4px" satisfied condition "running"
Jan 29 15:21:23.920: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-5331 PodName:hostexec-i-01fdcfd760c8f6458-pr4px ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 29 15:21:23.920: INFO: >>> kubeConfig: /root/.kube/config
Jan 29 15:21:23.921: INFO: ExecWithOptions: Clientset creation
Jan 29 15:21:23.921: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-7f766c79c0e2d093.elb.ap-northeast-2.amazonaws.com/api/v1/namespaces/runtimeclass-5331/pods/hostexec-i-01fdcfd760c8f6458-pr4px/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
E0129 15:21:24.543948    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:25.545036    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:25.568: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282" in namespace "runtimeclass-5331" to be "Succeeded or Failed"
Jan 29 15:21:25.747: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 179.511926ms
E0129 15:21:26.545225    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:27.545430    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:27.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2.358976916s
E0129 15:21:28.546323    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:29.546954    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:29.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4.358890062s
E0129 15:21:30.547263    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:31.547901    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:31.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 6.358241938s
E0129 15:21:32.548953    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:33.549317    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:33.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 8.358809048s
E0129 15:21:34.550352    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:35.551371    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:35.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 10.359396502s
E0129 15:21:36.552348    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:37.552509    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:37.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 12.359022734s
E0129 15:21:38.553345    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:39.553489    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:39.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 14.358530666s
E0129 15:21:40.554198    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:41.554697    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:41.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 16.358755432s
E0129 15:21:42.555597    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:43.556676    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:43.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 18.358355464s
E0129 15:21:44.556696    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:45.556829    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:45.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 20.35850962s
E0129 15:21:46.557570    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:47.557874    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:47.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 22.359221781s
E0129 15:21:48.558999    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:49.559462    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:49.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 24.35935962s
E0129 15:21:50.560066    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:51.560516    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:51.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 26.358317217s
E0129 15:21:52.561085    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:53.561229    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:53.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 28.359294587s
E0129 15:21:54.562080    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:55.562179    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:55.931: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 30.363337673s
E0129 15:21:56.563161    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:57.563370    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:57.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 32.359733312s
E0129 15:21:58.564025    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:21:59.564521    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:21:59.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 34.359105151s
E0129 15:22:00.564680    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:01.565366    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:01.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 36.359082227s
E0129 15:22:02.565498    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:03.565892    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:03.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 38.358849828s
E0129 15:22:04.566408    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:05.566582    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:05.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 40.358251489s
E0129 15:22:06.567490    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:07.567975    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:07.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 42.358615123s
E0129 15:22:08.568205    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:09.568432    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:09.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 44.35979118s
E0129 15:22:10.569162    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:11.569466    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:11.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 46.358868662s
E0129 15:22:12.569525    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:13.569743    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:13.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 48.35852647s
E0129 15:22:14.569890    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:15.571019    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:15.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 50.358779265s
E0129 15:22:16.571962    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:17.572483    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:17.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 52.358120918s
E0129 15:22:18.572857    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:19.573378    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:19.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 54.359505957s
E0129 15:22:20.574135    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:21.574686    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:21.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 56.36133941s
E0129 15:22:22.574884    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:23.575033    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:23.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 58.358420084s
E0129 15:22:24.576064    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:25.576434    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:25.932: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.363801366s
E0129 15:22:26.577025    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:27.577271    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:27.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.358922788s
E0129 15:22:28.577536    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:29.577997    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:29.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.358543326s
E0129 15:22:30.578026    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:31.578245    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:31.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.358812067s
E0129 15:22:32.578438    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:33.578945    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:33.931: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.36302696s
E0129 15:22:34.579776    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:35.580432    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:35.935: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.367185494s
E0129 15:22:36.581284    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:37.581476    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:37.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.361633303s
E0129 15:22:38.582244    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:39.582614    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:39.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.358794143s
E0129 15:22:40.583820    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:41.584155    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:41.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.35896049s
E0129 15:22:42.584794    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:43.585326    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:43.932: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.364170678s
E0129 15:22:44.586146    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:45.586695    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:45.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.360287745s
E0129 15:22:46.587576    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:47.588221    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:47.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.358805275s
E0129 15:22:48.588407    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:49.588855    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:49.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.358862634s
E0129 15:22:50.589547    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:51.590236    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:51.933: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.364786423s
E0129 15:22:52.590339    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:53.590487    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:53.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.358151163s
E0129 15:22:54.591162    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:55.591391    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:55.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.360544102s
E0129 15:22:56.591863    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:57.592564    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:57.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.359477106s
E0129 15:22:58.593014    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:22:59.593343    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:22:59.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.359084747s
E0129 15:23:00.593838    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:01.594484    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:01.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.359212226s
E0129 15:23:02.594865    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:03.595438    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:03.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.359170231s
E0129 15:23:04.595636    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:05.596136    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:05.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.358703312s
E0129 15:23:06.596972    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:07.597287    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:07.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.35889365s
E0129 15:23:08.597498    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:09.598058    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:09.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.35871269s
E0129 15:23:10.598549    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:11.599216    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:11.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.359517532s
E0129 15:23:12.600229    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:13.600350    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:13.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.359032334s
E0129 15:23:14.600377    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:15.601372    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:15.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.358938917s
E0129 15:23:16.601968    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:17.602333    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:17.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.359575947s
E0129 15:23:18.603076    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:19.603298    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:19.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.358649358s
E0129 15:23:20.603424    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:21.604107    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:21.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.358568296s
E0129 15:23:22.604212    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:23.604354    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:23.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.360477698s
E0129 15:23:24.605173    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:25.605331    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:25.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.359349806s
E0129 15:23:26.606159    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:27.606464    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:27.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.359361089s
E0129 15:23:28.606711    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:29.607217    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:29.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.359095932s
E0129 15:23:30.607398    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:31.607518    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:31.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.359146615s
E0129 15:23:32.607781    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:33.607845    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:33.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.358124235s
E0129 15:23:34.608932    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:35.609062    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:35.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.358643955s
E0129 15:23:36.609958    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:37.610285    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:37.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.361430019s
E0129 15:23:38.611283    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:39.612113    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:39.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.358795373s
E0129 15:23:40.612302    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:41.613327    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:41.933: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.365600849s
E0129 15:23:42.614088    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:43.614210    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:43.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.358528389s
E0129 15:23:44.615351    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:45.616071    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:45.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.359191975s
E0129 15:23:46.616509    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:47.616728    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:47.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.358307263s
E0129 15:23:48.616888    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:49.617076    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:49.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.358677133s
E0129 15:23:50.617227    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:51.617826    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:51.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.358230939s
E0129 15:23:52.618127    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:53.618275    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:53.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.357930744s
E0129 15:23:54.618474    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:55.619296    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:55.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.358120608s
E0129 15:23:56.619350    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:57.619460    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:57.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.358235907s
E0129 15:23:58.619661    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:23:59.619868    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:23:59.931: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.362908876s
E0129 15:24:00.620542    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:01.621327    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:01.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.357879945s
E0129 15:24:02.621527    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:03.622423    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:03.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.357809962s
E0129 15:24:04.622555    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:05.623228    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:05.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.35768081s
E0129 15:24:06.623952    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:07.624130    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:07.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.357588853s
E0129 15:24:08.624368    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:09.624437    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:09.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.357851887s
E0129 15:24:10.624500    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:11.624930    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:11.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.360848797s
E0129 15:24:12.625561    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:13.626086    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:13.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.357438696s
E0129 15:24:14.626947    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:15.627159    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:15.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.357658568s
E0129 15:24:16.627733    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:17.627940    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:17.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.357512624s
E0129 15:24:18.628258    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:19.628539    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:19.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.358407839s
E0129 15:24:20.629148    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:21.629333    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:21.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.357659642s
E0129 15:24:22.630337    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:23.630461    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:23.939: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.371062623s
E0129 15:24:24.630609    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:25.631376    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:25.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.358061705s
E0129 15:24:26.632243    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:27.632361    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:27.937: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.368738756s
E0129 15:24:28.632392    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:29.632730    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:29.930: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.362185751s
E0129 15:24:30.632879    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:31.633020    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:31.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.35735656s
E0129 15:24:32.634084    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:33.634508    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:33.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.358250536s
E0129 15:24:34.635092    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:35.635152    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:35.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.357639348s
E0129 15:24:36.635711    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:37.635913    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:37.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.357794119s
E0129 15:24:38.636475    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:39.637311    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:39.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.357711313s
E0129 15:24:40.637379    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:41.638152    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:41.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.357892205s
E0129 15:24:42.638492    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:43.638694    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:43.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.357100503s
E0129 15:24:44.638878    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:45.639052    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:45.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.357447648s
E0129 15:24:46.639562    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:47.640150    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:47.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.358141362s
E0129 15:24:48.640315    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:49.640821    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:49.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.357740789s
E0129 15:24:50.641695    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:51.642646    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:51.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.357206159s
E0129 15:24:52.643280    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:53.643472    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:53.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.359975123s
E0129 15:24:54.643723    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:55.644008    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:55.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.357894965s
E0129 15:24:56.644199    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:57.644744    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:57.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.35681266s
E0129 15:24:58.645459    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:24:59.645761    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:24:59.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.361297831s
E0129 15:25:00.645995    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:01.646130    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:01.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.35809691s
E0129 15:25:02.646717    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:03.647346    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:03.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.357672033s
E0129 15:25:04.647457    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:05.648030    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:05.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.357963088s
E0129 15:25:06.648139    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:07.648317    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:07.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.358503136s
E0129 15:25:08.649262    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:09.649467    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:09.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.358616855s
E0129 15:25:10.650287    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:11.651217    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:11.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.358011259s
E0129 15:25:12.651467    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:13.652104    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:13.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.357699882s
E0129 15:25:14.652320    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:15.652456    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:15.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.357609045s
E0129 15:25:16.653149    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:17.653329    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:17.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.36164186s
E0129 15:25:18.654390    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:19.654499    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:19.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.35785571s
E0129 15:25:20.654572    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:21.654665    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:21.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.359569768s
E0129 15:25:22.654869    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:23.655063    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:23.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.357891324s
E0129 15:25:24.655232    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:25.655551    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:25.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.357950352s
E0129 15:25:26.656447    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:27.656534    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:27.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.358460678s
E0129 15:25:28.657316    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:29.657481    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:29.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.357951419s
E0129 15:25:30.658408    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:31.659390    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:31.939: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.371114304s
E0129 15:25:32.659432    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:33.660044    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:33.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.357554202s
E0129 15:25:34.660200    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:35.660420    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:35.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.358181022s
E0129 15:25:36.660527    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:37.661599    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:37.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.357509868s
E0129 15:25:38.661936    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:39.662344    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:39.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.360135629s
E0129 15:25:40.663032    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:41.663277    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:41.929: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.36073628s
E0129 15:25:42.663426    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:43.664117    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:43.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.358202062s
E0129 15:25:44.665037    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:45.665276    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:45.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.357939249s
E0129 15:25:46.666254    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:47.666434    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:47.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.358593975s
E0129 15:25:48.667381    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:49.668190    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:49.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.358115369s
E0129 15:25:50.668947    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:51.669289    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:51.932: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.364660518s
E0129 15:25:52.669458    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:53.670605    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:53.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.358615212s
E0129 15:25:54.671620    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:55.672217    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:55.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.358627514s
E0129 15:25:56.672906    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:57.673483    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:57.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.360573346s
E0129 15:25:58.674258    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:25:59.674677    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:25:59.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.358146693s
E0129 15:26:00.674911    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:01.675526    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:01.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.358047918s
E0129 15:26:02.676032    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:03.676599    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:03.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.358564217s
E0129 15:26:04.677399    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:05.677877    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:05.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.358462161s
E0129 15:26:06.677876    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:07.678042    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:07.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.358106387s
E0129 15:26:08.679070    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:09.679660    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:09.925: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.357458679s
E0129 15:26:10.680319    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:11.681077    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:11.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.359784769s
E0129 15:26:12.681495    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:13.682084    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:13.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.360667077s
E0129 15:26:14.682339    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:15.683377    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:15.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.358297469s
E0129 15:26:16.684511    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:17.684627    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:17.927: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.35937969s
E0129 15:26:18.684782    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:19.684982    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:19.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.357846821s
E0129 15:26:20.685366    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:21.686044    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:21.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.357874836s
E0129 15:26:22.686682    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:23.687132    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:23.928: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.359843773s
E0129 15:26:24.687748    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
E0129 15:26:25.688104    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:25.926: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.358217747s
Jan 29 15:26:26.104: INFO: Pod "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.536309985s
Jan 29 15:26:26.105: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc0064fb6b0>: {
        msg: "timed out while waiting for pod runtimeclass-5331/test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282 to be Succeeded or Failed",
        observedObjects: [
            <*v1.Pod | 0xc003660900>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282",
                    GenerateName: "test-runtimeclass-runtimeclass-5331-preconfigured-handler-",
                    Namespace: "runtimeclass-5331",
                    SelfLink: "",
                    UID: "0d566f97-b0b5-43a6-be64-f6c2ca1d8188",
                    ResourceVersion: "35054",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810602485,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810602485,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810602489,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: nil,
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-01fdcfd760c8f6458",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
                        SupplementalGroups: nil,
                        FSGroup: nil,
                        Sysctls: nil,
                        FSGroupChangePolicy: nil,
               ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-5331/test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282 to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/29/23 15:26:26.106
< Exit [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/29/23 15:26:26.106 (5m10.916s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 15:26:26.106
Jan 29 15:26:26.106: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 15:26:26.285 (179ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/29/23 15:26:26.285
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/29/23 15:26:26.465 (180ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 15:26:26.465
STEP: Deleting pod hostexec-i-01fdcfd760c8f6458-pr4px in namespace runtimeclass-5331 - test/e2e/framework/pod/delete.go:41 @ 01/29/23 15:26:26.465
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 15:26:26.654 (188ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 15:26:26.654
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 15:26:26.654 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 15:26:26.654
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 15:26:26.654
STEP: Collecting events from namespace "runtimeclass-5331". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 15:26:26.654
E0129 15:26:26.688396    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 15:26:26.832
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:21:15 +0000 UTC - event for hostexec-i-01fdcfd760c8f6458-pr4px: {default-scheduler } Scheduled: Successfully assigned runtimeclass-5331/hostexec-i-01fdcfd760c8f6458-pr4px to i-01fdcfd760c8f6458
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:21:16 +0000 UTC - event for hostexec-i-01fdcfd760c8f6458-pr4px: {kubelet i-01fdcfd760c8f6458} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:21:16 +0000 UTC - event for hostexec-i-01fdcfd760c8f6458-pr4px: {kubelet i-01fdcfd760c8f6458} Created: Created container agnhost-container
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:21:16 +0000 UTC - event for hostexec-i-01fdcfd760c8f6458-pr4px: {kubelet i-01fdcfd760c8f6458} Started: Started container agnhost-container
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:21:25 +0000 UTC - event for test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282: {default-scheduler } Scheduled: Successfully assigned runtimeclass-5331/test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282 to i-01fdcfd760c8f6458
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:21:25 +0000 UTC - event for test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282: {kubelet i-01fdcfd760c8f6458} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 29 15:26:26.832: INFO: At 2023-01-29 15:26:26 +0000 UTC - event for hostexec-i-01fdcfd760c8f6458-pr4px: {kubelet i-01fdcfd760c8f6458} Killing: Stopping container agnhost-container
Jan 29 15:26:27.010: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 29 15:26:27.010: INFO: test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282  i-01fdcfd760c8f6458  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:21:25 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:21:25 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:21:25 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:21:25 +0000 UTC  }]
Jan 29 15:26:27.010: INFO: 
Jan 29 15:26:27.190: INFO: Unable to fetch runtimeclass-5331/test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282)
Jan 29 15:26:27.372: INFO: 
Logging node info for node i-01fdcfd760c8f6458
Jan 29 15:26:27.551: INFO: Node Info: &Node{ObjectMeta:{i-01fdcfd760c8f6458    b8e891f9-47bc-41bf-ba3b-eaded806373a 48178 0 2023-01-29 15:04:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-01fdcfd760c8f6458 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-01fdcfd760c8f6458 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8043":"i-01fdcfd760c8f6458","ebs.csi.aws.com":"i-01fdcfd760c8f6458"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:26:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-29 15:26:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-01fdcfd760c8f6458,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:21 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:21 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:21 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:26:21 +0000 UTC,LastTransitionTime:2023-01-29 15:04:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.35,},NodeAddress{Type:ExternalIP,Address:3.34.132.42,},NodeAddress{Type:InternalDNS,Address:i-01fdcfd760c8f6458.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-01fdcfd760c8f6458.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-34-132-42.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2821d88a75e39d0c46cdabf66ddc3a,SystemUUID:ec2821d8-8a75-e39d-0c46-cdabf66ddc3a,BootID:fb8fb5d4-a411-4061-acd7-f095f7bc0c35,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8043^3c04b6c4-9fe9-11ed-8b87-cebb1a193aa0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8043^3c04b6c4-9fe9-11ed-8b87-cebb1a193aa0,DevicePath:,},},Config:nil,},}
Jan 29 15:26:27.551: INFO: 
Logging kubelet events for node i-01fdcfd760c8f6458
E0129 15:26:27.689326    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:27.732: INFO: 
Logging pods the kubelet thinks is on node i-01fdcfd760c8f6458
Jan 29 15:26:27.915: INFO: test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282 started at 2023-01-29 15:21:25 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container test ready: false, restart count 0
Jan 29 15:26:27.915: INFO: webserver-987856868-f6mfp started at 2023-01-29 15:26:17 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:27.915: INFO: cilium-7pnxd started at 2023-01-29 15:04:05 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:26:27.915: INFO: csi-hostpathplugin-0 started at 2023-01-29 15:25:54 +0000 UTC (0+7 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:26:27.915: INFO: test-container-pod started at 2023-01-29 15:26:19 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:26:27.915: INFO: inline-volume-tester-m6djh started at 2023-01-29 15:26:00 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 15:26:27.915: INFO: ebs-csi-node-7k5b9 started at 2023-01-29 15:04:05 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:27.915: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:26:27.915: INFO: pod-projected-configmaps-0a84e930-2b7b-4819-abf9-1b92ea4e9f56 started at 2023-01-29 15:25:37 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:26:27.915: INFO: liveness-05e0cf22-381f-40e9-b311-f95a0a5d540b started at 2023-01-29 15:25:20 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:26:27.915: INFO: netserver-0 started at 2023-01-29 15:25:57 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:27.915: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:26:28.547: INFO: 
Latency metrics for node i-01fdcfd760c8f6458
Jan 29 15:26:28.547: INFO: 
Logging node info for node i-02a7543c7279738c4
E0129 15:26:28.690023    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:28.725: INFO: Node Info: &Node{ObjectMeta:{i-02a7543c7279738c4    dab094ab-9fd8-4656-bcde-75f7237c19cb 47705 0 2023-01-29 15:04:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-02a7543c7279738c4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-02a7543c7279738c4 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-6491":"i-02a7543c7279738c4","ebs.csi.aws.com":"i-02a7543c7279738c4"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 15:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-02a7543c7279738c4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:11 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:11 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:11 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:26:11 +0000 UTC,LastTransitionTime:2023-01-29 15:04:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.221,},NodeAddress{Type:ExternalIP,Address:13.124.71.225,},NodeAddress{Type:InternalDNS,Address:i-02a7543c7279738c4.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02a7543c7279738c4.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-124-71-225.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a903135d2101b0b336a192eb75d5e,SystemUUID:ec2a9031-35d2-101b-0b33-6a192eb75d5e,BootID:5a621eea-ba74-4af2-bce8-9484db00ee35,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 15:26:28.726: INFO: 
Logging kubelet events for node i-02a7543c7279738c4
Jan 29 15:26:28.918: INFO: 
Logging pods the kubelet thinks is on node i-02a7543c7279738c4
Jan 29 15:26:29.121: INFO: hostexec-i-02a7543c7279738c4-p4r2h started at 2023-01-29 15:26:14 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:26:29.121: INFO: netserver-1 started at 2023-01-29 15:25:57 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:26:29.121: INFO: webserver-987856868-6qwpd started at 2023-01-29 15:26:17 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:29.121: INFO: cilium-9n5ff started at 2023-01-29 15:04:04 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:26:29.121: INFO: csi-mockplugin-resizer-0 started at 2023-01-29 15:25:19 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:26:29.121: INFO: ebs-csi-node-78jpn started at 2023-01-29 15:04:05 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:26:29.121: INFO: ebs-csi-controller-555658678f-j4666 started at 2023-01-29 15:04:18 +0000 UTC (0+5 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:29.121: INFO: pvc-volume-tester-hcmwb started at 2023-01-29 15:25:31 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container volume-tester ready: true, restart count 0
Jan 29 15:26:29.121: INFO: pod-ephm-test-projected-fd4l started at 2023-01-29 15:24:42 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container test-container-subpath-projected-fd4l ready: false, restart count 0
Jan 29 15:26:29.121: INFO: podaa6a7f38-b2f8-41e1-bae7-ccb6e1a39b5f started at 2023-01-29 15:26:25 +0000 UTC (0+2 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container container-1 ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container container-2 ready: true, restart count 0
Jan 29 15:26:29.121: INFO: bin-false19e450a3-e97d-486b-8531-cd9c0afdc898 started at 2023-01-29 15:25:13 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container bin-false19e450a3-e97d-486b-8531-cd9c0afdc898 ready: false, restart count 0
Jan 29 15:26:29.121: INFO: deployment-74d7dd69db-mdc8h started at 2023-01-29 15:24:30 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container nginx ready: false, restart count 0
Jan 29 15:26:29.121: INFO: csi-mockplugin-0 started at 2023-01-29 15:25:19 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container mock ready: true, restart count 0
Jan 29 15:26:29.121: INFO: pod-d046d507-e14f-43fa-8dc8-bb7d89439c0b started at 2023-01-29 15:26:26 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container write-pod ready: true, restart count 0
Jan 29 15:26:29.121: INFO: webserver-987856868-nzgpl started at 2023-01-29 15:26:18 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:29.121: INFO: pod-configmaps-c861312e-8a41-4165-a014-00ed071485b2 started at 2023-01-29 15:25:15 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:29.121: INFO: 	Container createcm-volume-test ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container delcm-volume-test ready: true, restart count 0
Jan 29 15:26:29.121: INFO: 	Container updcm-volume-test ready: true, restart count 0
E0129 15:26:29.690201    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:29.830: INFO: 
Latency metrics for node i-02a7543c7279738c4
Jan 29 15:26:29.830: INFO: 
Logging node info for node i-05aef881ccbcc4ff8
Jan 29 15:26:30.008: INFO: Node Info: &Node{ObjectMeta:{i-05aef881ccbcc4ff8    43f6fb7c-a120-4145-bed7-ee1c8ff9a8d9 48286 0 2023-01-29 15:04:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-05aef881ccbcc4ff8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-05aef881ccbcc4ff8 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-05aef881ccbcc4ff8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 15:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-29 15:26:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-05aef881ccbcc4ff8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:25:59 +0000 UTC,LastTransitionTime:2023-01-29 15:04:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:25:59 +0000 UTC,LastTransitionTime:2023-01-29 15:04:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:25:59 +0000 UTC,LastTransitionTime:2023-01-29 15:04:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:25:59 +0000 UTC,LastTransitionTime:2023-01-29 15:04:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.43,},NodeAddress{Type:ExternalIP,Address:52.78.242.133,},NodeAddress{Type:InternalDNS,Address:i-05aef881ccbcc4ff8.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-05aef881ccbcc4ff8.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-78-242-133.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f8436978f06f88c07dbb8c360f7,SystemUUID:ec2d5f84-3697-8f06-f88c-07dbb8c360f7,BootID:176bcfc3-6c2e-4b62-b240-6240814ec15d,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0b63cc4cf0e523502],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f3d5b2b4df125104,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0b63cc4cf0e523502,DevicePath:,},},Config:nil,},}
Jan 29 15:26:30.008: INFO: 
Logging kubelet events for node i-05aef881ccbcc4ff8
Jan 29 15:26:30.190: INFO: 
Logging pods the kubelet thinks is on node i-05aef881ccbcc4ff8
Jan 29 15:26:30.387: INFO: pod-ephm-test-configmap-6g6r started at 2023-01-29 15:24:51 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container test-container-subpath-configmap-6g6r ready: false, restart count 0
Jan 29 15:26:30.387: INFO: startup-90ecea98-93bf-4d55-8b4f-164072125b0e started at 2023-01-29 15:22:40 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container busybox ready: false, restart count 0
Jan 29 15:26:30.387: INFO: webserver-7f5969cbc7-2tr89 started at <nil> (0+0 container statuses recorded)
Jan 29 15:26:30.387: INFO: coredns-autoscaler-7cb5c5b969-jd7tc started at 2023-01-29 15:04:16 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container autoscaler ready: true, restart count 0
Jan 29 15:26:30.387: INFO: webserver-987856868-796kq started at 2023-01-29 15:26:18 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:30.387: INFO: inline-volume-tester-f9qdb started at 2023-01-29 15:25:15 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 29 15:26:30.387: INFO: pod-5ae0f58d-6b04-4dab-aa41-1462cba35db9 started at 2023-01-29 15:26:22 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container write-pod ready: false, restart count 0
Jan 29 15:26:30.387: INFO: webserver-987856868-hhmc6 started at 2023-01-29 15:25:59 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:30.387: INFO: netserver-2 started at 2023-01-29 15:25:57 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:26:30.387: INFO: coredns-559769c974-jc24f started at 2023-01-29 15:04:16 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container coredns ready: true, restart count 0
Jan 29 15:26:30.387: INFO: ebs-csi-controller-555658678f-7mhtr started at 2023-01-29 15:04:16 +0000 UTC (0+5 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:30.387: INFO: explicit-nonroot-uid started at 2023-01-29 15:26:23 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container explicit-nonroot-uid ready: false, restart count 0
Jan 29 15:26:30.387: INFO: cilium-bj4gl started at 2023-01-29 15:04:04 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:26:30.387: INFO: ebs-csi-node-bjtsg started at 2023-01-29 15:04:04 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:30.387: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:30.387: INFO: 	Container node-driver-registrar ready: true, restart count 0
E0129 15:26:30.690921    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:31.072: INFO: 
Latency metrics for node i-05aef881ccbcc4ff8
Jan 29 15:26:31.072: INFO: 
Logging node info for node i-07e6c0806a4ed4d9b
Jan 29 15:26:31.250: INFO: Node Info: &Node{ObjectMeta:{i-07e6c0806a4ed4d9b    ecdebd5a-854b-4c19-ba1c-782163e5d553 40895 0 2023-01-29 15:00:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-07e6c0806a4ed4d9b kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07e6c0806a4ed4d9b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 15:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-29 15:01:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:02:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 15:02:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 15:23:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-07e6c0806a4ed4d9b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002131968 0} {<nil>} 3908332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897274368 0} {<nil>} 3805932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:23:57 +0000 UTC,LastTransitionTime:2023-01-29 15:00:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:23:57 +0000 UTC,LastTransitionTime:2023-01-29 15:00:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:23:57 +0000 UTC,LastTransitionTime:2023-01-29 15:00:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:23:57 +0000 UTC,LastTransitionTime:2023-01-29 15:02:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.28,},NodeAddress{Type:ExternalIP,Address:43.201.70.178,},NodeAddress{Type:InternalDNS,Address:i-07e6c0806a4ed4d9b.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e6c0806a4ed4d9b.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-201-70-178.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24b59f7cb7c42be1dbbc18df7ee357,SystemUUID:ec24b59f-7cb7-c42b-e1db-bc18df7ee357,BootID:af1d596f-2579-4827-87e4-016aef9342ca,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41194143,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39794011,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691093,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 15:26:31.250: INFO: 
Logging kubelet events for node i-07e6c0806a4ed4d9b
Jan 29 15:26:31.463: INFO: 
Logging pods the kubelet thinks is on node i-07e6c0806a4ed4d9b
Jan 29 15:26:31.653: INFO: kube-scheduler-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 29 15:26:31.653: INFO: dns-controller-85d56fc6db-tw87s started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container dns-controller ready: true, restart count 0
Jan 29 15:26:31.653: INFO: kops-controller-2kl54 started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container kops-controller ready: true, restart count 0
Jan 29 15:26:31.653: INFO: etcd-manager-main-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (10+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 15:26:31.653: INFO: kube-apiserver-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (0+2 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container healthcheck ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Container kube-apiserver ready: true, restart count 3
Jan 29 15:26:31.653: INFO: kube-controller-manager-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 29 15:26:31.653: INFO: ebs-csi-node-c68rn started at 2023-01-29 15:01:58 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:26:31.653: INFO: cilium-operator-6f7d7f696f-qxwgn started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 29 15:26:31.653: INFO: etcd-manager-events-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (10+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 15:26:31.653: INFO: cilium-9nkz2 started at 2023-01-29 15:01:58 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:26:31.653: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:26:31.653: INFO: aws-cloud-controller-manager-2gf7f started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:31.653: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
E0129 15:26:31.691544    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:32.278: INFO: 
Latency metrics for node i-07e6c0806a4ed4d9b
Jan 29 15:26:32.278: INFO: 
Logging node info for node i-0d88defc538d41c0f
Jan 29 15:26:32.460: INFO: Node Info: &Node{ObjectMeta:{i-0d88defc538d41c0f    cc2b9c7d-665d-4f90-9876-3031a48ddf2f 48298 0 2023-01-29 15:04:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0d88defc538d41c0f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0d88defc538d41c0f topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-workload-2518":"i-0d88defc538d41c0f","ebs.csi.aws.com":"i-0d88defc538d41c0f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:26:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-29 15:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0d88defc538d41c0f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:26:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:26:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.19,},NodeAddress{Type:ExternalIP,Address:3.36.72.235,},NodeAddress{Type:InternalDNS,Address:i-0d88defc538d41c0f.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d88defc538d41c0f.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-36-72-235.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24de7209a1b680f3801c96dc649e59,SystemUUID:ec24de72-09a1-b680-f380-1c96dc649e59,BootID:5e8870dc-fb5f-481a-a173-727fa378b0ab,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-2518^4630018e-9fe9-11ed-b1bb-326c63235d06],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-workload-2518^4630018e-9fe9-11ed-b1bb-326c63235d06,DevicePath:,},},Config:nil,},}
Jan 29 15:26:32.460: INFO: 
Logging kubelet events for node i-0d88defc538d41c0f
Jan 29 15:26:32.646: INFO: 
Logging pods the kubelet thinks is on node i-0d88defc538d41c0f
E0129 15:26:32.692242    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:32.833: INFO: pod1 started at 2023-01-29 15:25:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container container1 ready: true, restart count 0
Jan 29 15:26:32.833: INFO: pvc-volume-tester-hv8l5 started at 2023-01-29 15:26:17 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container volume-tester ready: true, restart count 0
Jan 29 15:26:32.833: INFO: webserver-987856868-tmw54 started at 2023-01-29 15:26:22 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:32.833: INFO: webserver-987856868-8ldpn started at 2023-01-29 15:26:17 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container httpd ready: true, restart count 0
Jan 29 15:26:32.833: INFO: coredns-559769c974-c6m6w started at 2023-01-29 15:04:45 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container coredns ready: true, restart count 0
Jan 29 15:26:32.833: INFO: csi-mockplugin-0 started at 2023-01-29 15:26:11 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:26:32.833: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 15:26:32.833: INFO: 	Container mock ready: true, restart count 0
Jan 29 15:26:32.833: INFO: webserver-7f5969cbc7-sd6k6 started at 2023-01-29 15:26:30 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container httpd ready: false, restart count 0
Jan 29 15:26:32.833: INFO: cilium-xkt7f started at 2023-01-29 15:04:08 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:26:32.833: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:26:32.833: INFO: hostexec-i-0d88defc538d41c0f-4gfs4 started at 2023-01-29 15:26:26 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:26:32.833: INFO: webserver-7f5969cbc7-5c5cx started at 2023-01-29 15:26:30 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container httpd ready: false, restart count 0
Jan 29 15:26:32.833: INFO: netserver-3 started at 2023-01-29 15:25:57 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:26:32.833: INFO: ebs-csi-node-7j66q started at 2023-01-29 15:04:08 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:26:32.833: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:26:32.833: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:26:32.833: INFO: pod2 started at 2023-01-29 15:25:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container container1 ready: true, restart count 0
Jan 29 15:26:32.833: INFO: csi-mockplugin-attacher-0 started at 2023-01-29 15:26:11 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:26:32.833: INFO: 	Container csi-attacher ready: true, restart count 0
E0129 15:26:33.692797    6715 retrywatcher.go:130] "Watch failed" err="context canceled"
Jan 29 15:26:33.702: INFO: 
Latency metrics for node i-0d88defc538d41c0f
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 15:26:33.702 (7.048s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 15:26:33.702 (7.048s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 15:26:33.702
STEP: Destroying namespace "runtimeclass-5331" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 15:26:33.702
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 15:26:33.881 (179ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 15:26:33.881
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 15:26:33.881 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-5331/test-runtimeclass-runtimeclass-5331-preconfigured-handler-6f282 mentions in log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints 5m34s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sscheduling\swithout\staints$'

[FAILED] timed out while waiting for pod runtimeclass-6226/test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/29/23 15:13:21.491

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 15:07:57.784
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 15:07:57.784
Jan 29 15:07:57.784: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/29/23 15:07:57.785
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 15:07:58.326
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 15:07:58.682
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/29/23 15:07:59.038 (1.253s)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 15:07:59.038
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 15:07:59.038 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/29/23 15:07:59.038
Jan 29 15:07:59.398: INFO: Waiting up to 5m0s for pod "hostexec-i-0d88defc538d41c0f-khzt2" in namespace "runtimeclass-6226" to be "running"
Jan 29 15:07:59.577: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Pending", Reason="", readiness=false. Elapsed: 178.817183ms
Jan 29 15:08:01.756: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.358044169s
Jan 29 15:08:03.756: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.357955538s
Jan 29 15:08:05.757: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.359032931s
Jan 29 15:08:07.756: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.358244973s
Jan 29 15:08:09.756: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.358215112s
Jan 29 15:08:11.756: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2": Phase="Running", Reason="", readiness=true. Elapsed: 12.358205006s
Jan 29 15:08:11.756: INFO: Pod "hostexec-i-0d88defc538d41c0f-khzt2" satisfied condition "running"
Jan 29 15:08:11.756: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-6226 PodName:hostexec-i-0d88defc538d41c0f-khzt2 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 29 15:08:11.756: INFO: >>> kubeConfig: /root/.kube/config
Jan 29 15:08:11.757: INFO: ExecWithOptions: Clientset creation
Jan 29 15:08:11.757: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-7f766c79c0e2d093.elb.ap-northeast-2.amazonaws.com/api/v1/namespaces/runtimeclass-6226/pods/hostexec-i-0d88defc538d41c0f-khzt2/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
STEP: Trying to launch a pod without a label to get a node which can launch it. - test/e2e/scheduling/predicates.go:1042 @ 01/29/23 15:08:12.934
Jan 29 15:08:13.116: INFO: Waiting up to 1m0s for pod "without-label" in namespace "runtimeclass-6226" to be "running"
Jan 29 15:08:13.307: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 190.698713ms
Jan 29 15:08:15.486: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 2.36940676s
Jan 29 15:08:17.486: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 4.370161747s
Jan 29 15:08:19.486: INFO: Pod "without-label": Phase="Running", Reason="", readiness=true. Elapsed: 6.370088957s
Jan 29 15:08:19.486: INFO: Pod "without-label" satisfied condition "running"
STEP: Explicitly delete pod here to free the resource it takes. - test/e2e/scheduling/predicates.go:973 @ 01/29/23 15:08:19.666
STEP: Trying to apply a label on the found node. - test/e2e/node/runtimeclass.go:148 @ 01/29/23 15:08:19.851
STEP: verifying the node has the label foo-1a946fc2-9298-403c-a12b-04512ae35814 bar - test/e2e/framework/node/helper.go:63 @ 01/29/23 15:08:20.038
STEP: verifying the node has the label fizz-d54c018f-e558-4149-96b8-21918aa43a62 buzz - test/e2e/framework/node/helper.go:63 @ 01/29/23 15:08:20.409
STEP: Trying to create runtimeclass and pod - test/e2e/node/runtimeclass.go:155 @ 01/29/23 15:08:20.588
Jan 29 15:08:20.948: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t" in namespace "runtimeclass-6226" to be "not pending"
Jan 29 15:08:21.133: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 184.167676ms
Jan 29 15:08:23.319: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2.370674846s
Jan 29 15:08:25.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4.364061155s
Jan 29 15:08:27.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 6.363234991s
Jan 29 15:08:29.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 8.364324998s
Jan 29 15:08:31.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 10.362830057s
Jan 29 15:08:33.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 12.365550578s
Jan 29 15:08:35.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 14.362741137s
Jan 29 15:08:37.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 16.363343978s
Jan 29 15:08:39.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 18.365709088s
Jan 29 15:08:41.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 20.364224837s
Jan 29 15:08:43.317: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 22.368201317s
Jan 29 15:08:45.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 24.365473708s
Jan 29 15:08:47.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 26.362998794s
Jan 29 15:08:49.315: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 28.366524081s
Jan 29 15:08:51.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 30.363631678s
Jan 29 15:08:53.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 32.363008939s
Jan 29 15:08:55.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 34.363505089s
Jan 29 15:08:57.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 36.36377261s
Jan 29 15:08:59.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 38.36348035s
Jan 29 15:09:01.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 40.363683817s
Jan 29 15:09:03.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 42.365244433s
Jan 29 15:09:05.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 44.36304953s
Jan 29 15:09:07.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 46.364301876s
Jan 29 15:09:09.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 48.365910723s
Jan 29 15:09:11.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 50.362949593s
Jan 29 15:09:13.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 52.364085699s
Jan 29 15:09:15.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 54.364495217s
Jan 29 15:09:17.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 56.36378098s
Jan 29 15:09:19.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 58.36385843s
Jan 29 15:09:21.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.363812597s
Jan 29 15:09:23.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.362831227s
Jan 29 15:09:25.317: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.36889967s
Jan 29 15:09:27.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.363864284s
Jan 29 15:09:29.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.363786877s
Jan 29 15:09:31.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.363372861s
Jan 29 15:09:33.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.362941034s
Jan 29 15:09:35.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.364387784s
Jan 29 15:09:37.315: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.366667121s
Jan 29 15:09:39.322: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.373492287s
Jan 29 15:09:41.315: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.366376224s
Jan 29 15:09:43.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.363200799s
Jan 29 15:09:45.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.36332543s
Jan 29 15:09:47.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.363886443s
Jan 29 15:09:49.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.364562936s
Jan 29 15:09:51.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.363339443s
Jan 29 15:09:53.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.36399356s
Jan 29 15:09:55.315: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.366720129s
Jan 29 15:09:57.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.363564059s
Jan 29 15:09:59.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.363437006s
Jan 29 15:10:01.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.363488728s
Jan 29 15:10:03.317: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.368842227s
Jan 29 15:10:05.316: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.36760979s
Jan 29 15:10:07.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.364997041s
Jan 29 15:10:09.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.363467913s
Jan 29 15:10:11.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.363778349s
Jan 29 15:10:13.334: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.386023588s
Jan 29 15:10:15.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.363702414s
Jan 29 15:10:17.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.363076781s
Jan 29 15:10:19.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.363767271s
Jan 29 15:10:21.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.364019907s
Jan 29 15:10:23.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.363988208s
Jan 29 15:10:25.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.363566337s
Jan 29 15:10:27.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.362908657s
Jan 29 15:10:29.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.363409622s
Jan 29 15:10:31.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.363120432s
Jan 29 15:10:33.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.363236848s
Jan 29 15:10:35.315: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.366355868s
Jan 29 15:10:37.316: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.367743226s
Jan 29 15:10:39.320: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.371779512s
Jan 29 15:10:41.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.363251047s
Jan 29 15:10:43.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.362608266s
Jan 29 15:10:45.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.363921796s
Jan 29 15:10:47.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.364176286s
Jan 29 15:10:49.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.365227539s
Jan 29 15:10:51.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.363205238s
Jan 29 15:10:53.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.363418878s
Jan 29 15:10:55.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.36384717s
Jan 29 15:10:57.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.363958656s
Jan 29 15:10:59.317: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.368553497s
Jan 29 15:11:01.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.363334404s
Jan 29 15:11:03.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.362746387s
Jan 29 15:11:05.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.363028112s
Jan 29 15:11:07.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.362789004s
Jan 29 15:11:09.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.363215496s
Jan 29 15:11:11.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.363394158s
Jan 29 15:11:13.316: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.367477583s
Jan 29 15:11:15.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.364430342s
Jan 29 15:11:17.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.363619102s
Jan 29 15:11:19.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.363532606s
Jan 29 15:11:21.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.362946609s
Jan 29 15:11:23.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.363109546s
Jan 29 15:11:25.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.362748869s
Jan 29 15:11:27.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.362755359s
Jan 29 15:11:29.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.363348194s
Jan 29 15:11:31.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.363359811s
Jan 29 15:11:33.317: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.368715563s
Jan 29 15:11:35.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.363299607s
Jan 29 15:11:37.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.362498833s
Jan 29 15:11:39.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.363442049s
Jan 29 15:11:41.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.364464795s
Jan 29 15:11:43.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.363672078s
Jan 29 15:11:45.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.363227327s
Jan 29 15:11:47.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.362886616s
Jan 29 15:11:49.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.362968625s
Jan 29 15:11:51.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.364171347s
Jan 29 15:11:53.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.362984407s
Jan 29 15:11:55.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.365040616s
Jan 29 15:11:57.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.36374112s
Jan 29 15:11:59.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.363221502s
Jan 29 15:12:01.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.363633919s
Jan 29 15:12:03.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.362843269s
Jan 29 15:12:05.316: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.367832307s
Jan 29 15:12:07.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.36392489s
Jan 29 15:12:09.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.363696902s
Jan 29 15:12:11.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.363504014s
Jan 29 15:12:13.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.364252063s
Jan 29 15:12:15.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.363243739s
Jan 29 15:12:17.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.363371027s
Jan 29 15:12:19.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.363724366s
Jan 29 15:12:21.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.364927638s
Jan 29 15:12:23.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.363895683s
Jan 29 15:12:25.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.363898602s
Jan 29 15:12:27.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.362811583s
Jan 29 15:12:29.314: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.365882571s
Jan 29 15:12:31.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.363766667s
Jan 29 15:12:33.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.363750379s
Jan 29 15:12:35.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.363975708s
Jan 29 15:12:37.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.363535327s
Jan 29 15:12:39.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.362816139s
Jan 29 15:12:41.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.363330788s
Jan 29 15:12:43.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.362978574s
Jan 29 15:12:45.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.363707117s
Jan 29 15:12:47.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.363516898s
Jan 29 15:12:49.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.363408747s
Jan 29 15:12:51.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.363066464s
Jan 29 15:12:53.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.362959804s
Jan 29 15:12:55.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.364125706s
Jan 29 15:12:57.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.363884217s
Jan 29 15:12:59.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.363815103s
Jan 29 15:13:01.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.363723409s
Jan 29 15:13:03.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.363003364s
Jan 29 15:13:05.311: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.362858653s
Jan 29 15:13:07.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.363966545s
Jan 29 15:13:09.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.36370476s
Jan 29 15:13:11.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.363298245s
Jan 29 15:13:13.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.363428271s
Jan 29 15:13:15.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.364008991s
Jan 29 15:13:17.313: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.364313856s
Jan 29 15:13:19.315: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.366254487s
Jan 29 15:13:21.312: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.363170752s
Jan 29 15:13:21.490: INFO: Pod "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.541497683s
Jan 29 15:13:21.491: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc002199c80>: {
        msg: "timed out while waiting for pod runtimeclass-6226/test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc001a0e000>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t",
                    GenerateName: "test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclass-",
                    Namespace: "runtimeclass-6226",
                    SelfLink: "",
                    UID: "cc087038-7716-4898-81ca-31ce22a3f16a",
                    ResourceVersion: "4048",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810601700,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810601700,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810601705,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: {
                        "foo-1a946fc2-9298-403c-a12b-04512ae35814": "bar",
                        "fizz-d54c018f-e558-4149-96b8-21918aa43a62": "buzz",
                    },
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0d88defc538d41c0f",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
 ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-6226/test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/29/23 15:13:21.491
< Exit [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/29/23 15:13:21.491 (5m22.453s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 15:13:21.491
Jan 29 15:13:21.491: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/29/23 15:13:21.672 (181ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 15:13:21.672
STEP: removing the label fizz-d54c018f-e558-4149-96b8-21918aa43a62 off the node i-0d88defc538d41c0f - test/e2e/framework/node/helper.go:72 @ 01/29/23 15:13:21.672
STEP: verifying the node doesn't have the label fizz-d54c018f-e558-4149-96b8-21918aa43a62 - test/e2e/framework/node/helper.go:75 @ 01/29/23 15:13:22.037
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 15:13:22.216 (545ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 15:13:22.216
STEP: removing the label foo-1a946fc2-9298-403c-a12b-04512ae35814 off the node i-0d88defc538d41c0f - test/e2e/framework/node/helper.go:72 @ 01/29/23 15:13:22.217
STEP: verifying the node doesn't have the label foo-1a946fc2-9298-403c-a12b-04512ae35814 - test/e2e/framework/node/helper.go:75 @ 01/29/23 15:13:22.586
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/29/23 15:13:22.766 (549ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 15:13:22.766
STEP: Deleting pod hostexec-i-0d88defc538d41c0f-khzt2 in namespace runtimeclass-6226 - test/e2e/framework/pod/delete.go:41 @ 01/29/23 15:13:22.766
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/29/23 15:13:22.959 (193ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 15:13:22.959
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 15:13:22.959 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 15:13:22.959
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 15:13:22.959
STEP: Collecting events from namespace "runtimeclass-6226". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 15:13:22.959
STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 15:13:23.139
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:07:59 +0000 UTC - event for hostexec-i-0d88defc538d41c0f-khzt2: {default-scheduler } Scheduled: Successfully assigned runtimeclass-6226/hostexec-i-0d88defc538d41c0f-khzt2 to i-0d88defc538d41c0f
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:00 +0000 UTC - event for hostexec-i-0d88defc538d41c0f-khzt2: {kubelet i-0d88defc538d41c0f} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:00 +0000 UTC - event for hostexec-i-0d88defc538d41c0f-khzt2: {kubelet i-0d88defc538d41c0f} Created: Created container agnhost-container
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:00 +0000 UTC - event for hostexec-i-0d88defc538d41c0f-khzt2: {kubelet i-0d88defc538d41c0f} Started: Started container agnhost-container
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:13 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned runtimeclass-6226/without-label to i-0d88defc538d41c0f
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:14 +0000 UTC - event for without-label: {kubelet i-0d88defc538d41c0f} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:14 +0000 UTC - event for without-label: {kubelet i-0d88defc538d41c0f} Created: Created container without-label
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:14 +0000 UTC - event for without-label: {kubelet i-0d88defc538d41c0f} Started: Started container without-label
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:19 +0000 UTC - event for without-label: {kubelet i-0d88defc538d41c0f} Killing: Stopping container without-label
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:20 +0000 UTC - event for test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t: {default-scheduler } Scheduled: Successfully assigned runtimeclass-6226/test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t to i-0d88defc538d41c0f
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:08:20 +0000 UTC - event for test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t: {kubelet i-0d88defc538d41c0f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 29 15:13:23.139: INFO: At 2023-01-29 15:13:22 +0000 UTC - event for hostexec-i-0d88defc538d41c0f-khzt2: {kubelet i-0d88defc538d41c0f} Killing: Stopping container agnhost-container
Jan 29 15:13:23.318: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 29 15:13:23.318: INFO: test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t  i-0d88defc538d41c0f  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:08:20 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:08:20 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:08:20 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 15:08:20 +0000 UTC  }]
Jan 29 15:13:23.318: INFO: 
Jan 29 15:13:23.764: INFO: Unable to fetch runtimeclass-6226/test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t)
Jan 29 15:13:23.943: INFO: 
Logging node info for node i-01fdcfd760c8f6458
Jan 29 15:13:24.122: INFO: Node Info: &Node{ObjectMeta:{i-01fdcfd760c8f6458    b8e891f9-47bc-41bf-ba3b-eaded806373a 12931 0 2023-01-29 15:04:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-01fdcfd760c8f6458 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-01fdcfd760c8f6458 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01fdcfd760c8f6458"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 15:12:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-01fdcfd760c8f6458,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:12:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:12:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:12:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:12:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.35,},NodeAddress{Type:ExternalIP,Address:3.34.132.42,},NodeAddress{Type:InternalDNS,Address:i-01fdcfd760c8f6458.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-01fdcfd760c8f6458.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-34-132-42.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2821d88a75e39d0c46cdabf66ddc3a,SystemUUID:ec2821d8-8a75-e39d-0c46-cdabf66ddc3a,BootID:fb8fb5d4-a411-4061-acd7-f095f7bc0c35,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 15:13:24.122: INFO: 
Logging kubelet events for node i-01fdcfd760c8f6458
Jan 29 15:13:24.305: INFO: 
Logging pods the kubelet thinks is on node i-01fdcfd760c8f6458
Jan 29 15:13:24.669: INFO: netserver-0 started at 2023-01-29 15:13:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:24.669: INFO: service-proxy-toggled-6qq5q started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container service-proxy-toggled ready: true, restart count 0
Jan 29 15:13:24.669: INFO: cilium-7pnxd started at 2023-01-29 15:04:05 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:13:24.669: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:13:24.669: INFO: netserver-0 started at <nil> (0+0 container statuses recorded)
Jan 29 15:13:24.669: INFO: ebs-csi-node-7k5b9 started at 2023-01-29 15:04:05 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:24.669: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:24.669: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:24.669: INFO: pod-terminate-status-1-14 started at <nil> (0+0 container statuses recorded)
Jan 29 15:13:24.669: INFO: test-webserver-47ca4c92-ea8e-456e-8eaa-16007e565b3f started at 2023-01-29 15:12:35 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container test-webserver ready: true, restart count 0
Jan 29 15:13:24.669: INFO: netserver-0 started at 2023-01-29 15:13:05 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:24.669: INFO: exceed-active-deadline-nj7db started at 2023-01-29 15:13:10 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container c ready: true, restart count 0
Jan 29 15:13:24.669: INFO: exceed-active-deadline-p4x4q started at 2023-01-29 15:13:10 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container c ready: true, restart count 0
Jan 29 15:13:24.669: INFO: netserver-0 started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:24.669: INFO: host-test-container-pod started at 2023-01-29 15:13:18 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 29 15:13:24.669: INFO: service-proxy-disabled-j5fht started at 2023-01-29 15:12:48 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container service-proxy-disabled ready: true, restart count 0
Jan 29 15:13:24.669: INFO: busybox-a3a06026-ce1c-4a21-afc0-05bf6d13d447 started at 2023-01-29 15:11:44 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container busybox ready: true, restart count 0
Jan 29 15:13:24.669: INFO: test-container-pod started at 2023-01-29 15:13:16 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container webserver ready: false, restart count 0
Jan 29 15:13:24.669: INFO: test-container-pod started at 2023-01-29 15:13:17 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container webserver ready: false, restart count 0
Jan 29 15:13:24.669: INFO: liveness-2a7f032d-e46b-4ebd-9e66-5c1f1338a8be started at 2023-01-29 15:12:17 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container agnhost-container ready: true, restart count 3
Jan 29 15:13:24.669: INFO: pause-pod-1 started at 2023-01-29 15:11:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:24.669: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:13:26.044: INFO: 
Latency metrics for node i-01fdcfd760c8f6458
Jan 29 15:13:26.044: INFO: 
Logging node info for node i-02a7543c7279738c4
Jan 29 15:13:26.223: INFO: Node Info: &Node{ObjectMeta:{i-02a7543c7279738c4    dab094ab-9fd8-4656-bcde-75f7237c19cb 15205 0 2023-01-29 15:04:04 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-02a7543c7279738c4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-02a7543c7279738c4 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8557":"i-02a7543c7279738c4","csi-mock-csi-mock-volumes-attach-1188":"i-02a7543c7279738c4","csi-mock-csi-mock-volumes-workload-9133":"i-02a7543c7279738c4","ebs.csi.aws.com":"i-02a7543c7279738c4"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 15:04:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 15:13:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-02a7543c7279738c4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:13:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:13:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:13:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:04 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:13:25 +0000 UTC,LastTransitionTime:2023-01-29 15:04:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.221,},NodeAddress{Type:ExternalIP,Address:13.124.71.225,},NodeAddress{Type:InternalDNS,Address:i-02a7543c7279738c4.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02a7543c7279738c4.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-124-71-225.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a903135d2101b0b336a192eb75d5e,SystemUUID:ec2a9031-35d2-101b-0b33-6a192eb75d5e,BootID:5a621eea-ba74-4af2-bce8-9484db00ee35,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 15:13:26.223: INFO: 
Logging kubelet events for node i-02a7543c7279738c4
Jan 29 15:13:26.406: INFO: 
Logging pods the kubelet thinks is on node i-02a7543c7279738c4
Jan 29 15:13:26.611: INFO: csi-mockplugin-0 started at 2023-01-29 15:13:21 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container mock ready: true, restart count 0
Jan 29 15:13:26.611: INFO: netserver-1 started at 2023-01-29 15:13:23 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container webserver ready: false, restart count 0
Jan 29 15:13:26.611: INFO: csi-mockplugin-attacher-0 started at 2023-01-29 15:13:20 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:13:26.611: INFO: cilium-9n5ff started at 2023-01-29 15:04:04 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:13:26.611: INFO: netserver-1 started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:26.611: INFO: csi-mockplugin-0 started at 2023-01-29 15:13:20 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container mock ready: true, restart count 0
Jan 29 15:13:26.611: INFO: ebs-csi-node-78jpn started at 2023-01-29 15:04:05 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:26.611: INFO: ebs-csi-controller-555658678f-j4666 started at 2023-01-29 15:04:18 +0000 UTC (0+5 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:26.611: INFO: csi-hostpathplugin-0 started at 2023-01-29 15:12:34 +0000 UTC (0+7 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:26.611: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:26.611: INFO: service-proxy-disabled-hmczn started at 2023-01-29 15:12:48 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container service-proxy-disabled ready: true, restart count 0
Jan 29 15:13:26.611: INFO: csi-mockplugin-attacher-0 started at 2023-01-29 15:13:22 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:13:26.611: INFO: netserver-1 started at 2023-01-29 15:13:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:26.611: INFO: netserver-1 started at 2023-01-29 15:13:05 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:26.611: INFO: 	Container webserver ready: false, restart count 0
Jan 29 15:13:27.422: INFO: 
Latency metrics for node i-02a7543c7279738c4
Jan 29 15:13:27.422: INFO: 
Logging node info for node i-05aef881ccbcc4ff8
Jan 29 15:13:27.601: INFO: Node Info: &Node{ObjectMeta:{i-05aef881ccbcc4ff8    43f6fb7c-a120-4145-bed7-ee1c8ff9a8d9 14903 0 2023-01-29 15:04:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-05aef881ccbcc4ff8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-05aef881ccbcc4ff8 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-attach-3702":"i-05aef881ccbcc4ff8","ebs.csi.aws.com":"i-05aef881ccbcc4ff8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 15:04:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-29 15:13:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-05aef881ccbcc4ff8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:12:53 +0000 UTC,LastTransitionTime:2023-01-29 15:04:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:12:53 +0000 UTC,LastTransitionTime:2023-01-29 15:04:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:12:53 +0000 UTC,LastTransitionTime:2023-01-29 15:04:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:12:53 +0000 UTC,LastTransitionTime:2023-01-29 15:04:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.43,},NodeAddress{Type:ExternalIP,Address:52.78.242.133,},NodeAddress{Type:InternalDNS,Address:i-05aef881ccbcc4ff8.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-05aef881ccbcc4ff8.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-78-242-133.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d5f8436978f06f88c07dbb8c360f7,SystemUUID:ec2d5f84-3697-8f06-f88c-07dbb8c360f7,BootID:176bcfc3-6c2e-4b62-b240-6240814ec15d,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 15:13:27.601: INFO: 
Logging kubelet events for node i-05aef881ccbcc4ff8
Jan 29 15:13:27.783: INFO: 
Logging pods the kubelet thinks is on node i-05aef881ccbcc4ff8
Jan 29 15:13:27.972: INFO: ebs-csi-controller-555658678f-7mhtr started at 2023-01-29 15:04:16 +0000 UTC (0+5 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:27.972: INFO: webserver-pod started at 2023-01-29 15:11:50 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container agnhost ready: false, restart count 0
Jan 29 15:13:27.972: INFO: cilium-bj4gl started at 2023-01-29 15:04:04 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:13:27.972: INFO: ebs-csi-node-bjtsg started at 2023-01-29 15:04:04 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:27.972: INFO: hostexec-i-05aef881ccbcc4ff8-btdbk started at 2023-01-29 15:12:44 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:13:27.972: INFO: service-proxy-toggled-c8zhm started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container service-proxy-toggled ready: true, restart count 0
Jan 29 15:13:27.972: INFO: netserver-2 started at 2023-01-29 15:13:23 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container webserver ready: false, restart count 0
Jan 29 15:13:27.972: INFO: netserver-2 started at 2023-01-29 15:13:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:27.972: INFO: coredns-autoscaler-7cb5c5b969-jd7tc started at 2023-01-29 15:04:16 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container autoscaler ready: true, restart count 0
Jan 29 15:13:27.972: INFO: pod-subpath-test-preprovisionedpv-6mcn started at 2023-01-29 15:13:05 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Init container init-volume-preprovisionedpv-6mcn ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container test-container-subpath-preprovisionedpv-6mcn ready: false, restart count 0
Jan 29 15:13:27.972: INFO: netserver-2 started at 2023-01-29 15:13:05 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:27.972: INFO: netserver-2 started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:27.972: INFO: service-proxy-disabled-rm8x5 started at 2023-01-29 15:12:48 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container service-proxy-disabled ready: true, restart count 0
Jan 29 15:13:27.972: INFO: coredns-559769c974-jc24f started at 2023-01-29 15:04:16 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container coredns ready: true, restart count 0
Jan 29 15:13:27.972: INFO: csi-mockplugin-0 started at 2023-01-29 15:13:16 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:27.972: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 29 15:13:27.972: INFO: 	Container mock ready: true, restart count 0
Jan 29 15:13:28.776: INFO: 
Latency metrics for node i-05aef881ccbcc4ff8
Jan 29 15:13:28.776: INFO: 
Logging node info for node i-07e6c0806a4ed4d9b
Jan 29 15:13:28.955: INFO: Node Info: &Node{ObjectMeta:{i-07e6c0806a4ed4d9b    ecdebd5a-854b-4c19-ba1c-782163e5d553 4478 0 2023-01-29 15:00:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-07e6c0806a4ed4d9b kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07e6c0806a4ed4d9b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 15:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-29 15:01:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:02:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:02:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 15:02:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 15:08:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-07e6c0806a4ed4d9b,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002131968 0} {<nil>} 3908332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897274368 0} {<nil>} 3805932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:08:38 +0000 UTC,LastTransitionTime:2023-01-29 15:00:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:08:38 +0000 UTC,LastTransitionTime:2023-01-29 15:00:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:08:38 +0000 UTC,LastTransitionTime:2023-01-29 15:00:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:08:38 +0000 UTC,LastTransitionTime:2023-01-29 15:02:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.28,},NodeAddress{Type:ExternalIP,Address:43.201.70.178,},NodeAddress{Type:InternalDNS,Address:i-07e6c0806a4ed4d9b.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e6c0806a4ed4d9b.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-201-70-178.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24b59f7cb7c42be1dbbc18df7ee357,SystemUUID:ec24b59f-7cb7-c42b-e1db-bc18df7ee357,BootID:af1d596f-2579-4827-87e4-016aef9342ca,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41194143,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39794011,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691093,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 29 15:13:28.955: INFO: 
Logging kubelet events for node i-07e6c0806a4ed4d9b
Jan 29 15:13:29.137: INFO: 
Logging pods the kubelet thinks is on node i-07e6c0806a4ed4d9b
Jan 29 15:13:29.324: INFO: etcd-manager-events-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (10+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 15:13:29.324: INFO: cilium-9nkz2 started at 2023-01-29 15:01:58 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:13:29.324: INFO: aws-cloud-controller-manager-2gf7f started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 29 15:13:29.324: INFO: ebs-csi-node-c68rn started at 2023-01-29 15:01:58 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:29.324: INFO: cilium-operator-6f7d7f696f-qxwgn started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 29 15:13:29.324: INFO: kops-controller-2kl54 started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container kops-controller ready: true, restart count 0
Jan 29 15:13:29.324: INFO: etcd-manager-main-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (10+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 29 15:13:29.324: INFO: kube-apiserver-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (0+2 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container healthcheck ready: true, restart count 0
Jan 29 15:13:29.324: INFO: 	Container kube-apiserver ready: true, restart count 3
Jan 29 15:13:29.324: INFO: kube-controller-manager-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 29 15:13:29.324: INFO: kube-scheduler-i-07e6c0806a4ed4d9b started at 2023-01-29 14:59:01 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 29 15:13:29.324: INFO: dns-controller-85d56fc6db-tw87s started at 2023-01-29 15:01:58 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:29.324: INFO: 	Container dns-controller ready: true, restart count 0
Jan 29 15:13:29.965: INFO: 
Latency metrics for node i-07e6c0806a4ed4d9b
Jan 29 15:13:29.965: INFO: 
Logging node info for node i-0d88defc538d41c0f
Jan 29 15:13:30.143: INFO: Node Info: &Node{ObjectMeta:{i-0d88defc538d41c0f    cc2b9c7d-665d-4f90-9876-3031a48ddf2f 15334 0 2023-01-29 15:04:07 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0d88defc538d41c0f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0d88defc538d41c0f topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2930":"i-0d88defc538d41c0f","ebs.csi.aws.com":"i-0d88defc538d41c0f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-29 15:04:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:04:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-29 15:13:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-29 15:13:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0d88defc538d41c0f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 15:13:29 +0000 UTC,LastTransitionTime:2023-01-29 15:04:07 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 15:13:29 +0000 UTC,LastTransitionTime:2023-01-29 15:04:07 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 15:13:29 +0000 UTC,LastTransitionTime:2023-01-29 15:04:07 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 15:13:29 +0000 UTC,LastTransitionTime:2023-01-29 15:04:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.19,},NodeAddress{Type:ExternalIP,Address:3.36.72.235,},NodeAddress{Type:InternalDNS,Address:i-0d88defc538d41c0f.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d88defc538d41c0f.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-36-72-235.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24de7209a1b680f3801c96dc649e59,SystemUUID:ec24de72-09a1-b680-f380-1c96dc649e59,BootID:5e8870dc-fb5f-481a-a173-727fa378b0ab,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.16,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-07df6709b858d1254],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-07df6709b858d1254,DevicePath:,},},Config:nil,},}
Jan 29 15:13:30.144: INFO: 
Logging kubelet events for node i-0d88defc538d41c0f
Jan 29 15:13:30.326: INFO: 
Logging pods the kubelet thinks is on node i-0d88defc538d41c0f
Jan 29 15:13:30.529: INFO: pod-78e859b2-6298-4c11-89f0-55edffa12d66 started at 2023-01-29 15:13:18 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.529: INFO: 	Container write-pod ready: false, restart count 0
Jan 29 15:13:30.530: INFO: verify-service-down-host-exec-pod started at 2023-01-29 15:13:21 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 29 15:13:30.530: INFO: cilium-xkt7f started at 2023-01-29 15:04:08 +0000 UTC (1+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 29 15:13:30.530: INFO: agnhost started at 2023-01-29 15:13:20 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container agnhost ready: true, restart count 0
Jan 29 15:13:30.530: INFO: netserver-3 started at 2023-01-29 15:13:02 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:30.530: INFO: ebs-csi-node-7j66q started at 2023-01-29 15:04:08 +0000 UTC (0+3 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:30.530: INFO: liveness-8547f101-bba9-4856-8856-9600e3aab698 started at 2023-01-29 15:11:34 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 29 15:13:30.530: INFO: netserver-3 started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:30.530: INFO: netserver-3 started at 2023-01-29 15:13:06 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container webserver ready: true, restart count 0
Jan 29 15:13:30.530: INFO: netserver-3 started at 2023-01-29 15:13:24 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container webserver ready: false, restart count 0
Jan 29 15:13:30.530: INFO: service-proxy-toggled-scxs8 started at 2023-01-29 15:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container service-proxy-toggled ready: true, restart count 0
Jan 29 15:13:30.530: INFO: coredns-559769c974-c6m6w started at 2023-01-29 15:04:45 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container coredns ready: true, restart count 0
Jan 29 15:13:30.530: INFO: csi-hostpathplugin-0 started at 2023-01-29 15:13:22 +0000 UTC (0+7 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container hostpath ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 29 15:13:30.530: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 29 15:13:30.530: INFO: test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t started at 2023-01-29 15:08:20 +0000 UTC (0+1 container statuses recorded)
Jan 29 15:13:30.530: INFO: 	Container test ready: false, restart count 0
Jan 29 15:13:31.648: INFO: 
Latency metrics for node i-0d88defc538d41c0f
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 15:13:31.649 (8.69s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/29/23 15:13:31.649 (8.69s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 15:13:31.649
STEP: Destroying namespace "runtimeclass-6226" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 15:13:31.649
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/29/23 15:13:31.832 (184ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 15:13:31.832
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 15:13:31.833 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-6226/test-runtimeclass-runtimeclass-6226-non-conflict-runtimeclnx68t mentions in log files | View test history on testgrid

kubetest2 Test 24m48s

exit status 255
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 895 Passed Tests

Show 6516 Skipped Tests

Result	FAILURE
Tests	3 failed / 895 succeeded
Started	2023-01-29 14:55
Elapsed	40m59s
Revision	master