e2e-kops-warm-pool #1619468953724129280 Results

Test Failures

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] 5m18s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sa\sconfigured\shandler\s\[NodeFeature\:RuntimeHandler\]$'

[FAILED] timed out while waiting for pod runtimeclass-8015/test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9 to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/28/23 23:14:08.98

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 23:08:56.985
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/28/23 23:08:56.985
Jan 28 23:08:56.985: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/28/23 23:08:56.988
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/28/23 23:08:57.441
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/28/23 23:08:57.734
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 23:08:58.027 (1.042s)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 23:08:58.027
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 23:08:58.027 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/28/23 23:08:58.027
Jan 28 23:08:58.345: INFO: Waiting up to 5m0s for pod "hostexec-i-0ca5d9ed6d7ac3691-w527p" in namespace "runtimeclass-8015" to be "running"
Jan 28 23:08:58.495: INFO: Pod "hostexec-i-0ca5d9ed6d7ac3691-w527p": Phase="Pending", Reason="", readiness=false. Elapsed: 150.724216ms
Jan 28 23:09:00.643: INFO: Pod "hostexec-i-0ca5d9ed6d7ac3691-w527p": Phase="Pending", Reason="", readiness=false. Elapsed: 2.297985134s
Jan 28 23:09:02.643: INFO: Pod "hostexec-i-0ca5d9ed6d7ac3691-w527p": Phase="Pending", Reason="", readiness=false. Elapsed: 4.298404795s
Jan 28 23:09:04.643: INFO: Pod "hostexec-i-0ca5d9ed6d7ac3691-w527p": Phase="Pending", Reason="", readiness=false. Elapsed: 6.29877513s
Jan 28 23:09:06.644: INFO: Pod "hostexec-i-0ca5d9ed6d7ac3691-w527p": Phase="Running", Reason="", readiness=true. Elapsed: 8.2987766s
Jan 28 23:09:06.644: INFO: Pod "hostexec-i-0ca5d9ed6d7ac3691-w527p" satisfied condition "running"
Jan 28 23:09:06.644: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-8015 PodName:hostexec-i-0ca5d9ed6d7ac3691-w527p ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 28 23:09:06.644: INFO: >>> kubeConfig: /root/.kube/config
Jan 28 23:09:06.645: INFO: ExecWithOptions: Clientset creation
Jan 28 23:09:06.645: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-9926793599095977.elb.ap-northeast-1.amazonaws.com/api/v1/namespaces/runtimeclass-8015/pods/hostexec-i-0ca5d9ed6d7ac3691-w527p/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
Jan 28 23:09:08.530: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9" in namespace "runtimeclass-8015" to be "Succeeded or Failed"
Jan 28 23:09:08.684: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 153.974688ms
Jan 28 23:09:10.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.301760024s
Jan 28 23:09:12.841: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.310446165s
Jan 28 23:09:14.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.302577761s
Jan 28 23:09:16.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.306245961s
Jan 28 23:09:18.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.302859255s
Jan 28 23:09:20.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 12.306344078s
Jan 28 23:09:22.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 14.3019295s
Jan 28 23:09:24.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 16.302559077s
Jan 28 23:09:26.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 18.302835542s
Jan 28 23:09:28.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 20.306853179s
Jan 28 23:09:30.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 22.302433493s
Jan 28 23:09:32.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 24.301953553s
Jan 28 23:09:34.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 26.302339292s
Jan 28 23:09:36.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 28.302242827s
Jan 28 23:09:38.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 30.301588737s
Jan 28 23:09:40.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 32.302153079s
Jan 28 23:09:42.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 34.302823451s
Jan 28 23:09:44.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 36.30157354s
Jan 28 23:09:46.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 38.302488179s
Jan 28 23:09:48.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 40.301768424s
Jan 28 23:09:50.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 42.306296826s
Jan 28 23:09:52.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 44.301708583s
Jan 28 23:09:54.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 46.3021119s
Jan 28 23:09:56.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 48.302168146s
Jan 28 23:09:58.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 50.302951996s
Jan 28 23:10:00.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 52.302717817s
Jan 28 23:10:02.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 54.304590147s
Jan 28 23:10:04.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 56.303339763s
Jan 28 23:10:06.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 58.303596413s
Jan 28 23:10:08.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.301593359s
Jan 28 23:10:10.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.302263378s
Jan 28 23:10:12.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.302727006s
Jan 28 23:10:14.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.301929951s
Jan 28 23:10:16.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.301928711s
Jan 28 23:10:18.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.304575139s
Jan 28 23:10:20.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.301629922s
Jan 28 23:10:22.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.3017105s
Jan 28 23:10:24.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.302842699s
Jan 28 23:10:26.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.304679939s
Jan 28 23:10:28.836: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.305619354s
Jan 28 23:10:30.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.303162597s
Jan 28 23:10:32.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.302511146s
Jan 28 23:10:34.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.304778011s
Jan 28 23:10:36.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.301782023s
Jan 28 23:10:38.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.302264688s
Jan 28 23:10:40.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.301280466s
Jan 28 23:10:42.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.301505295s
Jan 28 23:10:44.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.303359587s
Jan 28 23:10:46.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.301356216s
Jan 28 23:10:48.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.302073221s
Jan 28 23:10:50.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.302259989s
Jan 28 23:10:52.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.302632896s
Jan 28 23:10:54.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.301640754s
Jan 28 23:10:56.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.302134954s
Jan 28 23:10:58.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.302307374s
Jan 28 23:11:00.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.301947999s
Jan 28 23:11:02.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.303012401s
Jan 28 23:11:04.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.301848913s
Jan 28 23:11:06.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.302408229s
Jan 28 23:11:08.858: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.327975889s
Jan 28 23:11:10.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.302109891s
Jan 28 23:11:12.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.301686195s
Jan 28 23:11:14.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.301795554s
Jan 28 23:11:16.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.30234351s
Jan 28 23:11:18.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.302910216s
Jan 28 23:11:20.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.301373573s
Jan 28 23:11:22.839: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.308792549s
Jan 28 23:11:24.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.304797391s
Jan 28 23:11:26.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.301897906s
Jan 28 23:11:28.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.303978999s
Jan 28 23:11:30.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.30266501s
Jan 28 23:11:32.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.301374561s
Jan 28 23:11:34.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.303211065s
Jan 28 23:11:36.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.306304509s
Jan 28 23:11:38.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.304618932s
Jan 28 23:11:40.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.302649033s
Jan 28 23:11:42.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.302187543s
Jan 28 23:11:44.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.302757903s
Jan 28 23:11:46.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.30205065s
Jan 28 23:11:48.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.302714018s
Jan 28 23:11:50.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.302512605s
Jan 28 23:11:52.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.303485211s
Jan 28 23:11:54.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.301782638s
Jan 28 23:11:56.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.301830945s
Jan 28 23:11:58.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.301727756s
Jan 28 23:12:00.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.302642698s
Jan 28 23:12:02.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.306224634s
Jan 28 23:12:04.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.303317752s
Jan 28 23:12:06.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.301814276s
Jan 28 23:12:08.838: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.307643995s
Jan 28 23:12:10.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.302170433s
Jan 28 23:12:12.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.302080338s
Jan 28 23:12:14.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.301905049s
Jan 28 23:12:16.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.302561793s
Jan 28 23:12:18.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.307080989s
Jan 28 23:12:20.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.302399628s
Jan 28 23:12:22.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.302356565s
Jan 28 23:12:24.853: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.322300215s
Jan 28 23:12:26.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.302346865s
Jan 28 23:12:28.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.302812133s
Jan 28 23:12:30.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.302762674s
Jan 28 23:12:32.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.302165128s
Jan 28 23:12:34.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.302403308s
Jan 28 23:12:36.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.302364173s
Jan 28 23:12:38.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.302266294s
Jan 28 23:12:40.844: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.314081022s
Jan 28 23:12:42.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.302678885s
Jan 28 23:12:44.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.302259146s
Jan 28 23:12:46.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.304455053s
Jan 28 23:12:48.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.30242884s
Jan 28 23:12:50.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.302966324s
Jan 28 23:12:52.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.301514101s
Jan 28 23:12:54.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.30289904s
Jan 28 23:12:56.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.301386274s
Jan 28 23:12:58.841: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.310989934s
Jan 28 23:13:00.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.302592174s
Jan 28 23:13:02.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.302678265s
Jan 28 23:13:04.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.30217622s
Jan 28 23:13:06.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.302183471s
Jan 28 23:13:08.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.302542782s
Jan 28 23:13:10.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.302012251s
Jan 28 23:13:12.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.3014952s
Jan 28 23:13:14.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.302290703s
Jan 28 23:13:16.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.302702683s
Jan 28 23:13:18.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.303651849s
Jan 28 23:13:20.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.302194542s
Jan 28 23:13:22.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.305047668s
Jan 28 23:13:24.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.3027766s
Jan 28 23:13:26.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.303270694s
Jan 28 23:13:28.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.301394785s
Jan 28 23:13:30.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.301677073s
Jan 28 23:13:32.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.30232512s
Jan 28 23:13:34.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.301756802s
Jan 28 23:13:36.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.302672006s
Jan 28 23:13:38.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.301995228s
Jan 28 23:13:40.835: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.304136452s
Jan 28 23:13:42.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.302885961s
Jan 28 23:13:44.837: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.30640049s
Jan 28 23:13:46.834: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.303279334s
Jan 28 23:13:48.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.301321118s
Jan 28 23:13:50.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.302257092s
Jan 28 23:13:52.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.302076898s
Jan 28 23:13:54.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.301612709s
Jan 28 23:13:56.833: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.302290975s
Jan 28 23:13:58.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.301493064s
Jan 28 23:14:00.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.301393966s
Jan 28 23:14:02.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.301847432s
Jan 28 23:14:04.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.301824437s
Jan 28 23:14:06.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.30143734s
Jan 28 23:14:08.832: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.301842271s
Jan 28 23:14:08.979: INFO: Pod "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.448652205s
Jan 28 23:14:08.980: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc005df5c50>: {
        msg: "timed out while waiting for pod runtimeclass-8015/test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9 to be Succeeded or Failed",
        observedObjects: [
            <*v1.Pod | 0xc003b38000>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9",
                    GenerateName: "test-runtimeclass-runtimeclass-8015-preconfigured-handler-",
                    Namespace: "runtimeclass-8015",
                    SelfLink: "",
                    UID: "1e37113f-757f-4077-816d-4593710b807b",
                    ResourceVersion: "3778",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810544148,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810544148,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810544151,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: nil,
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0e580b9a44737376d",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
                        SupplementalGroups: nil,
                        FSGroup: nil,
                        Sysctls: nil,
                        FSGroupChangePolicy: nil,
                ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-8015/test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9 to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/28/23 23:14:08.98
< Exit [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/28/23 23:14:08.98 (5m10.953s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 23:14:08.98
Jan 28 23:14:08.980: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 23:14:09.129 (148ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/28/23 23:14:09.129
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/28/23 23:14:09.282 (154ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 23:14:09.282
STEP: Deleting pod hostexec-i-0ca5d9ed6d7ac3691-w527p in namespace runtimeclass-8015 - test/e2e/framework/pod/delete.go:41 @ 01/28/23 23:14:09.283
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 23:14:09.44 (158ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 23:14:09.44
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 23:14:09.441 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 23:14:09.441
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 23:14:09.441
STEP: Collecting events from namespace "runtimeclass-8015". - test/e2e/framework/debug/dump.go:42 @ 01/28/23 23:14:09.441
STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 01/28/23 23:14:09.588
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:08:58 +0000 UTC - event for hostexec-i-0ca5d9ed6d7ac3691-w527p: {default-scheduler } Scheduled: Successfully assigned runtimeclass-8015/hostexec-i-0ca5d9ed6d7ac3691-w527p to i-0ca5d9ed6d7ac3691
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:08:59 +0000 UTC - event for hostexec-i-0ca5d9ed6d7ac3691-w527p: {kubelet i-0ca5d9ed6d7ac3691} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:08:59 +0000 UTC - event for hostexec-i-0ca5d9ed6d7ac3691-w527p: {kubelet i-0ca5d9ed6d7ac3691} Created: Created container agnhost-container
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:08:59 +0000 UTC - event for hostexec-i-0ca5d9ed6d7ac3691-w527p: {kubelet i-0ca5d9ed6d7ac3691} Started: Started container agnhost-container
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:09:08 +0000 UTC - event for test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9: {default-scheduler } Scheduled: Successfully assigned runtimeclass-8015/test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9 to i-0e580b9a44737376d
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:09:08 +0000 UTC - event for test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9: {kubelet i-0e580b9a44737376d} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 28 23:14:09.588: INFO: At 2023-01-28 23:14:09 +0000 UTC - event for hostexec-i-0ca5d9ed6d7ac3691-w527p: {kubelet i-0ca5d9ed6d7ac3691} Killing: Stopping container agnhost-container
Jan 28 23:14:09.735: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 28 23:14:09.735: INFO: test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9  i-0e580b9a44737376d  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:09:08 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:09:08 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:09:08 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:09:08 +0000 UTC  }]
Jan 28 23:14:09.735: INFO: 
Jan 28 23:14:09.884: INFO: Unable to fetch runtimeclass-8015/test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9)
Jan 28 23:14:10.033: INFO: 
Logging node info for node i-0048d553d1e818ce2
Jan 28 23:14:10.179: INFO: Node Info: &Node{ObjectMeta:{i-0048d553d1e818ce2    5f406844-5ab1-474d-b516-d64f73ef8852 4316 0 2023-01-28 23:01:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0048d553d1e818ce2 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0048d553d1e818ce2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-28 23:01:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-28 23:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:03:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:03:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-28 23:03:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-28 23:09:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0048d553d1e818ce2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002136064 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897278464 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:09:23 +0000 UTC,LastTransitionTime:2023-01-28 23:01:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:09:23 +0000 UTC,LastTransitionTime:2023-01-28 23:01:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:09:23 +0000 UTC,LastTransitionTime:2023-01-28 23:01:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:09:23 +0000 UTC,LastTransitionTime:2023-01-28 23:03:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.204,},NodeAddress{Type:ExternalIP,Address:43.207.83.71,},NodeAddress{Type:InternalDNS,Address:i-0048d553d1e818ce2.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0048d553d1e818ce2.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-207-83-71.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec206bc212eb805963f847c43a5e9ed4,SystemUUID:ec206bc2-12eb-8059-63f8-47c43a5e9ed4,BootID:b575946a-8d48-4368-a1ce-ecd4b0610daf,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41194354,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39794006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691090,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 23:14:10.180: INFO: 
Logging kubelet events for node i-0048d553d1e818ce2
Jan 28 23:14:10.333: INFO: 
Logging pods the kubelet thinks is on node i-0048d553d1e818ce2
Jan 28 23:14:10.522: INFO: kube-controller-manager-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 28 23:14:10.522: INFO: etcd-manager-events-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (10+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 23:14:10.522: INFO: etcd-manager-main-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (10+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 23:14:10.522: INFO: aws-cloud-controller-manager-lgp2g started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 28 23:14:10.522: INFO: cilium-xf9g8 started at 2023-01-28 23:02:47 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:14:10.522: INFO: cilium-operator-6f7d7f696f-z945g started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 28 23:14:10.522: INFO: kops-controller-7lnlv started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container kops-controller ready: true, restart count 0
Jan 28 23:14:10.522: INFO: kube-scheduler-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 28 23:14:10.522: INFO: kube-apiserver-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (0+2 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container healthcheck ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Container kube-apiserver ready: true, restart count 2
Jan 28 23:14:10.522: INFO: ebs-csi-node-7xkq5 started at 2023-01-28 23:02:47 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:10.522: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:14:10.522: INFO: dns-controller-85d56fc6db-h8m2h started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:10.522: INFO: 	Container dns-controller ready: true, restart count 0
Jan 28 23:14:11.041: INFO: 
Latency metrics for node i-0048d553d1e818ce2
Jan 28 23:14:11.041: INFO: 
Logging node info for node i-025b378c35ee44e8d
Jan 28 23:14:11.189: INFO: Node Info: &Node{ObjectMeta:{i-025b378c35ee44e8d    2707438c-c6ef-4bcc-998a-fc257e4527e1 15071 0 2023-01-28 23:04:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-025b378c35ee44e8d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-025b378c35ee44e8d topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-025b378c35ee44e8d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:13:49 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 23:13:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-025b378c35ee44e8d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:04:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:04:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:04:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:05:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.147,},NodeAddress{Type:ExternalIP,Address:18.183.174.226,},NodeAddress{Type:InternalDNS,Address:i-025b378c35ee44e8d.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025b378c35ee44e8d.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-183-174-226.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2edd1afcb5a7ac731165fb411f29b1,SystemUUID:ec2edd1a-fcb5-a7ac-7311-65fb411f29b1,BootID:4f71aed6-a13a-4883-a811-3f7fe6528ad3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0100e075d8664bec1 kubernetes.io/csi/ebs.csi.aws.com^vol-07aca99ac1d64b869 kubernetes.io/csi/ebs.csi.aws.com^vol-0e4c6bd0435b13d34],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0100e075d8664bec1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e4c6bd0435b13d34,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-07aca99ac1d64b869,DevicePath:,},},Config:nil,},}
Jan 28 23:14:11.190: INFO: 
Logging kubelet events for node i-025b378c35ee44e8d
Jan 28 23:14:11.341: INFO: 
Logging pods the kubelet thinks is on node i-025b378c35ee44e8d
Jan 28 23:14:11.493: INFO: pod-413dc908-9828-4603-af4c-c42ec501dbb9 started at 2023-01-28 23:14:03 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container write-pod ready: false, restart count 0
Jan 28 23:14:11.493: INFO: coredns-559769c974-xf25h started at 2023-01-28 23:05:07 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container coredns ready: true, restart count 0
Jan 28 23:14:11.493: INFO: inline-volume-tester-crvrc started at 2023-01-28 23:13:45 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 28 23:14:11.493: INFO: pod-configmaps-28d39e73-8aa2-4c98-8d71-08adb078a319 started at 2023-01-28 23:14:06 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container createcm-volume-test ready: true, restart count 0
Jan 28 23:14:11.493: INFO: 	Container delcm-volume-test ready: true, restart count 0
Jan 28 23:14:11.493: INFO: 	Container updcm-volume-test ready: true, restart count 0
Jan 28 23:14:11.493: INFO: ebs-csi-node-dgzkq started at 2023-01-28 23:04:50 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:11.493: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:11.493: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:14:11.493: INFO: test-rolling-update-with-lb-56d9b65d4c-kdsjx started at 2023-01-28 23:13:56 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container agnhost ready: true, restart count 0
Jan 28 23:14:11.493: INFO: forbid-27915794-cwggh started at 2023-01-28 23:14:00 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Container c ready: true, restart count 0
Jan 28 23:14:11.493: INFO: cilium-kbvhs started at 2023-01-28 23:04:50 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:14:11.493: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:14:11.493: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:14:12.029: INFO: 
Latency metrics for node i-025b378c35ee44e8d
Jan 28 23:14:12.029: INFO: 
Logging node info for node i-0b9246b8e806089a2
Jan 28 23:14:12.177: INFO: Node Info: &Node{ObjectMeta:{i-0b9246b8e806089a2    375478cc-6531-4329-8c04-109db4516346 15112 0 2023-01-28 23:04:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0b9246b8e806089a2 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-0b9246b8e806089a2 topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0b9246b8e806089a2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:04:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:13:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0b9246b8e806089a2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:12:59 +0000 UTC,LastTransitionTime:2023-01-28 23:04:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:12:59 +0000 UTC,LastTransitionTime:2023-01-28 23:04:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:12:59 +0000 UTC,LastTransitionTime:2023-01-28 23:04:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:12:59 +0000 UTC,LastTransitionTime:2023-01-28 23:04:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.33,},NodeAddress{Type:ExternalIP,Address:3.113.32.156,},NodeAddress{Type:InternalDNS,Address:i-0b9246b8e806089a2.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b9246b8e806089a2.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-113-32-156.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2debf48c4e8135f0bb121941c04fcc,SystemUUID:ec2debf4-8c4e-8135-f0bb-121941c04fcc,BootID:f572b2c1-3b11-4e28-9c32-56c96735649d,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 23:14:12.177: INFO: 
Logging kubelet events for node i-0b9246b8e806089a2
Jan 28 23:14:12.388: INFO: 
Logging pods the kubelet thinks is on node i-0b9246b8e806089a2
Jan 28 23:14:12.686: INFO: coredns-559769c974-p7lh6 started at 2023-01-28 23:04:41 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Container coredns ready: true, restart count 0
Jan 28 23:14:12.686: INFO: cilium-msj4x started at 2023-01-28 23:04:29 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:14:12.686: INFO: coredns-autoscaler-7cb5c5b969-x7xbw started at 2023-01-28 23:04:41 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Container autoscaler ready: true, restart count 0
Jan 28 23:14:12.686: INFO: ebs-csi-controller-555658678f-28dcz started at 2023-01-28 23:04:41 +0000 UTC (0+5 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:12.686: INFO: hostexec-i-0b9246b8e806089a2-kxgtz started at 2023-01-28 23:13:58 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:14:12.686: INFO: ebs-csi-node-2xszr started at 2023-01-28 23:04:29 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:12.686: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:14:12.686: INFO: test-rolling-update-with-lb-56d9b65d4c-92ncf started at 2023-01-28 23:13:56 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:12.686: INFO: 	Container agnhost ready: true, restart count 0
Jan 28 23:14:13.211: INFO: 
Latency metrics for node i-0b9246b8e806089a2
Jan 28 23:14:13.211: INFO: 
Logging node info for node i-0ca5d9ed6d7ac3691
Jan 28 23:14:13.358: INFO: Node Info: &Node{ObjectMeta:{i-0ca5d9ed6d7ac3691    879b21d5-3e08-45fb-a6d5-4c3cb08aeb60 15821 0 2023-01-28 23:04:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0ca5d9ed6d7ac3691 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-0ca5d9ed6d7ac3691 topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-1365":"i-0ca5d9ed6d7ac3691","ebs.csi.aws.com":"i-0ca5d9ed6d7ac3691"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-28 23:04:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:04:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:13:50 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 23:14:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0ca5d9ed6d7ac3691,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027256832 0} {<nil>} 3932868Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922399232 0} {<nil>} 3830468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:04:48 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:04:48 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:04:48 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:13:50 +0000 UTC,LastTransitionTime:2023-01-28 23:05:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.63,},NodeAddress{Type:ExternalIP,Address:54.248.20.128,},NodeAddress{Type:InternalDNS,Address:i-0ca5d9ed6d7ac3691.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ca5d9ed6d7ac3691.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-248-20-128.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fe06328056b43b4b6440933646a88,SystemUUID:ec2fe063-2805-6b43-b4b6-440933646a88,BootID:d8c8e074-5f94-4c77-8a89-2e0724f5222f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0b67b61f100fd79fb kubernetes.io/csi/ebs.csi.aws.com^vol-0c603931cff057520],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0b67b61f100fd79fb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c603931cff057520,DevicePath:,},},Config:nil,},}
Jan 28 23:14:13.358: INFO: 
Logging kubelet events for node i-0ca5d9ed6d7ac3691
Jan 28 23:14:13.511: INFO: 
Logging pods the kubelet thinks is on node i-0ca5d9ed6d7ac3691
Jan 28 23:14:13.663: INFO: cilium-2jx7q started at 2023-01-28 23:04:49 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:14:13.663: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:14:13.663: INFO: ebs-csi-node-cslbj started at 2023-01-28 23:04:49 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:13.663: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:13.663: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:14:13.663: INFO: pod-secrets-3c2db5e1-b14d-40ae-afa6-1f8664c4e45f started at 2023-01-28 23:13:07 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container creates-volume-test ready: true, restart count 0
Jan 28 23:14:13.663: INFO: 	Container dels-volume-test ready: true, restart count 0
Jan 28 23:14:13.663: INFO: 	Container upds-volume-test ready: true, restart count 0
Jan 28 23:14:13.663: INFO: pod-ephm-test-secret-6g95 started at 2023-01-28 23:13:22 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container test-container-subpath-secret-6g95 ready: false, restart count 0
Jan 28 23:14:13.663: INFO: pod-ephm-test-projected-dlm2 started at 2023-01-28 23:13:27 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container test-container-subpath-projected-dlm2 ready: false, restart count 0
Jan 28 23:14:13.663: INFO: test-rolling-update-with-lb-56d9b65d4c-6bftj started at 2023-01-28 23:13:56 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container agnhost ready: true, restart count 0
Jan 28 23:14:13.663: INFO: hostexec-i-0ca5d9ed6d7ac3691-zbxvv started at 2023-01-28 23:13:53 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:14:13.663: INFO: hostexec-i-0ca5d9ed6d7ac3691-mtd8p started at 2023-01-28 23:13:55 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:14:13.663: INFO: csi-hostpathplugin-0 started at 2023-01-28 23:14:10 +0000 UTC (0+7 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 28 23:14:13.663: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 28 23:14:13.663: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 28 23:14:13.663: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 28 23:14:13.663: INFO: 	Container hostpath ready: false, restart count 0
Jan 28 23:14:13.663: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 28 23:14:13.663: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 28 23:14:13.663: INFO: inline-volume-tester-gw6jz started at 2023-01-28 23:12:54 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 28 23:14:13.663: INFO: pod-d223f807-db9e-46f1-9a01-20abc53c46e2 started at 2023-01-28 23:13:35 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container write-pod ready: true, restart count 0
Jan 28 23:14:13.663: INFO: hostexec-i-0ca5d9ed6d7ac3691-nbtm2 started at 2023-01-28 23:14:03 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:14:13.663: INFO: pod-41a0094e-c2e6-4f97-a8a9-700b93907cc6 started at 2023-01-28 23:14:06 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container write-pod ready: true, restart count 0
Jan 28 23:14:13.663: INFO: pod-f3c83e2b-5393-4ed3-be5e-3a021e16290c started at 2023-01-28 23:14:02 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:13.663: INFO: 	Container write-pod ready: true, restart count 0
Jan 28 23:14:14.596: INFO: 
Latency metrics for node i-0ca5d9ed6d7ac3691
Jan 28 23:14:14.596: INFO: 
Logging node info for node i-0e580b9a44737376d
Jan 28 23:14:14.743: INFO: Node Info: &Node{ObjectMeta:{i-0e580b9a44737376d    408eb394-ab61-4b06-9166-032d48955922 15574 0 2023-01-28 23:04:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0e580b9a44737376d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-0e580b9a44737376d topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-capacity-3705":"csi-mock-csi-mock-volumes-capacity-3705","csi-mock-csi-mock-volumes-workload-7711":"i-0e580b9a44737376d","ebs.csi.aws.com":"i-0e580b9a44737376d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:04:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:14:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 23:14:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0e580b9a44737376d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:14:04 +0000 UTC,LastTransitionTime:2023-01-28 23:04:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:14:04 +0000 UTC,LastTransitionTime:2023-01-28 23:04:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:14:04 +0000 UTC,LastTransitionTime:2023-01-28 23:04:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:14:04 +0000 UTC,LastTransitionTime:2023-01-28 23:04:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.37,},NodeAddress{Type:ExternalIP,Address:43.207.79.54,},NodeAddress{Type:InternalDNS,Address:i-0e580b9a44737376d.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e580b9a44737376d.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-207-79-54.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2274ceec5b1e09ea8cb50ff0129cd2,SystemUUID:ec2274ce-ec5b-1e09-ea8c-b50ff0129cd2,BootID:24063abd-567d-49a8-84a0-9fce9f15e169,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-07b0298739cf60c1f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-07b0298739cf60c1f,DevicePath:,},},Config:nil,},}
Jan 28 23:14:14.743: INFO: 
Logging kubelet events for node i-0e580b9a44737376d
Jan 28 23:14:14.895: INFO: 
Logging pods the kubelet thinks is on node i-0e580b9a44737376d
Jan 28 23:14:15.048: INFO: hostexec-i-0e580b9a44737376d-bxxmf started at 2023-01-28 23:14:04 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:14:15.048: INFO: cilium-7qp8l started at 2023-01-28 23:04:44 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:14:15.048: INFO: ebs-csi-controller-555658678f-g9474 started at 2023-01-28 23:04:55 +0000 UTC (0+5 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:15.048: INFO: master started at 2023-01-28 23:13:23 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container cntr ready: true, restart count 0
Jan 28 23:14:15.048: INFO: slave started at 2023-01-28 23:13:25 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container cntr ready: true, restart count 0
Jan 28 23:14:15.048: INFO: csi-mockplugin-0 started at 2023-01-28 23:13:28 +0000 UTC (0+4 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container busybox ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container mock ready: true, restart count 0
Jan 28 23:14:15.048: INFO: csi-mockplugin-0 started at 2023-01-28 23:13:33 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container mock ready: true, restart count 0
Jan 28 23:14:15.048: INFO: ebs-csi-node-5ptsn started at 2023-01-28 23:04:44 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:14:15.048: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:14:15.048: INFO: hostexec-i-0e580b9a44737376d-4dck7 started at 2023-01-28 23:13:51 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.048: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:14:15.048: INFO: test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9 started at 2023-01-28 23:09:08 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.049: INFO: 	Container test ready: false, restart count 0
Jan 28 23:14:15.049: INFO: private started at 2023-01-28 23:13:30 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.049: INFO: 	Container cntr ready: true, restart count 0
Jan 28 23:14:15.049: INFO: csi-mockplugin-attacher-0 started at 2023-01-28 23:13:33 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.049: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:14:15.049: INFO: local-client started at 2023-01-28 23:14:13 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.049: INFO: 	Container local-client ready: false, restart count 0
Jan 28 23:14:15.049: INFO: inline-volume-tester-jjl8s started at 2023-01-28 23:13:25 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.049: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 28 23:14:15.049: INFO: default started at 2023-01-28 23:13:33 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:14:15.049: INFO: 	Container cntr ready: true, restart count 0
Jan 28 23:14:15.589: INFO: 
Latency metrics for node i-0e580b9a44737376d
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 23:14:15.589 (6.149s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 23:14:15.59 (6.149s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 23:14:15.59
STEP: Destroying namespace "runtimeclass-8015" for this suite. - test/e2e/framework/framework.go:347 @ 01/28/23 23:14:15.59
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 23:14:15.739 (150ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 23:14:15.74
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 23:14:15.74 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-8015/test-runtimeclass-runtimeclass-8015-preconfigured-handler-z65r9 mentions in log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints 5m23s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sscheduling\swithout\staints$'

[FAILED] timed out while waiting for pod runtimeclass-2544/test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2 to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/28/23 23:22:46.736

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 23:17:31.982
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/28/23 23:17:31.982
Jan 28 23:17:31.982: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/28/23 23:17:31.984
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/28/23 23:17:32.432
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/28/23 23:17:32.731
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/28/23 23:17:33.027 (1.045s)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 23:17:33.027
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/28/23 23:17:33.027 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/28/23 23:17:33.027
Jan 28 23:17:33.331: INFO: Waiting up to 5m0s for pod "hostexec-i-025b378c35ee44e8d-7zjm8" in namespace "runtimeclass-2544" to be "running"
Jan 28 23:17:33.480: INFO: Pod "hostexec-i-025b378c35ee44e8d-7zjm8": Phase="Pending", Reason="", readiness=false. Elapsed: 148.952074ms
Jan 28 23:17:35.630: INFO: Pod "hostexec-i-025b378c35ee44e8d-7zjm8": Phase="Running", Reason="", readiness=true. Elapsed: 2.298663047s
Jan 28 23:17:35.630: INFO: Pod "hostexec-i-025b378c35ee44e8d-7zjm8" satisfied condition "running"
Jan 28 23:17:35.630: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-2544 PodName:hostexec-i-025b378c35ee44e8d-7zjm8 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 28 23:17:35.630: INFO: >>> kubeConfig: /root/.kube/config
Jan 28 23:17:35.631: INFO: ExecWithOptions: Clientset creation
Jan 28 23:17:35.631: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-9926793599095977.elb.ap-northeast-1.amazonaws.com/api/v1/namespaces/runtimeclass-2544/pods/hostexec-i-025b378c35ee44e8d-7zjm8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
STEP: Trying to launch a pod without a label to get a node which can launch it. - test/e2e/scheduling/predicates.go:1042 @ 01/28/23 23:17:36.615
Jan 28 23:17:36.766: INFO: Waiting up to 1m0s for pod "without-label" in namespace "runtimeclass-2544" to be "running"
Jan 28 23:17:36.915: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 149.111365ms
Jan 28 23:17:39.065: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 2.299750331s
Jan 28 23:17:41.065: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 4.299097833s
Jan 28 23:17:43.065: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 6.299541661s
Jan 28 23:17:45.065: INFO: Pod "without-label": Phase="Running", Reason="", readiness=true. Elapsed: 8.29934322s
Jan 28 23:17:45.065: INFO: Pod "without-label" satisfied condition "running"
STEP: Explicitly delete pod here to free the resource it takes. - test/e2e/scheduling/predicates.go:973 @ 01/28/23 23:17:45.214
STEP: Trying to apply a label on the found node. - test/e2e/node/runtimeclass.go:148 @ 01/28/23 23:17:45.373
STEP: verifying the node has the label foo-853fcda8-aa37-4704-92d4-0bed0bf01804 bar - test/e2e/framework/node/helper.go:63 @ 01/28/23 23:17:45.529
STEP: verifying the node has the label fizz-a12fa526-4bca-4486-8ab8-5ef5e0adf604 buzz - test/e2e/framework/node/helper.go:63 @ 01/28/23 23:17:45.836
STEP: Trying to create runtimeclass and pod - test/e2e/node/runtimeclass.go:155 @ 01/28/23 23:17:45.986
Jan 28 23:17:46.287: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2" in namespace "runtimeclass-2544" to be "not pending"
Jan 28 23:17:46.436: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 148.966446ms
Jan 28 23:17:48.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.298630844s
Jan 28 23:17:50.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.298335195s
Jan 28 23:17:52.617: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.329842415s
Jan 28 23:17:54.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.298096109s
Jan 28 23:17:56.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.298531383s
Jan 28 23:17:58.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.299602119s
Jan 28 23:18:00.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.298736365s
Jan 28 23:18:02.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.299481949s
Jan 28 23:18:04.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.301837954s
Jan 28 23:18:06.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.298509995s
Jan 28 23:18:08.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.298988947s
Jan 28 23:18:10.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 24.299130884s
Jan 28 23:18:12.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 26.29891493s
Jan 28 23:18:14.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 28.298448551s
Jan 28 23:18:16.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.299797139s
Jan 28 23:18:18.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 32.298916682s
Jan 28 23:18:20.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 34.298284094s
Jan 28 23:18:22.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 36.298414045s
Jan 28 23:18:24.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 38.298533105s
Jan 28 23:18:26.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 40.300757797s
Jan 28 23:18:28.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 42.298875794s
Jan 28 23:18:30.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 44.298703683s
Jan 28 23:18:32.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 46.298894207s
Jan 28 23:18:34.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 48.298760863s
Jan 28 23:18:36.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 50.29922192s
Jan 28 23:18:38.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 52.298840063s
Jan 28 23:18:40.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 54.299130325s
Jan 28 23:18:42.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.29981118s
Jan 28 23:18:44.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 58.298463714s
Jan 28 23:18:46.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.30043843s
Jan 28 23:18:48.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.298935808s
Jan 28 23:18:50.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.298934339s
Jan 28 23:18:52.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.299027106s
Jan 28 23:18:54.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.298577028s
Jan 28 23:18:56.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.298554989s
Jan 28 23:18:58.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.301938884s
Jan 28 23:19:00.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.298976926s
Jan 28 23:19:02.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.302711504s
Jan 28 23:19:04.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.298573549s
Jan 28 23:19:06.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.298758472s
Jan 28 23:19:08.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.299418463s
Jan 28 23:19:10.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.298871283s
Jan 28 23:19:12.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.298641733s
Jan 28 23:19:14.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.29797056s
Jan 28 23:19:16.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.301989619s
Jan 28 23:19:18.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.298445955s
Jan 28 23:19:20.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.298734204s
Jan 28 23:19:22.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.298169065s
Jan 28 23:19:24.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.299281569s
Jan 28 23:19:26.598: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.311483347s
Jan 28 23:19:28.591: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.304036794s
Jan 28 23:19:30.590: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.303311245s
Jan 28 23:19:32.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.300234031s
Jan 28 23:19:34.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.298943939s
Jan 28 23:19:36.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.298576911s
Jan 28 23:19:38.590: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.303759257s
Jan 28 23:19:40.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.298873532s
Jan 28 23:19:42.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.297940288s
Jan 28 23:19:44.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.298492854s
Jan 28 23:19:46.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.297940557s
Jan 28 23:19:48.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.298710799s
Jan 28 23:19:50.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.298654498s
Jan 28 23:19:52.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.299785319s
Jan 28 23:19:54.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.298663057s
Jan 28 23:19:56.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.300320882s
Jan 28 23:19:58.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.299010012s
Jan 28 23:20:00.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.298622821s
Jan 28 23:20:02.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.299129805s
Jan 28 23:20:04.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.298014072s
Jan 28 23:20:06.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.298766521s
Jan 28 23:20:08.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.298843085s
Jan 28 23:20:10.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.299099986s
Jan 28 23:20:12.602: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.315505695s
Jan 28 23:20:14.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.299733747s
Jan 28 23:20:16.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.29852298s
Jan 28 23:20:18.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.298612745s
Jan 28 23:20:20.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.298423818s
Jan 28 23:20:22.614: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.327146348s
Jan 28 23:20:24.593: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.30590977s
Jan 28 23:20:26.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.298698789s
Jan 28 23:20:28.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.298735419s
Jan 28 23:20:30.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.297836663s
Jan 28 23:20:32.597: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.310185296s
Jan 28 23:20:34.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.29831644s
Jan 28 23:20:36.590: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.303195051s
Jan 28 23:20:38.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.298761473s
Jan 28 23:20:40.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.298331154s
Jan 28 23:20:42.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.297849779s
Jan 28 23:20:44.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.298301766s
Jan 28 23:20:46.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.298932565s
Jan 28 23:20:48.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.298480702s
Jan 28 23:20:50.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.299804116s
Jan 28 23:20:52.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.297928143s
Jan 28 23:20:54.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.301959875s
Jan 28 23:20:56.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.298771488s
Jan 28 23:20:58.594: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.307588149s
Jan 28 23:21:00.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.298825561s
Jan 28 23:21:02.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.298291344s
Jan 28 23:21:04.596: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.309192305s
Jan 28 23:21:06.590: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.303382238s
Jan 28 23:21:08.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.300009843s
Jan 28 23:21:10.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.298430106s
Jan 28 23:21:12.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.298426692s
Jan 28 23:21:14.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.298198771s
Jan 28 23:21:16.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.302755255s
Jan 28 23:21:18.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.29851962s
Jan 28 23:21:20.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.297933576s
Jan 28 23:21:22.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.299141298s
Jan 28 23:21:24.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.298260513s
Jan 28 23:21:26.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.299127401s
Jan 28 23:21:28.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.29838354s
Jan 28 23:21:30.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.300515802s
Jan 28 23:21:32.591: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.304545622s
Jan 28 23:21:34.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.299215706s
Jan 28 23:21:36.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.299689161s
Jan 28 23:21:38.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.298203696s
Jan 28 23:21:40.616: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.329342908s
Jan 28 23:21:42.591: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.304300759s
Jan 28 23:21:44.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.298403894s
Jan 28 23:21:46.588: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.301234097s
Jan 28 23:21:48.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.299508652s
Jan 28 23:21:50.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.29951888s
Jan 28 23:21:52.593: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.306165692s
Jan 28 23:21:54.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.298004829s
Jan 28 23:21:56.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.298676474s
Jan 28 23:21:58.589: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.302125996s
Jan 28 23:22:00.588: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.301118539s
Jan 28 23:22:02.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.298951429s
Jan 28 23:22:04.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.297907447s
Jan 28 23:22:06.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.29868332s
Jan 28 23:22:08.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.299985439s
Jan 28 23:22:10.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.298603926s
Jan 28 23:22:12.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.298078424s
Jan 28 23:22:14.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.298759557s
Jan 28 23:22:16.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.29906807s
Jan 28 23:22:18.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.300000382s
Jan 28 23:22:20.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.298806209s
Jan 28 23:22:22.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.299153463s
Jan 28 23:22:24.591: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.30425806s
Jan 28 23:22:26.587: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.300130253s
Jan 28 23:22:28.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.299143465s
Jan 28 23:22:30.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.2984269s
Jan 28 23:22:32.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.298518896s
Jan 28 23:22:34.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.298887846s
Jan 28 23:22:36.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.298454162s
Jan 28 23:22:38.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.299573787s
Jan 28 23:22:40.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.298238492s
Jan 28 23:22:42.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.298591833s
Jan 28 23:22:44.586: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.299090312s
Jan 28 23:22:46.585: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.298335871s
Jan 28 23:22:46.734: INFO: Pod "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.447237314s
Jan 28 23:22:46.735: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc0046a4d50>: {
        msg: "timed out while waiting for pod runtimeclass-2544/test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2 to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc0058fe900>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2",
                    GenerateName: "test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclass-",
                    Namespace: "runtimeclass-2544",
                    SelfLink: "",
                    UID: "f878dd33-46ec-4a09-a253-e31744e0bb18",
                    ResourceVersion: "24546",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810544666,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810544666,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810544672,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: {
                        "fizz-a12fa526-4bca-4486-8ab8-5ef5e0adf604": "buzz",
                        "foo-853fcda8-aa37-4704-92d4-0bed0bf01804": "bar",
                    },
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0e580b9a44737376d",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-2544/test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2 to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/28/23 23:22:46.736
< Exit [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/28/23 23:22:46.736 (5m13.709s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 23:22:46.736
Jan 28 23:22:46.736: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/28/23 23:22:46.886 (151ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 23:22:46.886
STEP: removing the label fizz-a12fa526-4bca-4486-8ab8-5ef5e0adf604 off the node i-0e580b9a44737376d - test/e2e/framework/node/helper.go:72 @ 01/28/23 23:22:46.886
STEP: verifying the node doesn't have the label fizz-a12fa526-4bca-4486-8ab8-5ef5e0adf604 - test/e2e/framework/node/helper.go:75 @ 01/28/23 23:22:47.214
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 23:22:47.364 (478ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 23:22:47.364
STEP: removing the label foo-853fcda8-aa37-4704-92d4-0bed0bf01804 off the node i-0e580b9a44737376d - test/e2e/framework/node/helper.go:72 @ 01/28/23 23:22:47.364
STEP: verifying the node doesn't have the label foo-853fcda8-aa37-4704-92d4-0bed0bf01804 - test/e2e/framework/node/helper.go:75 @ 01/28/23 23:22:47.669
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/28/23 23:22:47.819 (455ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 23:22:47.819
STEP: Deleting pod hostexec-i-025b378c35ee44e8d-7zjm8 in namespace runtimeclass-2544 - test/e2e/framework/pod/delete.go:41 @ 01/28/23 23:22:47.819
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/28/23 23:22:47.978 (159ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 23:22:47.978
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/28/23 23:22:47.978 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 23:22:47.978
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 23:22:47.978
STEP: Collecting events from namespace "runtimeclass-2544". - test/e2e/framework/debug/dump.go:42 @ 01/28/23 23:22:47.978
STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 01/28/23 23:22:48.127
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:33 +0000 UTC - event for hostexec-i-025b378c35ee44e8d-7zjm8: {default-scheduler } Scheduled: Successfully assigned runtimeclass-2544/hostexec-i-025b378c35ee44e8d-7zjm8 to i-025b378c35ee44e8d
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:33 +0000 UTC - event for hostexec-i-025b378c35ee44e8d-7zjm8: {kubelet i-025b378c35ee44e8d} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:33 +0000 UTC - event for hostexec-i-025b378c35ee44e8d-7zjm8: {kubelet i-025b378c35ee44e8d} Created: Created container agnhost-container
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:33 +0000 UTC - event for hostexec-i-025b378c35ee44e8d-7zjm8: {kubelet i-025b378c35ee44e8d} Started: Started container agnhost-container
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:36 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned runtimeclass-2544/without-label to i-0e580b9a44737376d
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:37 +0000 UTC - event for without-label: {kubelet i-0e580b9a44737376d} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:37 +0000 UTC - event for without-label: {kubelet i-0e580b9a44737376d} Created: Created container without-label
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:38 +0000 UTC - event for without-label: {kubelet i-0e580b9a44737376d} Started: Started container without-label
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:45 +0000 UTC - event for without-label: {kubelet i-0e580b9a44737376d} Killing: Stopping container without-label
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:46 +0000 UTC - event for test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2: {default-scheduler } Scheduled: Successfully assigned runtimeclass-2544/test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2 to i-0e580b9a44737376d
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:17:46 +0000 UTC - event for test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2: {kubelet i-0e580b9a44737376d} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 28 23:22:48.127: INFO: At 2023-01-28 23:22:47 +0000 UTC - event for hostexec-i-025b378c35ee44e8d-7zjm8: {kubelet i-025b378c35ee44e8d} Killing: Stopping container agnhost-container
Jan 28 23:22:48.276: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 28 23:22:48.276: INFO: test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2  i-0e580b9a44737376d  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:17:46 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:17:46 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:17:46 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-28 23:17:46 +0000 UTC  }]
Jan 28 23:22:48.276: INFO: 
Jan 28 23:22:48.430: INFO: Unable to fetch runtimeclass-2544/test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2)
Jan 28 23:22:48.587: INFO: 
Logging node info for node i-0048d553d1e818ce2
Jan 28 23:22:48.739: INFO: Node Info: &Node{ObjectMeta:{i-0048d553d1e818ce2    5f406844-5ab1-474d-b516-d64f73ef8852 27624 0 2023-01-28 23:01:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0048d553d1e818ce2 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0048d553d1e818ce2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-28 23:01:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-28 23:02:06 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:03:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:03:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-28 23:03:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-28 23:19:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0048d553d1e818ce2,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002136064 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897278464 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:19:34 +0000 UTC,LastTransitionTime:2023-01-28 23:01:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:19:34 +0000 UTC,LastTransitionTime:2023-01-28 23:01:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:19:34 +0000 UTC,LastTransitionTime:2023-01-28 23:01:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:19:34 +0000 UTC,LastTransitionTime:2023-01-28 23:03:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.204,},NodeAddress{Type:ExternalIP,Address:43.207.83.71,},NodeAddress{Type:InternalDNS,Address:i-0048d553d1e818ce2.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0048d553d1e818ce2.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-207-83-71.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec206bc212eb805963f847c43a5e9ed4,SystemUUID:ec206bc2-12eb-8059-63f8-47c43a5e9ed4,BootID:b575946a-8d48-4368-a1ce-ecd4b0610daf,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:131348942,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41194354,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39794006,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691090,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 23:22:48.739: INFO: 
Logging kubelet events for node i-0048d553d1e818ce2
Jan 28 23:22:48.893: INFO: 
Logging pods the kubelet thinks is on node i-0048d553d1e818ce2
Jan 28 23:22:49.052: INFO: ebs-csi-node-7xkq5 started at 2023-01-28 23:02:47 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:49.052: INFO: dns-controller-85d56fc6db-h8m2h started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container dns-controller ready: true, restart count 0
Jan 28 23:22:49.052: INFO: kube-scheduler-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 28 23:22:49.052: INFO: kube-apiserver-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (0+2 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container healthcheck ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Container kube-apiserver ready: true, restart count 2
Jan 28 23:22:49.052: INFO: etcd-manager-main-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (10+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 23:22:49.052: INFO: aws-cloud-controller-manager-lgp2g started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 28 23:22:49.052: INFO: cilium-xf9g8 started at 2023-01-28 23:02:47 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:22:49.052: INFO: cilium-operator-6f7d7f696f-z945g started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 28 23:22:49.052: INFO: kops-controller-7lnlv started at 2023-01-28 23:02:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container kops-controller ready: true, restart count 0
Jan 28 23:22:49.052: INFO: kube-controller-manager-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 28 23:22:49.052: INFO: etcd-manager-events-i-0048d553d1e818ce2 started at 2023-01-28 23:00:15 +0000 UTC (10+1 container statuses recorded)
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 28 23:22:49.052: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 28 23:22:49.578: INFO: 
Latency metrics for node i-0048d553d1e818ce2
Jan 28 23:22:49.578: INFO: 
Logging node info for node i-025b378c35ee44e8d
Jan 28 23:22:49.728: INFO: Node Info: &Node{ObjectMeta:{i-025b378c35ee44e8d    2707438c-c6ef-4bcc-998a-fc257e4527e1 35221 0 2023-01-28 23:04:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-025b378c35ee44e8d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-025b378c35ee44e8d topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7634":"i-025b378c35ee44e8d","csi-hostpath-provisioning-8916":"i-025b378c35ee44e8d","csi-mock-csi-mock-volumes-fsgroup-mount-1796":"csi-mock-csi-mock-volumes-fsgroup-mount-1796","ebs.csi.aws.com":"i-025b378c35ee44e8d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:22:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-28 23:22:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-025b378c35ee44e8d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:41 +0000 UTC,LastTransitionTime:2023-01-28 23:04:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:41 +0000 UTC,LastTransitionTime:2023-01-28 23:04:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:41 +0000 UTC,LastTransitionTime:2023-01-28 23:04:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:22:41 +0000 UTC,LastTransitionTime:2023-01-28 23:05:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.147,},NodeAddress{Type:ExternalIP,Address:18.183.174.226,},NodeAddress{Type:InternalDNS,Address:i-025b378c35ee44e8d.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025b378c35ee44e8d.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-183-174-226.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2edd1afcb5a7ac731165fb411f29b1,SystemUUID:ec2edd1a-fcb5-a7ac-7311-65fb411f29b1,BootID:4f71aed6-a13a-4883-a811-3f7fe6528ad3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-8916^a61dd396-9f62-11ed-941a-fabae28fbc5c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-8916^a61dd396-9f62-11ed-941a-fabae28fbc5c,DevicePath:,},},Config:nil,},}
Jan 28 23:22:49.729: INFO: 
Logging kubelet events for node i-025b378c35ee44e8d
Jan 28 23:22:49.882: INFO: 
Logging pods the kubelet thinks is on node i-025b378c35ee44e8d
Jan 28 23:22:50.042: INFO: cilium-kbvhs started at 2023-01-28 23:04:50 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:22:50.042: INFO: pod-disruption-failure-ignore-1-6bv5n started at 2023-01-28 23:22:49 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container c ready: false, restart count 0
Jan 28 23:22:50.042: INFO: csi-mockplugin-0 started at 2023-01-28 23:21:40 +0000 UTC (0+4 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container busybox ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container mock ready: true, restart count 0
Jan 28 23:22:50.042: INFO: hostpath-client started at 2023-01-28 23:22:36 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container hostpath-client ready: true, restart count 0
Jan 28 23:22:50.042: INFO: pod-disruption-failure-ignore-0-j2m2k started at 2023-01-28 23:22:48 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container c ready: false, restart count 0
Jan 28 23:22:50.042: INFO: netserver-0 started at 2023-01-28 23:22:08 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container webserver ready: true, restart count 0
Jan 28 23:22:50.042: INFO: csi-hostpathplugin-0 started at 2023-01-28 23:22:08 +0000 UTC (0+7 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:50.042: INFO: ebs-csi-node-dgzkq started at 2023-01-28 23:04:50 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:50.042: INFO: coredns-559769c974-xf25h started at 2023-01-28 23:05:07 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container coredns ready: true, restart count 0
Jan 28 23:22:50.042: INFO: csi-hostpathplugin-0 started at 2023-01-28 23:20:56 +0000 UTC (0+7 container statuses recorded)
Jan 28 23:22:50.042: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:50.042: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:50.758: INFO: 
Latency metrics for node i-025b378c35ee44e8d
Jan 28 23:22:50.758: INFO: 
Logging node info for node i-0b9246b8e806089a2
Jan 28 23:22:50.915: INFO: Node Info: &Node{ObjectMeta:{i-0b9246b8e806089a2    375478cc-6531-4329-8c04-109db4516346 35144 0 2023-01-28 23:04:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0b9246b8e806089a2 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-0b9246b8e806089a2 topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-expansion-8487":"i-0b9246b8e806089a2","ebs.csi.aws.com":"i-0b9246b8e806089a2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-28 23:04:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:04:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:22:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-28 23:22:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0b9246b8e806089a2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:38 +0000 UTC,LastTransitionTime:2023-01-28 23:04:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:38 +0000 UTC,LastTransitionTime:2023-01-28 23:04:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:38 +0000 UTC,LastTransitionTime:2023-01-28 23:04:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:22:38 +0000 UTC,LastTransitionTime:2023-01-28 23:04:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.33,},NodeAddress{Type:ExternalIP,Address:3.113.32.156,},NodeAddress{Type:InternalDNS,Address:i-0b9246b8e806089a2.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b9246b8e806089a2.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-113-32-156.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2debf48c4e8135f0bb121941c04fcc,SystemUUID:ec2debf4-8c4e-8135-f0bb-121941c04fcc,BootID:f572b2c1-3b11-4e28-9c32-56c96735649d,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-8487^7424fd7d-9f62-11ed-9507-42e18d2a4c48],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-expansion-8487^7424fd7d-9f62-11ed-9507-42e18d2a4c48,DevicePath:,},},Config:nil,},}
Jan 28 23:22:50.916: INFO: 
Logging kubelet events for node i-0b9246b8e806089a2
Jan 28 23:22:51.069: INFO: 
Logging pods the kubelet thinks is on node i-0b9246b8e806089a2
Jan 28 23:22:51.229: INFO: coredns-559769c974-p7lh6 started at 2023-01-28 23:04:41 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container coredns ready: true, restart count 0
Jan 28 23:22:51.229: INFO: ebs-csi-controller-555658678f-28dcz started at 2023-01-28 23:04:41 +0000 UTC (0+5 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:51.229: INFO: csi-mockplugin-0 started at 2023-01-28 23:21:06 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container mock ready: true, restart count 0
Jan 28 23:22:51.229: INFO: netserver-1 started at 2023-01-28 23:22:09 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container webserver ready: true, restart count 0
Jan 28 23:22:51.229: INFO: pvc-volume-tester-fvcjv started at 2023-01-28 23:21:12 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container volume-tester ready: true, restart count 0
Jan 28 23:22:51.229: INFO: hostexec-i-0b9246b8e806089a2-2cw92 started at 2023-01-28 23:22:47 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:22:51.229: INFO: cilium-msj4x started at 2023-01-28 23:04:29 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:22:51.229: INFO: coredns-autoscaler-7cb5c5b969-x7xbw started at 2023-01-28 23:04:41 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container autoscaler ready: true, restart count 0
Jan 28 23:22:51.229: INFO: ebs-csi-node-2xszr started at 2023-01-28 23:04:29 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:51.229: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:51.229: INFO: csi-mockplugin-attacher-0 started at 2023-01-28 23:21:06 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:51.229: INFO: hostexec-i-0b9246b8e806089a2-5zqqt started at 2023-01-28 23:22:48 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:51.229: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:22:51.843: INFO: 
Latency metrics for node i-0b9246b8e806089a2
Jan 28 23:22:51.843: INFO: 
Logging node info for node i-0ca5d9ed6d7ac3691
Jan 28 23:22:51.992: INFO: Node Info: &Node{ObjectMeta:{i-0ca5d9ed6d7ac3691    879b21d5-3e08-45fb-a6d5-4c3cb08aeb60 35577 0 2023-01-28 23:04:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0ca5d9ed6d7ac3691 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-0ca5d9ed6d7ac3691 topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4999":"i-0ca5d9ed6d7ac3691","csi-mock-csi-mock-volumes-expansion-7732":"i-0ca5d9ed6d7ac3691","ebs.csi.aws.com":"i-0ca5d9ed6d7ac3691"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-28 23:04:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:04:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-28 23:22:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0ca5d9ed6d7ac3691,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027256832 0} {<nil>} 3932868Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922399232 0} {<nil>} 3830468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:51 +0000 UTC,LastTransitionTime:2023-01-28 23:04:48 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:51 +0000 UTC,LastTransitionTime:2023-01-28 23:04:48 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:51 +0000 UTC,LastTransitionTime:2023-01-28 23:04:48 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:22:51 +0000 UTC,LastTransitionTime:2023-01-28 23:05:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.63,},NodeAddress{Type:ExternalIP,Address:54.248.20.128,},NodeAddress{Type:InternalDNS,Address:i-0ca5d9ed6d7ac3691.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ca5d9ed6d7ac3691.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-248-20-128.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fe06328056b43b4b6440933646a88,SystemUUID:ec2fe063-2805-6b43-b4b6-440933646a88,BootID:d8c8e074-5f94-4c77-8a89-2e0724f5222f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 28 23:22:51.992: INFO: 
Logging kubelet events for node i-0ca5d9ed6d7ac3691
Jan 28 23:22:52.156: INFO: 
Logging pods the kubelet thinks is on node i-0ca5d9ed6d7ac3691
Jan 28 23:22:52.313: INFO: pod-service-account-nomountsa-mountspec started at 2023-01-28 23:21:40 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container token-test ready: false, restart count 0
Jan 28 23:22:52.313: INFO: deployment-74d7dd69db-knnjb started at 2023-01-28 23:21:44 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container nginx ready: false, restart count 0
Jan 28 23:22:52.313: INFO: csi-mockplugin-attacher-0 started at 2023-01-28 23:21:11 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:52.313: INFO: pod-service-account-defaultsa-mountspec started at 2023-01-28 23:21:40 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container token-test ready: false, restart count 0
Jan 28 23:22:52.313: INFO: pod-service-account-mountsa-mountspec started at 2023-01-28 23:21:40 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container token-test ready: false, restart count 0
Jan 28 23:22:52.313: INFO: netserver-2 started at 2023-01-28 23:22:09 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container webserver ready: true, restart count 0
Jan 28 23:22:52.313: INFO: pod-projected-configmaps-3e7d3124-22b1-40bb-897e-67b10fac4765 started at 2023-01-28 23:21:34 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container createcm-volume-test ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container delcm-volume-test ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container updcm-volume-test ready: true, restart count 0
Jan 28 23:22:52.313: INFO: csi-mockplugin-0 started at 2023-01-28 23:21:11 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container mock ready: true, restart count 0
Jan 28 23:22:52.313: INFO: csi-mockplugin-resizer-0 started at 2023-01-28 23:21:11 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:22:52.313: INFO: csi-hostpathplugin-0 started at 2023-01-28 23:21:36 +0000 UTC (0+7 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container hostpath ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:52.313: INFO: pfpod started at 2023-01-28 23:22:21 +0000 UTC (0+2 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container portforwardtester ready: false, restart count 0
Jan 28 23:22:52.313: INFO: 	Container readiness ready: false, restart count 0
Jan 28 23:22:52.313: INFO: ebs-csi-node-cslbj started at 2023-01-28 23:04:49 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:52.313: INFO: cilium-2jx7q started at 2023-01-28 23:04:49 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:22:52.313: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:22:52.313: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:22:53.628: INFO: 
Latency metrics for node i-0ca5d9ed6d7ac3691
Jan 28 23:22:53.628: INFO: 
Logging node info for node i-0e580b9a44737376d
Jan 28 23:22:53.777: INFO: Node Info: &Node{ObjectMeta:{i-0e580b9a44737376d    408eb394-ab61-4b06-9166-032d48955922 35702 0 2023-01-28 23:04:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0e580b9a44737376d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.hostpath.csi/node:i-0e580b9a44737376d topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e580b9a44737376d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-28 23:04:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-28 23:04:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-28 23:22:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-28 23:22:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-0e580b9a44737376d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:06 +0000 UTC,LastTransitionTime:2023-01-28 23:04:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:06 +0000 UTC,LastTransitionTime:2023-01-28 23:04:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-28 23:22:06 +0000 UTC,LastTransitionTime:2023-01-28 23:04:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-28 23:22:06 +0000 UTC,LastTransitionTime:2023-01-28 23:04:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.33.37,},NodeAddress{Type:ExternalIP,Address:43.207.79.54,},NodeAddress{Type:InternalDNS,Address:i-0e580b9a44737376d.ap-northeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e580b9a44737376d.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-207-79-54.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2274ceec5b1e09ea8cb50ff0129cd2,SystemUUID:ec2274ce-ec5b-1e09-ea8c-b50ff0129cd2,BootID:24063abd-567d-49a8-84a0-9fce9f15e169,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:80665728,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-075c6ad224d522efa],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-075c6ad224d522efa,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-043098529cd6be43e,DevicePath:,},},Config:nil,},}
Jan 28 23:22:53.778: INFO: 
Logging kubelet events for node i-0e580b9a44737376d
Jan 28 23:22:53.940: INFO: 
Logging pods the kubelet thinks is on node i-0e580b9a44737376d
Jan 28 23:22:54.094: INFO: pod-projected-configmaps-a7fe53d5-c0b3-4328-9325-09ad5c90e98f started at 2023-01-28 23:22:34 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:54.094: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 28 23:22:54.094: INFO: pod-secrets-cd47a526-df17-4d40-a761-ad21ac4327d6 started at 2023-01-28 23:22:51 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:54.094: INFO: 	Container secret-volume-test ready: false, restart count 0
Jan 28 23:22:54.094: INFO: ebs-csi-node-5ptsn started at 2023-01-28 23:04:44 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:54.094: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:54.094: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:54.094: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 28 23:22:54.094: INFO: external-client started at 2023-01-28 23:22:18 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:54.094: INFO: 	Container external-client ready: true, restart count 0
Jan 28 23:22:54.094: INFO: inline-volume-tester-qvkch started at 2023-01-28 23:22:50 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:54.094: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 28 23:22:54.094: INFO: cilium-7qp8l started at 2023-01-28 23:04:44 +0000 UTC (1+1 container statuses recorded)
Jan 28 23:22:54.094: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 28 23:22:54.094: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 28 23:22:54.095: INFO: ebs-csi-controller-555658678f-g9474 started at 2023-01-28 23:04:55 +0000 UTC (0+5 container statuses recorded)
Jan 28 23:22:54.095: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 28 23:22:54.095: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 28 23:22:54.095: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 28 23:22:54.095: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 28 23:22:54.095: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 28 23:22:54.095: INFO: test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2 started at 2023-01-28 23:17:46 +0000 UTC (0+1 container statuses recorded)
Jan 28 23:22:54.095: INFO: 	Container test ready: false, restart count 0
Jan 28 23:22:54.095: INFO: pod-projected-secrets-6f25c675-afb3-47a4-b2ff-b1b09aee5c22 started at 2023-01-28 23:22:02 +0000 UTC (0+3 container statuses recorded)
Jan 28 23:22:54.095: INFO: 	Container creates-volume-test ready: true, restart count 0
Jan 28 23:22:54.095: INFO: 	Container dels-volume-test ready: true, restart count 0
Jan 28 23:22:54.095: INFO: 	Container upds-volume-test ready: true, restart count 0
Jan 28 23:22:55.438: INFO: 
Latency metrics for node i-0e580b9a44737376d
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/28/23 23:22:55.438 (7.459s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/28/23 23:22:55.438 (7.46s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 23:22:55.438
STEP: Destroying namespace "runtimeclass-2544" for this suite. - test/e2e/framework/framework.go:347 @ 01/28/23 23:22:55.438
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/28/23 23:22:55.589 (151ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 23:22:55.589
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/28/23 23:22:55.589 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-2544/test-runtimeclass-runtimeclass-2544-non-conflict-runtimeclh67f2 mentions in log files | View test history on testgrid

kubetest2 Test 22m4s

exit status 255
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 895 Passed Tests

Show 6516 Skipped Tests

Result	FAILURE
Tests	3 failed / 895 succeeded
Started	2023-01-28 22:55
Elapsed	37m46s
Revision	master