e2e-kops-warm-pool #1619106509726158848 Results

Test Failures

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] 5m17s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sa\sconfigured\shandler\s\[NodeFeature\:RuntimeHandler\]$'

[FAILED] timed out while waiting for pod runtimeclass-3702/test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/27/23 23:26:16.823

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 23:21:06.832
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/27/23 23:21:06.832
Jan 27 23:21:06.832: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/27/23 23:21:06.833
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/27/23 23:21:07.363
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/27/23 23:21:07.714
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 23:21:08.065 (1.233s)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 23:21:08.065
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 23:21:08.065 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/27/23 23:21:08.065
Jan 27 23:21:08.422: INFO: Waiting up to 5m0s for pod "hostexec-i-0de4d337edbe48673-vsskv" in namespace "runtimeclass-3702" to be "running"
Jan 27 23:21:08.598: INFO: Pod "hostexec-i-0de4d337edbe48673-vsskv": Phase="Pending", Reason="", readiness=false. Elapsed: 175.933357ms
Jan 27 23:21:10.776: INFO: Pod "hostexec-i-0de4d337edbe48673-vsskv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.353143636s
Jan 27 23:21:12.775: INFO: Pod "hostexec-i-0de4d337edbe48673-vsskv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.352880394s
Jan 27 23:21:14.776: INFO: Pod "hostexec-i-0de4d337edbe48673-vsskv": Phase="Running", Reason="", readiness=true. Elapsed: 6.353343036s
Jan 27 23:21:14.776: INFO: Pod "hostexec-i-0de4d337edbe48673-vsskv" satisfied condition "running"
Jan 27 23:21:14.776: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-3702 PodName:hostexec-i-0de4d337edbe48673-vsskv ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 27 23:21:14.776: INFO: >>> kubeConfig: /root/.kube/config
Jan 27 23:21:14.777: INFO: ExecWithOptions: Clientset creation
Jan 27 23:21:14.777: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-f7bf815ef6902494.elb.ap-northeast-2.amazonaws.com/api/v1/namespaces/runtimeclass-3702/pods/hostexec-i-0de4d337edbe48673-vsskv/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
Jan 27 23:21:16.293: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp" in namespace "runtimeclass-3702" to be "Succeeded or Failed"
Jan 27 23:21:16.470: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 176.385161ms
Jan 27 23:21:18.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.353780895s
Jan 27 23:21:20.658: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.364649608s
Jan 27 23:21:22.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.354998163s
Jan 27 23:21:24.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.353473008s
Jan 27 23:21:26.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.353311178s
Jan 27 23:21:28.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 12.355763847s
Jan 27 23:21:30.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 14.353793545s
Jan 27 23:21:32.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 16.355383099s
Jan 27 23:21:34.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 18.353340435s
Jan 27 23:21:36.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 20.353296365s
Jan 27 23:21:38.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 22.353685097s
Jan 27 23:21:40.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 24.353342184s
Jan 27 23:21:42.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 26.355931149s
Jan 27 23:21:44.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 28.354452534s
Jan 27 23:21:46.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 30.35450221s
Jan 27 23:21:48.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 32.35321091s
Jan 27 23:21:50.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 34.353858151s
Jan 27 23:21:52.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 36.353626537s
Jan 27 23:21:54.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 38.353844003s
Jan 27 23:21:56.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 40.353607924s
Jan 27 23:21:58.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 42.353645069s
Jan 27 23:22:00.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 44.35352895s
Jan 27 23:22:02.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 46.352662563s
Jan 27 23:22:04.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 48.353887225s
Jan 27 23:22:06.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 50.355497948s
Jan 27 23:22:08.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 52.353907745s
Jan 27 23:22:10.652: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 54.359015427s
Jan 27 23:22:12.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 56.354048388s
Jan 27 23:22:14.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 58.353557252s
Jan 27 23:22:16.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.354018498s
Jan 27 23:22:18.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.353658889s
Jan 27 23:22:20.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.352953064s
Jan 27 23:22:22.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.353525314s
Jan 27 23:22:24.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.353392988s
Jan 27 23:22:26.658: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.365074532s
Jan 27 23:22:28.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.354016705s
Jan 27 23:22:30.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.353826271s
Jan 27 23:22:32.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.352989947s
Jan 27 23:22:34.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.356193807s
Jan 27 23:22:36.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.353780597s
Jan 27 23:22:38.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.354152716s
Jan 27 23:22:40.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.35353427s
Jan 27 23:22:42.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.353318576s
Jan 27 23:22:44.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.354032253s
Jan 27 23:22:46.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.35404736s
Jan 27 23:22:48.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.353065618s
Jan 27 23:22:50.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.35280047s
Jan 27 23:22:52.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.354870134s
Jan 27 23:22:54.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.353049506s
Jan 27 23:22:56.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.353069782s
Jan 27 23:22:58.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.352764719s
Jan 27 23:23:00.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.353322348s
Jan 27 23:23:02.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.352571287s
Jan 27 23:23:04.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.352483106s
Jan 27 23:23:06.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.353991796s
Jan 27 23:23:08.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.353600084s
Jan 27 23:23:10.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.35282835s
Jan 27 23:23:12.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.353839597s
Jan 27 23:23:14.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.353174254s
Jan 27 23:23:16.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.35308671s
Jan 27 23:23:18.650: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.356324396s
Jan 27 23:23:20.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.353136597s
Jan 27 23:23:22.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.352948372s
Jan 27 23:23:24.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.353663586s
Jan 27 23:23:26.651: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.357279721s
Jan 27 23:23:28.650: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.356690602s
Jan 27 23:23:30.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.353665697s
Jan 27 23:23:32.652: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.358432084s
Jan 27 23:23:34.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.353667427s
Jan 27 23:23:36.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.353276961s
Jan 27 23:23:38.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.353285442s
Jan 27 23:23:40.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.352932435s
Jan 27 23:23:42.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.35259798s
Jan 27 23:23:44.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.353692583s
Jan 27 23:23:46.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.353281344s
Jan 27 23:23:48.656: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.362771183s
Jan 27 23:23:50.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.35374701s
Jan 27 23:23:52.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.352711187s
Jan 27 23:23:54.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.353519154s
Jan 27 23:23:56.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.354211242s
Jan 27 23:23:58.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.353323422s
Jan 27 23:24:00.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.353531998s
Jan 27 23:24:02.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.353363301s
Jan 27 23:24:04.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.35513603s
Jan 27 23:24:06.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.354253491s
Jan 27 23:24:08.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.352608894s
Jan 27 23:24:10.652: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.358679869s
Jan 27 23:24:12.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.353653087s
Jan 27 23:24:14.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.353768611s
Jan 27 23:24:16.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.353431572s
Jan 27 23:24:18.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.354981745s
Jan 27 23:24:20.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.353700468s
Jan 27 23:24:22.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.353079773s
Jan 27 23:24:24.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.353413531s
Jan 27 23:24:26.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.353989701s
Jan 27 23:24:28.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.353872111s
Jan 27 23:24:30.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.354844916s
Jan 27 23:24:32.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.355175089s
Jan 27 23:24:34.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.35373294s
Jan 27 23:24:36.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.353462076s
Jan 27 23:24:38.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.353354346s
Jan 27 23:24:40.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.353289384s
Jan 27 23:24:42.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.353804772s
Jan 27 23:24:44.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.353958564s
Jan 27 23:24:46.651: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.358008857s
Jan 27 23:24:48.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.353815052s
Jan 27 23:24:50.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.35481472s
Jan 27 23:24:52.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.352496552s
Jan 27 23:24:54.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.353553049s
Jan 27 23:24:56.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.354823972s
Jan 27 23:24:58.652: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.358390332s
Jan 27 23:25:00.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.355873007s
Jan 27 23:25:02.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.353411988s
Jan 27 23:25:04.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.353742331s
Jan 27 23:25:06.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.35374724s
Jan 27 23:25:08.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.352954593s
Jan 27 23:25:10.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.352972923s
Jan 27 23:25:12.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.352905616s
Jan 27 23:25:14.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.353161835s
Jan 27 23:25:16.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.353284011s
Jan 27 23:25:18.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.353219512s
Jan 27 23:25:20.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.352762826s
Jan 27 23:25:22.664: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.370380094s
Jan 27 23:25:24.649: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.355909541s
Jan 27 23:25:26.650: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.356459144s
Jan 27 23:25:28.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.353146005s
Jan 27 23:25:30.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.352957494s
Jan 27 23:25:32.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.353893604s
Jan 27 23:25:34.661: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.367596942s
Jan 27 23:25:36.651: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.357324399s
Jan 27 23:25:38.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.352888055s
Jan 27 23:25:40.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.353057995s
Jan 27 23:25:42.652: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.358246517s
Jan 27 23:25:44.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.355155284s
Jan 27 23:25:46.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.352865999s
Jan 27 23:25:48.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.352996555s
Jan 27 23:25:50.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.353708218s
Jan 27 23:25:52.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.35248269s
Jan 27 23:25:54.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.353349915s
Jan 27 23:25:56.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.353183514s
Jan 27 23:25:58.652: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.359119699s
Jan 27 23:26:00.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.353268667s
Jan 27 23:26:02.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.352313203s
Jan 27 23:26:04.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.354380912s
Jan 27 23:26:06.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.353051762s
Jan 27 23:26:08.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.35329015s
Jan 27 23:26:10.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.353009251s
Jan 27 23:26:12.648: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.354739155s
Jan 27 23:26:14.647: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.35339373s
Jan 27 23:26:16.646: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.353115301s
Jan 27 23:26:16.822: INFO: Pod "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.528936695s
Jan 27 23:26:16.823: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc002d67dd0>: {
        msg: "timed out while waiting for pod runtimeclass-3702/test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp to be Succeeded or Failed",
        observedObjects: [
            <*v1.Pod | 0xc006360000>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp",
                    GenerateName: "test-runtimeclass-runtimeclass-3702-preconfigured-handler-",
                    Namespace: "runtimeclass-3702",
                    SelfLink: "",
                    UID: "8d711e5b-61db-4265-8ac1-01cb0428ab4d",
                    ResourceVersion: "36026",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810458476,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810458476,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810458478,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: nil,
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0147fcb5b1475b4a9",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
                        SupplementalGroups: nil,
                        FSGroup: nil,
                        Sysctls: nil,
                        FSGroupChangePolicy: nil,
               ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-3702/test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/27/23 23:26:16.823
< Exit [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/27/23 23:26:16.823 (5m8.758s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 23:26:16.823
Jan 27 23:26:16.823: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 23:26:17.001 (178ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/27/23 23:26:17.001
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/27/23 23:26:17.193 (192ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 23:26:17.193
STEP: Deleting pod hostexec-i-0de4d337edbe48673-vsskv in namespace runtimeclass-3702 - test/e2e/framework/pod/delete.go:41 @ 01/27/23 23:26:17.193
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 23:26:17.378 (185ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 23:26:17.378
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 23:26:17.378 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 23:26:17.378
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 23:26:17.379
STEP: Collecting events from namespace "runtimeclass-3702". - test/e2e/framework/debug/dump.go:42 @ 01/27/23 23:26:17.379
STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 01/27/23 23:26:17.555
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:21:08 +0000 UTC - event for hostexec-i-0de4d337edbe48673-vsskv: {default-scheduler } Scheduled: Successfully assigned runtimeclass-3702/hostexec-i-0de4d337edbe48673-vsskv to i-0de4d337edbe48673
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:21:09 +0000 UTC - event for hostexec-i-0de4d337edbe48673-vsskv: {kubelet i-0de4d337edbe48673} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:21:09 +0000 UTC - event for hostexec-i-0de4d337edbe48673-vsskv: {kubelet i-0de4d337edbe48673} Created: Created container agnhost-container
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:21:09 +0000 UTC - event for hostexec-i-0de4d337edbe48673-vsskv: {kubelet i-0de4d337edbe48673} Started: Started container agnhost-container
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:21:16 +0000 UTC - event for test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp: {default-scheduler } Scheduled: Successfully assigned runtimeclass-3702/test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp to i-0147fcb5b1475b4a9
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:21:16 +0000 UTC - event for test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp: {kubelet i-0147fcb5b1475b4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 27 23:26:17.555: INFO: At 2023-01-27 23:26:17 +0000 UTC - event for hostexec-i-0de4d337edbe48673-vsskv: {kubelet i-0de4d337edbe48673} Killing: Stopping container agnhost-container
Jan 27 23:26:17.731: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 27 23:26:17.731: INFO: test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp  i-0147fcb5b1475b4a9  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:21:16 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:21:16 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:21:16 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:21:16 +0000 UTC  }]
Jan 27 23:26:17.731: INFO: 
Jan 27 23:26:17.908: INFO: Unable to fetch runtimeclass-3702/test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp)
Jan 27 23:26:18.085: INFO: 
Logging node info for node i-005a7d1c79d2cd186
Jan 27 23:26:18.262: INFO: Node Info: &Node{ObjectMeta:{i-005a7d1c79d2cd186    b383aef7-d328-4732-aae4-97be98df8ea3 49261 0 2023-01-27 23:03:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-005a7d1c79d2cd186 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-005a7d1c79d2cd186 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8232":"i-005a7d1c79d2cd186","csi-mock-csi-mock-volumes-workload-1990":"i-005a7d1c79d2cd186","ebs.csi.aws.com":"i-005a7d1c79d2cd186"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 23:03:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:03:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:26:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 23:26:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-005a7d1c79d2cd186,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:26:10 +0000 UTC,LastTransitionTime:2023-01-27 23:03:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:26:10 +0000 UTC,LastTransitionTime:2023-01-27 23:03:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:26:10 +0000 UTC,LastTransitionTime:2023-01-27 23:03:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:26:10 +0000 UTC,LastTransitionTime:2023-01-27 23:03:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.94,},NodeAddress{Type:ExternalIP,Address:3.36.130.122,},NodeAddress{Type:InternalDNS,Address:i-005a7d1c79d2cd186.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-005a7d1c79d2cd186.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-36-130-122.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dbf2c8f19b1f825de313e947864c3,SystemUUID:ec2dbf2c-8f19-b1f8-25de-313e947864c3,BootID:a24bfb76-8cd0-4da4-a66f-df130d54d172,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-8232^f9f964fc-9e99-11ed-b744-624be354c3a3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-8232^f9f964fc-9e99-11ed-b744-624be354c3a3,DevicePath:,},},Config:nil,},}
Jan 27 23:26:18.263: INFO: 
Logging kubelet events for node i-005a7d1c79d2cd186
Jan 27 23:26:18.443: INFO: 
Logging pods the kubelet thinks is on node i-005a7d1c79d2cd186
Jan 27 23:26:18.626: INFO: csi-mockplugin-attacher-0 started at 2023-01-27 23:24:20 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:18.626: INFO: coredns-559769c974-blbhs started at 2023-01-27 23:03:36 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container coredns ready: true, restart count 0
Jan 27 23:26:18.626: INFO: ebs-csi-controller-555658678f-rlfv6 started at 2023-01-27 23:03:36 +0000 UTC (0+5 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:18.626: INFO: csi-hostpathplugin-0 started at 2023-01-27 23:26:05 +0000 UTC (0+7 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:18.626: INFO: pod-subpath-test-configmap-t8zf started at 2023-01-27 23:25:58 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container test-container-subpath-configmap-t8zf ready: true, restart count 0
Jan 27 23:26:18.626: INFO: cilium-l4hk9 started at 2023-01-27 23:03:23 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:26:18.626: INFO: ebs-csi-node-295rz started at 2023-01-27 23:03:23 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:18.626: INFO: rs-g8jlm started at 2023-01-27 23:24:18 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container donothing ready: false, restart count 0
Jan 27 23:26:18.626: INFO: pod-subpath-test-dynamicpv-x6j8 started at 2023-01-27 23:26:18 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container test-container-subpath-dynamicpv-x6j8 ready: false, restart count 0
Jan 27 23:26:18.626: INFO: csi-mockplugin-0 started at 2023-01-27 23:24:20 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 27 23:26:18.626: INFO: 	Container mock ready: true, restart count 0
Jan 27 23:26:18.626: INFO: pvc-volume-tester-dd6g4 started at 2023-01-27 23:24:26 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container volume-tester ready: true, restart count 0
Jan 27 23:26:18.626: INFO: coredns-autoscaler-7cb5c5b969-qjj2v started at 2023-01-27 23:03:36 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:18.626: INFO: 	Container autoscaler ready: true, restart count 0
Jan 27 23:26:19.280: INFO: 
Latency metrics for node i-005a7d1c79d2cd186
Jan 27 23:26:19.280: INFO: 
Logging node info for node i-0128f0ba48bf8b895
Jan 27 23:26:19.458: INFO: Node Info: &Node{ObjectMeta:{i-0128f0ba48bf8b895    b5be9659-dbe5-485a-a7ac-40e3fc44f0d0 49250 0 2023-01-27 23:03:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0128f0ba48bf8b895 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0128f0ba48bf8b895 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1080":"i-0128f0ba48bf8b895","csi-hostpath-ephemeral-8243":"i-0128f0ba48bf8b895","ebs.csi.aws.com":"i-0128f0ba48bf8b895"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:25:57 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 23:26:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0128f0ba48bf8b895,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:57 +0000 UTC,LastTransitionTime:2023-01-27 23:03:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:57 +0000 UTC,LastTransitionTime:2023-01-27 23:03:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:57 +0000 UTC,LastTransitionTime:2023-01-27 23:03:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:25:57 +0000 UTC,LastTransitionTime:2023-01-27 23:03:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.157,},NodeAddress{Type:ExternalIP,Address:13.125.98.230,},NodeAddress{Type:InternalDNS,Address:i-0128f0ba48bf8b895.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0128f0ba48bf8b895.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-125-98-230.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21a49715d3a20c86721cecf166b3f6,SystemUUID:ec21a497-15d3-a20c-8672-1cecf166b3f6,BootID:71254e58-268b-49b7-abf3-ee8be4faba5b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1080^dff9c84b-9e99-11ed-83e0-866f2c1a1bb0 kubernetes.io/csi/csi-hostpath-ephemeral-8243^e11c4733-9e99-11ed-8507-b6e90518e638 kubernetes.io/csi/csi-hostpath-ephemeral-8243^e37c838f-9e99-11ed-8507-b6e90518e638],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1080^dff9c84b-9e99-11ed-83e0-866f2c1a1bb0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8243^e37c838f-9e99-11ed-8507-b6e90518e638,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8243^e11c4733-9e99-11ed-8507-b6e90518e638,DevicePath:,},},Config:nil,},}
Jan 27 23:26:19.459: INFO: 
Logging kubelet events for node i-0128f0ba48bf8b895
Jan 27 23:26:19.639: INFO: 
Logging pods the kubelet thinks is on node i-0128f0ba48bf8b895
Jan 27 23:26:19.821: INFO: inline-volume-tester-llgsj started at 2023-01-27 23:25:27 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:19.821: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 23:26:19.821: INFO: ebs-csi-node-xdnpg started at 2023-01-27 23:03:22 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:26:19.821: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:19.821: INFO: ebs-csi-controller-555658678f-fhdcg started at 2023-01-27 23:03:39 +0000 UTC (0+5 container statuses recorded)
Jan 27 23:26:19.821: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:19.821: INFO: csi-hostpathplugin-0 started at 2023-01-27 23:25:19 +0000 UTC (0+7 container statuses recorded)
Jan 27 23:26:19.821: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:19.821: INFO: cilium-4ltlr started at 2023-01-27 23:03:22 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:26:19.821: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:26:19.821: INFO: csi-hostpathplugin-0 started at 2023-01-27 23:25:20 +0000 UTC (0+7 container statuses recorded)
Jan 27 23:26:19.821: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:19.821: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:20.497: INFO: 
Latency metrics for node i-0128f0ba48bf8b895
Jan 27 23:26:20.497: INFO: 
Logging node info for node i-0147fcb5b1475b4a9
Jan 27 23:26:20.673: INFO: Node Info: &Node{ObjectMeta:{i-0147fcb5b1475b4a9    b75711d7-3b74-4314-bce7-6ba2acc4cf1f 49451 0 2023-01-27 23:03:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0147fcb5b1475b4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0147fcb5b1475b4a9 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0147fcb5b1475b4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-27 23:03:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 23:03:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:27 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-27 23:26:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0147fcb5b1475b4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:54 +0000 UTC,LastTransitionTime:2023-01-27 23:03:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:54 +0000 UTC,LastTransitionTime:2023-01-27 23:03:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:54 +0000 UTC,LastTransitionTime:2023-01-27 23:03:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:25:54 +0000 UTC,LastTransitionTime:2023-01-27 23:03:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.68,},NodeAddress{Type:ExternalIP,Address:3.36.65.63,},NodeAddress{Type:InternalDNS,Address:i-0147fcb5b1475b4a9.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0147fcb5b1475b4a9.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-36-65-63.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec265e97871b3e69b29f11a5716124fb,SystemUUID:ec265e97-871b-3e69-b29f-11a5716124fb,BootID:e189a9bb-474a-4469-b489-7df802939814,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 23:26:20.673: INFO: 
Logging kubelet events for node i-0147fcb5b1475b4a9
Jan 27 23:26:20.853: INFO: 
Logging pods the kubelet thinks is on node i-0147fcb5b1475b4a9
Jan 27 23:26:21.033: INFO: inline-volume-kxfcq started at 2023-01-27 23:24:31 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container volume-tester ready: false, restart count 0
Jan 27 23:26:21.033: INFO: ebs-csi-node-tblxj started at 2023-01-27 23:03:27 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:21.033: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:21.033: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:21.033: INFO: hostexec-i-0147fcb5b1475b4a9-tvjpv started at 2023-01-27 23:25:50 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 23:26:21.033: INFO: test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp started at 2023-01-27 23:21:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container test ready: false, restart count 0
Jan 27 23:26:21.033: INFO: pod-service-account-nomountsa-mountspec started at 2023-01-27 23:24:53 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container token-test ready: false, restart count 0
Jan 27 23:26:21.033: INFO: cilium-wt7j4 started at 2023-01-27 23:03:27 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:26:21.033: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:26:21.033: INFO: startup-25152ed4-4f3e-4dbc-8ed8-0d929661454f started at 2023-01-27 23:24:14 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container busybox ready: false, restart count 0
Jan 27 23:26:21.033: INFO: pod-service-account-mountsa-mountspec started at 2023-01-27 23:24:53 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container token-test ready: false, restart count 0
Jan 27 23:26:21.033: INFO: bin-false9f769d27-d873-4fc2-b5ce-eab60d701c27 started at 2023-01-27 23:24:55 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:21.033: INFO: 	Container bin-false9f769d27-d873-4fc2-b5ce-eab60d701c27 ready: false, restart count 0
Jan 27 23:26:21.649: INFO: 
Latency metrics for node i-0147fcb5b1475b4a9
Jan 27 23:26:21.649: INFO: 
Logging node info for node i-0d150dfe60fe1f69e
Jan 27 23:26:21.826: INFO: Node Info: &Node{ObjectMeta:{i-0d150dfe60fe1f69e    e78a5a72-af4f-4117-9c51-55cb018ef7d4 41861 0 2023-01-27 23:00:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0d150dfe60fe1f69e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d150dfe60fe1f69e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 23:00:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-27 23:01:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:01:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:01:59 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-27 23:01:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 23:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0d150dfe60fe1f69e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002131968 0} {<nil>} 3908332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897274368 0} {<nil>} 3805932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:00:48 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:00:48 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:00:48 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:01:59 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.121,},NodeAddress{Type:ExternalIP,Address:13.124.132.120,},NodeAddress{Type:InternalDNS,Address:i-0d150dfe60fe1f69e.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d150dfe60fe1f69e.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-124-132-120.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec231eef2170563ff0f500060bb1e067,SystemUUID:ec231eef-2170-563f-f0f5-00060bb1e067,BootID:16c3be0f-e237-41e0-8b6f-94291b590db4,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:131283406,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:121191730,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41190270,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39793987,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691073,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 23:26:21.826: INFO: 
Logging kubelet events for node i-0d150dfe60fe1f69e
Jan 27 23:26:22.005: INFO: 
Logging pods the kubelet thinks is on node i-0d150dfe60fe1f69e
Jan 27 23:26:22.189: INFO: etcd-manager-events-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (10+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 23:26:22.189: INFO: kube-apiserver-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (0+2 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container healthcheck ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Container kube-apiserver ready: true, restart count 3
Jan 27 23:26:22.189: INFO: cilium-6s9zm started at 2023-01-27 23:01:44 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:26:22.189: INFO: dns-controller-85d56fc6db-s7m9c started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container dns-controller ready: true, restart count 0
Jan 27 23:26:22.189: INFO: aws-cloud-controller-manager-v4pv8 started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 27 23:26:22.189: INFO: etcd-manager-main-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (10+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 23:26:22.189: INFO: kube-controller-manager-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 27 23:26:22.189: INFO: kube-scheduler-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 27 23:26:22.189: INFO: ebs-csi-node-csbs2 started at 2023-01-27 23:01:44 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:22.189: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:22.189: INFO: cilium-operator-6f7d7f696f-vxsqf started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 27 23:26:22.189: INFO: kops-controller-m74lq started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:22.189: INFO: 	Container kops-controller ready: true, restart count 0
Jan 27 23:26:22.766: INFO: 
Latency metrics for node i-0d150dfe60fe1f69e
Jan 27 23:26:22.766: INFO: 
Logging node info for node i-0de4d337edbe48673
Jan 27 23:26:22.942: INFO: Node Info: &Node{ObjectMeta:{i-0de4d337edbe48673    f9e74f3e-15fc-4b8d-add0-d24cd1dee80a 48108 0 2023-01-27 23:03:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0de4d337edbe48673 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0de4d337edbe48673 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-175":"i-0de4d337edbe48673","ebs.csi.aws.com":"i-0de4d337edbe48673"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:03:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:25:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 23:25:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0de4d337edbe48673,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:41 +0000 UTC,LastTransitionTime:2023-01-27 23:03:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:41 +0000 UTC,LastTransitionTime:2023-01-27 23:03:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:25:41 +0000 UTC,LastTransitionTime:2023-01-27 23:03:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:25:41 +0000 UTC,LastTransitionTime:2023-01-27 23:03:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.45.231,},NodeAddress{Type:ExternalIP,Address:3.35.167.184,},NodeAddress{Type:InternalDNS,Address:i-0de4d337edbe48673.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0de4d337edbe48673.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-35-167-184.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec242fd8546d2f932cd08e334f4c281a,SystemUUID:ec242fd8-546d-2f93-2cd0-8e334f4c281a,BootID:3030de72-ca5e-4dcc-8f87-a7c7816e4e4f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-175^e7aa294e-9e99-11ed-88e5-5ed5adb113f9],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-175^e7aa294e-9e99-11ed-88e5-5ed5adb113f9,DevicePath:,},},Config:nil,},}
Jan 27 23:26:22.943: INFO: 
Logging kubelet events for node i-0de4d337edbe48673
Jan 27 23:26:23.122: INFO: 
Logging pods the kubelet thinks is on node i-0de4d337edbe48673
Jan 27 23:26:23.302: INFO: csi-hostpathplugin-0 started at 2023-01-27 23:25:34 +0000 UTC (0+7 container statuses recorded)
Jan 27 23:26:23.302: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:23.302: INFO: funny-ip-gr8l9 started at 2023-01-27 23:22:15 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:23.302: INFO: 	Container funny-ip ready: true, restart count 0
Jan 27 23:26:23.302: INFO: cilium-xb8bj started at 2023-01-27 23:03:26 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:26:23.302: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:26:23.302: INFO: coredns-559769c974-4sstc started at 2023-01-27 23:04:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:23.302: INFO: 	Container coredns ready: true, restart count 0
Jan 27 23:26:23.302: INFO: execpodhm24x started at 2023-01-27 23:22:21 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:26:23.302: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 23:26:23.302: INFO: ebs-csi-node-f6d2h started at 2023-01-27 23:03:26 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:26:23.302: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:26:23.302: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:26:23.918: INFO: 
Latency metrics for node i-0de4d337edbe48673
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 23:26:23.918 (6.54s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 23:26:23.918 (6.54s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 23:26:23.918
STEP: Destroying namespace "runtimeclass-3702" for this suite. - test/e2e/framework/framework.go:347 @ 01/27/23 23:26:23.918
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 23:26:24.096 (178ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 23:26:24.096
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 23:26:24.096 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-3702/test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp mentions in log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints 5m29s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sscheduling\swithout\staints$'

[FAILED] timed out while waiting for pod runtimeclass-3979/test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/27/23 23:24:20.886

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 23:19:01.16
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/27/23 23:19:01.16
Jan 27 23:19:01.160: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/27/23 23:19:01.161
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/27/23 23:19:01.699
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/27/23 23:19:02.056
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 23:19:02.415 (1.255s)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 23:19:02.415
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 23:19:02.415 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/27/23 23:19:02.415
Jan 27 23:19:02.790: INFO: Waiting up to 5m0s for pod "hostexec-i-0147fcb5b1475b4a9-cvztk" in namespace "runtimeclass-3979" to be "running"
Jan 27 23:19:02.969: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk": Phase="Pending", Reason="", readiness=false. Elapsed: 179.138886ms
Jan 27 23:19:05.149: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.358623793s
Jan 27 23:19:07.148: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.358384437s
Jan 27 23:19:09.149: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.358836718s
Jan 27 23:19:11.153: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.363013125s
Jan 27 23:19:13.149: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk": Phase="Running", Reason="", readiness=true. Elapsed: 10.359016901s
Jan 27 23:19:13.149: INFO: Pod "hostexec-i-0147fcb5b1475b4a9-cvztk" satisfied condition "running"
Jan 27 23:19:13.149: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-3979 PodName:hostexec-i-0147fcb5b1475b4a9-cvztk ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 27 23:19:13.149: INFO: >>> kubeConfig: /root/.kube/config
Jan 27 23:19:13.150: INFO: ExecWithOptions: Clientset creation
Jan 27 23:19:13.150: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-f7bf815ef6902494.elb.ap-northeast-2.amazonaws.com/api/v1/namespaces/runtimeclass-3979/pods/hostexec-i-0147fcb5b1475b4a9-cvztk/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
STEP: Trying to launch a pod without a label to get a node which can launch it. - test/e2e/scheduling/predicates.go:1042 @ 01/27/23 23:19:14.308
Jan 27 23:19:14.491: INFO: Waiting up to 1m0s for pod "without-label" in namespace "runtimeclass-3979" to be "running"
Jan 27 23:19:14.674: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 182.748352ms
Jan 27 23:19:16.853: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 2.362325569s
Jan 27 23:19:18.853: INFO: Pod "without-label": Phase="Running", Reason="", readiness=true. Elapsed: 4.362367572s
Jan 27 23:19:18.853: INFO: Pod "without-label" satisfied condition "running"
STEP: Explicitly delete pod here to free the resource it takes. - test/e2e/scheduling/predicates.go:973 @ 01/27/23 23:19:19.039
STEP: Trying to apply a label on the found node. - test/e2e/node/runtimeclass.go:148 @ 01/27/23 23:19:19.23
STEP: verifying the node has the label foo-df8dd255-02a7-45f4-b393-d775dd1ef9de bar - test/e2e/framework/node/helper.go:63 @ 01/27/23 23:19:19.416
STEP: verifying the node has the label fizz-32dc763e-770a-4d2f-94ec-5b840863b5e0 buzz - test/e2e/framework/node/helper.go:63 @ 01/27/23 23:19:19.786
STEP: Trying to create runtimeclass and pod - test/e2e/node/runtimeclass.go:155 @ 01/27/23 23:19:19.975
Jan 27 23:19:20.347: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn" in namespace "runtimeclass-3979" to be "not pending"
Jan 27 23:19:20.526: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 179.314352ms
Jan 27 23:19:22.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.361095304s
Jan 27 23:19:24.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.359219634s
Jan 27 23:19:26.732: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 6.384730092s
Jan 27 23:19:28.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 8.358494616s
Jan 27 23:19:30.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 10.358332704s
Jan 27 23:19:32.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 12.35895261s
Jan 27 23:19:34.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 14.35800031s
Jan 27 23:19:36.722: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 16.374608736s
Jan 27 23:19:38.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 18.358705496s
Jan 27 23:19:40.710: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 20.362973871s
Jan 27 23:19:42.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 22.358644946s
Jan 27 23:19:44.713: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 24.366103668s
Jan 27 23:19:46.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 26.358891338s
Jan 27 23:19:48.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 28.358849671s
Jan 27 23:19:50.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 30.358802219s
Jan 27 23:19:52.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 32.358820188s
Jan 27 23:19:54.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 34.358483761s
Jan 27 23:19:56.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 36.35890369s
Jan 27 23:19:58.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 38.359082687s
Jan 27 23:20:00.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 40.359645755s
Jan 27 23:20:02.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 42.35823569s
Jan 27 23:20:04.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 44.358832543s
Jan 27 23:20:06.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 46.359120953s
Jan 27 23:20:08.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 48.358997903s
Jan 27 23:20:10.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 50.358326363s
Jan 27 23:20:12.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 52.358490851s
Jan 27 23:20:14.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 54.358351112s
Jan 27 23:20:16.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 56.358114985s
Jan 27 23:20:18.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 58.358627356s
Jan 27 23:20:20.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.358976425s
Jan 27 23:20:22.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.359293685s
Jan 27 23:20:24.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.358659949s
Jan 27 23:20:26.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.358527861s
Jan 27 23:20:28.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.360239068s
Jan 27 23:20:30.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.357962731s
Jan 27 23:20:32.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.361417569s
Jan 27 23:20:34.709: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.362029975s
Jan 27 23:20:36.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.358971844s
Jan 27 23:20:38.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.360309679s
Jan 27 23:20:40.709: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.36162555s
Jan 27 23:20:42.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.358380208s
Jan 27 23:20:44.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.358791507s
Jan 27 23:20:46.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.359059614s
Jan 27 23:20:48.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.361163702s
Jan 27 23:20:50.709: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.36174533s
Jan 27 23:20:52.710: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.363265475s
Jan 27 23:20:54.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.358104337s
Jan 27 23:20:56.711: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.363648635s
Jan 27 23:20:58.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.360468027s
Jan 27 23:21:00.711: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.363954919s
Jan 27 23:21:02.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.360469837s
Jan 27 23:21:04.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.35843332s
Jan 27 23:21:06.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.359287311s
Jan 27 23:21:08.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.358090412s
Jan 27 23:21:10.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.35880663s
Jan 27 23:21:12.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.358645282s
Jan 27 23:21:14.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.359130024s
Jan 27 23:21:16.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.359762894s
Jan 27 23:21:18.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.35852428s
Jan 27 23:21:20.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.358669696s
Jan 27 23:21:22.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.359701806s
Jan 27 23:21:24.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.360037129s
Jan 27 23:21:26.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.360678181s
Jan 27 23:21:28.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.358911828s
Jan 27 23:21:30.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.358928506s
Jan 27 23:21:32.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.360369286s
Jan 27 23:21:34.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.358058961s
Jan 27 23:21:36.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.358328903s
Jan 27 23:21:38.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.358488092s
Jan 27 23:21:40.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.358939104s
Jan 27 23:21:42.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.358445614s
Jan 27 23:21:44.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.358733783s
Jan 27 23:21:46.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.358178181s
Jan 27 23:21:48.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.35788949s
Jan 27 23:21:50.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.358950547s
Jan 27 23:21:52.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.359067089s
Jan 27 23:21:54.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.358411401s
Jan 27 23:21:56.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.358193232s
Jan 27 23:21:58.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.358604666s
Jan 27 23:22:00.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.358966633s
Jan 27 23:22:02.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.358364349s
Jan 27 23:22:04.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.358989684s
Jan 27 23:22:06.712: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.365288332s
Jan 27 23:22:08.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.359508831s
Jan 27 23:22:10.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.358811578s
Jan 27 23:22:12.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.359106312s
Jan 27 23:22:14.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.358833848s
Jan 27 23:22:16.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.358517751s
Jan 27 23:22:18.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.358534747s
Jan 27 23:22:20.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.358365247s
Jan 27 23:22:22.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.358616366s
Jan 27 23:22:24.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.358564777s
Jan 27 23:22:26.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.361410224s
Jan 27 23:22:28.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.358408077s
Jan 27 23:22:30.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.360779438s
Jan 27 23:22:32.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.359716064s
Jan 27 23:22:34.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.358141354s
Jan 27 23:22:36.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.358729269s
Jan 27 23:22:38.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.358264s
Jan 27 23:22:40.711: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.363541449s
Jan 27 23:22:42.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.358430568s
Jan 27 23:22:44.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.358591362s
Jan 27 23:22:46.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.358493694s
Jan 27 23:22:48.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.358182148s
Jan 27 23:22:50.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.35828839s
Jan 27 23:22:52.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.358322616s
Jan 27 23:22:54.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.359089413s
Jan 27 23:22:56.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.358475918s
Jan 27 23:22:58.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.359050245s
Jan 27 23:23:00.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.358675923s
Jan 27 23:23:02.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.358912885s
Jan 27 23:23:04.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.35923962s
Jan 27 23:23:06.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.358560408s
Jan 27 23:23:08.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.361095908s
Jan 27 23:23:10.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.359116897s
Jan 27 23:23:12.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.358287793s
Jan 27 23:23:14.709: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.36174163s
Jan 27 23:23:16.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.358537898s
Jan 27 23:23:18.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.359919469s
Jan 27 23:23:20.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.358431693s
Jan 27 23:23:22.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.35868741s
Jan 27 23:23:24.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.358235497s
Jan 27 23:23:26.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.358124949s
Jan 27 23:23:28.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.358878506s
Jan 27 23:23:30.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.359106274s
Jan 27 23:23:32.710: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.362925297s
Jan 27 23:23:34.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.3592205s
Jan 27 23:23:36.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.358680074s
Jan 27 23:23:38.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.358844537s
Jan 27 23:23:40.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.358433834s
Jan 27 23:23:42.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.360153106s
Jan 27 23:23:44.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.358820956s
Jan 27 23:23:46.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.359120065s
Jan 27 23:23:48.708: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.360813589s
Jan 27 23:23:50.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.358861609s
Jan 27 23:23:52.709: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.361625472s
Jan 27 23:23:54.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.358730015s
Jan 27 23:23:56.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.359317095s
Jan 27 23:23:58.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.358195347s
Jan 27 23:24:00.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.359034325s
Jan 27 23:24:02.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.358787621s
Jan 27 23:24:04.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.35885406s
Jan 27 23:24:06.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.359326755s
Jan 27 23:24:08.707: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.360391267s
Jan 27 23:24:10.705: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.358361639s
Jan 27 23:24:12.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.358776802s
Jan 27 23:24:14.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.359253069s
Jan 27 23:24:16.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.358797979s
Jan 27 23:24:18.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.358648403s
Jan 27 23:24:20.706: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.358879588s
Jan 27 23:24:20.885: INFO: Pod "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.537861255s
Jan 27 23:24:20.886: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc005d02f60>: {
        msg: "timed out while waiting for pod runtimeclass-3979/test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc005bd9b00>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn",
                    GenerateName: "test-runtimeclass-runtimeclass-3979-non-conflict-runtimeclass-",
                    Namespace: "runtimeclass-3979",
                    SelfLink: "",
                    UID: "b8ec3f12-cfea-4dbf-a94b-45c09a2301ed",
                    ResourceVersion: "31782",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810458360,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810458360,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810458360,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: {
                        "fizz-32dc763e-770a-4d2f-94ec-5b840863b5e0": "buzz",
                        "foo-df8dd255-02a7-45f4-b393-d775dd1ef9de": "bar",
                    },
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0de4d337edbe48673",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-3979/test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/27/23 23:24:20.886
< Exit [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/27/23 23:24:20.887 (5m18.472s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 23:24:20.887
Jan 27 23:24:20.887: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 23:24:21.066 (179ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 23:24:21.066
STEP: removing the label fizz-32dc763e-770a-4d2f-94ec-5b840863b5e0 off the node i-0de4d337edbe48673 - test/e2e/framework/node/helper.go:72 @ 01/27/23 23:24:21.066
STEP: verifying the node doesn't have the label fizz-32dc763e-770a-4d2f-94ec-5b840863b5e0 - test/e2e/framework/node/helper.go:75 @ 01/27/23 23:24:21.429
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 23:24:21.609 (543ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 23:24:21.609
STEP: removing the label foo-df8dd255-02a7-45f4-b393-d775dd1ef9de off the node i-0de4d337edbe48673 - test/e2e/framework/node/helper.go:72 @ 01/27/23 23:24:21.609
STEP: verifying the node doesn't have the label foo-df8dd255-02a7-45f4-b393-d775dd1ef9de - test/e2e/framework/node/helper.go:75 @ 01/27/23 23:24:21.978
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 23:24:22.16 (550ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 23:24:22.16
STEP: Deleting pod hostexec-i-0147fcb5b1475b4a9-cvztk in namespace runtimeclass-3979 - test/e2e/framework/pod/delete.go:41 @ 01/27/23 23:24:22.16
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 23:24:22.345 (186ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 23:24:22.345
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 23:24:22.345 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 23:24:22.345
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 23:24:22.345
STEP: Collecting events from namespace "runtimeclass-3979". - test/e2e/framework/debug/dump.go:42 @ 01/27/23 23:24:22.345
STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 01/27/23 23:24:22.524
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:02 +0000 UTC - event for hostexec-i-0147fcb5b1475b4a9-cvztk: {default-scheduler } Scheduled: Successfully assigned runtimeclass-3979/hostexec-i-0147fcb5b1475b4a9-cvztk to i-0147fcb5b1475b4a9
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:03 +0000 UTC - event for hostexec-i-0147fcb5b1475b4a9-cvztk: {kubelet i-0147fcb5b1475b4a9} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:03 +0000 UTC - event for hostexec-i-0147fcb5b1475b4a9-cvztk: {kubelet i-0147fcb5b1475b4a9} Created: Created container agnhost-container
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:03 +0000 UTC - event for hostexec-i-0147fcb5b1475b4a9-cvztk: {kubelet i-0147fcb5b1475b4a9} Started: Started container agnhost-container
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:14 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned runtimeclass-3979/without-label to i-0de4d337edbe48673
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:15 +0000 UTC - event for without-label: {kubelet i-0de4d337edbe48673} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:15 +0000 UTC - event for without-label: {kubelet i-0de4d337edbe48673} Created: Created container without-label
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:16 +0000 UTC - event for without-label: {kubelet i-0de4d337edbe48673} Started: Started container without-label
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:19 +0000 UTC - event for without-label: {kubelet i-0de4d337edbe48673} Killing: Stopping container without-label
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:20 +0000 UTC - event for test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn: {default-scheduler } Scheduled: Successfully assigned runtimeclass-3979/test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn to i-0de4d337edbe48673
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:19:20 +0000 UTC - event for test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn: {kubelet i-0de4d337edbe48673} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 27 23:24:22.524: INFO: At 2023-01-27 23:24:22 +0000 UTC - event for hostexec-i-0147fcb5b1475b4a9-cvztk: {kubelet i-0147fcb5b1475b4a9} Killing: Stopping container agnhost-container
Jan 27 23:24:22.703: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 27 23:24:22.703: INFO: test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn  i-0de4d337edbe48673  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:19:20 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:19:20 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:19:20 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 23:19:20 +0000 UTC  }]
Jan 27 23:24:22.703: INFO: 
Jan 27 23:24:22.883: INFO: Unable to fetch runtimeclass-3979/test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn)
Jan 27 23:24:23.088: INFO: 
Logging node info for node i-005a7d1c79d2cd186
Jan 27 23:24:23.267: INFO: Node Info: &Node{ObjectMeta:{i-005a7d1c79d2cd186    b383aef7-d328-4732-aae4-97be98df8ea3 42468 0 2023-01-27 23:03:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-005a7d1c79d2cd186 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-005a7d1c79d2cd186 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6841":"i-005a7d1c79d2cd186","ebs.csi.aws.com":"i-005a7d1c79d2cd186"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 23:03:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:03:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:23:47 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 23:23:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-005a7d1c79d2cd186,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:58 +0000 UTC,LastTransitionTime:2023-01-27 23:03:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:58 +0000 UTC,LastTransitionTime:2023-01-27 23:03:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:58 +0000 UTC,LastTransitionTime:2023-01-27 23:03:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:23:58 +0000 UTC,LastTransitionTime:2023-01-27 23:03:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.44.94,},NodeAddress{Type:ExternalIP,Address:3.36.130.122,},NodeAddress{Type:InternalDNS,Address:i-005a7d1c79d2cd186.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-005a7d1c79d2cd186.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-36-130-122.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dbf2c8f19b1f825de313e947864c3,SystemUUID:ec2dbf2c-8f19-b1f8-25de-313e947864c3,BootID:a24bfb76-8cd0-4da4-a66f-df130d54d172,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6841^a428239e-9e99-11ed-965a-b6ece410eb86],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6841^a428239e-9e99-11ed-965a-b6ece410eb86,DevicePath:,},},Config:nil,},}
Jan 27 23:24:23.268: INFO: 
Logging kubelet events for node i-005a7d1c79d2cd186
Jan 27 23:24:23.450: INFO: 
Logging pods the kubelet thinks is on node i-005a7d1c79d2cd186
Jan 27 23:24:23.636: INFO: netserver-0 started at 2023-01-27 23:24:15 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container webserver ready: false, restart count 0
Jan 27 23:24:23.636: INFO: cilium-l4hk9 started at 2023-01-27 23:03:23 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:24:23.636: INFO: ebs-csi-node-295rz started at 2023-01-27 23:03:23 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:24:23.636: INFO: hostexec-i-005a7d1c79d2cd186-4dpx9 started at 2023-01-27 23:24:03 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 23:24:23.636: INFO: rs-g8jlm started at 2023-01-27 23:24:18 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container donothing ready: false, restart count 0
Jan 27 23:24:23.636: INFO: busybox-d8ef26c1-8c38-4060-bf55-c90397f12576 started at 2023-01-27 23:20:41 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container busybox ready: true, restart count 0
Jan 27 23:24:23.636: INFO: csi-mockplugin-0 started at 2023-01-27 23:24:20 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 27 23:24:23.636: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 27 23:24:23.636: INFO: 	Container mock ready: false, restart count 0
Jan 27 23:24:23.636: INFO: netserver-0 started at 2023-01-27 23:23:45 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container webserver ready: true, restart count 0
Jan 27 23:24:23.636: INFO: csi-hostpathplugin-0 started at 2023-01-27 23:23:38 +0000 UTC (0+7 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:24:23.636: INFO: coredns-autoscaler-7cb5c5b969-qjj2v started at 2023-01-27 23:03:36 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container autoscaler ready: true, restart count 0
Jan 27 23:24:23.636: INFO: inline-volume-tester-7pqw2 started at 2023-01-27 23:23:47 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 23:24:23.636: INFO: csi-mockplugin-attacher-0 started at 2023-01-27 23:24:20 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 27 23:24:23.636: INFO: coredns-559769c974-blbhs started at 2023-01-27 23:03:36 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container coredns ready: true, restart count 0
Jan 27 23:24:23.636: INFO: ebs-csi-controller-555658678f-rlfv6 started at 2023-01-27 23:03:36 +0000 UTC (0+5 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:23.636: INFO: rs-sjh9s started at 2023-01-27 23:24:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Container donothing ready: true, restart count 0
Jan 27 23:24:23.636: INFO: pod-subpath-test-preprovisionedpv-jkhb started at 2023-01-27 23:24:16 +0000 UTC (2+1 container statuses recorded)
Jan 27 23:24:23.636: INFO: 	Init container init-volume-preprovisionedpv-jkhb ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Init container test-init-subpath-preprovisionedpv-jkhb ready: true, restart count 0
Jan 27 23:24:23.636: INFO: 	Container test-container-subpath-preprovisionedpv-jkhb ready: false, restart count 0
Jan 27 23:24:25.099: INFO: 
Latency metrics for node i-005a7d1c79d2cd186
Jan 27 23:24:25.099: INFO: 
Logging node info for node i-0128f0ba48bf8b895
Jan 27 23:24:25.278: INFO: Node Info: &Node{ObjectMeta:{i-0128f0ba48bf8b895    b5be9659-dbe5-485a-a7ac-40e3fc44f0d0 42194 0 2023-01-27 23:03:21 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0128f0ba48bf8b895 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0128f0ba48bf8b895 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0128f0ba48bf8b895"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 23:03:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-27 23:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0128f0ba48bf8b895,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:22:12 +0000 UTC,LastTransitionTime:2023-01-27 23:03:21 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:22:12 +0000 UTC,LastTransitionTime:2023-01-27 23:03:21 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:22:12 +0000 UTC,LastTransitionTime:2023-01-27 23:03:21 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:22:12 +0000 UTC,LastTransitionTime:2023-01-27 23:03:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.157,},NodeAddress{Type:ExternalIP,Address:13.125.98.230,},NodeAddress{Type:InternalDNS,Address:i-0128f0ba48bf8b895.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0128f0ba48bf8b895.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-125-98-230.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21a49715d3a20c86721cecf166b3f6,SystemUUID:ec21a497-15d3-a20c-8672-1cecf166b3f6,BootID:71254e58-268b-49b7-abf3-ee8be4faba5b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 23:24:25.279: INFO: 
Logging kubelet events for node i-0128f0ba48bf8b895
Jan 27 23:24:25.461: INFO: 
Logging pods the kubelet thinks is on node i-0128f0ba48bf8b895
Jan 27 23:24:25.647: INFO: ebs-csi-node-xdnpg started at 2023-01-27 23:03:22 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:24:25.647: INFO: ebs-csi-controller-555658678f-fhdcg started at 2023-01-27 23:03:39 +0000 UTC (0+5 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:25.647: INFO: test-webserver-f75491d4-dc22-4f87-87b1-fb6822432893 started at 2023-01-27 23:24:24 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container test-webserver ready: false, restart count 0
Jan 27 23:24:25.647: INFO: rs-8m6nw started at 2023-01-27 23:24:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container donothing ready: true, restart count 0
Jan 27 23:24:25.647: INFO: cilium-4ltlr started at 2023-01-27 23:03:22 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:24:25.647: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:24:25.647: INFO: netserver-1 started at 2023-01-27 23:24:15 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container webserver ready: false, restart count 0
Jan 27 23:24:25.647: INFO: rs-mq5hf started at 2023-01-27 23:24:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container donothing ready: true, restart count 0
Jan 27 23:24:25.647: INFO: rs-ggc6d started at 2023-01-27 23:24:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container donothing ready: true, restart count 0
Jan 27 23:24:25.647: INFO: pod-subpath-test-downwardapi-jwjj started at 2023-01-27 23:24:09 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container test-container-subpath-downwardapi-jwjj ready: true, restart count 0
Jan 27 23:24:25.647: INFO: service-proxy-disabled-kfcxp started at 2023-01-27 23:24:24 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:25.647: INFO: 	Container service-proxy-disabled ready: false, restart count 0
Jan 27 23:24:26.681: INFO: 
Latency metrics for node i-0128f0ba48bf8b895
Jan 27 23:24:26.681: INFO: 
Logging node info for node i-0147fcb5b1475b4a9
Jan 27 23:24:26.860: INFO: Node Info: &Node{ObjectMeta:{i-0147fcb5b1475b4a9    b75711d7-3b74-4314-bce7-6ba2acc4cf1f 43338 0 2023-01-27 23:03:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0147fcb5b1475b4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0147fcb5b1475b4a9 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0147fcb5b1475b4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-27 23:03:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 23:03:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:27 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:27 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-27 23:24:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-27 23:24:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0147fcb5b1475b4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:24:22 +0000 UTC,LastTransitionTime:2023-01-27 23:03:26 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:24:22 +0000 UTC,LastTransitionTime:2023-01-27 23:03:26 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:24:22 +0000 UTC,LastTransitionTime:2023-01-27 23:03:26 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:24:22 +0000 UTC,LastTransitionTime:2023-01-27 23:03:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.68,},NodeAddress{Type:ExternalIP,Address:3.36.65.63,},NodeAddress{Type:InternalDNS,Address:i-0147fcb5b1475b4a9.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0147fcb5b1475b4a9.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-36-65-63.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec265e97871b3e69b29f11a5716124fb,SystemUUID:ec265e97-871b-3e69-b29f-11a5716124fb,BootID:e189a9bb-474a-4469-b489-7df802939814,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0684585a7f98a7e92 kubernetes.io/csi/ebs.csi.aws.com^vol-099ff3b6acdc9c1a2 kubernetes.io/csi/ebs.csi.aws.com^vol-0acfaa0692ee12f82],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-099ff3b6acdc9c1a2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0acfaa0692ee12f82,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0684585a7f98a7e92,DevicePath:,},},Config:nil,},}
Jan 27 23:24:26.860: INFO: 
Logging kubelet events for node i-0147fcb5b1475b4a9
Jan 27 23:24:27.043: INFO: 
Logging pods the kubelet thinks is on node i-0147fcb5b1475b4a9
Jan 27 23:24:27.228: INFO: rs-88d4v started at 2023-01-27 23:24:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container donothing ready: true, restart count 0
Jan 27 23:24:27.228: INFO: startup-25152ed4-4f3e-4dbc-8ed8-0d929661454f started at 2023-01-27 23:24:14 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container busybox ready: false, restart count 0
Jan 27 23:24:27.228: INFO: netserver-2 started at 2023-01-27 23:24:15 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container webserver ready: false, restart count 0
Jan 27 23:24:27.228: INFO: inline-volume-tester-pc54b started at 2023-01-27 23:23:27 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 23:24:27.228: INFO: netserver-2 started at 2023-01-27 23:23:45 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container webserver ready: true, restart count 0
Jan 27 23:24:27.228: INFO: inline-volume-tester-j6p78 started at 2023-01-27 23:23:58 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 23:24:27.228: INFO: rs-9qd48 started at 2023-01-27 23:24:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container donothing ready: true, restart count 0
Jan 27 23:24:27.228: INFO: server started at 2023-01-27 23:24:20 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 27 23:24:27.228: INFO: ebs-csi-node-tblxj started at 2023-01-27 23:03:27 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:27.228: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:27.228: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:24:27.228: INFO: downwardapi-volume-941d1b51-51f6-4858-9532-1978d683b5d2 started at 2023-01-27 23:24:18 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container client-container ready: false, restart count 0
Jan 27 23:24:27.228: INFO: inline-volume-tester2-5lsmh started at 2023-01-27 23:24:19 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 27 23:24:27.228: INFO: explicit-nonroot-uid started at 2023-01-27 23:24:19 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container explicit-nonroot-uid ready: false, restart count 0
Jan 27 23:24:27.228: INFO: test-runtimeclass-runtimeclass-3702-preconfigured-handler-q97vp started at 2023-01-27 23:21:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Container test ready: false, restart count 0
Jan 27 23:24:27.228: INFO: cilium-wt7j4 started at 2023-01-27 23:03:27 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:24:27.228: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:24:27.228: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:24:27.228: INFO: service-proxy-disabled-952vj started at <nil> (0+0 container statuses recorded)
Jan 27 23:24:28.242: INFO: 
Latency metrics for node i-0147fcb5b1475b4a9
Jan 27 23:24:28.242: INFO: 
Logging node info for node i-0d150dfe60fe1f69e
Jan 27 23:24:28.421: INFO: Node Info: &Node{ObjectMeta:{i-0d150dfe60fe1f69e    e78a5a72-af4f-4117-9c51-55cb018ef7d4 41861 0 2023-01-27 23:00:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0d150dfe60fe1f69e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0d150dfe60fe1f69e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 23:00:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-27 23:01:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:01:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:01:59 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-27 23:01:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 23:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0d150dfe60fe1f69e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002131968 0} {<nil>} 3908332Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897274368 0} {<nil>} 3805932Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:00:48 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:00:48 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:00:48 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:23:44 +0000 UTC,LastTransitionTime:2023-01-27 23:01:59 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.58.121,},NodeAddress{Type:ExternalIP,Address:13.124.132.120,},NodeAddress{Type:InternalDNS,Address:i-0d150dfe60fe1f69e.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d150dfe60fe1f69e.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-124-132-120.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec231eef2170563ff0f500060bb1e067,SystemUUID:ec231eef-2170-563f-f0f5-00060bb1e067,BootID:16c3be0f-e237-41e0-8b6f-94291b590db4,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:131283406,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:121191730,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41190270,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39793987,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4691073,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 23:24:28.422: INFO: 
Logging kubelet events for node i-0d150dfe60fe1f69e
Jan 27 23:24:28.604: INFO: 
Logging pods the kubelet thinks is on node i-0d150dfe60fe1f69e
Jan 27 23:24:28.790: INFO: ebs-csi-node-csbs2 started at 2023-01-27 23:01:44 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:24:28.790: INFO: cilium-operator-6f7d7f696f-vxsqf started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 27 23:24:28.790: INFO: kops-controller-m74lq started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container kops-controller ready: true, restart count 0
Jan 27 23:24:28.790: INFO: etcd-manager-main-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (10+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 23:24:28.790: INFO: kube-controller-manager-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 27 23:24:28.790: INFO: kube-scheduler-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 27 23:24:28.790: INFO: dns-controller-85d56fc6db-s7m9c started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container dns-controller ready: true, restart count 0
Jan 27 23:24:28.790: INFO: aws-cloud-controller-manager-v4pv8 started at 2023-01-27 23:01:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 27 23:24:28.790: INFO: etcd-manager-events-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (10+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 23:24:28.790: INFO: kube-apiserver-i-0d150dfe60fe1f69e started at 2023-01-27 22:58:47 +0000 UTC (0+2 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Container healthcheck ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Container kube-apiserver ready: true, restart count 3
Jan 27 23:24:28.790: INFO: cilium-6s9zm started at 2023-01-27 23:01:44 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:24:28.790: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:24:28.790: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:24:29.413: INFO: 
Latency metrics for node i-0d150dfe60fe1f69e
Jan 27 23:24:29.413: INFO: 
Logging node info for node i-0de4d337edbe48673
Jan 27 23:24:29.592: INFO: Node Info: &Node{ObjectMeta:{i-0de4d337edbe48673    f9e74f3e-15fc-4b8d-add0-d24cd1dee80a 43279 0 2023-01-27 23:03:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-2 failure-domain.beta.kubernetes.io/zone:ap-northeast-2a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0de4d337edbe48673 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ap-northeast-2a topology.hostpath.csi/node:i-0de4d337edbe48673 topology.kubernetes.io/region:ap-northeast-2 topology.kubernetes.io/zone:ap-northeast-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0de4d337edbe48673"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-27 23:03:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:03:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-27 23:24:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 23:24:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-2a/i-0de4d337edbe48673,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027248640 0} {<nil>} 3932860Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922391040 0} {<nil>} 3830460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 23:24:09 +0000 UTC,LastTransitionTime:2023-01-27 23:03:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 23:24:09 +0000 UTC,LastTransitionTime:2023-01-27 23:03:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 23:24:09 +0000 UTC,LastTransitionTime:2023-01-27 23:03:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 23:24:09 +0000 UTC,LastTransitionTime:2023-01-27 23:03:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.45.231,},NodeAddress{Type:ExternalIP,Address:3.35.167.184,},NodeAddress{Type:InternalDNS,Address:i-0de4d337edbe48673.ap-northeast-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0de4d337edbe48673.ap-northeast-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-35-167-184.ap-northeast-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec242fd8546d2f932cd08e334f4c281a,SystemUUID:ec242fd8-546d-2f93-2cd0-8e334f4c281a,BootID:3030de72-ca5e-4dcc-8f87-a7c7816e4e4f,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,KubeProxyVersion:v1.27.0-alpha.1.61+1f02f43ec6910c,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.61_1f02f43ec6910c],SizeBytes:63182024,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-057fe93800c1f76c2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-057fe93800c1f76c2,DevicePath:,},},Config:nil,},}
Jan 27 23:24:29.592: INFO: 
Logging kubelet events for node i-0de4d337edbe48673
Jan 27 23:24:29.774: INFO: 
Logging pods the kubelet thinks is on node i-0de4d337edbe48673
Jan 27 23:24:29.960: INFO: netserver-3 started at 2023-01-27 23:24:15 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.960: INFO: 	Container webserver ready: true, restart count 0
Jan 27 23:24:29.961: INFO: hostexec-i-0de4d337edbe48673-sk5ks started at 2023-01-27 23:24:17 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 23:24:29.961: INFO: cilium-xb8bj started at 2023-01-27 23:03:26 +0000 UTC (1+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 23:24:29.961: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 23:24:29.961: INFO: coredns-559769c974-4sstc started at 2023-01-27 23:04:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container coredns ready: true, restart count 0
Jan 27 23:24:29.961: INFO: test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn started at 2023-01-27 23:19:20 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container test ready: false, restart count 0
Jan 27 23:24:29.961: INFO: execpodhm24x started at 2023-01-27 23:22:21 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 23:24:29.961: INFO: all-pods-removed-zjj95 started at 2023-01-27 23:24:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container c ready: true, restart count 0
Jan 27 23:24:29.961: INFO: hostexec-i-0de4d337edbe48673-vsskv started at 2023-01-27 23:21:08 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 23:24:29.961: INFO: ss-0 started at 2023-01-27 23:24:06 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container webserver ready: true, restart count 0
Jan 27 23:24:29.961: INFO: pod-ephm-test-configmap-vjch started at 2023-01-27 23:22:45 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container test-container-subpath-configmap-vjch ready: false, restart count 0
Jan 27 23:24:29.961: INFO: service-proxy-disabled-2l2fb started at 2023-01-27 23:24:24 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container service-proxy-disabled ready: true, restart count 0
Jan 27 23:24:29.961: INFO: ebs-csi-node-f6d2h started at 2023-01-27 23:03:26 +0000 UTC (0+3 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 23:24:29.961: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 23:24:29.961: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 23:24:29.961: INFO: all-pods-removed-pq2bj started at 2023-01-27 23:24:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container c ready: true, restart count 0
Jan 27 23:24:29.961: INFO: funny-ip-gr8l9 started at 2023-01-27 23:22:15 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container funny-ip ready: true, restart count 0
Jan 27 23:24:29.961: INFO: liveness-84fffbc6-7737-4854-8a5c-1330189e9d63 started at 2023-01-27 23:22:06 +0000 UTC (0+1 container statuses recorded)
Jan 27 23:24:29.961: INFO: 	Container agnhost-container ready: false, restart count 4
Jan 27 23:24:30.580: INFO: 
Latency metrics for node i-0de4d337edbe48673
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 23:24:30.58 (8.234s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 23:24:30.58 (8.235s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 23:24:30.58
STEP: Destroying namespace "runtimeclass-3979" for this suite. - test/e2e/framework/framework.go:347 @ 01/27/23 23:24:30.58
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 23:24:30.764 (184ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 23:24:30.764
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 23:24:30.764 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-3979/test-runtimeclass-runtimeclass-3979-non-conflict-runtimecll8xhn mentions in log files | View test history on testgrid

kubetest2 Test 22m46s

exit status 255
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 895 Passed Tests

Show 6516 Skipped Tests

Result	FAILURE
Tests	3 failed / 895 succeeded
Started	2023-01-27 22:54
Elapsed	37m50s
Revision	master