e2e-kops-warm-pool #1618865094232379392 Results

Test Failures

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] 5m6s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sa\sconfigured\shandler\s\[NodeFeature\:RuntimeHandler\]$'

[FAILED] timed out while waiting for pod runtimeclass-6787/test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/27/23 07:23:09.113

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 07:18:04.319
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/27/23 07:18:04.32
Jan 27 07:18:04.320: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/27/23 07:18:04.321
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/27/23 07:18:04.425
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/27/23 07:18:04.486
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 07:18:04.547 (228ms)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 07:18:04.547
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 07:18:04.547 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/27/23 07:18:04.547
Jan 27 07:18:04.616: INFO: Waiting up to 5m0s for pod "hostexec-i-07778c09b254061f9-48gh8" in namespace "runtimeclass-6787" to be "running"
Jan 27 07:18:04.647: INFO: Pod "hostexec-i-07778c09b254061f9-48gh8": Phase="Pending", Reason="", readiness=false. Elapsed: 30.996101ms
Jan 27 07:18:06.680: INFO: Pod "hostexec-i-07778c09b254061f9-48gh8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063074881s
Jan 27 07:18:08.681: INFO: Pod "hostexec-i-07778c09b254061f9-48gh8": Phase="Running", Reason="", readiness=true. Elapsed: 4.064368622s
Jan 27 07:18:08.681: INFO: Pod "hostexec-i-07778c09b254061f9-48gh8" satisfied condition "running"
Jan 27 07:18:08.681: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-6787 PodName:hostexec-i-07778c09b254061f9-48gh8 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 27 07:18:08.681: INFO: >>> kubeConfig: /root/.kube/config
Jan 27 07:18:08.682: INFO: ExecWithOptions: Clientset creation
Jan 27 07:18:08.682: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-c6c35181c3f604f2.elb.ca-central-1.amazonaws.com/api/v1/namespaces/runtimeclass-6787/pods/hostexec-i-07778c09b254061f9-48gh8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
Jan 27 07:18:09.015: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc" in namespace "runtimeclass-6787" to be "Succeeded or Failed"
Jan 27 07:18:09.047: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 32.194067ms
Jan 27 07:18:11.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064091135s
Jan 27 07:18:13.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.064007406s
Jan 27 07:18:15.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.064900593s
Jan 27 07:18:17.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.064451118s
Jan 27 07:18:19.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 10.064531897s
Jan 27 07:18:21.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 12.064589809s
Jan 27 07:18:23.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 14.064117511s
Jan 27 07:18:25.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 16.064169005s
Jan 27 07:18:27.100: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 18.084818574s
Jan 27 07:18:29.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 20.065990824s
Jan 27 07:18:31.118: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 22.103598887s
Jan 27 07:18:33.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 24.065365853s
Jan 27 07:18:35.086: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 26.071417653s
Jan 27 07:18:37.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063652219s
Jan 27 07:18:39.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 30.064496126s
Jan 27 07:18:41.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 32.065574346s
Jan 27 07:18:43.082: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 34.067573479s
Jan 27 07:18:45.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 36.064837304s
Jan 27 07:18:47.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 38.064817756s
Jan 27 07:18:49.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 40.064576279s
Jan 27 07:18:51.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 42.064412934s
Jan 27 07:18:53.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 44.065086188s
Jan 27 07:18:55.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 46.064195143s
Jan 27 07:18:57.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 48.064281717s
Jan 27 07:18:59.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 50.064022106s
Jan 27 07:19:01.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 52.065204131s
Jan 27 07:19:03.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 54.064643099s
Jan 27 07:19:05.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 56.064414784s
Jan 27 07:19:07.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063882484s
Jan 27 07:19:09.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.065707169s
Jan 27 07:19:11.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.063761657s
Jan 27 07:19:13.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.065178773s
Jan 27 07:19:15.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.064978672s
Jan 27 07:19:17.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.064850942s
Jan 27 07:19:19.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.064632941s
Jan 27 07:19:21.082: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.067480515s
Jan 27 07:19:23.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.064381179s
Jan 27 07:19:25.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.06593148s
Jan 27 07:19:27.082: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.066868221s
Jan 27 07:19:29.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.064524717s
Jan 27 07:19:31.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.064554996s
Jan 27 07:19:33.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.063696865s
Jan 27 07:19:35.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.06421345s
Jan 27 07:19:37.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.066718263s
Jan 27 07:19:39.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.064736498s
Jan 27 07:19:41.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.064656628s
Jan 27 07:19:43.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.063573559s
Jan 27 07:19:45.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.064424261s
Jan 27 07:19:47.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.063871504s
Jan 27 07:19:49.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.064504178s
Jan 27 07:19:51.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.064376502s
Jan 27 07:19:53.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.064083575s
Jan 27 07:19:55.084: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.069703043s
Jan 27 07:19:57.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.063560981s
Jan 27 07:19:59.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.066447839s
Jan 27 07:20:01.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.066203574s
Jan 27 07:20:03.098: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.08342638s
Jan 27 07:20:05.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063925767s
Jan 27 07:20:07.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.065200382s
Jan 27 07:20:09.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.065454139s
Jan 27 07:20:11.094: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.0792625s
Jan 27 07:20:13.086: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.071748849s
Jan 27 07:20:15.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.064516231s
Jan 27 07:20:17.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.063537185s
Jan 27 07:20:19.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.064497874s
Jan 27 07:20:21.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.064457896s
Jan 27 07:20:23.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.065391873s
Jan 27 07:20:25.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.064909249s
Jan 27 07:20:27.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.064730357s
Jan 27 07:20:29.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.064131414s
Jan 27 07:20:31.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.064669515s
Jan 27 07:20:33.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.063817511s
Jan 27 07:20:35.083: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.068678996s
Jan 27 07:20:37.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.06507252s
Jan 27 07:20:39.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.064678413s
Jan 27 07:20:41.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.064655063s
Jan 27 07:20:43.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.064669886s
Jan 27 07:20:45.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.066028409s
Jan 27 07:20:47.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.064951533s
Jan 27 07:20:49.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.065858208s
Jan 27 07:20:51.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.065195894s
Jan 27 07:20:53.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.064030275s
Jan 27 07:20:55.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063698875s
Jan 27 07:20:57.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.064556177s
Jan 27 07:20:59.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.065364937s
Jan 27 07:21:01.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.064486488s
Jan 27 07:21:03.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.064592046s
Jan 27 07:21:05.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.064268395s
Jan 27 07:21:07.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.064982267s
Jan 27 07:21:09.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.064978877s
Jan 27 07:21:11.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.064762873s
Jan 27 07:21:13.082: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.06704467s
Jan 27 07:21:15.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.06422593s
Jan 27 07:21:17.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.064323279s
Jan 27 07:21:19.094: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.078834082s
Jan 27 07:21:21.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.064332369s
Jan 27 07:21:23.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.06445079s
Jan 27 07:21:25.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.064491127s
Jan 27 07:21:27.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.06376156s
Jan 27 07:21:29.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.064828102s
Jan 27 07:21:31.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.066711419s
Jan 27 07:21:33.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.064745441s
Jan 27 07:21:35.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.064932042s
Jan 27 07:21:37.083: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.068188938s
Jan 27 07:21:39.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.064070344s
Jan 27 07:21:41.078: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063649895s
Jan 27 07:21:43.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.06516132s
Jan 27 07:21:45.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.064531564s
Jan 27 07:21:47.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.064419883s
Jan 27 07:21:49.097: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.082454665s
Jan 27 07:21:51.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.065115016s
Jan 27 07:21:53.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.06449181s
Jan 27 07:21:55.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.063979487s
Jan 27 07:21:57.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.065032369s
Jan 27 07:21:59.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.064039518s
Jan 27 07:22:01.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.064441188s
Jan 27 07:22:03.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.064239139s
Jan 27 07:22:05.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.06483877s
Jan 27 07:22:07.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.064918021s
Jan 27 07:22:09.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.064165096s
Jan 27 07:22:11.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.066169467s
Jan 27 07:22:13.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.063796919s
Jan 27 07:22:15.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.064030165s
Jan 27 07:22:17.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.064086266s
Jan 27 07:22:19.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.064340348s
Jan 27 07:22:21.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.06492422s
Jan 27 07:22:23.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.065428256s
Jan 27 07:22:25.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.064352415s
Jan 27 07:22:27.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.064564774s
Jan 27 07:22:29.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.064156038s
Jan 27 07:22:31.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.064395059s
Jan 27 07:22:33.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063886583s
Jan 27 07:22:35.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.063867337s
Jan 27 07:22:37.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.065315287s
Jan 27 07:22:39.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.064786502s
Jan 27 07:22:41.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.065077868s
Jan 27 07:22:43.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.064868797s
Jan 27 07:22:45.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.064091915s
Jan 27 07:22:47.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.065832251s
Jan 27 07:22:49.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.064324057s
Jan 27 07:22:51.083: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.068209171s
Jan 27 07:22:53.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.064502003s
Jan 27 07:22:55.083: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.068031651s
Jan 27 07:22:57.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.065372921s
Jan 27 07:22:59.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.065538579s
Jan 27 07:23:01.081: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.066504608s
Jan 27 07:23:03.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.064921417s
Jan 27 07:23:05.082: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.067078493s
Jan 27 07:23:07.079: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.064561438s
Jan 27 07:23:09.080: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.064800109s
Jan 27 07:23:09.112: INFO: Pod "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.09773533s
Jan 27 07:23:09.113: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc004b9a7b0>: {
        msg: "timed out while waiting for pod runtimeclass-6787/test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc to be Succeeded or Failed",
        observedObjects: [
            <*v1.Pod | 0xc003bb2900>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc",
                    GenerateName: "test-runtimeclass-runtimeclass-6787-preconfigured-handler-",
                    Namespace: "runtimeclass-6787",
                    SelfLink: "",
                    UID: "9074184f-3d5a-431d-a25b-328c11e33c75",
                    ResourceVersion: "36701",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810400688,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810400688,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810400693,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: nil,
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0ec9d55a708b6e024",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
                        SupplementalGroups: nil,
                        FSGroup: nil,
                        Sysctls: nil,
                        FSGroupChangePolicy: nil,
               ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-6787/test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc to be Succeeded or Failed
In [It] at: test/e2e/common/node/runtimeclass.go:386 @ 01/27/23 07:23:09.113
< Exit [It] should run a Pod requesting a RuntimeClass with a configured handler [NodeFeature:RuntimeHandler] - test/e2e/common/node/runtimeclass.go:85 @ 01/27/23 07:23:09.114 (5m4.566s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 07:23:09.114
Jan 27 07:23:09.114: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 07:23:09.147 (33ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/27/23 07:23:09.147
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/common/node/runtimeclass.go:91 @ 01/27/23 07:23:09.186 (39ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 07:23:09.186
STEP: Deleting pod hostexec-i-07778c09b254061f9-48gh8 in namespace runtimeclass-6787 - test/e2e/framework/pod/delete.go:41 @ 01/27/23 07:23:09.186
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 07:23:09.232 (46ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 07:23:09.232
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 07:23:09.232 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 07:23:09.232
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 07:23:09.232
STEP: Collecting events from namespace "runtimeclass-6787". - test/e2e/framework/debug/dump.go:42 @ 01/27/23 07:23:09.232
STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 01/27/23 07:23:09.264
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:18:04 +0000 UTC - event for hostexec-i-07778c09b254061f9-48gh8: {default-scheduler } Scheduled: Successfully assigned runtimeclass-6787/hostexec-i-07778c09b254061f9-48gh8 to i-07778c09b254061f9
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:18:05 +0000 UTC - event for hostexec-i-07778c09b254061f9-48gh8: {kubelet i-07778c09b254061f9} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:18:05 +0000 UTC - event for hostexec-i-07778c09b254061f9-48gh8: {kubelet i-07778c09b254061f9} Created: Created container agnhost-container
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:18:06 +0000 UTC - event for hostexec-i-07778c09b254061f9-48gh8: {kubelet i-07778c09b254061f9} Started: Started container agnhost-container
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:18:09 +0000 UTC - event for test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc: {default-scheduler } Scheduled: Successfully assigned runtimeclass-6787/test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc to i-0ec9d55a708b6e024
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:18:09 +0000 UTC - event for test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc: {kubelet i-0ec9d55a708b6e024} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 27 07:23:09.264: INFO: At 2023-01-27 07:23:09 +0000 UTC - event for hostexec-i-07778c09b254061f9-48gh8: {kubelet i-07778c09b254061f9} Killing: Stopping container agnhost-container
Jan 27 07:23:09.295: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 27 07:23:09.295: INFO: test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc  i-0ec9d55a708b6e024  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:18:09 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:18:09 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:18:09 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:18:09 +0000 UTC  }]
Jan 27 07:23:09.295: INFO: 
Jan 27 07:23:09.328: INFO: Unable to fetch runtimeclass-6787/test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc)
Jan 27 07:23:09.360: INFO: 
Logging node info for node i-05d5bb17fb5a2a4fe
Jan 27 07:23:09.394: INFO: Node Info: &Node{ObjectMeta:{i-05d5bb17fb5a2a4fe    f128e504-78aa-4e47-83e8-71ab2b2139aa 47619 0 2023-01-27 07:00:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-05d5bb17fb5a2a4fe kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-05d5bb17fb5a2a4fe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 07:00:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-27 07:00:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:01:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:01:09 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-27 07:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-27 07:22:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-05d5bb17fb5a2a4fe,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002136064 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897278464 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:22:40 +0000 UTC,LastTransitionTime:2023-01-27 07:00:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:22:40 +0000 UTC,LastTransitionTime:2023-01-27 07:00:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:22:40 +0000 UTC,LastTransitionTime:2023-01-27 07:00:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:22:40 +0000 UTC,LastTransitionTime:2023-01-27 07:01:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.188,},NodeAddress{Type:ExternalIP,Address:3.99.161.161,},NodeAddress{Type:InternalDNS,Address:i-05d5bb17fb5a2a4fe.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-05d5bb17fb5a2a4fe.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-161-161.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2971c2098b0fef841934b8fe07dccf,SystemUUID:ec2971c2-098b-0fef-8419-34b8fe07dccf,BootID:fd18e339-e670-4d9d-ac84-eff3cc4ad416,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:131283406,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41127440,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39662357,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4692712,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 07:23:09.395: INFO: 
Logging kubelet events for node i-05d5bb17fb5a2a4fe
Jan 27 07:23:09.437: INFO: 
Logging pods the kubelet thinks is on node i-05d5bb17fb5a2a4fe
Jan 27 07:23:09.474: INFO: cilium-operator-6f7d7f696f-fbjj9 started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 27 07:23:09.475: INFO: kube-controller-manager-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 27 07:23:09.475: INFO: kube-scheduler-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 27 07:23:09.475: INFO: etcd-manager-events-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (10+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 07:23:09.475: INFO: kube-apiserver-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (0+2 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container healthcheck ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Container kube-apiserver ready: true, restart count 2
Jan 27 07:23:09.475: INFO: aws-cloud-controller-manager-2b4gz started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 27 07:23:09.475: INFO: kops-controller-tvkvc started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container kops-controller ready: true, restart count 0
Jan 27 07:23:09.475: INFO: etcd-manager-main-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (10+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 07:23:09.475: INFO: cilium-j96s2 started at 2023-01-27 07:01:00 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:23:09.475: INFO: ebs-csi-node-p8p5w started at 2023-01-27 07:01:00 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:09.475: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:09.475: INFO: dns-controller-85d56fc6db-kj5mr started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.475: INFO: 	Container dns-controller ready: true, restart count 0
Jan 27 07:23:09.632: INFO: 
Latency metrics for node i-05d5bb17fb5a2a4fe
Jan 27 07:23:09.632: INFO: 
Logging node info for node i-07778c09b254061f9
Jan 27 07:23:09.667: INFO: Node Info: &Node{ObjectMeta:{i-07778c09b254061f9    05fedfc1-e441-4062-b18f-0be7bf9e72b8 48651 0 2023-01-27 07:02:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-07778c09b254061f9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07778c09b254061f9 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07778c09b254061f9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 07:02:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:22:37 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 07:23:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07778c09b254061f9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:08 +0000 UTC,LastTransitionTime:2023-01-27 07:02:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:08 +0000 UTC,LastTransitionTime:2023-01-27 07:02:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:08 +0000 UTC,LastTransitionTime:2023-01-27 07:02:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:23:08 +0000 UTC,LastTransitionTime:2023-01-27 07:02:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.193,},NodeAddress{Type:ExternalIP,Address:99.79.123.97,},NodeAddress{Type:InternalDNS,Address:i-07778c09b254061f9.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07778c09b254061f9.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-123-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d034437d002d81c902239c261a23a,SystemUUID:ec2d0344-37d0-02d8-1c90-2239c261a23a,BootID:eb9494ef-8e4a-40ec-ae05-5de034b9a14d,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:23857462,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0408b1300d5ab25dc kubernetes.io/csi/ebs.csi.aws.com^vol-0b894f9250be5f690 kubernetes.io/csi/ebs.csi.aws.com^vol-0eba0242b06200867],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0b894f9250be5f690,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0eba0242b06200867,DevicePath:,},},Config:nil,},}
Jan 27 07:23:09.668: INFO: 
Logging kubelet events for node i-07778c09b254061f9
Jan 27 07:23:09.703: INFO: 
Logging pods the kubelet thinks is on node i-07778c09b254061f9
Jan 27 07:23:09.743: INFO: inline-volume-tester-dk8mj started at 2023-01-27 07:21:55 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 07:23:09.743: INFO: cilium-qxcl5 started at 2023-01-27 07:02:33 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:23:09.743: INFO: coredns-autoscaler-7cb5c5b969-dmqdg started at 2023-01-27 07:02:43 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container autoscaler ready: true, restart count 0
Jan 27 07:23:09.743: INFO: suspend-true-to-false-kvh4k started at 2023-01-27 07:23:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container c ready: false, restart count 0
Jan 27 07:23:09.743: INFO: test-container-pod started at 2023-01-27 07:23:06 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:09.743: INFO: ebs-csi-node-b4rg7 started at 2023-01-27 07:02:33 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:09.743: INFO: netserver-0 started at 2023-01-27 07:22:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:09.743: INFO: suspend-true-to-false-7svjv started at 2023-01-27 07:22:57 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container c ready: false, restart count 0
Jan 27 07:23:09.743: INFO: inline-volume-tester-b5zt8 started at 2023-01-27 07:22:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 07:23:09.743: INFO: coredns-559769c974-vqbts started at 2023-01-27 07:02:43 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container coredns ready: true, restart count 0
Jan 27 07:23:09.743: INFO: suspend-true-to-false-gmj28 started at 2023-01-27 07:22:57 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container c ready: false, restart count 0
Jan 27 07:23:09.743: INFO: suspend-true-to-false-s59zr started at 2023-01-27 07:23:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container c ready: false, restart count 0
Jan 27 07:23:09.743: INFO: netserver-0 started at 2023-01-27 07:22:54 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:09.743: INFO: test-container-pod started at 2023-01-27 07:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container webserver ready: false, restart count 0
Jan 27 07:23:09.743: INFO: webserver-pod started at 2023-01-27 07:22:06 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container agnhost ready: false, restart count 0
Jan 27 07:23:09.743: INFO: external-client started at 2023-01-27 07:23:06 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container external-client ready: false, restart count 0
Jan 27 07:23:09.743: INFO: ebs-csi-controller-555658678f-cxzmp started at 2023-01-27 07:02:43 +0000 UTC (0+5 container statuses recorded)
Jan 27 07:23:09.743: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:09.743: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:09.976: INFO: 
Latency metrics for node i-07778c09b254061f9
Jan 27 07:23:09.976: INFO: 
Logging node info for node i-09d518fc71e7d13f4
Jan 27 07:23:10.011: INFO: Node Info: &Node{ObjectMeta:{i-09d518fc71e7d13f4    37f43cec-bc69-406d-aaed-12e07084bb9a 48620 0 2023-01-27 07:02:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-09d518fc71e7d13f4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-09d518fc71e7d13f4 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-2640":"i-09d518fc71e7d13f4","csi-hostpath-volume-expand-2641":"i-09d518fc71e7d13f4","ebs.csi.aws.com":"i-09d518fc71e7d13f4"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:23:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 07:23:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-09d518fc71e7d13f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027256832 0} {<nil>} 3932868Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922399232 0} {<nil>} 3830468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:04 +0000 UTC,LastTransitionTime:2023-01-27 07:02:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:04 +0000 UTC,LastTransitionTime:2023-01-27 07:02:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:04 +0000 UTC,LastTransitionTime:2023-01-27 07:02:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:23:04 +0000 UTC,LastTransitionTime:2023-01-27 07:02:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.245,},NodeAddress{Type:ExternalIP,Address:3.97.15.71,},NodeAddress{Type:InternalDNS,Address:i-09d518fc71e7d13f4.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-09d518fc71e7d13f4.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-15-71.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec258db0dd134a5ee6f95576b5a7a229,SystemUUID:ec258db0-dd13-4a5e-e6f9-5576b5a7a229,BootID:9feee0d4-fb5c-41be-b58a-e30e99e2b3a5,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-2641^3744c9af-9e13-11ed-8f98-c69d6d448de6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-2641^3744c9af-9e13-11ed-8f98-c69d6d448de6,DevicePath:,},},Config:nil,},}
Jan 27 07:23:10.012: INFO: 
Logging kubelet events for node i-09d518fc71e7d13f4
Jan 27 07:23:10.049: INFO: 
Logging pods the kubelet thinks is on node i-09d518fc71e7d13f4
Jan 27 07:23:10.100: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:22:41 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.100: INFO: netserver-1 started at 2023-01-27 07:22:54 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:10.100: INFO: ebs-csi-node-mm5lb started at 2023-01-27 07:02:40 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.100: INFO: cilium-5xr4k started at 2023-01-27 07:02:40 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:23:10.100: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:21:27 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.100: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.100: INFO: pod-server-1 started at 2023-01-27 07:22:59 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Init container init ready: false, restart count 0
Jan 27 07:23:10.100: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 27 07:23:10.100: INFO: netserver-1 started at 2023-01-27 07:22:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:10.100: INFO: coredns-559769c974-x9f76 started at 2023-01-27 07:03:08 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.100: INFO: 	Container coredns ready: true, restart count 0
Jan 27 07:23:10.338: INFO: 
Latency metrics for node i-09d518fc71e7d13f4
Jan 27 07:23:10.338: INFO: 
Logging node info for node i-0dce49bbc382aba7b
Jan 27 07:23:10.370: INFO: Node Info: &Node{ObjectMeta:{i-0dce49bbc382aba7b    d297687c-6c03-44bc-930d-72e717e9f53e 48474 0 2023-01-27 07:02:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0dce49bbc382aba7b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0dce49bbc382aba7b topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-8368":"i-0dce49bbc382aba7b","ebs.csi.aws.com":"i-0dce49bbc382aba7b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-27 07:23:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-27 07:23:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dce49bbc382aba7b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:01 +0000 UTC,LastTransitionTime:2023-01-27 07:02:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:01 +0000 UTC,LastTransitionTime:2023-01-27 07:02:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:01 +0000 UTC,LastTransitionTime:2023-01-27 07:02:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:23:01 +0000 UTC,LastTransitionTime:2023-01-27 07:02:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.46.196,},NodeAddress{Type:ExternalIP,Address:3.99.177.105,},NodeAddress{Type:InternalDNS,Address:i-0dce49bbc382aba7b.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dce49bbc382aba7b.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-177-105.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec248f4a8308f7fd64b0b4060b34c4bf,SystemUUID:ec248f4a-8308-f7fd-64b0-b4060b34c4bf,BootID:207a92f1-a9ae-4fd1-9422-4b96b5d6bd70,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-8368^560371e2-9e13-11ed-80d4-feb91e388077 kubernetes.io/csi/ebs.csi.aws.com^vol-0408b1300d5ab25dc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0408b1300d5ab25dc,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-8368^560371e2-9e13-11ed-80d4-feb91e388077,DevicePath:,},},Config:nil,},}
Jan 27 07:23:10.371: INFO: 
Logging kubelet events for node i-0dce49bbc382aba7b
Jan 27 07:23:10.405: INFO: 
Logging pods the kubelet thinks is on node i-0dce49bbc382aba7b
Jan 27 07:23:10.447: INFO: netserver-2 started at 2023-01-27 07:22:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:10.447: INFO: hostexec-i-0dce49bbc382aba7b-wd42r started at 2023-01-27 07:22:50 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:23:10.447: INFO: netserver-2 started at 2023-01-27 07:22:55 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:10.447: INFO: ebs-csi-node-gpzhk started at 2023-01-27 07:02:36 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.447: INFO: hostexec-i-0dce49bbc382aba7b-jdqnc started at 2023-01-27 07:22:47 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:23:10.447: INFO: local-injector started at 2023-01-27 07:23:02 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container local-injector ready: true, restart count 0
Jan 27 07:23:10.447: INFO: pod-client started at 2023-01-27 07:22:46 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container pod-client ready: true, restart count 0
Jan 27 07:23:10.447: INFO: ebs-csi-controller-555658678f-hkscp started at 2023-01-27 07:02:45 +0000 UTC (0+5 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.447: INFO: cilium-v2mzs started at 2023-01-27 07:02:36 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:23:10.447: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:22:14 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:23:10.447: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.447: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.671: INFO: 
Latency metrics for node i-0dce49bbc382aba7b
Jan 27 07:23:10.671: INFO: 
Logging node info for node i-0ec9d55a708b6e024
Jan 27 07:23:10.703: INFO: Node Info: &Node{ObjectMeta:{i-0ec9d55a708b6e024    2c212d72-c705-4245-bf30-3b3b8e467a38 48739 0 2023-01-27 07:02:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0ec9d55a708b6e024 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0ec9d55a708b6e024 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7644":"i-0ec9d55a708b6e024","ebs.csi.aws.com":"i-0ec9d55a708b6e024"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:23:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 07:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0ec9d55a708b6e024,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:03 +0000 UTC,LastTransitionTime:2023-01-27 07:02:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:03 +0000 UTC,LastTransitionTime:2023-01-27 07:02:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:23:03 +0000 UTC,LastTransitionTime:2023-01-27 07:02:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:23:03 +0000 UTC,LastTransitionTime:2023-01-27 07:02:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.94,},NodeAddress{Type:ExternalIP,Address:3.99.189.218,},NodeAddress{Type:InternalDNS,Address:i-0ec9d55a708b6e024.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ec9d55a708b6e024.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-189-218.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec237e94973848c124a158045848306f,SystemUUID:ec237e94-9738-48c1-24a1-58045848306f,BootID:b8c904d5-b4d0-4bfa-bd10-fe4d19137eff,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7644^4c3c9ac1-9e13-11ed-a287-9edf383b1fcb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7644^4c3c9ac1-9e13-11ed-a287-9edf383b1fcb,DevicePath:,},},Config:nil,},}
Jan 27 07:23:10.704: INFO: 
Logging kubelet events for node i-0ec9d55a708b6e024
Jan 27 07:23:10.738: INFO: 
Logging pods the kubelet thinks is on node i-0ec9d55a708b6e024
Jan 27 07:23:10.775: INFO: ebs-csi-node-tvth8 started at 2023-01-27 07:02:37 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.775: INFO: netserver-3 started at 2023-01-27 07:22:44 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:10.775: INFO: funny-ip-zs576 started at 2023-01-27 07:21:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container funny-ip ready: true, restart count 0
Jan 27 07:23:10.775: INFO: concurrent-27913403-td56r started at 2023-01-27 07:23:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container c ready: true, restart count 0
Jan 27 07:23:10.775: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:21:58 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:23:10.775: INFO: inline-volume-tester-ljf2s started at 2023-01-27 07:22:07 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 27 07:23:10.775: INFO: execpodvh44p started at 2023-01-27 07:21:09 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:23:10.775: INFO: pause-pod-1 started at 2023-01-27 07:22:09 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:23:10.775: INFO: cilium-rs5vx started at 2023-01-27 07:02:37 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:23:10.775: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:23:10.775: INFO: test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc started at 2023-01-27 07:18:09 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container test ready: false, restart count 0
Jan 27 07:23:10.775: INFO: netserver-3 started at 2023-01-27 07:22:55 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:23:10.775: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:23:11.006: INFO: 
Latency metrics for node i-0ec9d55a708b6e024
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 07:23:11.006 (1.774s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 07:23:11.007 (1.774s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 07:23:11.007
STEP: Destroying namespace "runtimeclass-6787" for this suite. - test/e2e/framework/framework.go:347 @ 01/27/23 07:23:11.007
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 07:23:11.04 (33ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 07:23:11.04
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 07:23:11.04 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-6787/test-runtimeclass-runtimeclass-6787-preconfigured-handler-n5fvc mentions in log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-node] RuntimeClass should run a Pod requesting a RuntimeClass with scheduling without taints 5m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sRuntimeClass\sshould\srun\sa\sPod\srequesting\sa\sRuntimeClass\swith\sscheduling\swithout\staints$'

[FAILED] timed out while waiting for pod runtimeclass-7990/test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9 to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/27/23 07:16:46.388

				> Enter [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 07:11:37.304
STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/27/23 07:11:37.304
Jan 27 07:11:37.305: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename runtimeclass - test/e2e/framework/framework.go:247 @ 01/27/23 07:11:37.305
STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/27/23 07:11:37.4
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/27/23 07:11:37.461
< Exit [BeforeEach] [sig-node] RuntimeClass - set up framework | framework.go:188 @ 01/27/23 07:11:37.524 (219ms)
> Enter [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 07:11:37.524
< Exit [BeforeEach] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:33 @ 01/27/23 07:11:37.524 (0s)
> Enter [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/27/23 07:11:37.524
Jan 27 07:11:37.590: INFO: Waiting up to 5m0s for pod "hostexec-i-07778c09b254061f9-2vpw8" in namespace "runtimeclass-7990" to be "running"
Jan 27 07:11:37.623: INFO: Pod "hostexec-i-07778c09b254061f9-2vpw8": Phase="Pending", Reason="", readiness=false. Elapsed: 32.8351ms
Jan 27 07:11:39.656: INFO: Pod "hostexec-i-07778c09b254061f9-2vpw8": Phase="Running", Reason="", readiness=true. Elapsed: 2.0657665s
Jan 27 07:11:39.656: INFO: Pod "hostexec-i-07778c09b254061f9-2vpw8" satisfied condition "running"
Jan 27 07:11:39.656: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c if [ -e '/etc/containerd/config.toml' ]; then
grep -q 'runtimes.test-handler' /etc/containerd/config.toml
  return
fi

if [ -e '/etc/crio/crio.conf' ]; then
  grep -q 'runtimes.test-handler' /etc/crio/crio.conf
  return
fi
] Namespace:runtimeclass-7990 PodName:hostexec-i-07778c09b254061f9-2vpw8 ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Jan 27 07:11:39.656: INFO: >>> kubeConfig: /root/.kube/config
Jan 27 07:11:39.657: INFO: ExecWithOptions: Clientset creation
Jan 27 07:11:39.657: INFO: ExecWithOptions: execute(POST https://api-e2e-e2e-kops-warm-poo-agujp3-c6c35181c3f604f2.elb.ca-central-1.amazonaws.com/api/v1/namespaces/runtimeclass-7990/pods/hostexec-i-07778c09b254061f9-2vpw8/exec?command=nsenter&command=--mount%3D%2Frootfs%2Fproc%2F1%2Fns%2Fmnt&command=--&command=sh&command=-c&command=if+%5B+-e+%27%2Fetc%2Fcontainerd%2Fconfig.toml%27+%5D%3B+then%0Agrep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcontainerd%2Fconfig.toml%0A++return%0Afi%0A%0Aif+%5B+-e+%27%2Fetc%2Fcrio%2Fcrio.conf%27+%5D%3B+then%0A++grep+-q+%27runtimes.test-handler%27+%2Fetc%2Fcrio%2Fcrio.conf%0A++return%0Afi%0A&container=agnhost-container&container=agnhost-container&stderr=true&stdout=true)
STEP: Trying to launch a pod without a label to get a node which can launch it. - test/e2e/scheduling/predicates.go:1042 @ 01/27/23 07:11:39.918
Jan 27 07:11:39.952: INFO: Waiting up to 1m0s for pod "without-label" in namespace "runtimeclass-7990" to be "running"
Jan 27 07:11:39.984: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 31.207415ms
Jan 27 07:11:42.021: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 2.068163068s
Jan 27 07:11:44.016: INFO: Pod "without-label": Phase="Pending", Reason="", readiness=false. Elapsed: 4.063537807s
Jan 27 07:11:46.016: INFO: Pod "without-label": Phase="Running", Reason="", readiness=true. Elapsed: 6.063774179s
Jan 27 07:11:46.016: INFO: Pod "without-label" satisfied condition "running"
STEP: Explicitly delete pod here to free the resource it takes. - test/e2e/scheduling/predicates.go:973 @ 01/27/23 07:11:46.048
STEP: Trying to apply a label on the found node. - test/e2e/node/runtimeclass.go:148 @ 01/27/23 07:11:46.086
STEP: verifying the node has the label foo-b702d09c-61c9-4a34-84a5-6f5474c8c426 bar - test/e2e/framework/node/helper.go:63 @ 01/27/23 07:11:46.124
STEP: verifying the node has the label fizz-3539aeab-48b2-4c64-ae6e-6387d78f2eb3 buzz - test/e2e/framework/node/helper.go:63 @ 01/27/23 07:11:46.194
STEP: Trying to create runtimeclass and pod - test/e2e/node/runtimeclass.go:155 @ 01/27/23 07:11:46.225
Jan 27 07:11:46.292: INFO: Waiting up to 5m0s for pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9" in namespace "runtimeclass-7990" to be "not pending"
Jan 27 07:11:46.323: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 31.262477ms
Jan 27 07:11:48.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064100941s
Jan 27 07:11:50.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.062942233s
Jan 27 07:11:52.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.062976985s
Jan 27 07:11:54.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.064393238s
Jan 27 07:11:56.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.063461539s
Jan 27 07:11:58.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 12.066416169s
Jan 27 07:12:00.359: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 14.06735588s
Jan 27 07:12:02.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 16.06423206s
Jan 27 07:12:04.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 18.064205068s
Jan 27 07:12:06.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 20.065120038s
Jan 27 07:12:08.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 22.063396932s
Jan 27 07:12:10.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 24.064310797s
Jan 27 07:12:12.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 26.065092982s
Jan 27 07:12:14.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 28.06640331s
Jan 27 07:12:16.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 30.063773598s
Jan 27 07:12:18.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 32.065245681s
Jan 27 07:12:20.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063963934s
Jan 27 07:12:22.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063616754s
Jan 27 07:12:24.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 38.063881571s
Jan 27 07:12:26.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 40.063167922s
Jan 27 07:12:28.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 42.063284375s
Jan 27 07:12:30.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 44.063379939s
Jan 27 07:12:32.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 46.063079142s
Jan 27 07:12:34.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 48.063626882s
Jan 27 07:12:36.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 50.063372129s
Jan 27 07:12:38.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062845068s
Jan 27 07:12:40.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 54.062904799s
Jan 27 07:12:42.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 56.064050672s
Jan 27 07:12:44.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 58.065413134s
Jan 27 07:12:46.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.06569903s
Jan 27 07:12:48.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.063209742s
Jan 27 07:12:50.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.063563268s
Jan 27 07:12:52.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.065520424s
Jan 27 07:12:54.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.063920029s
Jan 27 07:12:56.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.06292534s
Jan 27 07:12:58.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.06395577s
Jan 27 07:13:00.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.063933702s
Jan 27 07:13:02.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.063298043s
Jan 27 07:13:04.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.06379475s
Jan 27 07:13:06.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.063837483s
Jan 27 07:13:08.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.063210226s
Jan 27 07:13:10.354: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.062716913s
Jan 27 07:13:12.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063465419s
Jan 27 07:13:14.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.063127051s
Jan 27 07:13:16.359: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.067227069s
Jan 27 07:13:18.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.063378564s
Jan 27 07:13:20.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.064492475s
Jan 27 07:13:22.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.066235985s
Jan 27 07:13:24.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.063796022s
Jan 27 07:13:26.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.06397297s
Jan 27 07:13:28.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.066646169s
Jan 27 07:13:30.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.064409917s
Jan 27 07:13:32.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.063885389s
Jan 27 07:13:34.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.063779107s
Jan 27 07:13:36.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.064349996s
Jan 27 07:13:38.360: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.067889285s
Jan 27 07:13:40.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.06331098s
Jan 27 07:13:42.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063787291s
Jan 27 07:13:44.361: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.069213379s
Jan 27 07:13:46.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.063132628s
Jan 27 07:13:48.394: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.102615559s
Jan 27 07:13:50.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.063538698s
Jan 27 07:13:52.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.062894748s
Jan 27 07:13:54.364: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.071828331s
Jan 27 07:13:56.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.063287862s
Jan 27 07:13:58.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062986179s
Jan 27 07:14:00.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.06415526s
Jan 27 07:14:02.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.063871298s
Jan 27 07:14:04.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.063581516s
Jan 27 07:14:06.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.06311725s
Jan 27 07:14:08.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.063612836s
Jan 27 07:14:10.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.065361829s
Jan 27 07:14:12.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063963064s
Jan 27 07:14:14.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.063863016s
Jan 27 07:14:16.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.065944674s
Jan 27 07:14:18.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.063440728s
Jan 27 07:14:20.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.063884441s
Jan 27 07:14:22.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.066298144s
Jan 27 07:14:24.354: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.062685651s
Jan 27 07:14:26.365: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.073492769s
Jan 27 07:14:28.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.064209363s
Jan 27 07:14:30.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.063429538s
Jan 27 07:14:32.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063919823s
Jan 27 07:14:34.403: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.1113576s
Jan 27 07:14:36.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.064347042s
Jan 27 07:14:38.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.064173903s
Jan 27 07:14:40.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.06522131s
Jan 27 07:14:42.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.065039337s
Jan 27 07:14:44.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.063273951s
Jan 27 07:14:46.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.06333876s
Jan 27 07:14:48.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.062956552s
Jan 27 07:14:50.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.063456985s
Jan 27 07:14:52.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.064254525s
Jan 27 07:14:54.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.063239983s
Jan 27 07:14:56.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.064912638s
Jan 27 07:14:58.354: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.062643076s
Jan 27 07:15:00.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.064528057s
Jan 27 07:15:02.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063832318s
Jan 27 07:15:04.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.064503121s
Jan 27 07:15:06.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.063936124s
Jan 27 07:15:08.384: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.092530492s
Jan 27 07:15:10.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063351662s
Jan 27 07:15:12.510: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.218390028s
Jan 27 07:15:14.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063696912s
Jan 27 07:15:16.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.063829059s
Jan 27 07:15:18.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063866364s
Jan 27 07:15:20.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.063496103s
Jan 27 07:15:22.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.062726734s
Jan 27 07:15:24.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.064577172s
Jan 27 07:15:26.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.063611757s
Jan 27 07:15:28.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062998647s
Jan 27 07:15:30.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.063949269s
Jan 27 07:15:32.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.062746723s
Jan 27 07:15:34.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.063462371s
Jan 27 07:15:36.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.064658157s
Jan 27 07:15:38.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.063945213s
Jan 27 07:15:40.358: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.066138523s
Jan 27 07:15:42.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.064076496s
Jan 27 07:15:44.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.064168016s
Jan 27 07:15:46.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.062909878s
Jan 27 07:15:48.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.065323269s
Jan 27 07:15:50.360: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.068038167s
Jan 27 07:15:52.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.06303935s
Jan 27 07:15:54.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.063427653s
Jan 27 07:15:56.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.064431986s
Jan 27 07:15:58.365: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.072994193s
Jan 27 07:16:00.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.063368953s
Jan 27 07:16:02.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063692056s
Jan 27 07:16:04.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.06524175s
Jan 27 07:16:06.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062852376s
Jan 27 07:16:08.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063615006s
Jan 27 07:16:10.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063345985s
Jan 27 07:16:12.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.063208498s
Jan 27 07:16:14.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.06342013s
Jan 27 07:16:16.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.06394109s
Jan 27 07:16:18.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.06319731s
Jan 27 07:16:20.357: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.065174301s
Jan 27 07:16:22.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.063739741s
Jan 27 07:16:24.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.063543805s
Jan 27 07:16:26.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.064177402s
Jan 27 07:16:28.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.064073967s
Jan 27 07:16:30.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.06392036s
Jan 27 07:16:32.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.06338374s
Jan 27 07:16:34.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.063840947s
Jan 27 07:16:36.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.064065424s
Jan 27 07:16:38.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.064228444s
Jan 27 07:16:40.366: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.073748457s
Jan 27 07:16:42.355: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.062881665s
Jan 27 07:16:44.359: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.067409587s
Jan 27 07:16:46.356: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.063924623s
Jan 27 07:16:46.387: INFO: Pod "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.095279497s
Jan 27 07:16:46.388: INFO: Unexpected error: 
    <*pod.timeoutError | 0xc0005c0600>: {
        msg: "timed out while waiting for pod runtimeclass-7990/test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9 to be not pending",
        observedObjects: [
            <*v1.Pod | 0xc003460000>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9",
                    GenerateName: "test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclass-",
                    Namespace: "runtimeclass-7990",
                    SelfLink: "",
                    UID: "acdd75db-cea6-4f9a-95ee-ffa36976c148",
                    ResourceVersion: "18118",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63810400306,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -9223372036854775808,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810400306,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:metadata\":{\"f:generateName\":{}},\"f:spec\":{\"f:automountServiceAccountToken\":{},\"f:containers\":{\"k:{\\\"name\\\":\\\"test\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{},\"f:restartPolicy\":{},\"f:runtimeClassName\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63810400330,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: nil,
                    InitContainers: nil,
                    Containers: [
                        {
                            Name: "test",
                            Image: "registry.k8s.io/e2e-test-images/busybox:1.29-4",
                            Command: ["true"],
                            Args: nil,
                            WorkingDir: "",
                            Ports: nil,
                            EnvFrom: nil,
                            Env: nil,
                            Resources: {Limits: nil, Requests: nil, Claims: nil},
                            VolumeMounts: nil,
                            VolumeDevices: nil,
                            LivenessProbe: nil,
                            ReadinessProbe: nil,
                            StartupProbe: nil,
                            Lifecycle: nil,
                            TerminationMessagePath: "/dev/termination-log",
                            TerminationMessagePolicy: "File",
                            ImagePullPolicy: "IfNotPresent",
                            SecurityContext: nil,
                            Stdin: false,
                            StdinOnce: false,
                            TTY: false,
                        },
                    ],
                    EphemeralContainers: nil,
                    RestartPolicy: "Never",
                    TerminationGracePeriodSeconds: 30,
                    ActiveDeadlineSeconds: nil,
                    DNSPolicy: "ClusterFirst",
                    NodeSelector: {
                        "fizz-3539aeab-48b2-4c64-ae6e-6387d78f2eb3": "buzz",
                        "foo-b702d09c-61c9-4a34-84a5-6f5474c8c426": "bar",
                    },
                    ServiceAccountName: "default",
                    DeprecatedServiceAccount: "default",
                    AutomountServiceAccountToken: false,
                    NodeName: "i-0ec9d55a708b6e024",
                    HostNetwork: false,
                    HostPID: false,
                    HostIPC: false,
                    ShareProcessNamespace: nil,
                    SecurityContext: {
                        SELinuxOptions: nil,
                        WindowsOptions: nil,
                        RunAsUser: nil,
                        RunAsGroup: nil,
                        RunAsNonRoot: nil,
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

[FAILED] timed out while waiting for pod runtimeclass-7990/test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9 to be not pending
In [It] at: test/e2e/node/runtimeclass.go:167 @ 01/27/23 07:16:46.388
< Exit [It] should run a Pod requesting a RuntimeClass with scheduling without taints  - test/e2e/node/runtimeclass.go:131 @ 01/27/23 07:16:46.388 (5m8.865s)
> Enter [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 07:16:46.388
Jan 27 07:16:46.388: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
< Exit [AfterEach] [sig-node] RuntimeClass - test/e2e/framework/node/init/init.go:33 @ 01/27/23 07:16:46.421 (32ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 07:16:46.421
STEP: removing the label fizz-3539aeab-48b2-4c64-ae6e-6387d78f2eb3 off the node i-0ec9d55a708b6e024 - test/e2e/framework/node/helper.go:72 @ 01/27/23 07:16:46.421
STEP: verifying the node doesn't have the label fizz-3539aeab-48b2-4c64-ae6e-6387d78f2eb3 - test/e2e/framework/node/helper.go:75 @ 01/27/23 07:16:46.49
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 07:16:46.524 (103ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 07:16:46.524
STEP: removing the label foo-b702d09c-61c9-4a34-84a5-6f5474c8c426 off the node i-0ec9d55a708b6e024 - test/e2e/framework/node/helper.go:72 @ 01/27/23 07:16:46.524
STEP: verifying the node doesn't have the label foo-b702d09c-61c9-4a34-84a5-6f5474c8c426 - test/e2e/framework/node/helper.go:75 @ 01/27/23 07:16:46.596
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/node/runtimeclass.go:152 @ 01/27/23 07:16:46.628 (104ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 07:16:46.628
STEP: Deleting pod hostexec-i-07778c09b254061f9-2vpw8 in namespace runtimeclass-7990 - test/e2e/framework/pod/delete.go:41 @ 01/27/23 07:16:46.628
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/node/runtimeclass/runtimeclass.go:64 @ 01/27/23 07:16:46.673 (45ms)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 07:16:46.673
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - test/e2e/framework/metrics/init/init.go:35 @ 01/27/23 07:16:46.673 (0s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 07:16:46.673
STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 07:16:46.673
STEP: Collecting events from namespace "runtimeclass-7990". - test/e2e/framework/debug/dump.go:42 @ 01/27/23 07:16:46.673
STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 01/27/23 07:16:46.706
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:37 +0000 UTC - event for hostexec-i-07778c09b254061f9-2vpw8: {default-scheduler } Scheduled: Successfully assigned runtimeclass-7990/hostexec-i-07778c09b254061f9-2vpw8 to i-07778c09b254061f9
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:37 +0000 UTC - event for hostexec-i-07778c09b254061f9-2vpw8: {kubelet i-07778c09b254061f9} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:38 +0000 UTC - event for hostexec-i-07778c09b254061f9-2vpw8: {kubelet i-07778c09b254061f9} Created: Created container agnhost-container
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:38 +0000 UTC - event for hostexec-i-07778c09b254061f9-2vpw8: {kubelet i-07778c09b254061f9} Started: Started container agnhost-container
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:39 +0000 UTC - event for without-label: {default-scheduler } Scheduled: Successfully assigned runtimeclass-7990/without-label to i-0ec9d55a708b6e024
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:41 +0000 UTC - event for without-label: {kubelet i-0ec9d55a708b6e024} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:41 +0000 UTC - event for without-label: {kubelet i-0ec9d55a708b6e024} Created: Created container without-label
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:41 +0000 UTC - event for without-label: {kubelet i-0ec9d55a708b6e024} Started: Started container without-label
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:46 +0000 UTC - event for test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9: {default-scheduler } Scheduled: Successfully assigned runtimeclass-7990/test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9 to i-0ec9d55a708b6e024
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:46 +0000 UTC - event for test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9: {kubelet i-0ec9d55a708b6e024} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "test-handler" is configured
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:11:46 +0000 UTC - event for without-label: {kubelet i-0ec9d55a708b6e024} Killing: Stopping container without-label
Jan 27 07:16:46.706: INFO: At 2023-01-27 07:16:46 +0000 UTC - event for hostexec-i-07778c09b254061f9-2vpw8: {kubelet i-07778c09b254061f9} Killing: Stopping container agnhost-container
Jan 27 07:16:46.737: INFO: POD                                                              NODE                 PHASE    GRACE  CONDITIONS
Jan 27 07:16:46.737: INFO: test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9  i-0ec9d55a708b6e024  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:11:46 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:11:46 +0000 UTC ContainersNotReady containers with unready status: [test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:11:46 +0000 UTC ContainersNotReady containers with unready status: [test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-27 07:11:46 +0000 UTC  }]
Jan 27 07:16:46.737: INFO: 
Jan 27 07:16:46.769: INFO: Unable to fetch runtimeclass-7990/test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9/test logs: the server rejected our request for an unknown reason (get pods test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9)
Jan 27 07:16:46.801: INFO: 
Logging node info for node i-05d5bb17fb5a2a4fe
Jan 27 07:16:46.833: INFO: Node Info: &Node{ObjectMeta:{i-05d5bb17fb5a2a4fe    f128e504-78aa-4e47-83e8-71ab2b2139aa 18876 0 2023-01-27 07:00:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-05d5bb17fb5a2a4fe kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-05d5bb17fb5a2a4fe"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 07:00:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-27 07:00:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:01:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:01:09 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-27 07:01:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-27 07:12:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-05d5bb17fb5a2a4fe,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4002136064 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897278464 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:12:29 +0000 UTC,LastTransitionTime:2023-01-27 07:00:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:12:29 +0000 UTC,LastTransitionTime:2023-01-27 07:00:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:12:29 +0000 UTC,LastTransitionTime:2023-01-27 07:00:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:12:29 +0000 UTC,LastTransitionTime:2023-01-27 07:01:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.188,},NodeAddress{Type:ExternalIP,Address:3.99.161.161,},NodeAddress{Type:InternalDNS,Address:i-05d5bb17fb5a2a4fe.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-05d5bb17fb5a2a4fe.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-161-161.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2971c2098b0fef841934b8fe07dccf,SystemUUID:ec2971c2-098b-0fef-8419-34b8fe07dccf,BootID:fd18e339-e670-4d9d-ac84-eff3cc4ad416,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:157797353,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:151677080,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:134531559,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:131283406,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:126979107,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:121190708,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:81436097,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:81120118,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:81114891,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:61500433,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:60827222,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:59553904,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:56047923,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:41127440,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:39662357,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:24567287,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:18345226,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4692712,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 07:16:46.833: INFO: 
Logging kubelet events for node i-05d5bb17fb5a2a4fe
Jan 27 07:16:46.869: INFO: 
Logging pods the kubelet thinks is on node i-05d5bb17fb5a2a4fe
Jan 27 07:16:46.909: INFO: kube-apiserver-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (0+2 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container healthcheck ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Container kube-apiserver ready: true, restart count 2
Jan 27 07:16:46.909: INFO: cilium-operator-6f7d7f696f-fbjj9 started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 27 07:16:46.909: INFO: kube-controller-manager-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container kube-controller-manager ready: true, restart count 4
Jan 27 07:16:46.909: INFO: kube-scheduler-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 27 07:16:46.909: INFO: etcd-manager-events-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (10+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 07:16:46.909: INFO: dns-controller-85d56fc6db-kj5mr started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container dns-controller ready: true, restart count 0
Jan 27 07:16:46.909: INFO: aws-cloud-controller-manager-2b4gz started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 27 07:16:46.909: INFO: kops-controller-tvkvc started at 2023-01-27 07:01:00 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container kops-controller ready: true, restart count 0
Jan 27 07:16:46.909: INFO: etcd-manager-main-i-05d5bb17fb5a2a4fe started at 2023-01-27 06:58:42 +0000 UTC (10+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 27 07:16:46.909: INFO: cilium-j96s2 started at 2023-01-27 07:01:00 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:16:46.909: INFO: ebs-csi-node-p8p5w started at 2023-01-27 07:01:00 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:46.909: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:46.909: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:47.087: INFO: 
Latency metrics for node i-05d5bb17fb5a2a4fe
Jan 27 07:16:47.087: INFO: 
Logging node info for node i-07778c09b254061f9
Jan 27 07:16:47.121: INFO: Node Info: &Node{ObjectMeta:{i-07778c09b254061f9    05fedfc1-e441-4062-b18f-0be7bf9e72b8 29179 0 2023-01-27 07:02:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-07778c09b254061f9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07778c09b254061f9 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8171":"i-07778c09b254061f9","ebs.csi.aws.com":"i-07778c09b254061f9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-27 07:02:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:16:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07778c09b254061f9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:15:38 +0000 UTC,LastTransitionTime:2023-01-27 07:02:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:15:38 +0000 UTC,LastTransitionTime:2023-01-27 07:02:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:15:38 +0000 UTC,LastTransitionTime:2023-01-27 07:02:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:15:38 +0000 UTC,LastTransitionTime:2023-01-27 07:02:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.193,},NodeAddress{Type:ExternalIP,Address:99.79.123.97,},NodeAddress{Type:InternalDNS,Address:i-07778c09b254061f9.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07778c09b254061f9.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-123-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d034437d002d81c902239c261a23a,SystemUUID:ec2d0344-37d0-02d8-1c90-2239c261a23a,BootID:eb9494ef-8e4a-40ec-ae05-5de034b9a14d,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:19007623,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 07:16:47.121: INFO: 
Logging kubelet events for node i-07778c09b254061f9
Jan 27 07:16:47.158: INFO: 
Logging pods the kubelet thinks is on node i-07778c09b254061f9
Jan 27 07:16:47.201: INFO: affinity-clusterip-timeout-6t8ch started at 2023-01-27 07:15:56 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container affinity-clusterip-timeout ready: true, restart count 0
Jan 27 07:16:47.201: INFO: cilium-qxcl5 started at 2023-01-27 07:02:33 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:16:47.201: INFO: coredns-autoscaler-7cb5c5b969-dmqdg started at 2023-01-27 07:02:43 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container autoscaler ready: true, restart count 0
Jan 27 07:16:47.201: INFO: ss2-0 started at 2023-01-27 07:16:12 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:47.201: INFO: ebs-csi-node-b4rg7 started at 2023-01-27 07:02:33 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:47.201: INFO: pod-handle-http-request started at 2023-01-27 07:16:35 +0000 UTC (0+2 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container container-handle-http-request ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container container-handle-https-request ready: true, restart count 0
Jan 27 07:16:47.201: INFO: coredns-559769c974-vqbts started at 2023-01-27 07:02:43 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container coredns ready: true, restart count 0
Jan 27 07:16:47.201: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:16:04 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:47.201: INFO: rs-8hfph started at 2023-01-27 07:16:35 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container donothing ready: false, restart count 0
Jan 27 07:16:47.201: INFO: ebs-csi-controller-555658678f-cxzmp started at 2023-01-27 07:02:43 +0000 UTC (0+5 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:47.201: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.201: INFO: netserver-0 started at 2023-01-27 07:16:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.201: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:47.412: INFO: 
Latency metrics for node i-07778c09b254061f9
Jan 27 07:16:47.412: INFO: 
Logging node info for node i-09d518fc71e7d13f4
Jan 27 07:16:47.446: INFO: Node Info: &Node{ObjectMeta:{i-09d518fc71e7d13f4    37f43cec-bc69-406d-aaed-12e07084bb9a 31559 0 2023-01-27 07:02:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-09d518fc71e7d13f4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-09d518fc71e7d13f4 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-4617":"i-09d518fc71e7d13f4","csi-mock-csi-mock-volumes-workload-9258":"i-09d518fc71e7d13f4","ebs.csi.aws.com":"i-09d518fc71e7d13f4"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:02:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-27 07:16:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-09d518fc71e7d13f4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027256832 0} {<nil>} 3932868Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922399232 0} {<nil>} 3830468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:37 +0000 UTC,LastTransitionTime:2023-01-27 07:02:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:37 +0000 UTC,LastTransitionTime:2023-01-27 07:02:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:37 +0000 UTC,LastTransitionTime:2023-01-27 07:02:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:16:37 +0000 UTC,LastTransitionTime:2023-01-27 07:02:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.245,},NodeAddress{Type:ExternalIP,Address:3.97.15.71,},NodeAddress{Type:InternalDNS,Address:i-09d518fc71e7d13f4.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-09d518fc71e7d13f4.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-15-71.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec258db0dd134a5ee6f95576b5a7a229,SystemUUID:ec258db0-dd13-4a5e-e6f9-5576b5a7a229,BootID:9feee0d4-fb5c-41be-b58a-e30e99e2b3a5,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:80539316,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:13766234,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 27 07:16:47.446: INFO: 
Logging kubelet events for node i-09d518fc71e7d13f4
Jan 27 07:16:47.488: INFO: 
Logging pods the kubelet thinks is on node i-09d518fc71e7d13f4
Jan 27 07:16:47.527: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:15:53 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container hostpath ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:47.527: INFO: netserver-1 started at 2023-01-27 07:16:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:47.527: INFO: csi-mockplugin-0 started at 2023-01-27 07:15:33 +0000 UTC (0+4 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container busybox ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container mock ready: true, restart count 0
Jan 27 07:16:47.527: INFO: coredns-559769c974-x9f76 started at 2023-01-27 07:03:08 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container coredns ready: true, restart count 0
Jan 27 07:16:47.527: INFO: pvc-volume-tester-x5vvf started at 2023-01-27 07:16:27 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container volume-tester ready: true, restart count 0
Jan 27 07:16:47.527: INFO: deployment-6c94ddcb9f-vgbm4 started at 2023-01-27 07:15:31 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container nginx ready: false, restart count 0
Jan 27 07:16:47.527: INFO: ebs-csi-node-mm5lb started at 2023-01-27 07:02:40 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:47.527: INFO: csi-mockplugin-attacher-0 started at 2023-01-27 07:16:17 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:16:47.527: INFO: cilium-5xr4k started at 2023-01-27 07:02:40 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:16:47.527: INFO: csi-mockplugin-0 started at 2023-01-27 07:16:17 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 27 07:16:47.527: INFO: 	Container mock ready: true, restart count 0
Jan 27 07:16:47.527: INFO: affinity-nodeport-timeout-rs9gg started at 2023-01-27 07:16:40 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container affinity-nodeport-timeout ready: true, restart count 0
Jan 27 07:16:47.527: INFO: test-grpc-8895bffc-edee-472b-a8e5-811f64febb99 started at 2023-01-27 07:15:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.527: INFO: 	Container etcd ready: true, restart count 0
Jan 27 07:16:47.758: INFO: 
Latency metrics for node i-09d518fc71e7d13f4
Jan 27 07:16:47.758: INFO: 
Logging node info for node i-0dce49bbc382aba7b
Jan 27 07:16:47.789: INFO: Node Info: &Node{ObjectMeta:{i-0dce49bbc382aba7b    d297687c-6c03-44bc-930d-72e717e9f53e 30008 0 2023-01-27 07:02:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0dce49bbc382aba7b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0dce49bbc382aba7b topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dce49bbc382aba7b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:02:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:16:22 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-27 07:16:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dce49bbc382aba7b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:22 +0000 UTC,LastTransitionTime:2023-01-27 07:02:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:22 +0000 UTC,LastTransitionTime:2023-01-27 07:02:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:22 +0000 UTC,LastTransitionTime:2023-01-27 07:02:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:16:22 +0000 UTC,LastTransitionTime:2023-01-27 07:02:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.46.196,},NodeAddress{Type:ExternalIP,Address:3.99.177.105,},NodeAddress{Type:InternalDNS,Address:i-0dce49bbc382aba7b.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dce49bbc382aba7b.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-177-105.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec248f4a8308f7fd64b0b4060b34c4bf,SystemUUID:ec248f4a-8308-f7fd-64b0-b4060b34c4bf,BootID:207a92f1-a9ae-4fd1-9422-4b96b5d6bd70,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-083a725128f2e8712],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-083a725128f2e8712,DevicePath:,},},Config:nil,},}
Jan 27 07:16:47.790: INFO: 
Logging kubelet events for node i-0dce49bbc382aba7b
Jan 27 07:16:47.828: INFO: 
Logging pods the kubelet thinks is on node i-0dce49bbc382aba7b
Jan 27 07:16:47.866: INFO: affinity-nodeport-timeout-vsjn5 started at 2023-01-27 07:16:40 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container affinity-nodeport-timeout ready: true, restart count 0
Jan 27 07:16:47.866: INFO: ss-0 started at 2023-01-27 07:16:20 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:47.866: INFO: netserver-2 started at 2023-01-27 07:16:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:47.866: INFO: pause-pod-747f76c69b-skdhw started at 2023-01-27 07:16:43 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container agnhost-pause ready: true, restart count 0
Jan 27 07:16:47.866: INFO: echo-sourceip started at 2023-01-27 07:16:37 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:47.866: INFO: ebs-csi-node-gpzhk started at 2023-01-27 07:02:36 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:47.866: INFO: affinity-clusterip-timeout-r8jfj started at 2023-01-27 07:15:56 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container affinity-clusterip-timeout ready: true, restart count 0
Jan 27 07:16:47.866: INFO: ss2-2 started at 2023-01-27 07:16:35 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:47.866: INFO: configmap-client started at 2023-01-27 07:16:38 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container configmap-client ready: true, restart count 0
Jan 27 07:16:47.866: INFO: deployment-6c94ddcb9f-gpcc7 started at 2023-01-27 07:15:31 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container nginx ready: false, restart count 0
Jan 27 07:16:47.866: INFO: execpod-affinity9qpbz started at 2023-01-27 07:16:08 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:47.866: INFO: ebs-csi-controller-555658678f-hkscp started at 2023-01-27 07:02:45 +0000 UTC (0+5 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:47.866: INFO: cilium-v2mzs started at 2023-01-27 07:02:36 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:16:47.866: INFO: pod-secrets-c4f4aaef-53ff-4fe3-95f4-8d8e69b587b7 started at 2023-01-27 07:15:43 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container creates-volume-test ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container dels-volume-test ready: true, restart count 0
Jan 27 07:16:47.866: INFO: 	Container upds-volume-test ready: true, restart count 0
Jan 27 07:16:47.866: INFO: kube-proxy-mode-detector started at 2023-01-27 07:16:35 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:47.866: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:48.159: INFO: 
Latency metrics for node i-0dce49bbc382aba7b
Jan 27 07:16:48.159: INFO: 
Logging node info for node i-0ec9d55a708b6e024
Jan 27 07:16:48.190: INFO: Node Info: &Node{ObjectMeta:{i-0ec9d55a708b6e024    2c212d72-c705-4245-bf30-3b3b8e467a38 31571 0 2023-01-27 07:02:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0ec9d55a708b6e024 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0ec9d55a708b6e024 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8269":"i-0ec9d55a708b6e024","ebs.csi.aws.com":"i-0ec9d55a708b6e024"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-27 07:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-27 07:16:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-27 07:16:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0ec9d55a708b6e024,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4027252736 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3922395136 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:44 +0000 UTC,LastTransitionTime:2023-01-27 07:02:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:44 +0000 UTC,LastTransitionTime:2023-01-27 07:02:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-27 07:16:44 +0000 UTC,LastTransitionTime:2023-01-27 07:02:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-27 07:16:44 +0000 UTC,LastTransitionTime:2023-01-27 07:02:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.94,},NodeAddress{Type:ExternalIP,Address:3.99.189.218,},NodeAddress{Type:InternalDNS,Address:i-0ec9d55a708b6e024.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ec9d55a708b6e024.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-189-218.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec237e94973848c124a158045848306f,SystemUUID:ec237e94-9738-48c1-24a1-58045848306f,BootID:b8c904d5-b4d0-4bfa-bd10-fe4d19137eff,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.27.0-alpha.1.52+336934ab0a94cb,KubeProxyVersion:v1.27.0-alpha.1.52+336934ab0a94cb,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:157636062,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:116764683,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.27.0-alpha.1.52_336934ab0a94cb],SizeBytes:63181512,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:49808364,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:47953400,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41528818,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40343601,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:28932904,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:23945474,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:22678632,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:22434180,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:22394501,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:18561972,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18267611,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8223819,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:6883347,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6860089,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:772933,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:268051,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8269^8cf89b71-9e12-11ed-8270-fa0d4fab479b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8269^8cf89b71-9e12-11ed-8270-fa0d4fab479b,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8269^8cfb8f36-9e12-11ed-8270-fa0d4fab479b,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-024a88af3e912b3ad,DevicePath:,},},Config:nil,},}
Jan 27 07:16:48.191: INFO: 
Logging kubelet events for node i-0ec9d55a708b6e024
Jan 27 07:16:48.225: INFO: 
Logging pods the kubelet thinks is on node i-0ec9d55a708b6e024
Jan 27 07:16:48.266: INFO: rs-bxw9x started at 2023-01-27 07:16:27 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container donothing ready: true, restart count 0
Jan 27 07:16:48.266: INFO: downwardapi-volume-1d6584a7-af84-452f-a48e-3862aba4eaee started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: metadata-volume-4f9e026c-842e-48e0-a82a-2132423bd05d started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: inline-volume-tester-f55rq started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: ss2-1 started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: deployment-6c94ddcb9f-vv7jn started at 2023-01-27 07:15:31 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container nginx ready: false, restart count 0
Jan 27 07:16:48.266: INFO: busybox-09083417-15de-4b42-bc92-5df2eb0ab5ca started at 2023-01-27 07:16:21 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container busybox ready: true, restart count 0
Jan 27 07:16:48.266: INFO: kube-proxy-mode-detector started at 2023-01-27 07:16:29 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:48.266: INFO: test-rs-wd4qv started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9 started at 2023-01-27 07:11:46 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container test ready: false, restart count 0
Jan 27 07:16:48.266: INFO: pause-pod-747f76c69b-v5qsd started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: affinity-clusterip-timeout-jtc22 started at 2023-01-27 07:15:56 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container affinity-clusterip-timeout ready: true, restart count 0
Jan 27 07:16:48.266: INFO: ss-1 started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: webhook-to-be-mutated started at 2023-01-27 07:16:03 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Init container webhook-added-init-container ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container example ready: false, restart count 0
Jan 27 07:16:48.266: INFO: csi-hostpathplugin-0 started at 2023-01-27 07:16:38 +0000 UTC (0+7 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container hostpath ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 27 07:16:48.266: INFO: rs-q9g4f started at 2023-01-27 07:16:27 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container donothing ready: true, restart count 0
Jan 27 07:16:48.266: INFO: kube-proxy-mode-detector started at 2023-01-27 07:15:51 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:48.266: INFO: liveness-e42dcccf-f306-4d56-936b-512b26c0879b started at 2023-01-27 07:15:31 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container agnhost-container ready: true, restart count 3
Jan 27 07:16:48.266: INFO: liveness-3392ec9e-1145-4e35-8874-db5f5a159da9 started at 2023-01-27 07:15:43 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:48.266: INFO: pod-subpath-test-inlinevolume-4ss2 started at 2023-01-27 07:16:37 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Init container init-volume-inlinevolume-4ss2 ready: false, restart count 0
Jan 27 07:16:48.266: INFO: 	Container test-container-subpath-inlinevolume-4ss2 ready: false, restart count 0
Jan 27 07:16:48.266: INFO: cilium-rs5vx started at 2023-01-27 07:02:37 +0000 UTC (1+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 27 07:16:48.266: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 27 07:16:48.266: INFO: rs-pdfv5 started at 2023-01-27 07:16:27 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container donothing ready: true, restart count 0
Jan 27 07:16:48.266: INFO: inline-volume-vkmqp started at 2023-01-27 07:16:33 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container volume-tester ready: false, restart count 0
Jan 27 07:16:48.266: INFO: ebs-csi-node-tvth8 started at 2023-01-27 07:02:37 +0000 UTC (0+3 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 27 07:16:48.266: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 27 07:16:48.266: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 27 07:16:48.266: INFO: pod-configmaps-8d793697-9257-42f7-aa92-03a4ce9b8bb8 started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: affinity-nodeport-timeout-j5nt2 started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: test-container-pod started at <nil> (0+0 container statuses recorded)
Jan 27 07:16:48.266: INFO: deployment-74d7dd69db-8jj8b started at 2023-01-27 07:15:31 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container nginx ready: false, restart count 0
Jan 27 07:16:48.266: INFO: pod-projected-configmaps-1f1b47f6-81c1-4ab1-b5d1-f8a121608b0b started at 2023-01-27 07:15:52 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 27 07:16:48.266: INFO: netserver-3 started at 2023-01-27 07:16:16 +0000 UTC (0+1 container statuses recorded)
Jan 27 07:16:48.266: INFO: 	Container webserver ready: true, restart count 0
Jan 27 07:16:49.515: INFO: 
Latency metrics for node i-0ec9d55a708b6e024
END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/27/23 07:16:49.515 (2.842s)
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - dump namespaces | framework.go:206 @ 01/27/23 07:16:49.515 (2.843s)
> Enter [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 07:16:49.515
STEP: Destroying namespace "runtimeclass-7990" for this suite. - test/e2e/framework/framework.go:347 @ 01/27/23 07:16:49.515
< Exit [DeferCleanup (Each)] [sig-node] RuntimeClass - tear down framework | framework.go:203 @ 01/27/23 07:16:49.548 (33ms)
> Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 07:16:49.549
< Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/27/23 07:16:49.549 (0s)

				Click to see stdout/stderrfrom junit_01.xml

Find runtimeclass-7990/test-runtimeclass-runtimeclass-7990-non-conflict-runtimeclvd6w9 mentions in log files | View test history on testgrid

kubetest2 Test 20m13s

exit status 255
				from junit_runner.xml

Filter through log files | View test history on testgrid

Show 894 Passed Tests

Show 6516 Skipped Tests

Result	FAILURE
Tests	3 failed / 894 succeeded
Started	2023-01-27 06:55
Elapsed	32m33s
Revision	master