kubernetes/kops PR #14619 pull-kops-e2e-cni-cilium-eni #1596056799335682048
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | glomikuz: [cilium - eni IPAM MODE] problem with connection from POD to external resource in additional subnet after kops upgrade from 1.23 -> 1.25 #14575 |
| Result | FAILURE |
| Tests | 51 failed / 819 succeeded |
| Started | |
| Elapsed | 1h3m |
| Revision | 850713a6f180fba53b89c6af8be1b10c3771116f |
| Refs |
14619 |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\(allowExpansion\)\]\svolume\-expand\sVerify\sif\soffline\sPVC\sexpansion\sworks$'
test/e2e/storage/testsuites/volume_expand.go:198 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:198 +0x3bafrom junit_01.xml
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works","completed":5,"skipped":59,"failed":2,"failures":["[sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should not deadlock when a pod's predecessor fails","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works"]} [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:58:19.828�[0m Nov 25 08:58:19.828: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m11/25/22 08:58:19.829�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:58:20.17�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:58:20.393�[0m [It] Verify if offline PVC expansion works test/e2e/storage/testsuites/volume_expand.go:176 Nov 25 08:58:20.616: INFO: Creating resource for dynamic PV Nov 25 08:58:20.616: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-8932-e2e-sc4grwm �[38;5;243m11/25/22 08:58:20.616�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:58:20.736�[0m �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m11/25/22 08:58:20.962�[0m Nov 25 08:58:21.076: INFO: Waiting up to 5m0s for pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f" in namespace "volume-expand-8932" to be "running" Nov 25 08:58:21.188: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 112.392526ms Nov 25 08:58:23.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226346934s Nov 25 08:58:25.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.225021084s Nov 25 08:58:27.305: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.228650227s Nov 25 08:58:29.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.225948306s Nov 25 08:58:31.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.224566024s Nov 25 08:58:33.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.225270718s Nov 25 08:58:35.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.2257339s Nov 25 08:58:37.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 16.226072516s Nov 25 08:58:39.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 18.226369397s Nov 25 08:58:41.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.225691714s Nov 25 08:58:43.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 22.225977717s Nov 25 08:58:45.308: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 24.231471685s Nov 25 08:58:47.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.22513088s Nov 25 08:58:49.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 28.226063097s Nov 25 08:58:51.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 30.224622984s Nov 25 08:58:53.303: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 32.22739251s Nov 25 08:58:55.304: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 34.227601454s Nov 25 08:58:57.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 36.225644014s Nov 25 08:58:59.303: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 38.227298264s Nov 25 08:59:01.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 40.225196616s Nov 25 08:59:03.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 42.22529262s Nov 25 08:59:05.304: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 44.227505114s Nov 25 08:59:07.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 46.225394221s Nov 25 08:59:09.304: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 48.227542722s Nov 25 08:59:11.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 50.224568506s Nov 25 08:59:13.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 52.224968347s Nov 25 08:59:15.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 54.225615995s Nov 25 08:59:17.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 56.224860876s Nov 25 08:59:19.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 58.225036431s Nov 25 08:59:21.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.225436945s Nov 25 08:59:23.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.225207051s Nov 25 08:59:25.305: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.228582953s Nov 25 08:59:27.304: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.228445954s Nov 25 08:59:29.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.225754198s Nov 25 08:59:31.304: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.227865281s Nov 25 08:59:33.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.225345029s Nov 25 08:59:35.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.224892029s Nov 25 08:59:37.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.226094292s Nov 25 08:59:39.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.225197008s Nov 25 08:59:41.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.226075586s Nov 25 08:59:43.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.22541293s Nov 25 08:59:45.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.224637319s Nov 25 08:59:47.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.226386923s Nov 25 08:59:49.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.226135383s Nov 25 08:59:51.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.22531238s Nov 25 08:59:53.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.225156495s Nov 25 08:59:55.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.225632722s Nov 25 08:59:57.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.226067385s Nov 25 08:59:59.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.225721355s Nov 25 09:00:01.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.226334627s Nov 25 09:00:03.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.225903953s Nov 25 09:00:05.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.225221643s Nov 25 09:00:07.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.225292039s Nov 25 09:00:09.309: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.233147012s Nov 25 09:00:11.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.225502254s Nov 25 09:00:13.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.225038567s Nov 25 09:00:15.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.225398997s Nov 25 09:00:17.305: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.229188977s Nov 25 09:00:19.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.224971662s Nov 25 09:00:21.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.225081209s Nov 25 09:00:23.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.225377054s Nov 25 09:00:25.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226078082s Nov 25 09:00:27.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.225666934s Nov 25 09:00:29.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.225981058s Nov 25 09:00:31.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.225104456s Nov 25 09:00:33.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.226210223s Nov 25 09:00:35.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.225383028s Nov 25 09:00:37.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.225590928s Nov 25 09:00:39.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.224610676s Nov 25 09:00:41.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.225118689s Nov 25 09:00:43.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.225512089s Nov 25 09:00:45.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.225616592s Nov 25 09:00:47.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.225026436s Nov 25 09:00:49.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.225281562s Nov 25 09:00:51.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.225090041s Nov 25 09:00:53.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.225675119s Nov 25 09:00:55.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.225666368s Nov 25 09:00:57.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.225268031s Nov 25 09:00:59.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226048365s Nov 25 09:01:01.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.22575545s Nov 25 09:01:03.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.225301832s Nov 25 09:01:05.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.22572678s Nov 25 09:01:07.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.224846706s Nov 25 09:01:09.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.224719462s Nov 25 09:01:11.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.224885364s Nov 25 09:01:13.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.22567339s Nov 25 09:01:15.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.225429291s Nov 25 09:01:17.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.224644726s Nov 25 09:01:19.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.225069169s Nov 25 09:01:21.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.226168377s Nov 25 09:01:23.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.225503602s Nov 25 09:01:25.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.225697345s Nov 25 09:01:27.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.225343847s Nov 25 09:01:29.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.225072224s Nov 25 09:01:31.303: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.227334942s Nov 25 09:01:33.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.225497836s Nov 25 09:01:35.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.225007653s Nov 25 09:01:37.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.2249776s Nov 25 09:01:39.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.224831951s Nov 25 09:01:41.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.225375713s Nov 25 09:01:43.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.225180966s Nov 25 09:01:45.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.225104614s Nov 25 09:01:47.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.224611412s Nov 25 09:01:49.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.224629797s Nov 25 09:01:51.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.225330476s Nov 25 09:01:53.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.225029001s Nov 25 09:01:55.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.225942878s Nov 25 09:01:57.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.225542748s Nov 25 09:01:59.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.225755845s Nov 25 09:02:01.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.224842588s Nov 25 09:02:03.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.22485708s Nov 25 09:02:05.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.225757029s Nov 25 09:02:07.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.224774027s Nov 25 09:02:09.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.224859843s Nov 25 09:02:11.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.224707299s Nov 25 09:02:13.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.225496922s Nov 25 09:02:15.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.224586324s Nov 25 09:02:17.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.225742656s Nov 25 09:02:19.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.225678128s Nov 25 09:02:21.305: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.22859412s Nov 25 09:02:23.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.225473174s Nov 25 09:02:25.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.224934638s Nov 25 09:02:27.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.224987462s Nov 25 09:02:29.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.225732774s Nov 25 09:02:31.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.224992747s Nov 25 09:02:33.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.225869585s Nov 25 09:02:35.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.225415795s Nov 25 09:02:37.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.224931544s Nov 25 09:02:39.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.225004381s Nov 25 09:02:41.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.22532697s Nov 25 09:02:43.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.225885433s Nov 25 09:02:45.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.225757089s Nov 25 09:02:47.305: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.228890887s Nov 25 09:02:49.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.226352225s Nov 25 09:02:51.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.225820424s Nov 25 09:02:53.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.225273973s Nov 25 09:02:55.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.225428267s Nov 25 09:02:57.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.225055902s Nov 25 09:02:59.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.225118606s Nov 25 09:03:01.303: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.226463084s Nov 25 09:03:03.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.224569501s Nov 25 09:03:05.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.225097386s Nov 25 09:03:07.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.224795539s Nov 25 09:03:09.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.225617799s Nov 25 09:03:11.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.225027456s Nov 25 09:03:13.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.225373509s Nov 25 09:03:15.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.225537668s Nov 25 09:03:17.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.224732808s Nov 25 09:03:19.302: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.225623879s Nov 25 09:03:21.301: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.224837756s Nov 25 09:03:21.413: INFO: Pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.337273957s Nov 25 09:03:21.413: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc00443c2f0>: { s: "pod \"pod-d9ebd3a2-e5bb-4884-981f-44366c98352f\" is not Running: timed out while waiting for pod volume-expand-8932/pod-d9ebd3a2-e5bb-4884-981f-44366c98352f to be running", } Nov 25 09:03:21.413: FAIL: While creating pods for resizing: pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f" is not Running: timed out while waiting for pod volume-expand-8932/pod-d9ebd3a2-e5bb-4884-981f-44366c98352f to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:198 +0x3ba Nov 25 09:03:21.414: INFO: Deleting pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f" in namespace "volume-expand-8932" Nov 25 09:03:21.528: INFO: Wait up to 5m0s for pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m11/25/22 09:03:21.641�[0m Nov 25 09:03:21.641: INFO: Deleting pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f" in namespace "volume-expand-8932" �[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 09:03:21.756�[0m Nov 25 09:03:21.891: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comwsb7t" �[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 09:03:22.005�[0m [AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "volume-expand-8932". �[38;5;243m11/25/22 09:03:22.118�[0m �[1mSTEP:�[0m Found 5 events. �[38;5;243m11/25/22 09:03:22.231�[0m Nov 25 09:03:22.231: INFO: At 2022-11-25 08:58:20 +0000 UTC - event for ebs.csi.aws.comwsb7t: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Nov 25 09:03:22.231: INFO: At 2022-11-25 08:58:21 +0000 UTC - event for ebs.csi.aws.comwsb7t: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Nov 25 09:03:22.231: INFO: At 2022-11-25 08:58:21 +0000 UTC - event for ebs.csi.aws.comwsb7t: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "volume-expand-8932/ebs.csi.aws.comwsb7t" Nov 25 09:03:22.231: INFO: At 2022-11-25 08:58:31 +0000 UTC - event for ebs.csi.aws.comwsb7t: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-8932-e2e-sc4grwm": rpc error: code = DeadlineExceeded desc = context deadline exceeded Nov 25 09:03:22.231: INFO: At 2022-11-25 09:03:22 +0000 UTC - event for pod-d9ebd3a2-e5bb-4884-981f-44366c98352f: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "pod-d9ebd3a2-e5bb-4884-981f-44366c98352f" not found Nov 25 09:03:22.343: INFO: POD NODE PHASE GRACE CONDITIONS Nov 25 09:03:22.343: INFO: Nov 25 09:03:22.456: INFO: Logging node info for node i-0727ab730bff76f5a Nov 25 09:03:22.568: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 31534 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:00:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:03:22.569: INFO: Logging kubelet events for node i-0727ab730bff76f5a Nov 25 09:03:22.686: INFO: Logging pods the kubelet thinks is on node i-0727ab730bff76f5a Nov 25 09:03:22.804: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:03:22.804: INFO: Container cilium-agent ready: true, restart count 1 Nov 25 09:03:22.804: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container cilium-operator ready: true, restart count 1 Nov 25 09:03:22.804: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded) Nov 25 09:03:22.804: INFO: Container healthcheck ready: true, restart count 0 Nov 25 09:03:22.804: INFO: Container kube-apiserver ready: true, restart count 1 Nov 25 09:03:22.804: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container kube-controller-manager ready: true, restart count 2 Nov 25 09:03:22.804: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container kube-scheduler ready: true, restart count 0 Nov 25 09:03:22.804: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container kops-controller ready: true, restart count 0 Nov 25 09:03:22.804: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:22.804: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:22.804: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:22.804: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:03:22.804: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Nov 25 09:03:22.804: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 09:03:22.804: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 09:03:22.804: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:22.804: INFO: Container dns-controller ready: true, restart count 0 Nov 25 09:03:23.193: INFO: Latency metrics for node i-0727ab730bff76f5a Nov 25 09:03:23.193: INFO: Logging node info for node i-078e7a116b258cef8 Nov 25 09:03:23.306: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 33832 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:01:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:03:23.307: INFO: Logging kubelet events for node i-078e7a116b258cef8 Nov 25 09:03:23.422: INFO: Logging pods the kubelet thinks is on node i-078e7a116b258cef8 Nov 25 09:03:23.538: INFO: probe-test-aa4ff277-92c6-4e74-b03b-20ed3d8c7c55 started at 2022-11-25 09:03:13 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:23.538: INFO: Container probe-test-aa4ff277-92c6-4e74-b03b-20ed3d8c7c55 ready: true, restart count 0 Nov 25 09:03:23.538: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:23.538: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:03:23.538: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded) Nov 25 09:03:23.538: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:23.538: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:03:23.538: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:03:23.538: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:03:23.538: INFO: externalsvc-hj652 started at 2022-11-25 09:03:16 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:23.538: INFO: Container externalsvc ready: true, restart count 0 Nov 25 09:03:23.956: INFO: Latency metrics for node i-078e7a116b258cef8 Nov 25 09:03:23.956: INFO: Logging node info for node i-08bdea9de27e461c9 Nov 25 09:03:24.069: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 35645 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2944":"i-08bdea9de27e461c9","ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 09:02:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 09:03:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:03:03 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:03:03 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:03:03 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:03:03 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2944^f19dd483-6c9f-11ed-9852-2ed210b4058d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2944^f19dd483-6c9f-11ed-9852-2ed210b4058d,DevicePath:,},},Config:nil,},} Nov 25 09:03:24.069: INFO: Logging kubelet events for node i-08bdea9de27e461c9 Nov 25 09:03:24.184: INFO: Logging pods the kubelet thinks is on node i-08bdea9de27e461c9 Nov 25 09:03:24.301: INFO: liveness-7c7a8998-666c-49a6-87bb-dbe91fac6c38 started at 2022-11-25 08:59:43 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:24.301: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:03:24.301: INFO: csi-hostpathplugin-0 started at 2022-11-25 09:02:50 +0000 UTC (0+7 container statuses recorded) Nov 25 09:03:24.301: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container hostpath ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:03:24.301: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:03:24.301: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:03:24.301: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:24.301: INFO: Container coredns ready: true, restart count 0 Nov 25 09:03:24.301: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:24.301: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:24.301: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:03:24.301: INFO: inline-volume-tester-ml8m5 started at 2022-11-25 09:02:53 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:24.301: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 25 09:03:24.719: INFO: Latency metrics for node i-08bdea9de27e461c9 Nov 25 09:03:24.719: INFO: Logging node info for node i-08ef366c24e606a30 Nov 25 09:03:24.832: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 35944 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-845":"i-08ef366c24e606a30","ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 09:02:51 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 09:03:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:02:54 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:02:54 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:02:54 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:02:54 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:22614022,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-845^f028eebd-6c9f-11ed-97a0-36937c4a9e91],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-845^f028eebd-6c9f-11ed-97a0-36937c4a9e91,DevicePath:,},},Config:nil,},} Nov 25 09:03:24.832: INFO: Logging kubelet events for node i-08ef366c24e606a30 Nov 25 09:03:24.948: INFO: Logging pods the kubelet thinks is on node i-08ef366c24e606a30 Nov 25 09:03:25.065: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:25.065: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:03:25.065: INFO: csi-mockplugin-0 started at 2022-11-25 09:02:44 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:25.065: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container driver-registrar ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container mock ready: true, restart count 0 Nov 25 09:03:25.065: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded) Nov 25 09:03:25.065: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:03:25.065: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.065: INFO: Container autoscaler ready: true, restart count 0 Nov 25 09:03:25.065: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded) Nov 25 09:03:25.065: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:25.065: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:25.065: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.065: INFO: Container coredns ready: true, restart count 0 Nov 25 09:03:25.065: INFO: pvc-volume-tester-sfft2 started at 2022-11-25 09:02:50 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.065: INFO: Container volume-tester ready: true, restart count 0 Nov 25 09:03:25.065: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 09:02:44 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.065: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:03:25.485: INFO: Latency metrics for node i-08ef366c24e606a30 Nov 25 09:03:25.485: INFO: Logging node info for node i-0eefb921dfa90622c Nov 25 09:03:25.598: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 34111 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:01:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:03:25.598: INFO: Logging kubelet events for node i-0eefb921dfa90622c Nov 25 09:03:25.722: INFO: Logging pods the kubelet thinks is on node i-0eefb921dfa90622c Nov 25 09:03:25.838: INFO: externalsvc-wqrnj started at 2022-11-25 09:03:16 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.838: INFO: Container externalsvc ready: true, restart count 0 Nov 25 09:03:25.838: INFO: pod-terminate-status-0-4 started at <nil> (0+0 container statuses recorded) Nov 25 09:03:25.838: INFO: pod-terminate-status-2-4 started at 2022-11-25 09:03:19 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.838: INFO: Container fail ready: true, restart count 0 Nov 25 09:03:25.838: INFO: nodeport-test-lvngr started at <nil> (0+0 container statuses recorded) Nov 25 09:03:25.838: INFO: dns-test-83499dbb-3040-485d-920c-886c5b7d2076 started at 2022-11-25 09:03:03 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:25.838: INFO: Container jessie-querier ready: true, restart count 0 Nov 25 09:03:25.838: INFO: Container querier ready: true, restart count 0 Nov 25 09:03:25.838: INFO: Container webserver ready: true, restart count 0 Nov 25 09:03:25.838: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:03:25.838: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:03:25.838: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:03:25.838: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:03:25.838: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:03:25.838: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:03:25.838: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:03:25.838: INFO: sample-webhook-deployment-5d85dd8cdb-mxvhl started at 2022-11-25 09:03:21 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.838: INFO: Container sample-webhook ready: false, restart count 0 Nov 25 09:03:25.838: INFO: execpodtf74r started at <nil> (0+0 container statuses recorded) Nov 25 09:03:25.838: INFO: test-webserver-623b59f1-9829-4b5c-bd53-f3e0db0e8321 started at 2022-11-25 09:03:14 +0000 UTC (0+1 container statuses recorded) Nov 25 09:03:25.838: INFO: Container test-webserver ready: true, restart count 0 Nov 25 09:03:26.267: INFO: Latency metrics for node i-0eefb921dfa90622c Nov 25 09:03:26.267: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "volume-expand-8932" for this suite. �[38;5;243m11/25/22 09:03:26.38�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\(allowExpansion\)\]\svolume\-expand\sshould\sresize\svolume\swhen\sPVC\sis\sedited\swhile\spod\sis\susing\sit$'
test/e2e/storage/testsuites/volume_expand.go:274 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:274 +0x3b3from junit_01.xml
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","completed":11,"skipped":119,"failed":2,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]} [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:57:33.38�[0m Nov 25 08:57:33.380: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m11/25/22 08:57:33.381�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:57:33.716�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:57:33.938�[0m [It] should resize volume when PVC is edited while pod is using it test/e2e/storage/testsuites/volume_expand.go:252 Nov 25 08:57:34.159: INFO: Creating resource for dynamic PV Nov 25 08:57:34.159: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-9502-e2e-sc262s8 �[38;5;243m11/25/22 08:57:34.159�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:57:34.272�[0m �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m11/25/22 08:57:34.497�[0m Nov 25 08:57:34.610: INFO: Waiting up to 5m0s for pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5" in namespace "volume-expand-9502" to be "running" Nov 25 08:57:34.721: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 110.996455ms Nov 25 08:57:36.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223078606s Nov 25 08:57:38.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.222568999s Nov 25 08:57:40.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.222947369s Nov 25 08:57:42.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.22342547s Nov 25 08:57:44.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.224385017s Nov 25 08:57:46.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.223160904s Nov 25 08:57:48.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.223294486s Nov 25 08:57:50.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.223057684s Nov 25 08:57:52.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.223459661s Nov 25 08:57:54.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.223030433s Nov 25 08:57:56.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.223177386s Nov 25 08:57:58.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.222851702s Nov 25 08:58:00.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.22330507s Nov 25 08:58:02.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.223017787s Nov 25 08:58:04.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.223695409s Nov 25 08:58:06.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.222885559s Nov 25 08:58:08.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.222830324s Nov 25 08:58:10.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.223281864s Nov 25 08:58:12.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.222905957s Nov 25 08:58:14.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.22289036s Nov 25 08:58:16.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.222831257s Nov 25 08:58:18.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.224068811s Nov 25 08:58:20.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.224896722s Nov 25 08:58:22.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.223694291s Nov 25 08:58:24.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 50.224816223s Nov 25 08:58:26.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.223187671s Nov 25 08:58:28.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.222300299s Nov 25 08:58:30.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 56.222600511s Nov 25 08:58:32.839: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 58.228688235s Nov 25 08:58:34.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.223418932s Nov 25 08:58:36.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.223224608s Nov 25 08:58:38.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.222540322s Nov 25 08:58:40.837: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.226791497s Nov 25 08:58:42.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.223189293s Nov 25 08:58:44.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.222754935s Nov 25 08:58:46.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.224377983s Nov 25 08:58:48.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.223331916s Nov 25 08:58:50.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.222542764s Nov 25 08:58:52.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.223124176s Nov 25 08:58:54.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.224520127s Nov 25 08:58:56.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.223851476s Nov 25 08:58:58.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.222755299s Nov 25 08:59:00.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.223248095s Nov 25 08:59:02.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.222547603s Nov 25 08:59:04.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.225188548s Nov 25 08:59:06.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.222679716s Nov 25 08:59:08.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.222656119s Nov 25 08:59:10.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.222870971s Nov 25 08:59:12.842: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.231957408s Nov 25 08:59:14.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.223136329s Nov 25 08:59:16.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.224581988s Nov 25 08:59:18.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.222680112s Nov 25 08:59:20.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.223293914s Nov 25 08:59:22.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.223850857s Nov 25 08:59:24.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.222975771s Nov 25 08:59:26.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.223612379s Nov 25 08:59:28.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.222983095s Nov 25 08:59:30.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.223201688s Nov 25 08:59:32.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.222807166s Nov 25 08:59:34.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.223170969s Nov 25 08:59:36.838: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.228208353s Nov 25 08:59:38.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.223067295s Nov 25 08:59:40.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.223096462s Nov 25 08:59:42.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.22295144s Nov 25 08:59:44.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.223217904s Nov 25 08:59:46.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.222348902s Nov 25 08:59:48.837: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.227118645s Nov 25 08:59:50.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.223044929s Nov 25 08:59:52.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.223076551s Nov 25 08:59:54.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.223057715s Nov 25 08:59:56.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.224994273s Nov 25 08:59:58.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.223046706s Nov 25 09:00:00.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.222724851s Nov 25 09:00:02.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.222841179s Nov 25 09:00:04.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.222784186s Nov 25 09:00:06.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.223240264s Nov 25 09:00:08.836: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.226114705s Nov 25 09:00:10.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.223058596s Nov 25 09:00:12.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.223270518s Nov 25 09:00:14.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.222785024s Nov 25 09:00:16.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.222773066s Nov 25 09:00:18.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.22244292s Nov 25 09:00:20.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.22291918s Nov 25 09:00:22.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.22311178s Nov 25 09:00:24.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.222998483s Nov 25 09:00:26.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.222881658s Nov 25 09:00:28.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.222540388s Nov 25 09:00:30.836: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.226575769s Nov 25 09:00:32.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.223259733s Nov 25 09:00:34.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.222623135s Nov 25 09:00:36.842: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.231912716s Nov 25 09:00:38.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.222559098s Nov 25 09:00:40.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.223877786s Nov 25 09:00:42.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.222980231s Nov 25 09:00:44.836: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.22644408s Nov 25 09:00:46.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.222713903s Nov 25 09:00:48.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.222570824s Nov 25 09:00:50.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.222665779s Nov 25 09:00:52.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.222454807s Nov 25 09:00:54.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.22299316s Nov 25 09:00:56.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.223104472s Nov 25 09:00:58.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.222490267s Nov 25 09:01:00.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.225514671s Nov 25 09:01:02.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.223449491s Nov 25 09:01:04.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.223106607s Nov 25 09:01:06.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.222995826s Nov 25 09:01:08.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.222505424s Nov 25 09:01:10.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.223220687s Nov 25 09:01:12.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.223083648s Nov 25 09:01:14.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.223145952s Nov 25 09:01:16.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.22348257s Nov 25 09:01:18.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.222730054s Nov 25 09:01:20.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.223146998s Nov 25 09:01:22.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.222938749s Nov 25 09:01:24.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.223490773s Nov 25 09:01:26.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.223207385s Nov 25 09:01:28.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.222517316s Nov 25 09:01:30.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.223466419s Nov 25 09:01:32.853: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.242869981s Nov 25 09:01:34.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.223255279s Nov 25 09:01:36.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.223160912s Nov 25 09:01:38.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.223099129s Nov 25 09:01:40.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.222883404s Nov 25 09:01:42.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.222995865s Nov 25 09:01:44.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.222883215s Nov 25 09:01:46.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.223315723s Nov 25 09:01:48.834: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.224255903s Nov 25 09:01:50.832: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.222548089s Nov 25 09:01:52.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.222934126s Nov 25 09:01:54.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.225128291s Nov 25 09:01:56.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.223219179s Nov 25 09:01:58.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.222760865s Nov 25 09:02:00.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.223234206s Nov 25 09:02:02.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.222793895s Nov 25 09:02:04.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.223041596s Nov 25 09:02:06.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.22335999s Nov 25 09:02:08.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.222984929s Nov 25 09:02:10.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.223200567s Nov 25 09:02:12.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.223216385s Nov 25 09:02:14.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.225034174s Nov 25 09:02:16.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.223024384s Nov 25 09:02:18.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.222656483s Nov 25 09:02:20.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.223259092s Nov 25 09:02:22.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.223198745s Nov 25 09:02:24.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.223165635s Nov 25 09:02:26.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.223195862s Nov 25 09:02:28.835: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.224590704s Nov 25 09:02:30.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.223237164s Nov 25 09:02:32.833: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.223513776s Nov 25 09:02:34.836: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.225879747s Nov 25 09:02:34.947: INFO: Pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.33708574s Nov 25 09:02:34.947: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc0008345f0>: { s: "pod \"pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5\" is not Running: timed out while waiting for pod volume-expand-9502/pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5 to be running", } Nov 25 09:02:34.947: FAIL: While creating pods for resizing: pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5" is not Running: timed out while waiting for pod volume-expand-9502/pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:274 +0x3b3 Nov 25 09:02:34.947: INFO: Deleting pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5" in namespace "volume-expand-9502" Nov 25 09:02:35.065: INFO: Wait up to 5m0s for pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m11/25/22 09:02:35.178�[0m Nov 25 09:02:35.179: INFO: Deleting pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5" in namespace "volume-expand-9502" �[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 09:02:35.289�[0m Nov 25 09:02:35.400: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comc6rsf" �[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 09:02:35.512�[0m [AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "volume-expand-9502". �[38;5;243m11/25/22 09:02:35.625�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m11/25/22 09:02:35.736�[0m Nov 25 09:02:35.736: INFO: At 2022-11-25 08:57:34 +0000 UTC - event for ebs.csi.aws.comc6rsf: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Nov 25 09:02:35.736: INFO: At 2022-11-25 08:57:34 +0000 UTC - event for ebs.csi.aws.comc6rsf: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Nov 25 09:02:35.736: INFO: At 2022-11-25 08:57:34 +0000 UTC - event for ebs.csi.aws.comc6rsf: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "volume-expand-9502/ebs.csi.aws.comc6rsf" Nov 25 09:02:35.736: INFO: At 2022-11-25 08:57:44 +0000 UTC - event for ebs.csi.aws.comc6rsf: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-9502-e2e-sc262s8": rpc error: code = DeadlineExceeded desc = context deadline exceeded Nov 25 09:02:35.736: INFO: At 2022-11-25 08:57:55 +0000 UTC - event for ebs.csi.aws.comc6rsf: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-9502-e2e-sc262s8": rpc error: code = Internal desc = Could not create volume "pvc-2ac2e384-9f75-44c4-9044-6756a01ef62d": could not create volume in EC2: RequestCanceled: request context canceled caused by: context deadline exceeded Nov 25 09:02:35.736: INFO: At 2022-11-25 09:02:35 +0000 UTC - event for pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "pod-52d43bc1-161e-41f1-bd0f-411d93a8e5d5" not found Nov 25 09:02:35.847: INFO: POD NODE PHASE GRACE CONDITIONS Nov 25 09:02:35.847: INFO: Nov 25 09:02:35.959: INFO: Logging node info for node i-0727ab730bff76f5a Nov 25 09:02:36.071: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 31534 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:00:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:00:02 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:02:36.071: INFO: Logging kubelet events for node i-0727ab730bff76f5a Nov 25 09:02:36.186: INFO: Logging pods the kubelet thinks is on node i-0727ab730bff76f5a Nov 25 09:02:36.303: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container cilium-operator ready: true, restart count 1 Nov 25 09:02:36.303: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:02:36.303: INFO: Container cilium-agent ready: true, restart count 1 Nov 25 09:02:36.303: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 09:02:36.303: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded) Nov 25 09:02:36.303: INFO: Container healthcheck ready: true, restart count 0 Nov 25 09:02:36.303: INFO: Container kube-apiserver ready: true, restart count 1 Nov 25 09:02:36.303: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container kube-controller-manager ready: true, restart count 2 Nov 25 09:02:36.303: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container kube-scheduler ready: true, restart count 0 Nov 25 09:02:36.303: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container kops-controller ready: true, restart count 0 Nov 25 09:02:36.303: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded) Nov 25 09:02:36.303: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:36.303: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:36.303: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:02:36.303: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Nov 25 09:02:36.303: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 09:02:36.303: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:36.303: INFO: Container dns-controller ready: true, restart count 0 Nov 25 09:02:36.698: INFO: Latency metrics for node i-0727ab730bff76f5a Nov 25 09:02:36.698: INFO: Logging node info for node i-078e7a116b258cef8 Nov 25 09:02:36.809: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 33832 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:01:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:01:36 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:02:36.810: INFO: Logging kubelet events for node i-078e7a116b258cef8 Nov 25 09:02:36.925: INFO: Logging pods the kubelet thinks is on node i-078e7a116b258cef8 Nov 25 09:02:37.040: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded) Nov 25 09:02:37.040: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:37.040: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:02:37.040: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:02:37.040: INFO: test-rolling-update-with-lb-8cc597cbd-cdq27 started at 2022-11-25 09:01:40 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.040: INFO: Container agnhost ready: true, restart count 0 Nov 25 09:02:37.040: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:02:37.040: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:02:37.040: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:02:37.040: INFO: pod-0 started at 2022-11-25 09:01:50 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.040: INFO: Container donothing ready: true, restart count 0 Nov 25 09:02:37.454: INFO: Latency metrics for node i-078e7a116b258cef8 Nov 25 09:02:37.454: INFO: Logging node info for node i-08bdea9de27e461c9 Nov 25 09:02:37.566: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 33463 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:01:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:31 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:31 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:31 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:01:31 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:02:37.566: INFO: Logging kubelet events for node i-08bdea9de27e461c9 Nov 25 09:02:37.686: INFO: Logging pods the kubelet thinks is on node i-08bdea9de27e461c9 Nov 25 09:02:37.801: INFO: pod-1 started at 2022-11-25 09:01:51 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Container donothing ready: true, restart count 0 Nov 25 09:02:37.801: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:02:37.801: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:02:37.801: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Container coredns ready: true, restart count 0 Nov 25 09:02:37.801: INFO: liveness-7c7a8998-666c-49a6-87bb-dbe91fac6c38 started at 2022-11-25 08:59:43 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:02:37.801: INFO: externalname-service-rhgc6 started at 2022-11-25 09:02:17 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Container externalname-service ready: true, restart count 0 Nov 25 09:02:37.801: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:02:37.801: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:37.801: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:37.801: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:02:37.801: INFO: busybox-76f698f8-7593-4908-a862-b7e6dde0835b started at 2022-11-25 08:58:49 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Container busybox ready: true, restart count 0 Nov 25 09:02:37.801: INFO: test-rolling-update-with-lb-8cc597cbd-w57x9 started at 2022-11-25 09:01:36 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:37.801: INFO: Container agnhost ready: true, restart count 0 Nov 25 09:02:38.219: INFO: Latency metrics for node i-08bdea9de27e461c9 Nov 25 09:02:38.219: INFO: Logging node info for node i-08ef366c24e606a30 Nov 25 09:02:38.331: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 34872 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4277":"i-08ef366c24e606a30","ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:02:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:02:33 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:02:33 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:02:33 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:02:33 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:22614022,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:02:38.332: INFO: Logging kubelet events for node i-08ef366c24e606a30 Nov 25 09:02:38.446: INFO: Logging pods the kubelet thinks is on node i-08ef366c24e606a30 Nov 25 09:02:38.562: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 09:02:08 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:02:38.562: INFO: pod-a0eb4a4f-1a35-4a0b-93bc-3d26214028f3 started at 2022-11-25 09:02:35 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Container write-pod ready: true, restart count 0 Nov 25 09:02:38.562: INFO: hostexec-i-08ef366c24e606a30-gbsgb started at 2022-11-25 09:02:30 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:02:38.562: INFO: pod-2 started at 2022-11-25 09:01:51 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Container donothing ready: true, restart count 0 Nov 25 09:02:38.562: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded) Nov 25 09:02:38.562: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:02:38.562: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Container autoscaler ready: true, restart count 0 Nov 25 09:02:38.562: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded) Nov 25 09:02:38.562: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:38.562: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Container coredns ready: true, restart count 0 Nov 25 09:02:38.562: INFO: csi-mockplugin-0 started at 2022-11-25 09:02:08 +0000 UTC (0+3 container statuses recorded) Nov 25 09:02:38.562: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container driver-registrar ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container mock ready: true, restart count 0 Nov 25 09:02:38.562: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded) Nov 25 09:02:38.562: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:02:38.562: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:02:39.046: INFO: Latency metrics for node i-08ef366c24e606a30 Nov 25 09:02:39.046: INFO: Logging node info for node i-0eefb921dfa90622c Nov 25 09:02:39.158: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 34111 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:01:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:01:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:02:39.158: INFO: Logging kubelet events for node i-0eefb921dfa90622c Nov 25 09:02:39.272: INFO: Logging pods the kubelet thinks is on node i-0eefb921dfa90622c Nov 25 09:02:39.387: INFO: test-rolling-update-with-lb-8cc597cbd-ph5gs started at 2022-11-25 09:01:38 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container agnhost ready: true, restart count 0 Nov 25 09:02:39.387: INFO: startup-b411a5ba-a38b-4b16-ba51-2fe3ed180ac3 started at 2022-11-25 09:02:08 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container busybox ready: false, restart count 0 Nov 25 09:02:39.387: INFO: hostexec-i-0eefb921dfa90622c-4xdh5 started at 2022-11-25 09:02:17 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:02:39.387: INFO: suspend-false-to-true-r4cs4 started at 2022-11-25 09:02:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container c ready: true, restart count 0 Nov 25 09:02:39.387: INFO: hostexec-i-0eefb921dfa90622c-mb7xr started at 2022-11-25 09:02:38 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:02:39.387: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:02:39.387: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:02:39.387: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:02:39.387: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:02:39.387: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:02:39.387: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:02:39.387: INFO: execpodggsvs started at 2022-11-25 09:02:20 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:02:39.387: INFO: pod-f9ced281-fa9d-417c-b725-529e86fa6987 started at 2022-11-25 09:02:36 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container write-pod ready: true, restart count 0 Nov 25 09:02:39.387: INFO: suspend-false-to-true-pwh85 started at 2022-11-25 09:02:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container c ready: true, restart count 0 Nov 25 09:02:39.387: INFO: externalname-service-fgg42 started at 2022-11-25 09:02:17 +0000 UTC (0+1 container statuses recorded) Nov 25 09:02:39.387: INFO: Container externalname-service ready: true, restart count 0 Nov 25 09:02:39.817: INFO: Latency metrics for node i-0eefb921dfa90622c Nov 25 09:02:39.817: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "volume-expand-9502" for this suite. �[38;5;243m11/25/22 09:02:39.929�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\]\svolumeMode\sshould\snot\smount\s\/\smap\sunused\svolumes\sin\sa\spod\s\[LinuxOnly\]$'
test/e2e/storage/testsuites/volumemode.go:387 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeModeTestSuite).DefineTests.func7() test/e2e/storage/testsuites/volumemode.go:387 +0x62bfrom junit_01.xml
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","completed":7,"skipped":78,"failed":3,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]"]} [BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 09:04:26.304�[0m Nov 25 09:04:26.304: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volumemode �[38;5;243m11/25/22 09:04:26.305�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 09:04:26.64�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 09:04:26.861�[0m [It] should not mount / map unused volumes in a pod [LinuxOnly] test/e2e/storage/testsuites/volumemode.go:354 Nov 25 09:04:27.081: INFO: Creating resource for dynamic PV Nov 25 09:04:27.081: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP:�[0m creating a StorageClass volumemode-2047-e2e-sc8b6bh �[38;5;243m11/25/22 09:04:27.082�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 09:04:27.195�[0m �[1mSTEP:�[0m Creating pod �[38;5;243m11/25/22 09:04:27.424�[0m Nov 25 09:04:27.536: INFO: Waiting up to 5m0s for pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f" in namespace "volumemode-2047" to be "running" Nov 25 09:04:27.648: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 111.687934ms Nov 25 09:04:29.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224279631s Nov 25 09:04:31.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.223118474s Nov 25 09:04:33.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.223260029s Nov 25 09:04:35.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.223499629s Nov 25 09:04:37.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.223142122s Nov 25 09:04:39.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.223541308s Nov 25 09:04:41.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.222784442s Nov 25 09:04:43.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 16.223119243s Nov 25 09:04:45.762: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 18.225523978s Nov 25 09:04:47.762: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.22639799s Nov 25 09:04:49.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 22.225288145s Nov 25 09:04:51.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 24.223555126s Nov 25 09:04:53.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.223198793s Nov 25 09:04:55.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 28.223477291s Nov 25 09:04:57.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 30.223494354s Nov 25 09:04:59.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 32.22355594s Nov 25 09:05:01.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 34.224840633s Nov 25 09:05:03.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 36.223425467s Nov 25 09:05:05.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 38.223217894s Nov 25 09:05:07.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 40.22362842s Nov 25 09:05:09.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 42.223528703s Nov 25 09:05:11.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 44.223900901s Nov 25 09:05:13.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 46.224795034s Nov 25 09:05:15.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 48.223888826s Nov 25 09:05:17.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 50.223408282s Nov 25 09:05:19.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 52.223815253s Nov 25 09:05:21.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 54.223638119s Nov 25 09:05:23.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 56.223335541s Nov 25 09:05:25.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 58.225349318s Nov 25 09:05:27.762: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.225557155s Nov 25 09:05:29.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.223478287s Nov 25 09:05:31.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.223932053s Nov 25 09:05:33.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.224795622s Nov 25 09:05:35.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.22429191s Nov 25 09:05:37.790: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.253502483s Nov 25 09:05:39.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.224420464s Nov 25 09:05:41.766: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.229601197s Nov 25 09:05:43.765: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.228611483s Nov 25 09:05:45.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.223052421s Nov 25 09:05:47.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.223853611s Nov 25 09:05:49.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.223051419s Nov 25 09:05:51.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.22322753s Nov 25 09:05:53.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.225087266s Nov 25 09:05:55.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.223989524s Nov 25 09:05:57.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.222980019s Nov 25 09:05:59.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.223904033s Nov 25 09:06:01.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.22440728s Nov 25 09:06:03.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.223697599s Nov 25 09:06:05.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.223157251s Nov 25 09:06:07.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.223386638s Nov 25 09:06:09.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.223695469s Nov 25 09:06:11.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.224213408s Nov 25 09:06:13.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.22349785s Nov 25 09:06:15.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.222831853s Nov 25 09:06:17.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.223208472s Nov 25 09:06:19.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.224509831s Nov 25 09:06:21.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.22302308s Nov 25 09:06:23.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.223607824s Nov 25 09:06:25.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.223464577s Nov 25 09:06:27.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.223427283s Nov 25 09:06:29.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.222817016s Nov 25 09:06:31.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.22352556s Nov 25 09:06:33.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.223642607s Nov 25 09:06:35.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.223083539s Nov 25 09:06:37.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.223371643s Nov 25 09:06:39.822: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.285598783s Nov 25 09:06:41.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.223480221s Nov 25 09:06:43.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.225418209s Nov 25 09:06:45.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.223192841s Nov 25 09:06:47.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.223247417s Nov 25 09:06:49.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.22402241s Nov 25 09:06:51.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.223543468s Nov 25 09:06:53.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.223540874s Nov 25 09:06:55.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.223319124s Nov 25 09:06:57.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.223832749s Nov 25 09:06:59.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.223759516s Nov 25 09:07:01.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.223271963s Nov 25 09:07:03.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.223430735s Nov 25 09:07:05.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.223440442s Nov 25 09:07:07.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.223495199s Nov 25 09:07:09.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.223661636s Nov 25 09:07:11.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.225106657s Nov 25 09:07:13.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.225007009s Nov 25 09:07:15.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.223225524s Nov 25 09:07:17.764: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.22776654s Nov 25 09:07:19.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.223132777s Nov 25 09:07:21.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.224262886s Nov 25 09:07:23.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.22329062s Nov 25 09:07:25.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.22330943s Nov 25 09:07:27.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.223635381s Nov 25 09:07:29.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.223868373s Nov 25 09:07:31.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.223236207s Nov 25 09:07:33.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.223160876s Nov 25 09:07:35.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.223189746s Nov 25 09:07:37.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.223106804s Nov 25 09:07:39.762: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.225458464s Nov 25 09:07:41.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.224081491s Nov 25 09:07:43.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.223392442s Nov 25 09:07:45.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.223228526s Nov 25 09:07:47.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.223626082s Nov 25 09:07:49.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.2234832s Nov 25 09:07:51.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.223565277s Nov 25 09:07:53.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.223701383s Nov 25 09:07:55.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.223414517s Nov 25 09:07:57.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.223831344s Nov 25 09:07:59.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.224112389s Nov 25 09:08:01.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.223601673s Nov 25 09:08:03.765: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.228838255s Nov 25 09:08:05.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.225250725s Nov 25 09:08:07.772: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.235650985s Nov 25 09:08:09.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.223468301s Nov 25 09:08:11.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.223732715s Nov 25 09:08:13.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.22349455s Nov 25 09:08:15.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.224990177s Nov 25 09:08:17.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.223272745s Nov 25 09:08:19.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.222944128s Nov 25 09:08:21.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.223199934s Nov 25 09:08:23.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.223477515s Nov 25 09:08:25.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.222851923s Nov 25 09:08:27.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.223483828s Nov 25 09:08:29.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.22376524s Nov 25 09:08:31.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.223622874s Nov 25 09:08:33.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.223441373s Nov 25 09:08:35.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.223406838s Nov 25 09:08:37.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.223107222s Nov 25 09:08:39.763: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.227042593s Nov 25 09:08:41.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.223492088s Nov 25 09:08:43.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.223204526s Nov 25 09:08:45.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.223218101s Nov 25 09:08:47.773: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.236973766s Nov 25 09:08:49.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.223981896s Nov 25 09:08:51.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.224384699s Nov 25 09:08:53.761: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.224682981s Nov 25 09:08:55.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.222950249s Nov 25 09:08:57.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.223474211s Nov 25 09:08:59.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.223464264s Nov 25 09:09:01.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.22374812s Nov 25 09:09:03.764: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.227582472s Nov 25 09:09:05.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.223372734s Nov 25 09:09:07.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.223468233s Nov 25 09:09:09.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.223407117s Nov 25 09:09:11.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.223624415s Nov 25 09:09:13.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.223180475s Nov 25 09:09:15.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.223471238s Nov 25 09:09:17.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.223257843s Nov 25 09:09:19.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.223015926s Nov 25 09:09:21.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.22337416s Nov 25 09:09:23.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.223158004s Nov 25 09:09:25.759: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.223368978s Nov 25 09:09:27.760: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.223666497s Nov 25 09:09:27.871: INFO: Pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.335104401s Nov 25 09:09:27.872: INFO: Unexpected error: <*pod.timeoutError | 0xc0030081b0>: { msg: "timed out while waiting for pod volumemode-2047/pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f to be running", observedObjects: [ <*v1.Pod | 0xc0018b4c00>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f", GenerateName: "", Namespace: "volumemode-2047", SelfLink: "", UID: "c1fff92f-a385-4a98-90b0-ffdf7e88f01e", ResourceVersion: "38636", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63804963867, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: nil, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63804963867, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"write-pod\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:securityContext\":{\".\":{},\"f:privileged\":{}},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{\".\":{},\"f:fsGroup\":{},\"f:seLinuxOptions\":{\".\":{},\"f:level\":{}}},\"f:terminationGracePeriodSeconds\":{},\"f:volumes\":{\".\":{},\"k:{\\\"name\\\":\\\"volume1\\\"}\":{\".\":{},\"f:name\":{},\"f:persistentVolumeClaim\":{\".\":{},\"f:claimName\":{}}}}}}", }, Subresource: "", }, ], }, Spec: { Volumes: [ { Name: "vol... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Nov 25 09:09:27.872: FAIL: timed out while waiting for pod volumemode-2047/pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeModeTestSuite).DefineTests.func7() test/e2e/storage/testsuites/volumemode.go:387 +0x62b Nov 25 09:09:27.872: INFO: Deleting pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f" in namespace "volumemode-2047" Nov 25 09:09:27.987: INFO: Wait up to 5m0s for pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f" to be fully deleted �[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 09:09:28.098�[0m Nov 25 09:09:28.213: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comwrvrl" �[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 09:09:28.325�[0m [AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "volumemode-2047". �[38;5;243m11/25/22 09:09:28.437�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m11/25/22 09:09:28.548�[0m Nov 25 09:09:28.548: INFO: At 2022-11-25 09:04:27 +0000 UTC - event for ebs.csi.aws.comwrvrl: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Nov 25 09:09:28.548: INFO: At 2022-11-25 09:04:27 +0000 UTC - event for ebs.csi.aws.comwrvrl: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Nov 25 09:09:28.548: INFO: At 2022-11-25 09:04:27 +0000 UTC - event for ebs.csi.aws.comwrvrl: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "volumemode-2047/ebs.csi.aws.comwrvrl" Nov 25 09:09:28.548: INFO: At 2022-11-25 09:04:37 +0000 UTC - event for ebs.csi.aws.comwrvrl: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volumemode-2047-e2e-sc8b6bh": rpc error: code = DeadlineExceeded desc = context deadline exceeded Nov 25 09:09:28.548: INFO: At 2022-11-25 09:05:14 +0000 UTC - event for ebs.csi.aws.comwrvrl: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volumemode-2047-e2e-sc8b6bh": rpc error: code = Internal desc = Could not create volume "pvc-d4c93c5c-bd3f-4637-bf9d-538f05c8157b": could not create volume in EC2: RequestCanceled: request context canceled caused by: context deadline exceeded Nov 25 09:09:28.548: INFO: At 2022-11-25 09:09:28 +0000 UTC - event for pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "pod-beffe3b3-51a9-4d23-b591-f7f644c6d67f" not found Nov 25 09:09:28.659: INFO: POD NODE PHASE GRACE CONDITIONS Nov 25 09:09:28.659: INFO: Nov 25 09:09:28.771: INFO: Logging node info for node i-0727ab730bff76f5a Nov 25 09:09:28.883: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 40159 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:05:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:09:28.883: INFO: Logging kubelet events for node i-0727ab730bff76f5a Nov 25 09:09:28.997: INFO: Logging pods the kubelet thinks is on node i-0727ab730bff76f5a Nov 25 09:09:29.113: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:09:29.113: INFO: Container cilium-agent ready: true, restart count 1 Nov 25 09:09:29.113: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container cilium-operator ready: true, restart count 1 Nov 25 09:09:29.113: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Nov 25 09:09:29.113: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 09:09:29.113: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 09:09:29.113: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded) Nov 25 09:09:29.113: INFO: Container healthcheck ready: true, restart count 0 Nov 25 09:09:29.113: INFO: Container kube-apiserver ready: true, restart count 1 Nov 25 09:09:29.113: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container kube-controller-manager ready: true, restart count 2 Nov 25 09:09:29.113: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container kube-scheduler ready: true, restart count 0 Nov 25 09:09:29.113: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container kops-controller ready: true, restart count 0 Nov 25 09:09:29.113: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:29.113: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:29.113: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:29.113: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:29.113: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.113: INFO: Container dns-controller ready: true, restart count 0 Nov 25 09:09:29.529: INFO: Latency metrics for node i-0727ab730bff76f5a Nov 25 09:09:29.529: INFO: Logging node info for node i-078e7a116b258cef8 Nov 25 09:09:29.656: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 47522 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1533":"i-078e7a116b258cef8","csi-mock-csi-mock-volumes-2844":"i-078e7a116b258cef8","ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 09:09:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 09:09:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:09:15 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:09:15 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:09:15 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:09:15 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1533^d21a820d-6ca0-11ed-99b6-1aea0099e413],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1533^d21a820d-6ca0-11ed-99b6-1aea0099e413,DevicePath:,},},Config:nil,},} Nov 25 09:09:29.656: INFO: Logging kubelet events for node i-078e7a116b258cef8 Nov 25 09:09:29.799: INFO: Logging pods the kubelet thinks is on node i-078e7a116b258cef8 Nov 25 09:09:29.918: INFO: csi-mockplugin-0 started at 2022-11-25 09:09:03 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:29.918: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container driver-registrar ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container mock ready: true, restart count 0 Nov 25 09:09:29.918: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:09:29.918: INFO: pod-subpath-test-preprovisionedpv-628x started at 2022-11-25 09:09:05 +0000 UTC (1+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Init container init-volume-preprovisionedpv-628x ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container test-container-subpath-preprovisionedpv-628x ready: false, restart count 0 Nov 25 09:09:29.918: INFO: hostexec-i-078e7a116b258cef8-6gxnd started at 2022-11-25 09:08:57 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:09:29.918: INFO: csi-mockplugin-0 started at 2022-11-25 09:07:38 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:29.918: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container driver-registrar ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container mock ready: true, restart count 0 Nov 25 09:09:29.918: INFO: pvc-volume-tester-pghzl started at 2022-11-25 09:09:09 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Container volume-tester ready: true, restart count 0 Nov 25 09:09:29.918: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded) Nov 25 09:09:29.918: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:29.918: INFO: pvc-volume-tester-gmjz2 started at 2022-11-25 09:07:43 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Container volume-tester ready: true, restart count 0 Nov 25 09:09:29.918: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:29.918: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:29.918: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:29.918: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 09:07:38 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:09:29.918: INFO: csi-mockplugin-resizer-0 started at 2022-11-25 09:09:03 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:09:29.918: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 09:09:03 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:29.918: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:09:30.397: INFO: Latency metrics for node i-078e7a116b258cef8 Nov 25 09:09:30.397: INFO: Logging node info for node i-08bdea9de27e461c9 Nov 25 09:09:30.526: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 46561 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-8710":"i-08bdea9de27e461c9","ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:08:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:08:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:09:30.526: INFO: Logging kubelet events for node i-08bdea9de27e461c9 Nov 25 09:09:30.647: INFO: Logging pods the kubelet thinks is on node i-08bdea9de27e461c9 Nov 25 09:09:30.765: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:09:30.765: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:09:30.765: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:30.765: INFO: Container coredns ready: true, restart count 0 Nov 25 09:09:30.765: INFO: client-envvars-b9f93f9c-2449-4d9b-9a85-ea1811b5f4f7 started at 2022-11-25 09:09:30 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:30.765: INFO: Container env3cont ready: false, restart count 0 Nov 25 09:09:30.765: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:30.765: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:30.765: INFO: inline-volume-p5p7r started at 2022-11-25 09:07:46 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:30.765: INFO: Container volume-tester ready: false, restart count 0 Nov 25 09:09:30.765: INFO: csi-hostpathplugin-0 started at 2022-11-25 09:08:43 +0000 UTC (0+7 container statuses recorded) Nov 25 09:09:30.765: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container hostpath ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:30.765: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:30.765: INFO: service-proxy-disabled-lcdm6 started at 2022-11-25 09:09:30 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:30.765: INFO: Container service-proxy-disabled ready: false, restart count 0 Nov 25 09:09:31.260: INFO: Latency metrics for node i-08bdea9de27e461c9 Nov 25 09:09:31.260: INFO: Logging node info for node i-08ef366c24e606a30 Nov 25 09:09:31.371: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 46343 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:08:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:30 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:30 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:30 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:08:30 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:22614022,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 09:09:31.371: INFO: Logging kubelet events for node i-08ef366c24e606a30 Nov 25 09:09:31.485: INFO: Logging pods the kubelet thinks is on node i-08ef366c24e606a30 Nov 25 09:09:31.604: INFO: rs-vr45w started at 2022-11-25 09:08:52 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container donothing ready: false, restart count 0 Nov 25 09:09:31.604: INFO: server-envvars-6dc6248b-a44c-49cf-b82b-a1d47dbd5810 started at 2022-11-25 09:09:27 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container srv ready: true, restart count 0 Nov 25 09:09:31.604: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:31.604: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:31.604: INFO: hairpin started at 2022-11-25 09:09:28 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 09:09:31.604: INFO: startup-27d845f6-8530-4c11-954c-bfa30641023c started at 2022-11-25 09:08:54 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container busybox ready: true, restart count 0 Nov 25 09:09:31.604: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:09:31.604: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container autoscaler ready: true, restart count 0 Nov 25 09:09:31.604: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded) Nov 25 09:09:31.604: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:31.604: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:31.604: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container coredns ready: true, restart count 0 Nov 25 09:09:31.604: INFO: service-proxy-disabled-5z4gm started at 2022-11-25 09:09:30 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:31.604: INFO: Container service-proxy-disabled ready: false, restart count 0 Nov 25 09:09:32.030: INFO: Latency metrics for node i-08ef366c24e606a30 Nov 25 09:09:32.030: INFO: Logging node info for node i-0eefb921dfa90622c Nov 25 09:09:32.147: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 47650 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3982":"i-0eefb921dfa90622c","ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:09:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-11-25 09:09:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:09:23 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:09:23 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:09:23 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:09:23 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3982^dbfe174e-6ca0-11ed-b07f-2a65b831c545,DevicePath:,},},Config:nil,},} Nov 25 09:09:32.147: INFO: Logging kubelet events for node i-0eefb921dfa90622c Nov 25 09:09:32.261: INFO: Logging pods the kubelet thinks is on node i-0eefb921dfa90622c Nov 25 09:09:32.377: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:32.377: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:32.377: INFO: hostpath-client started at 2022-11-25 09:09:26 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:32.377: INFO: Container hostpath-client ready: false, restart count 0 Nov 25 09:09:32.377: INFO: pod-secrets-2d688d20-4b67-4f1a-9944-6d9563699a6b started at 2022-11-25 09:08:02 +0000 UTC (0+3 container statuses recorded) Nov 25 09:09:32.377: INFO: Container creates-volume-test ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container dels-volume-test ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container upds-volume-test ready: true, restart count 0 Nov 25 09:09:32.377: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 09:09:32.377: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 09:09:32.377: INFO: csi-hostpathplugin-0 started at 2022-11-25 09:08:54 +0000 UTC (0+7 container statuses recorded) Nov 25 09:09:32.377: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container hostpath ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 09:09:32.377: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 09:09:32.377: INFO: service-proxy-disabled-6mw9t started at 2022-11-25 09:09:30 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:32.377: INFO: Container service-proxy-disabled ready: false, restart count 0 Nov 25 09:09:32.377: INFO: rand-non-local-rnczj started at 2022-11-25 09:09:30 +0000 UTC (0+1 container statuses recorded) Nov 25 09:09:32.377: INFO: Container c ready: false, restart count 0 Nov 25 09:09:32.804: INFO: Latency metrics for node i-0eefb921dfa90622c Nov 25 09:09:32.804: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "volumemode-2047" for this suite. �[38;5;243m11/25/22 09:09:32.917�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\]\svolumes\sshould\sstore\sdata$'
test/e2e/storage/testsuites/volumes.go:188 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3() test/e2e/storage/testsuites/volumes.go:188 +0x457from junit_01.xml
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data","completed":15,"skipped":160,"failed":1,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data"]} [BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:51:37.258�[0m Nov 25 08:51:37.259: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m11/25/22 08:51:37.259�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:51:37.596�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:51:37.819�[0m [It] should store data test/e2e/storage/testsuites/volumes.go:161 Nov 25 08:51:38.041: INFO: Creating resource for dynamic PV Nov 25 08:51:38.041: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP:�[0m creating a StorageClass volume-1807-e2e-scf5hd8 �[38;5;243m11/25/22 08:51:38.041�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:51:38.154�[0m �[1mSTEP:�[0m starting external-injector �[38;5;243m11/25/22 08:51:38.381�[0m Nov 25 08:51:38.494: INFO: Waiting up to 5m0s for pod "external-injector" in namespace "volume-1807" to be "running" Nov 25 08:51:38.605: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 111.759257ms Nov 25 08:51:40.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.224598499s Nov 25 08:51:42.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224727365s Nov 25 08:51:44.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.224192818s Nov 25 08:51:46.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.225970249s Nov 25 08:51:48.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.224632327s Nov 25 08:51:50.722: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.227975094s Nov 25 08:51:52.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.224228494s Nov 25 08:51:54.721: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.227555187s Nov 25 08:51:56.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.22471086s Nov 25 08:51:58.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.226810639s Nov 25 08:52:00.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 22.224161198s Nov 25 08:52:02.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 24.22402181s Nov 25 08:52:04.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 26.224859714s Nov 25 08:52:06.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 28.226742892s Nov 25 08:52:08.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 30.223965317s Nov 25 08:52:10.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 32.224764044s Nov 25 08:52:12.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 34.224771097s Nov 25 08:52:14.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 36.225521638s Nov 25 08:52:16.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 38.225818171s Nov 25 08:52:18.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 40.224827907s Nov 25 08:52:20.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 42.224862917s Nov 25 08:52:22.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 44.224594855s Nov 25 08:52:24.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 46.225275563s Nov 25 08:52:26.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 48.224313601s Nov 25 08:52:28.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 50.224580946s Nov 25 08:52:30.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 52.225486015s Nov 25 08:52:32.721: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 54.227087205s Nov 25 08:52:34.724: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 56.230640666s Nov 25 08:52:36.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 58.22431833s Nov 25 08:52:38.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.223291853s Nov 25 08:52:40.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.224187341s Nov 25 08:52:42.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.223237955s Nov 25 08:52:44.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.22413714s Nov 25 08:52:46.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.223932601s Nov 25 08:52:48.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.223846293s Nov 25 08:52:50.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.224109058s Nov 25 08:52:52.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.224296955s Nov 25 08:52:54.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.225128113s Nov 25 08:52:56.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.223504505s Nov 25 08:52:58.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.223363129s Nov 25 08:53:00.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.223960018s Nov 25 08:53:02.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.22354087s Nov 25 08:53:04.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.225196021s Nov 25 08:53:06.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.225864693s Nov 25 08:53:08.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.226131293s Nov 25 08:53:10.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.224178311s Nov 25 08:53:12.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.223906305s Nov 25 08:53:14.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.225220445s Nov 25 08:53:16.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.223602275s Nov 25 08:53:18.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.223397507s Nov 25 08:53:20.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.225167183s Nov 25 08:53:22.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.22388693s Nov 25 08:53:24.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.224160713s Nov 25 08:53:26.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.224978798s Nov 25 08:53:28.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.224392491s Nov 25 08:53:30.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.224335794s Nov 25 08:53:32.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.22381705s Nov 25 08:53:34.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.223785925s Nov 25 08:53:36.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.223861112s Nov 25 08:53:38.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.224050614s Nov 25 08:53:40.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.224099638s Nov 25 08:53:42.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.22475132s Nov 25 08:53:44.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.224306144s Nov 25 08:53:46.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.22523766s Nov 25 08:53:48.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.224284711s Nov 25 08:53:50.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.225915524s Nov 25 08:53:52.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.224476951s Nov 25 08:53:54.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.224698372s Nov 25 08:53:56.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.225881251s Nov 25 08:53:58.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.224039346s Nov 25 08:54:00.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.223895986s Nov 25 08:54:02.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.224148522s Nov 25 08:54:04.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.224251476s Nov 25 08:54:06.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.223959682s Nov 25 08:54:08.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.224087993s Nov 25 08:54:10.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.224558213s Nov 25 08:54:12.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.224826291s Nov 25 08:54:14.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.224982569s Nov 25 08:54:16.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.224113609s Nov 25 08:54:18.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.224106735s Nov 25 08:54:20.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.223452988s Nov 25 08:54:22.727: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.233732447s Nov 25 08:54:24.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.223786728s Nov 25 08:54:26.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.224533028s Nov 25 08:54:28.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.224100422s Nov 25 08:54:30.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.223973138s Nov 25 08:54:32.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.223853328s Nov 25 08:54:34.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.224109505s Nov 25 08:54:36.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.22383534s Nov 25 08:54:38.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.224340779s Nov 25 08:54:40.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.223500818s Nov 25 08:54:42.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.224320734s Nov 25 08:54:44.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.225784421s Nov 25 08:54:46.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.223596053s Nov 25 08:54:48.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.224181781s Nov 25 08:54:50.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.22453151s Nov 25 08:54:52.722: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.228607376s Nov 25 08:54:54.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.224122756s Nov 25 08:54:56.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.22447114s Nov 25 08:54:58.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.224175598s Nov 25 08:55:00.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.224009608s Nov 25 08:55:02.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.224228025s Nov 25 08:55:04.719: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.225120939s Nov 25 08:55:06.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.224101961s Nov 25 08:55:08.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.223550049s Nov 25 08:55:10.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.223954854s Nov 25 08:55:12.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.224031015s Nov 25 08:55:14.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.223456334s Nov 25 08:55:16.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.223935334s Nov 25 08:55:18.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.22344533s Nov 25 08:55:20.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.22410793s Nov 25 08:55:22.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.224287831s Nov 25 08:55:24.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.223858771s Nov 25 08:55:26.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.223688542s Nov 25 08:55:28.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.224094208s Nov 25 08:55:30.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.226119078s Nov 25 08:55:32.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.223997401s Nov 25 08:55:34.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.22369451s Nov 25 08:55:36.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.224604318s Nov 25 08:55:38.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.223981726s Nov 25 08:55:40.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.224009977s Nov 25 08:55:42.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.224476656s Nov 25 08:55:44.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.224390858s Nov 25 08:55:46.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.224558843s Nov 25 08:55:48.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.22660911s Nov 25 08:55:50.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.22395358s Nov 25 08:55:52.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.224054506s Nov 25 08:55:54.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.224637044s Nov 25 08:55:56.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.224052591s Nov 25 08:55:58.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.224887329s Nov 25 08:56:00.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.224064886s Nov 25 08:56:02.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.224599558s Nov 25 08:56:04.720: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.226194478s Nov 25 08:56:06.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.223843817s Nov 25 08:56:08.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.224553503s Nov 25 08:56:10.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.224296105s Nov 25 08:56:12.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.224027758s Nov 25 08:56:14.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.224373423s Nov 25 08:56:16.723: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.229540779s Nov 25 08:56:18.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.223462895s Nov 25 08:56:20.721: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.227848252s Nov 25 08:56:22.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.22353896s Nov 25 08:56:24.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.223975752s Nov 25 08:56:26.722: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.228192584s Nov 25 08:56:28.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.224053256s Nov 25 08:56:30.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.22390016s Nov 25 08:56:32.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.2236725s Nov 25 08:56:34.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.223626796s Nov 25 08:56:36.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.224079465s Nov 25 08:56:38.718: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.224324878s Nov 25 08:56:38.829: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.335849498s �[1mSTEP:�[0m Deleting pod external-injector in namespace volume-1807 �[38;5;243m11/25/22 08:56:38.829�[0m Nov 25 08:56:38.945: INFO: Waiting for pod external-injector to disappear Nov 25 08:56:39.056: INFO: Pod external-injector no longer exists Nov 25 08:56:39.056: FAIL: Failed to create injector pod: timed out while waiting for pod volume-1807/external-injector to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3() test/e2e/storage/testsuites/volumes.go:188 +0x457 �[1mSTEP:�[0m cleaning the environment after external �[38;5;243m11/25/22 08:56:39.056�[0m �[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 08:56:39.056�[0m Nov 25 08:56:39.168: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comwv6dw" �[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 08:56:39.281�[0m [AfterEach] [Testpattern: Dynamic PV (block volmode)] volumes test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "volume-1807". �[38;5;243m11/25/22 08:56:39.396�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m11/25/22 08:56:39.507�[0m Nov 25 08:56:39.507: INFO: At 2022-11-25 08:51:38 +0000 UTC - event for ebs.csi.aws.comwv6dw: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Nov 25 08:56:39.507: INFO: At 2022-11-25 08:51:38 +0000 UTC - event for ebs.csi.aws.comwv6dw: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "volume-1807/ebs.csi.aws.comwv6dw" Nov 25 08:56:39.507: INFO: At 2022-11-25 08:51:38 +0000 UTC - event for ebs.csi.aws.comwv6dw: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Nov 25 08:56:39.507: INFO: At 2022-11-25 08:51:48 +0000 UTC - event for ebs.csi.aws.comwv6dw: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-1807-e2e-scf5hd8": rpc error: code = DeadlineExceeded desc = context deadline exceeded Nov 25 08:56:39.507: INFO: At 2022-11-25 08:52:43 +0000 UTC - event for ebs.csi.aws.comwv6dw: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-1807-e2e-scf5hd8": rpc error: code = Internal desc = Could not create volume "pvc-8cc0902c-8964-4e77-a371-39f8b42248a3": could not create volume in EC2: RequestCanceled: request context canceled caused by: context deadline exceeded Nov 25 08:56:39.507: INFO: At 2022-11-25 08:56:39 +0000 UTC - event for external-injector: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "external-injector" not found Nov 25 08:56:39.619: INFO: POD NODE PHASE GRACE CONDITIONS Nov 25 08:56:39.619: INFO: Nov 25 08:56:39.731: INFO: Logging node info for node i-0727ab730bff76f5a Nov 25 08:56:39.843: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 22720 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:54:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:56:39.843: INFO: Logging kubelet events for node i-0727ab730bff76f5a Nov 25 08:56:39.957: INFO: Logging pods the kubelet thinks is on node i-0727ab730bff76f5a Nov 25 08:56:40.085: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:56:40.085: INFO: Container cilium-agent ready: true, restart count 1 Nov 25 08:56:40.085: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container cilium-operator ready: true, restart count 1 Nov 25 08:56:40.085: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded) Nov 25 08:56:40.085: INFO: Container healthcheck ready: true, restart count 0 Nov 25 08:56:40.085: INFO: Container kube-apiserver ready: true, restart count 1 Nov 25 08:56:40.085: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container kube-controller-manager ready: true, restart count 2 Nov 25 08:56:40.085: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container kube-scheduler ready: true, restart count 0 Nov 25 08:56:40.085: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container kops-controller ready: true, restart count 0 Nov 25 08:56:40.085: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded) Nov 25 08:56:40.085: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:40.085: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:40.085: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:56:40.085: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Nov 25 08:56:40.085: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 08:56:40.085: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 08:56:40.085: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.085: INFO: Container dns-controller ready: true, restart count 0 Nov 25 08:56:40.470: INFO: Latency metrics for node i-0727ab730bff76f5a Nov 25 08:56:40.470: INFO: Logging node info for node i-078e7a116b258cef8 Nov 25 08:56:40.582: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 23261 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:55:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:17 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:17 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:17 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:55:17 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:56:40.582: INFO: Logging kubelet events for node i-078e7a116b258cef8 Nov 25 08:56:40.696: INFO: Logging pods the kubelet thinks is on node i-078e7a116b258cef8 Nov 25 08:56:40.811: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:56:40.811: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:56:40.811: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded) Nov 25 08:56:40.811: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:40.811: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:56:40.811: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:56:40.811: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:56:40.811: INFO: hostpath-symlink-prep-provisioning-4532 started at 2022-11-25 08:56:40 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:40.811: INFO: Container init-volume-provisioning-4532 ready: false, restart count 0 Nov 25 08:56:41.232: INFO: Latency metrics for node i-078e7a116b258cef8 Nov 25 08:56:41.232: INFO: Logging node info for node i-08bdea9de27e461c9 Nov 25 08:56:41.344: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 24418 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:56:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:56:41.345: INFO: Logging kubelet events for node i-08bdea9de27e461c9 Nov 25 08:56:41.467: INFO: Logging pods the kubelet thinks is on node i-08bdea9de27e461c9 Nov 25 08:56:41.588: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:56:41.588: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:56:41.588: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:56:41.588: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:41.588: INFO: Container coredns ready: true, restart count 0 Nov 25 08:56:41.588: INFO: hostexec-i-08bdea9de27e461c9-66d7g started at 2022-11-25 08:56:37 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:41.588: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 08:56:41.588: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:56:41.588: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:41.588: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:41.588: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:56:41.588: INFO: pod-1e3ca361-810e-4615-b45d-c56b111c7b48 started at 2022-11-25 08:56:35 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:41.588: INFO: Container write-pod ready: true, restart count 0 Nov 25 08:56:41.588: INFO: hostexec-i-08bdea9de27e461c9-mrlxx started at 2022-11-25 08:56:16 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:41.588: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 08:56:41.588: INFO: deployment-97c6466db-dxjhz started at 2022-11-25 08:56:41 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:41.588: INFO: Container nginx ready: false, restart count 0 Nov 25 08:56:42.006: INFO: Latency metrics for node i-08bdea9de27e461c9 Nov 25 08:56:42.006: INFO: Logging node info for node i-08ef366c24e606a30 Nov 25 08:56:42.118: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 23498 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2736":"i-08ef366c24e606a30","ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:55:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:53:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:53:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:53:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:53:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:22614022,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:56:42.118: INFO: Logging kubelet events for node i-08ef366c24e606a30 Nov 25 08:56:42.232: INFO: Logging pods the kubelet thinks is on node i-08ef366c24e606a30 Nov 25 08:56:42.361: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded) Nov 25 08:56:42.361: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:56:42.361: INFO: csi-mockplugin-0 started at 2022-11-25 08:55:21 +0000 UTC (0+3 container statuses recorded) Nov 25 08:56:42.361: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container driver-registrar ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container mock ready: true, restart count 0 Nov 25 08:56:42.361: INFO: csi-mockplugin-resizer-0 started at 2022-11-25 08:55:22 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:42.361: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:56:42.361: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded) Nov 25 08:56:42.361: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:56:42.361: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:42.361: INFO: Container autoscaler ready: true, restart count 0 Nov 25 08:56:42.361: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded) Nov 25 08:56:42.361: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:42.361: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:42.361: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:42.361: INFO: Container coredns ready: true, restart count 0 Nov 25 08:56:42.361: INFO: pvc-volume-tester-b29d7 started at 2022-11-25 08:55:28 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:42.361: INFO: Container volume-tester ready: true, restart count 0 Nov 25 08:56:42.361: INFO: deployment-97c6466db-rhsx5 started at 2022-11-25 08:56:41 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:42.361: INFO: Container nginx ready: false, restart count 0 Nov 25 08:56:42.775: INFO: Latency metrics for node i-08ef366c24e606a30 Nov 25 08:56:42.775: INFO: Logging node info for node i-0eefb921dfa90622c Nov 25 08:56:42.887: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 23882 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:55:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:56:42.888: INFO: Logging kubelet events for node i-0eefb921dfa90622c Nov 25 08:56:43.002: INFO: Logging pods the kubelet thinks is on node i-0eefb921dfa90622c Nov 25 08:56:43.117: INFO: pod2 started at 2022-11-25 08:56:07 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:43.117: INFO: Container container1 ready: true, restart count 0 Nov 25 08:56:43.117: INFO: busybox-f64898c8-7c0b-4892-9740-4f3e2e270eae started at 2022-11-25 08:56:37 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:43.117: INFO: Container busybox ready: true, restart count 0 Nov 25 08:56:43.117: INFO: deployment-97c6466db-ttbkt started at 2022-11-25 08:56:41 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:43.117: INFO: Container nginx ready: true, restart count 0 Nov 25 08:56:43.117: INFO: pod1 started at 2022-11-25 08:56:07 +0000 UTC (0+1 container statuses recorded) Nov 25 08:56:43.117: INFO: Container container1 ready: true, restart count 0 Nov 25 08:56:43.117: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:56:43.117: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:56:43.117: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:56:43.117: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:56:43.117: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:56:43.117: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:56:43.117: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:56:43.527: INFO: Latency metrics for node i-0eefb921dfa90622c Nov 25 08:56:43.527: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "volume-1807" for this suite. �[38;5;243m11/25/22 08:56:43.645�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\(allowExpansion\)\]\svolume\-expand\sVerify\sif\soffline\sPVC\sexpansion\sworks$'
test/e2e/storage/testsuites/volume_expand.go:198 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:198 +0x3bafrom junit_01.xml
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","completed":17,"skipped":146,"failed":2,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works"]} [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:52:48.728�[0m Nov 25 08:52:48.728: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m11/25/22 08:52:48.729�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:52:49.07�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:52:49.296�[0m [It] Verify if offline PVC expansion works test/e2e/storage/testsuites/volume_expand.go:176 Nov 25 08:52:49.522: INFO: Creating resource for dynamic PV Nov 25 08:52:49.522: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-9299-e2e-sc7pcrx �[38;5;243m11/25/22 08:52:49.523�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:52:49.638�[0m Nov 25 08:52:49.638: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m11/25/22 08:52:49.867�[0m Nov 25 08:52:49.982: INFO: Waiting up to 5m0s for pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185" in namespace "volume-expand-9299" to be "running" Nov 25 08:52:50.095: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 113.421326ms Nov 25 08:52:52.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2.227898365s Nov 25 08:52:54.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4.228355967s Nov 25 08:52:56.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22836679s Nov 25 08:52:58.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 8.228198449s Nov 25 08:53:00.222: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 10.240330858s Nov 25 08:53:02.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 12.227984778s Nov 25 08:53:04.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 14.228454215s Nov 25 08:53:06.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 16.22802935s Nov 25 08:53:08.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 18.227896055s Nov 25 08:53:10.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 20.228404808s Nov 25 08:53:12.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 22.228058455s Nov 25 08:53:14.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 24.227959696s Nov 25 08:53:16.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 26.227516946s Nov 25 08:53:18.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 28.227911574s Nov 25 08:53:20.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 30.227650559s Nov 25 08:53:22.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 32.227666997s Nov 25 08:53:24.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 34.227414743s Nov 25 08:53:26.214: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 36.232297663s Nov 25 08:53:28.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 38.228751735s Nov 25 08:53:30.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 40.228301731s Nov 25 08:53:32.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 42.227785531s Nov 25 08:53:34.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 44.228384914s Nov 25 08:53:36.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 46.228185189s Nov 25 08:53:38.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 48.228024134s Nov 25 08:53:40.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 50.229559236s Nov 25 08:53:42.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 52.228159031s Nov 25 08:53:44.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 54.228085635s Nov 25 08:53:46.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 56.228432723s Nov 25 08:53:48.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 58.227376228s Nov 25 08:53:50.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.227657898s Nov 25 08:53:52.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.227982788s Nov 25 08:53:54.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.228102025s Nov 25 08:53:56.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.227185172s Nov 25 08:53:58.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.228643394s Nov 25 08:54:00.235: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.252979417s Nov 25 08:54:02.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.228011732s Nov 25 08:54:04.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.228028705s Nov 25 08:54:06.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.228214971s Nov 25 08:54:08.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.228411027s Nov 25 08:54:10.213: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.230771603s Nov 25 08:54:12.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.227782681s Nov 25 08:54:14.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.228301631s Nov 25 08:54:16.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.22780856s Nov 25 08:54:18.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.228211422s Nov 25 08:54:20.212: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.229752176s Nov 25 08:54:22.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.227798458s Nov 25 08:54:24.214: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.231939169s Nov 25 08:54:26.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.227783025s Nov 25 08:54:28.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.228241644s Nov 25 08:54:30.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.227524591s Nov 25 08:54:32.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.229333029s Nov 25 08:54:34.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.228322206s Nov 25 08:54:36.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.227572111s Nov 25 08:54:38.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.22805719s Nov 25 08:54:40.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.227854468s Nov 25 08:54:42.212: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.230145042s Nov 25 08:54:44.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.228275654s Nov 25 08:54:46.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.227903913s Nov 25 08:54:48.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.228120997s Nov 25 08:54:50.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.228213098s Nov 25 08:54:52.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.227907928s Nov 25 08:54:54.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.228860636s Nov 25 08:54:56.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.227943831s Nov 25 08:54:58.214: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.232573578s Nov 25 08:55:00.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.228343493s Nov 25 08:55:02.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.227793594s Nov 25 08:55:04.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.226995958s Nov 25 08:55:06.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.22851816s Nov 25 08:55:08.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.227517206s Nov 25 08:55:10.225: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.242883565s Nov 25 08:55:12.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.227831348s Nov 25 08:55:14.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.227687846s Nov 25 08:55:16.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.227888611s Nov 25 08:55:18.212: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.230538208s Nov 25 08:55:20.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.22766117s Nov 25 08:55:22.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.228813009s Nov 25 08:55:24.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.22830039s Nov 25 08:55:26.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.228061748s Nov 25 08:55:28.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.227473889s Nov 25 08:55:30.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.227853454s Nov 25 08:55:32.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.227611307s Nov 25 08:55:34.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.227599754s Nov 25 08:55:36.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.227385796s Nov 25 08:55:38.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.227657461s Nov 25 08:55:40.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.227655545s Nov 25 08:55:42.218: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.236420769s Nov 25 08:55:44.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.228123558s Nov 25 08:55:46.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.228224345s Nov 25 08:55:48.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.228017016s Nov 25 08:55:50.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.227793231s Nov 25 08:55:52.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.227248365s Nov 25 08:55:54.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.227496658s Nov 25 08:55:56.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.227152598s Nov 25 08:55:58.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.228064485s Nov 25 08:56:00.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.228373827s Nov 25 08:56:02.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.228029045s Nov 25 08:56:04.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.228561494s Nov 25 08:56:06.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.228203847s Nov 25 08:56:08.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.227746749s Nov 25 08:56:10.214: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.231903702s Nov 25 08:56:12.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.22823756s Nov 25 08:56:14.212: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.229827485s Nov 25 08:56:16.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.228228827s Nov 25 08:56:18.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.228099395s Nov 25 08:56:20.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.228407429s Nov 25 08:56:22.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.228241927s Nov 25 08:56:24.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.228334192s Nov 25 08:56:26.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.228056492s Nov 25 08:56:28.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.227423114s Nov 25 08:56:30.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.228177723s Nov 25 08:56:32.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.228245137s Nov 25 08:56:34.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.227974314s Nov 25 08:56:36.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.228244618s Nov 25 08:56:38.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.228183619s Nov 25 08:56:40.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.228107821s Nov 25 08:56:42.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.227589787s Nov 25 08:56:44.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.227878277s Nov 25 08:56:46.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.229107531s Nov 25 08:56:48.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.228002794s Nov 25 08:56:50.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.228218107s Nov 25 08:56:52.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.22826045s Nov 25 08:56:54.213: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.231213048s Nov 25 08:56:56.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.227853792s Nov 25 08:56:58.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.228147672s Nov 25 08:57:00.221: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.239568435s Nov 25 08:57:02.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.228441947s Nov 25 08:57:04.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.228480711s Nov 25 08:57:06.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.22882869s Nov 25 08:57:08.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.227989128s Nov 25 08:57:10.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.227780211s Nov 25 08:57:12.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.227607606s Nov 25 08:57:14.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.227667505s Nov 25 08:57:16.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.227676233s Nov 25 08:57:18.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.227922901s Nov 25 08:57:20.212: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.229725536s Nov 25 08:57:22.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.228027031s Nov 25 08:57:24.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.227795092s Nov 25 08:57:26.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.227617679s Nov 25 08:57:28.209: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.227581746s Nov 25 08:57:30.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.228013863s Nov 25 08:57:32.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.228505009s Nov 25 08:57:34.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.228278588s Nov 25 08:57:36.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.227860736s Nov 25 08:57:38.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.227630236s Nov 25 08:57:40.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.228086249s Nov 25 08:57:42.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.227807479s Nov 25 08:57:44.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.227919315s Nov 25 08:57:46.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.228048061s Nov 25 08:57:48.210: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.22814753s Nov 25 08:57:50.211: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.228738681s Nov 25 08:57:50.326: INFO: Pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.34407985s Nov 25 08:57:50.326: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc005dc9040>: { s: "pod \"pod-a313aa16-93d4-49cf-ab0d-9096876d2185\" is not Running: timed out while waiting for pod volume-expand-9299/pod-a313aa16-93d4-49cf-ab0d-9096876d2185 to be running", } Nov 25 08:57:50.326: FAIL: While creating pods for resizing: pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185" is not Running: timed out while waiting for pod volume-expand-9299/pod-a313aa16-93d4-49cf-ab0d-9096876d2185 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:198 +0x3ba Nov 25 08:57:50.326: INFO: Deleting pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185" in namespace "volume-expand-9299" Nov 25 08:57:50.450: INFO: Wait up to 5m0s for pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m11/25/22 08:57:50.566�[0m Nov 25 08:57:50.566: INFO: Deleting pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185" in namespace "volume-expand-9299" �[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 08:57:50.683�[0m Nov 25 08:57:50.797: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comml96s" �[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 08:57:50.917�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "volume-expand-9299". �[38;5;243m11/25/22 08:57:51.032�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m11/25/22 08:57:51.148�[0m Nov 25 08:57:51.148: INFO: At 2022-11-25 08:52:49 +0000 UTC - event for ebs.csi.aws.comml96s: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Nov 25 08:57:51.148: INFO: At 2022-11-25 08:52:49 +0000 UTC - event for ebs.csi.aws.comml96s: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Nov 25 08:57:51.148: INFO: At 2022-11-25 08:52:49 +0000 UTC - event for ebs.csi.aws.comml96s: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "volume-expand-9299/ebs.csi.aws.comml96s" Nov 25 08:57:51.148: INFO: At 2022-11-25 08:52:59 +0000 UTC - event for ebs.csi.aws.comml96s: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-9299-e2e-sc7pcrx": rpc error: code = Internal desc = Could not create volume "pvc-5843fe9a-c7d2-44bf-86fe-278a09fb5da4": could not create volume in EC2: RequestCanceled: request context canceled caused by: context deadline exceeded Nov 25 08:57:51.148: INFO: At 2022-11-25 08:53:10 +0000 UTC - event for ebs.csi.aws.comml96s: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-9299-e2e-sc7pcrx": rpc error: code = DeadlineExceeded desc = context deadline exceeded Nov 25 08:57:51.148: INFO: At 2022-11-25 08:57:50 +0000 UTC - event for pod-a313aa16-93d4-49cf-ab0d-9096876d2185: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "pod-a313aa16-93d4-49cf-ab0d-9096876d2185" not found Nov 25 08:57:51.262: INFO: POD NODE PHASE GRACE CONDITIONS Nov 25 08:57:51.262: INFO: Nov 25 08:57:51.381: INFO: Logging node info for node i-0727ab730bff76f5a Nov 25 08:57:51.495: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 22720 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:54:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:54:54 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:57:51.496: INFO: Logging kubelet events for node i-0727ab730bff76f5a Nov 25 08:57:51.613: INFO: Logging pods the kubelet thinks is on node i-0727ab730bff76f5a Nov 25 08:57:51.739: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:57:51.739: INFO: Container cilium-agent ready: true, restart count 1 Nov 25 08:57:51.739: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container cilium-operator ready: true, restart count 1 Nov 25 08:57:51.739: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container kube-controller-manager ready: true, restart count 2 Nov 25 08:57:51.739: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container kube-scheduler ready: true, restart count 0 Nov 25 08:57:51.739: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container kops-controller ready: true, restart count 0 Nov 25 08:57:51.739: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded) Nov 25 08:57:51.739: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:51.739: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:51.739: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:57:51.739: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Nov 25 08:57:51.739: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 08:57:51.739: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 08:57:51.739: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded) Nov 25 08:57:51.739: INFO: Container healthcheck ready: true, restart count 0 Nov 25 08:57:51.739: INFO: Container kube-apiserver ready: true, restart count 1 Nov 25 08:57:51.739: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:51.739: INFO: Container dns-controller ready: true, restart count 0 Nov 25 08:57:52.147: INFO: Latency metrics for node i-0727ab730bff76f5a Nov 25 08:57:52.147: INFO: Logging node info for node i-078e7a116b258cef8 Nov 25 08:57:52.261: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 26690 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:57:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:57:50 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:57:50 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:57:50 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:57:50 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:57:52.261: INFO: Logging kubelet events for node i-078e7a116b258cef8 Nov 25 08:57:52.379: INFO: Logging pods the kubelet thinks is on node i-078e7a116b258cef8 Nov 25 08:57:52.500: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:57:52.500: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:57:52.500: INFO: pod-exec-websocket-0bcb97ff-8c99-4410-a326-cd26221bd03c started at 2022-11-25 08:57:21 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:52.500: INFO: Container main ready: true, restart count 0 Nov 25 08:57:52.500: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:57:52.500: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:57:52.500: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded) Nov 25 08:57:52.500: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:52.500: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:52.918: INFO: Latency metrics for node i-078e7a116b258cef8 Nov 25 08:57:52.918: INFO: Logging node info for node i-08bdea9de27e461c9 Nov 25 08:57:53.032: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 26559 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:56:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:56:25 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:57:53.032: INFO: Logging kubelet events for node i-08bdea9de27e461c9 Nov 25 08:57:53.149: INFO: Logging pods the kubelet thinks is on node i-08bdea9de27e461c9 Nov 25 08:57:53.278: INFO: pod-ephm-test-configmap-dx2k started at 2022-11-25 08:56:44 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Container test-container-subpath-configmap-dx2k ready: false, restart count 0 Nov 25 08:57:53.278: INFO: successful-jobs-history-limit-27822777-bnbh9 started at 2022-11-25 08:57:00 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Container c ready: false, restart count 0 Nov 25 08:57:53.278: INFO: inline-volume-w4j88 started at 2022-11-25 08:57:29 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Container volume-tester ready: false, restart count 0 Nov 25 08:57:53.278: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:57:53.278: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:57:53.278: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Container coredns ready: true, restart count 0 Nov 25 08:57:53.278: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:57:53.278: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:53.278: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:53.278: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:57:53.278: INFO: pod-subpath-test-preprovisionedpv-q8g6 started at 2022-11-25 08:57:50 +0000 UTC (2+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Init container init-volume-preprovisionedpv-q8g6 ready: true, restart count 0 Nov 25 08:57:53.278: INFO: Init container test-init-volume-preprovisionedpv-q8g6 ready: false, restart count 0 Nov 25 08:57:53.278: INFO: Container test-container-subpath-preprovisionedpv-q8g6 ready: false, restart count 0 Nov 25 08:57:53.278: INFO: hostexec-i-08bdea9de27e461c9-4rt7g started at 2022-11-25 08:57:39 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:53.278: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 08:57:53.730: INFO: Latency metrics for node i-08bdea9de27e461c9 Nov 25 08:57:53.730: INFO: Logging node info for node i-08ef366c24e606a30 Nov 25 08:57:53.845: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 26567 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2812":"i-08ef366c24e606a30","ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:57:16 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 08:57:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:57:26 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:57:26 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:57:26 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:57:26 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:22614022,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2812^285ceb8a-6c9f-11ed-b014-a285dbe77068],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2812^285ceb8a-6c9f-11ed-b014-a285dbe77068,DevicePath:,},},Config:nil,},} Nov 25 08:57:53.845: INFO: Logging kubelet events for node i-08ef366c24e606a30 Nov 25 08:57:53.963: INFO: Logging pods the kubelet thinks is on node i-08ef366c24e606a30 Nov 25 08:57:54.084: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded) Nov 25 08:57:54.084: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:57:54.084: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 08:57:04 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:54.084: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:57:54.084: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded) Nov 25 08:57:54.084: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:57:54.084: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:54.084: INFO: Container autoscaler ready: true, restart count 0 Nov 25 08:57:54.084: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded) Nov 25 08:57:54.084: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:54.084: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:54.084: INFO: Container coredns ready: true, restart count 0 Nov 25 08:57:54.084: INFO: csi-mockplugin-0 started at 2022-11-25 08:57:04 +0000 UTC (0+3 container statuses recorded) Nov 25 08:57:54.084: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container driver-registrar ready: true, restart count 0 Nov 25 08:57:54.084: INFO: Container mock ready: true, restart count 0 Nov 25 08:57:54.084: INFO: pvc-volume-tester-nl8vb started at 2022-11-25 08:57:15 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:54.084: INFO: Container volume-tester ready: true, restart count 0 Nov 25 08:57:54.511: INFO: Latency metrics for node i-08ef366c24e606a30 Nov 25 08:57:54.511: INFO: Logging node info for node i-0eefb921dfa90622c Nov 25 08:57:54.625: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 26574 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:55:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:55:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:57:54.625: INFO: Logging kubelet events for node i-0eefb921dfa90622c Nov 25 08:57:54.742: INFO: Logging pods the kubelet thinks is on node i-0eefb921dfa90622c Nov 25 08:57:54.858: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:57:54.858: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:57:54.859: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:57:54.859: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:57:54.859: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:57:54.859: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:57:54.859: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:57:54.859: INFO: pod-ephm-test-projected-smm5 started at 2022-11-25 08:56:57 +0000 UTC (0+1 container statuses recorded) Nov 25 08:57:54.859: INFO: Container test-container-subpath-projected-smm5 ready: false, restart count 0 Nov 25 08:57:55.265: INFO: Latency metrics for node i-0eefb921dfa90622c Nov 25 08:57:55.265: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "volume-expand-9299" for this suite. �[38;5;243m11/25/22 08:57:55.38�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\(allowExpansion\)\]\svolume\-expand\sshould\sresize\svolume\swhen\sPVC\sis\sedited\swhile\spod\sis\susing\sit$'
test/e2e/storage/testsuites/volume_expand.go:274 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:274 +0x3b3from junit_01.xml
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","completed":2,"skipped":24,"failed":1,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it"]} [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:43:08.731�[0m Nov 25 08:43:08.731: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m11/25/22 08:43:08.732�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:43:09.083�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:43:09.307�[0m [It] should resize volume when PVC is edited while pod is using it test/e2e/storage/testsuites/volume_expand.go:252 Nov 25 08:43:09.531: INFO: Creating resource for dynamic PV Nov 25 08:43:09.532: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-6124-e2e-scq97fk �[38;5;243m11/25/22 08:43:09.532�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:43:09.646�[0m Nov 25 08:43:09.646: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m11/25/22 08:43:09.876�[0m Nov 25 08:43:09.990: INFO: Waiting up to 5m0s for pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a" in namespace "volume-expand-6124" to be "running" Nov 25 08:43:10.103: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 113.206933ms Nov 25 08:43:12.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.227135986s Nov 25 08:43:14.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.227004485s Nov 25 08:43:16.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22688832s Nov 25 08:43:18.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.227054867s Nov 25 08:43:20.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229364644s Nov 25 08:43:22.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 12.227040664s Nov 25 08:43:24.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 14.226441572s Nov 25 08:43:26.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 16.226736821s Nov 25 08:43:28.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.229677229s Nov 25 08:43:30.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.226239959s Nov 25 08:43:32.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.228021129s Nov 25 08:43:34.224: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.233764879s Nov 25 08:43:36.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 26.226654902s Nov 25 08:43:38.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 28.227003972s Nov 25 08:43:40.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 30.22740491s Nov 25 08:43:42.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226485325s Nov 25 08:43:44.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 34.226934064s Nov 25 08:43:46.221: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 36.231077942s Nov 25 08:43:48.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 38.226916654s Nov 25 08:43:50.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 40.226494257s Nov 25 08:43:52.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 42.226936478s Nov 25 08:43:54.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 44.226502667s Nov 25 08:43:56.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 46.22688871s Nov 25 08:43:58.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 48.227650007s Nov 25 08:44:00.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 50.227135472s Nov 25 08:44:02.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 52.226898461s Nov 25 08:44:04.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 54.228264423s Nov 25 08:44:06.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 56.227417965s Nov 25 08:44:08.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 58.226864526s Nov 25 08:44:10.226: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.235437808s Nov 25 08:44:12.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.226510681s Nov 25 08:44:14.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.226429663s Nov 25 08:44:16.223: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.232675729s Nov 25 08:44:18.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.226593455s Nov 25 08:44:20.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.226723412s Nov 25 08:44:22.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.22662613s Nov 25 08:44:24.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.227287795s Nov 25 08:44:26.216: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.22617117s Nov 25 08:44:28.229: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.23908368s Nov 25 08:44:30.229: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.239134715s Nov 25 08:44:32.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.226557477s Nov 25 08:44:34.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.22661431s Nov 25 08:44:36.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.228594529s Nov 25 08:44:38.222: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.23189974s Nov 25 08:44:40.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.228569613s Nov 25 08:44:42.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.226940604s Nov 25 08:44:44.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.227213246s Nov 25 08:44:46.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.226509167s Nov 25 08:44:48.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.229773711s Nov 25 08:44:50.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.226582714s Nov 25 08:44:52.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.226806309s Nov 25 08:44:54.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.226781204s Nov 25 08:44:56.231: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.240295376s Nov 25 08:44:58.247: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.256754473s Nov 25 08:45:00.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.228240939s Nov 25 08:45:02.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.226865576s Nov 25 08:45:04.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.228370924s Nov 25 08:45:06.224: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.23329269s Nov 25 08:45:08.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.228996449s Nov 25 08:45:10.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.228093064s Nov 25 08:45:12.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.226543334s Nov 25 08:45:14.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.227153002s Nov 25 08:45:16.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.227008324s Nov 25 08:45:18.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.226941324s Nov 25 08:45:20.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.226545964s Nov 25 08:45:22.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.22675005s Nov 25 08:45:24.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.227012486s Nov 25 08:45:26.216: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.226220435s Nov 25 08:45:28.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.22691817s Nov 25 08:45:30.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.229157671s Nov 25 08:45:32.216: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.226116314s Nov 25 08:45:34.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.226267235s Nov 25 08:45:36.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.227262678s Nov 25 08:45:38.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.230144108s Nov 25 08:45:40.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.226836157s Nov 25 08:45:42.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.226890001s Nov 25 08:45:44.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.226904673s Nov 25 08:45:46.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.22636188s Nov 25 08:45:48.216: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226063657s Nov 25 08:45:50.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.226635468s Nov 25 08:45:52.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.227047245s Nov 25 08:45:54.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.230044039s Nov 25 08:45:56.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.227239499s Nov 25 08:45:58.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.226679259s Nov 25 08:46:00.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.22686154s Nov 25 08:46:02.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.226984913s Nov 25 08:46:04.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.226599026s Nov 25 08:46:06.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.226908771s Nov 25 08:46:08.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.226835269s Nov 25 08:46:10.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.227821954s Nov 25 08:46:12.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.227001614s Nov 25 08:46:14.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.2283284s Nov 25 08:46:16.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.226862427s Nov 25 08:46:18.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.228327559s Nov 25 08:46:20.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.226927502s Nov 25 08:46:22.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.226935013s Nov 25 08:46:24.226: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.235235789s Nov 25 08:46:26.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.226537915s Nov 25 08:46:28.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.226943809s Nov 25 08:46:30.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.227024942s Nov 25 08:46:32.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.227651831s Nov 25 08:46:34.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.227068035s Nov 25 08:46:36.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.226590004s Nov 25 08:46:38.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.226578885s Nov 25 08:46:40.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.227318818s Nov 25 08:46:42.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.226977886s Nov 25 08:46:44.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.227413121s Nov 25 08:46:46.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.228297823s Nov 25 08:46:48.216: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.226202686s Nov 25 08:46:50.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.22722255s Nov 25 08:46:52.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.227769772s Nov 25 08:46:54.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.226923216s Nov 25 08:46:56.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.227508818s Nov 25 08:46:58.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.228289599s Nov 25 08:47:00.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.22794615s Nov 25 08:47:02.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.226838679s Nov 25 08:47:04.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.226471747s Nov 25 08:47:06.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.227849872s Nov 25 08:47:08.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.227964262s Nov 25 08:47:10.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.227238999s Nov 25 08:47:12.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.227777506s Nov 25 08:47:14.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.226446247s Nov 25 08:47:16.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.226795198s Nov 25 08:47:18.222: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.231570451s Nov 25 08:47:20.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.227392693s Nov 25 08:47:22.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.229445349s Nov 25 08:47:24.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.227722327s Nov 25 08:47:26.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.227112055s Nov 25 08:47:28.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.227199992s Nov 25 08:47:30.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.227773339s Nov 25 08:47:32.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.228136254s Nov 25 08:47:34.225: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.234580484s Nov 25 08:47:36.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.227686306s Nov 25 08:47:38.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.22672285s Nov 25 08:47:40.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.226414614s Nov 25 08:47:42.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.227863763s Nov 25 08:47:44.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.22749461s Nov 25 08:47:46.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.226915838s Nov 25 08:47:48.229: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.238264591s Nov 25 08:47:50.219: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.228420231s Nov 25 08:47:52.221: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.230290789s Nov 25 08:47:54.221: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.230655782s Nov 25 08:47:56.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.228082584s Nov 25 08:47:58.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.227088171s Nov 25 08:48:00.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.226412468s Nov 25 08:48:02.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.227550041s Nov 25 08:48:04.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.227680137s Nov 25 08:48:06.217: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.226280687s Nov 25 08:48:08.220: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.229802222s Nov 25 08:48:10.218: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.227331242s Nov 25 08:48:10.331: INFO: Pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.340356988s Nov 25 08:48:10.331: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc000f53990>: { s: "pod \"pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a\" is not Running: timed out while waiting for pod volume-expand-6124/pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a to be running", } Nov 25 08:48:10.331: FAIL: While creating pods for resizing: pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a" is not Running: timed out while waiting for pod volume-expand-6124/pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:274 +0x3b3 Nov 25 08:48:10.331: INFO: Deleting pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a" in namespace "volume-expand-6124" Nov 25 08:48:10.449: INFO: Wait up to 5m0s for pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m11/25/22 08:48:10.562�[0m Nov 25 08:48:10.562: INFO: Deleting pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a" in namespace "volume-expand-6124" �[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 08:48:10.675�[0m Nov 25 08:48:10.790: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comzr8hp" �[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 08:48:10.907�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "volume-expand-6124". �[38;5;243m11/25/22 08:48:11.024�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m11/25/22 08:48:11.137�[0m Nov 25 08:48:11.137: INFO: At 2022-11-25 08:43:09 +0000 UTC - event for ebs.csi.aws.comzr8hp: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Nov 25 08:48:11.137: INFO: At 2022-11-25 08:43:09 +0000 UTC - event for ebs.csi.aws.comzr8hp: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Nov 25 08:48:11.137: INFO: At 2022-11-25 08:43:09 +0000 UTC - event for ebs.csi.aws.comzr8hp: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "volume-expand-6124/ebs.csi.aws.comzr8hp" Nov 25 08:48:11.137: INFO: At 2022-11-25 08:43:19 +0000 UTC - event for ebs.csi.aws.comzr8hp: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-6124-e2e-scq97fk": rpc error: code = DeadlineExceeded desc = context deadline exceeded Nov 25 08:48:11.137: INFO: At 2022-11-25 08:43:56 +0000 UTC - event for ebs.csi.aws.comzr8hp: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "volume-expand-6124-e2e-scq97fk": rpc error: code = Internal desc = Could not create volume "pvc-7c2c4bff-a16e-46e0-917a-26a29a7eb7bc": could not create volume in EC2: RequestCanceled: request context canceled caused by: context deadline exceeded Nov 25 08:48:11.137: INFO: At 2022-11-25 08:48:10 +0000 UTC - event for pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a: {default-scheduler } FailedScheduling: running PreBind plugin "VolumeBinding": binding volumes: pod does not exist any more: pod "pod-f8929658-0cf5-4455-ad4f-7a7480bd2a0a" not found Nov 25 08:48:11.250: INFO: POD NODE PHASE GRACE CONDITIONS Nov 25 08:48:11.250: INFO: Nov 25 08:48:11.364: INFO: Logging node info for node i-0727ab730bff76f5a Nov 25 08:48:11.477: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 7158 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:44:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:44:42 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:44:42 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:44:42 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:44:42 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:48:11.477: INFO: Logging kubelet events for node i-0727ab730bff76f5a Nov 25 08:48:11.593: INFO: Logging pods the kubelet thinks is on node i-0727ab730bff76f5a Nov 25 08:48:11.715: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container kube-scheduler ready: true, restart count 0 Nov 25 08:48:11.715: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container kops-controller ready: true, restart count 0 Nov 25 08:48:11.715: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:11.715: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:11.715: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:11.715: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:11.715: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Nov 25 08:48:11.715: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 08:48:11.715: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container etcd-manager ready: true, restart count 0 Nov 25 08:48:11.715: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded) Nov 25 08:48:11.715: INFO: Container healthcheck ready: true, restart count 0 Nov 25 08:48:11.715: INFO: Container kube-apiserver ready: true, restart count 1 Nov 25 08:48:11.715: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container kube-controller-manager ready: true, restart count 2 Nov 25 08:48:11.715: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container dns-controller ready: true, restart count 0 Nov 25 08:48:11.715: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:48:11.715: INFO: Container cilium-agent ready: true, restart count 1 Nov 25 08:48:11.715: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:11.715: INFO: Container cilium-operator ready: true, restart count 1 Nov 25 08:48:12.129: INFO: Latency metrics for node i-0727ab730bff76f5a Nov 25 08:48:12.129: INFO: Logging node info for node i-078e7a116b258cef8 Nov 25 08:48:12.261: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 14162 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4732":"i-078e7a116b258cef8","ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:47:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 08:47:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:57 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:57 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:57 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:47:57 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-4732^d9f02896-6c9d-11ed-8747-168e9bef5f85],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-4732^d9f02896-6c9d-11ed-8747-168e9bef5f85,DevicePath:,},},Config:nil,},} Nov 25 08:48:12.261: INFO: Logging kubelet events for node i-078e7a116b258cef8 Nov 25 08:48:12.377: INFO: Logging pods the kubelet thinks is on node i-078e7a116b258cef8 Nov 25 08:48:12.499: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:48:12.499: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:48:12.499: INFO: inline-volume-tester-5nvsx started at 2022-11-25 08:47:55 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:12.499: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 25 08:48:12.499: INFO: netserver-0 started at 2022-11-25 08:47:58 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:12.499: INFO: Container webserver ready: false, restart count 0 Nov 25 08:48:12.499: INFO: csi-hostpathplugin-0 started at 2022-11-25 08:47:52 +0000 UTC (0+7 container statuses recorded) Nov 25 08:48:12.499: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container hostpath ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:12.499: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:12.499: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:12.499: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded) Nov 25 08:48:12.499: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:12.499: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:12.499: INFO: hostexec-i-078e7a116b258cef8-t6vzt started at 2022-11-25 08:48:06 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:12.499: INFO: Container agnhost-container ready: true, restart count 0 Nov 25 08:48:12.953: INFO: Latency metrics for node i-078e7a116b258cef8 Nov 25 08:48:12.953: INFO: Logging node info for node i-08bdea9de27e461c9 Nov 25 08:48:13.068: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 14103 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7136":"i-08bdea9de27e461c9","ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:47:33 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 08:47:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7136^cd4774ef-6c9d-11ed-8d84-4a04f3971ddd],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7136^cd4774ef-6c9d-11ed-8d84-4a04f3971ddd,DevicePath:,},},Config:nil,},} Nov 25 08:48:13.069: INFO: Logging kubelet events for node i-08bdea9de27e461c9 Nov 25 08:48:13.185: INFO: Logging pods the kubelet thinks is on node i-08bdea9de27e461c9 Nov 25 08:48:13.416: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:13.416: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:13.416: INFO: pod-projected-configmaps-9784990c-2348-4da4-b2e3-0534d6950852 started at 2022-11-25 08:46:44 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:13.416: INFO: Container createcm-volume-test ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container delcm-volume-test ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container updcm-volume-test ready: true, restart count 0 Nov 25 08:48:13.416: INFO: inline-volume-tester-x89wx started at 2022-11-25 08:47:32 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:13.416: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 25 08:48:13.416: INFO: boom-server started at 2022-11-25 08:47:27 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:13.416: INFO: Container boom-server ready: true, restart count 0 Nov 25 08:48:13.416: INFO: oidc-discovery-validator started at 2022-11-25 08:46:53 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:13.416: INFO: Container oidc-discovery-validator ready: false, restart count 0 Nov 25 08:48:13.416: INFO: csi-hostpathplugin-0 started at 2022-11-25 08:47:30 +0000 UTC (0+7 container statuses recorded) Nov 25 08:48:13.416: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container hostpath ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:13.416: INFO: netserver-1 started at 2022-11-25 08:47:58 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:13.416: INFO: Container webserver ready: true, restart count 0 Nov 25 08:48:13.416: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:48:13.416: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:48:13.416: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:48:13.416: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:13.416: INFO: Container coredns ready: true, restart count 0 Nov 25 08:48:13.868: INFO: Latency metrics for node i-08bdea9de27e461c9 Nov 25 08:48:13.868: INFO: Logging node info for node i-08ef366c24e606a30 Nov 25 08:48:13.981: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 14315 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:48:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:47:55 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:48:13.981: INFO: Logging kubelet events for node i-08ef366c24e606a30 Nov 25 08:48:14.098: INFO: Logging pods the kubelet thinks is on node i-08ef366c24e606a30 Nov 25 08:48:14.218: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:14.219: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:14.219: INFO: startup-script started at 2022-11-25 08:47:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Container startup-script ready: true, restart count 0 Nov 25 08:48:14.219: INFO: test-grpc-598ee4b9-b264-4f9a-a48a-d4098e59a35d started at 2022-11-25 08:45:41 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Container etcd ready: true, restart count 0 Nov 25 08:48:14.219: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:48:14.219: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Container autoscaler ready: true, restart count 0 Nov 25 08:48:14.219: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded) Nov 25 08:48:14.219: INFO: Container csi-attacher ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container csi-provisioner ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container csi-resizer ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:14.219: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:14.219: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Container coredns ready: true, restart count 0 Nov 25 08:48:14.219: INFO: netserver-2 started at 2022-11-25 08:47:58 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Container webserver ready: false, restart count 0 Nov 25 08:48:14.219: INFO: webserver-pod started at 2022-11-25 08:44:32 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.219: INFO: Container agnhost ready: false, restart count 0 Nov 25 08:48:14.633: INFO: Latency metrics for node i-08ef366c24e606a30 Nov 25 08:48:14.633: INFO: Logging node info for node i-0eefb921dfa90622c Nov 25 08:48:14.747: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 13840 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:47:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:47 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:47 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:47:47 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:47:47 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 25 08:48:14.748: INFO: Logging kubelet events for node i-0eefb921dfa90622c Nov 25 08:48:14.864: INFO: Logging pods the kubelet thinks is on node i-0eefb921dfa90622c Nov 25 08:48:14.982: INFO: pod-configmaps-c3300ee3-0da4-4965-8292-ada29f4a6dd8 started at 2022-11-25 08:47:49 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:14.982: INFO: Container createcm-volume-test ready: true, restart count 0 Nov 25 08:48:14.982: INFO: Container delcm-volume-test ready: true, restart count 0 Nov 25 08:48:14.982: INFO: Container updcm-volume-test ready: true, restart count 0 Nov 25 08:48:14.982: INFO: netserver-3 started at 2022-11-25 08:47:58 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.982: INFO: Container webserver ready: false, restart count 0 Nov 25 08:48:14.982: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded) Nov 25 08:48:14.982: INFO: Container ebs-plugin ready: true, restart count 0 Nov 25 08:48:14.982: INFO: Container liveness-probe ready: true, restart count 0 Nov 25 08:48:14.982: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 25 08:48:14.982: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded) Nov 25 08:48:14.982: INFO: Init container clean-cilium-state ready: true, restart count 0 Nov 25 08:48:14.982: INFO: Container cilium-agent ready: true, restart count 0 Nov 25 08:48:14.982: INFO: httpd started at 2022-11-25 08:48:13 +0000 UTC (0+1 container statuses recorded) Nov 25 08:48:14.982: INFO: Container httpd ready: false, restart count 0 Nov 25 08:48:15.384: INFO: Latency metrics for node i-0eefb921dfa90622c Nov 25 08:48:15.384: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "volume-expand-6124" for this suite. �[38;5;243m11/25/22 08:48:15.499�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0014522c0, 0xc007fa5e30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","completed":16,"skipped":132,"failed":1,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:186
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:47:33.361�[0m
Nov 25 08:47:33.361: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m11/25/22 08:47:33.363�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:47:33.705�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:47:33.932�[0m
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:216
Nov 25 08:47:34.160: INFO: Creating resource for dynamic PV
Nov 25 08:47:34.160: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-59-e2e-scbxxnd �[38;5;243m11/25/22 08:47:34.162�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:47:34.284�[0m
Nov 25 08:47:34.284: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-59 with fsgroup 1000 �[38;5;243m11/25/22 08:47:34.516�[0m
Nov 25 08:47:34.632: INFO: Waiting up to 5m0s for pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0" in namespace "fsgroupchangepolicy-59" to be "running"
Nov 25 08:47:34.746: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 113.82297ms
Nov 25 08:47:36.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228434584s
Nov 25 08:47:38.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4.228663376s
Nov 25 08:47:40.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 6.229138925s
Nov 25 08:47:42.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 8.227991086s
Nov 25 08:47:44.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 10.227537172s
Nov 25 08:47:46.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 12.228981175s
Nov 25 08:47:48.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 14.229474819s
Nov 25 08:47:50.867: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 16.234816854s
Nov 25 08:47:52.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 18.228723385s
Nov 25 08:47:54.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 20.229236419s
Nov 25 08:47:56.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 22.230216895s
Nov 25 08:47:58.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 24.227917s
Nov 25 08:48:00.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 26.229745222s
Nov 25 08:48:02.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 28.228945431s
Nov 25 08:48:04.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 30.230987073s
Nov 25 08:48:06.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 32.229126499s
Nov 25 08:48:08.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 34.229045774s
Nov 25 08:48:10.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 36.229080339s
Nov 25 08:48:12.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 38.230384927s
Nov 25 08:48:14.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 40.22837515s
Nov 25 08:48:16.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 42.228474672s
Nov 25 08:48:18.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 44.229013534s
Nov 25 08:48:20.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 46.229012118s
Nov 25 08:48:22.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 48.228770051s
Nov 25 08:48:24.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 50.228921616s
Nov 25 08:48:26.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 52.229434353s
Nov 25 08:48:28.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 54.22951824s
Nov 25 08:48:30.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 56.229422092s
Nov 25 08:48:32.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 58.227668357s
Nov 25 08:48:34.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.228482518s
Nov 25 08:48:36.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.22896307s
Nov 25 08:48:38.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.229771498s
Nov 25 08:48:40.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.229679762s
Nov 25 08:48:42.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.22777687s
Nov 25 08:48:44.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.227282396s
Nov 25 08:48:46.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.228538246s
Nov 25 08:48:48.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.227736511s
Nov 25 08:48:50.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.228911172s
Nov 25 08:48:52.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.228727437s
Nov 25 08:48:54.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.228372848s
Nov 25 08:48:56.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.228931996s
Nov 25 08:48:58.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.228613774s
Nov 25 08:49:00.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.229107707s
Nov 25 08:49:02.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.228948839s
Nov 25 08:49:04.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.229459287s
Nov 25 08:49:06.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.228703179s
Nov 25 08:49:08.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.230410517s
Nov 25 08:49:10.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.229815532s
Nov 25 08:49:12.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.22951315s
Nov 25 08:49:14.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.228640974s
Nov 25 08:49:16.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.228714874s
Nov 25 08:49:18.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.230850286s
Nov 25 08:49:20.871: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.238178665s
Nov 25 08:49:22.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.228888491s
Nov 25 08:49:24.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.229352252s
Nov 25 08:49:26.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.228953914s
Nov 25 08:49:28.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.228679395s
Nov 25 08:49:30.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.228713801s
Nov 25 08:49:32.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.228870702s
Nov 25 08:49:34.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.229505909s
Nov 25 08:49:36.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.228477428s
Nov 25 08:49:38.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.228998666s
Nov 25 08:49:40.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.228789245s
Nov 25 08:49:42.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.228955579s
Nov 25 08:49:44.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.228751521s
Nov 25 08:49:46.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.229390296s
Nov 25 08:49:48.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.228125445s
Nov 25 08:49:50.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.22899246s
Nov 25 08:49:52.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.228711233s
Nov 25 08:49:54.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.228966553s
Nov 25 08:49:56.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.228738806s
Nov 25 08:49:58.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.22843426s
Nov 25 08:50:00.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.229120427s
Nov 25 08:50:02.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.230263916s
Nov 25 08:50:04.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.229373336s
Nov 25 08:50:06.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.229519388s
Nov 25 08:50:08.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.228586722s
Nov 25 08:50:10.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.228831341s
Nov 25 08:50:12.866: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.233284567s
Nov 25 08:50:14.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.229507761s
Nov 25 08:50:16.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.229671137s
Nov 25 08:50:18.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.228609864s
Nov 25 08:50:20.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.22930952s
Nov 25 08:50:22.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.227567841s
Nov 25 08:50:24.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.228734734s
Nov 25 08:50:26.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.228966479s
Nov 25 08:50:28.866: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.233828935s
Nov 25 08:50:30.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.228320946s
Nov 25 08:50:32.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.229052789s
Nov 25 08:50:34.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.228813512s
Nov 25 08:50:36.867: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.234970006s
Nov 25 08:50:38.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.228661756s
Nov 25 08:50:40.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.228081794s
Nov 25 08:50:42.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.229287224s
Nov 25 08:50:44.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.227898052s
Nov 25 08:50:46.868: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.235357877s
Nov 25 08:50:48.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.229893457s
Nov 25 08:50:50.867: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.234411246s
Nov 25 08:50:52.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.229217822s
Nov 25 08:50:54.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.229787279s
Nov 25 08:50:56.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.229156872s
Nov 25 08:50:58.873: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.240793007s
Nov 25 08:51:00.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.23044666s
Nov 25 08:51:02.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.228408914s
Nov 25 08:51:04.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.230300322s
Nov 25 08:51:06.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.229251764s
Nov 25 08:51:08.865: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.232041008s
Nov 25 08:51:10.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.22906199s
Nov 25 08:51:12.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.228934345s
Nov 25 08:51:14.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.229002512s
Nov 25 08:51:16.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.22889517s
Nov 25 08:51:18.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.229163848s
Nov 25 08:51:20.869: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.236842543s
Nov 25 08:51:22.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.228853044s
Nov 25 08:51:24.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.228941156s
Nov 25 08:51:26.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.22865602s
Nov 25 08:51:28.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.230218505s
Nov 25 08:51:30.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.228277902s
Nov 25 08:51:32.860: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.227794934s
Nov 25 08:51:34.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.229491353s
Nov 25 08:51:36.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.22839243s
Nov 25 08:51:38.864: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.231497196s
Nov 25 08:51:40.868: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.235226484s
Nov 25 08:51:42.865: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.23283083s
Nov 25 08:51:44.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.228621327s
Nov 25 08:51:46.863: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.230378006s
Nov 25 08:51:48.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.229355537s
Nov 25 08:51:50.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.228282143s
Nov 25 08:51:52.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.228066172s
Nov 25 08:51:54.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.22877836s
Nov 25 08:51:56.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.228692188s
Nov 25 08:51:58.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.228581368s
Nov 25 08:52:00.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.229601092s
Nov 25 08:52:02.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.22856465s
Nov 25 08:52:04.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.228728381s
Nov 25 08:52:06.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.22984111s
Nov 25 08:52:08.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.228361488s
Nov 25 08:52:10.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.228923301s
Nov 25 08:52:12.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.229947129s
Nov 25 08:52:14.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.229648497s
Nov 25 08:52:16.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.228952577s
Nov 25 08:52:18.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.229921779s
Nov 25 08:52:20.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.229674857s
Nov 25 08:52:22.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.228763769s
Nov 25 08:52:24.861: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.228885405s
Nov 25 08:52:26.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.229231836s
Nov 25 08:52:28.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.229780144s
Nov 25 08:52:30.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.229166478s
Nov 25 08:52:32.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.229782392s
Nov 25 08:52:34.862: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.229231563s
Nov 25 08:52:34.976: INFO: Pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.343060058s
Nov 25 08:52:34.976: INFO: Unexpected error:
<*errors.errorString | 0xc0011b2cf0>: {
s: "pod \"pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0\" is not Running: timed out while waiting for pod fsgroupchangepolicy-59/pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0 to be running",
}
Nov 25 08:52:34.976: FAIL: pod "pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0" is not Running: timed out while waiting for pod fsgroupchangepolicy-59/pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0 to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0014522c0, 0xc007fa5e30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 08:52:34.976�[0m
Nov 25 08:52:35.090: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comq9hj6"
�[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 08:52:35.205�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:187
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-59". �[38;5;243m11/25/22 08:52:35.32�[0m
�[1mSTEP:�[0m Found 5 events. �[38;5;243m11/25/22 08:52:35.44�[0m
Nov 25 08:52:35.440: INFO: At 2022-11-25 08:47:34 +0000 UTC - event for ebs.csi.aws.comq9hj6: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Nov 25 08:52:35.440: INFO: At 2022-11-25 08:47:34 +0000 UTC - event for ebs.csi.aws.comq9hj6: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-59/ebs.csi.aws.comq9hj6"
Nov 25 08:52:35.440: INFO: At 2022-11-25 08:47:34 +0000 UTC - event for ebs.csi.aws.comq9hj6: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Nov 25 08:52:35.440: INFO: At 2022-11-25 08:47:44 +0000 UTC - event for ebs.csi.aws.comq9hj6: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-59-e2e-scbxxnd": rpc error: code = DeadlineExceeded desc = context deadline exceeded
Nov 25 08:52:35.440: INFO: At 2022-11-25 08:49:05 +0000 UTC - event for ebs.csi.aws.comq9hj6: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-59-e2e-scbxxnd": rpc error: code = Internal desc = Could not create volume "pvc-6f6480d4-20f5-4afe-a9c6-ea1c0f4bc50b": could not create volume in EC2: RequestCanceled: request context canceled
caused by: context deadline exceeded
Nov 25 08:52:35.555: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 25 08:52:35.556: INFO: pod-b3bc911c-7ac6-4b8d-88ab-7ddceccd70a0 Pending []
Nov 25 08:52:35.556: INFO:
Nov 25 08:52:35.789: INFO:
Logging node info for node i-0727ab730bff76f5a
Nov 25 08:52:35.903: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 16552 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:52:35.903: INFO:
Logging kubelet events for node i-0727ab730bff76f5a
Nov 25 08:52:36.019: INFO:
Logging pods the kubelet thinks is on node i-0727ab730bff76f5a
Nov 25 08:52:36.141: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:52:36.141: INFO: Container cilium-agent ready: true, restart count 1
Nov 25 08:52:36.141: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container cilium-operator ready: true, restart count 1
Nov 25 08:52:36.141: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 08:52:36.141: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 08:52:36.141: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container healthcheck ready: true, restart count 0
Nov 25 08:52:36.141: INFO: Container kube-apiserver ready: true, restart count 1
Nov 25 08:52:36.141: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container kube-controller-manager ready: true, restart count 2
Nov 25 08:52:36.141: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container kube-scheduler ready: true, restart count 0
Nov 25 08:52:36.141: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container kops-controller ready: true, restart count 0
Nov 25 08:52:36.141: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:36.141: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:36.141: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:52:36.141: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Nov 25 08:52:36.141: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.141: INFO: Container dns-controller ready: true, restart count 0
Nov 25 08:52:36.555: INFO:
Latency metrics for node i-0727ab730bff76f5a
Nov 25 08:52:36.555: INFO:
Logging node info for node i-078e7a116b258cef8
Nov 25 08:52:36.668: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 19659 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:52:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:52:36.669: INFO:
Logging kubelet events for node i-078e7a116b258cef8
Nov 25 08:52:36.785: INFO:
Logging pods the kubelet thinks is on node i-078e7a116b258cef8
Nov 25 08:52:36.904: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:52:36.904: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:52:36.904: INFO: csi-mockplugin-0 started at 2022-11-25 08:51:08 +0000 UTC (0+4 container statuses recorded)
Nov 25 08:52:36.904: INFO: Container busybox ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container csi-provisioner ready: true, restart count 2
Nov 25 08:52:36.904: INFO: Container driver-registrar ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container mock ready: true, restart count 0
Nov 25 08:52:36.904: INFO: startup-b5596d58-69bc-468d-8ed5-43d075c00a19 started at 2022-11-25 08:49:21 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.904: INFO: Container busybox ready: false, restart count 0
Nov 25 08:52:36.904: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:52:36.904: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:52:36.904: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded)
Nov 25 08:52:36.904: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:36.904: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:36.904: INFO: hostexec-i-078e7a116b258cef8-t5hxg started at 2022-11-25 08:52:25 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:36.904: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 08:52:37.338: INFO:
Latency metrics for node i-078e7a116b258cef8
Nov 25 08:52:37.338: INFO:
Logging node info for node i-08bdea9de27e461c9
Nov 25 08:52:37.452: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 18440 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:51:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:52:37.453: INFO:
Logging kubelet events for node i-08bdea9de27e461c9
Nov 25 08:52:37.570: INFO:
Logging pods the kubelet thinks is on node i-08bdea9de27e461c9
Nov 25 08:52:37.696: INFO: liveness-a412bce0-e9f5-4002-88f8-188e5220629a started at 2022-11-25 08:49:45 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:37.696: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 08:52:37.696: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:52:37.696: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:52:37.696: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:52:37.696: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:37.696: INFO: Container coredns ready: true, restart count 0
Nov 25 08:52:37.696: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:52:37.696: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:37.696: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:37.696: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:52:38.122: INFO:
Latency metrics for node i-08bdea9de27e461c9
Nov 25 08:52:38.122: INFO:
Logging node info for node i-08ef366c24e606a30
Nov 25 08:52:38.235: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 19612 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8678":"i-08ef366c24e606a30","ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:52:20 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 08:52:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:52:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:52:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:52:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:52:20 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-8678^78488e26-6c9e-11ed-9caa-72d8ab9b6846],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-8678^78488e26-6c9e-11ed-9caa-72d8ab9b6846,DevicePath:,},},Config:nil,},}
Nov 25 08:52:38.236: INFO:
Logging kubelet events for node i-08ef366c24e606a30
Nov 25 08:52:38.353: INFO:
Logging pods the kubelet thinks is on node i-08ef366c24e606a30
Nov 25 08:52:38.482: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:52:38.482: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:52:38.482: INFO: csi-hostpathplugin-0 started at 2022-11-25 08:51:47 +0000 UTC (0+7 container statuses recorded)
Nov 25 08:52:38.482: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container csi-snapshotter ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container hostpath ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:52:38.482: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded)
Nov 25 08:52:38.482: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:38.482: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:38.482: INFO: Container coredns ready: true, restart count 0
Nov 25 08:52:38.482: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:52:38.482: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:52:38.482: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:52:38.482: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:38.482: INFO: Container autoscaler ready: true, restart count 0
Nov 25 08:52:38.913: INFO:
Latency metrics for node i-08ef366c24e606a30
Nov 25 08:52:38.913: INFO:
Logging node info for node i-0eefb921dfa90622c
Nov 25 08:52:39.026: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 19183 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:51:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:42 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:42 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:42 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:51:42 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:52:39.027: INFO:
Logging kubelet events for node i-0eefb921dfa90622c
Nov 25 08:52:39.143: INFO:
Logging pods the kubelet thinks is on node i-0eefb921dfa90622c
Nov 25 08:52:39.260: INFO: replace-27822772-b7xpk started at 2022-11-25 08:52:00 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:39.260: INFO: Container c ready: true, restart count 0
Nov 25 08:52:39.260: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:52:39.260: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:52:39.260: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:52:39.260: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:52:39.260: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:52:39.260: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:52:39.260: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:52:39.260: INFO: concurrent-27822772-mt59d started at 2022-11-25 08:52:00 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:39.260: INFO: Container c ready: true, restart count 0
Nov 25 08:52:39.260: INFO: hostexec-i-0eefb921dfa90622c-f9bf9 started at 2022-11-25 08:52:36 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:52:39.260: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 08:52:39.653: INFO:
Latency metrics for node i-0eefb921dfa90622c
Nov 25 08:52:39.653: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-59" for this suite. �[38;5;243m11/25/22 08:52:39.767�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\svolume\scontents\sownership\schanged\svia\schgrp\sin\sfirst\spod\,\snew\spod\swith\sdifferent\sfsgroup\sapplied\sto\sthe\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00143a160, 0xc0039c5e30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents","completed":15,"skipped":154,"failed":1,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents"]}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:186
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 08:46:26.157�[0m
Nov 25 08:46:26.157: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m11/25/22 08:46:26.158�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 08:46:26.494�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 08:46:26.715�[0m
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with different fsgroup applied to the volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:216
Nov 25 08:46:26.936: INFO: Creating resource for dynamic PV
Nov 25 08:46:26.936: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-2947-e2e-sc6jscm �[38;5;243m11/25/22 08:46:26.936�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 08:46:27.048�[0m
Nov 25 08:46:27.048: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-2947 with fsgroup 1000 �[38;5;243m11/25/22 08:46:27.273�[0m
Nov 25 08:46:27.386: INFO: Waiting up to 5m0s for pod "pod-998afaa4-936d-4f34-b117-8780c74c5778" in namespace "fsgroupchangepolicy-2947" to be "running"
Nov 25 08:46:27.498: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 112.7122ms
Nov 25 08:46:29.615: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228907823s
Nov 25 08:46:31.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4.225073796s
Nov 25 08:46:33.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22467888s
Nov 25 08:46:35.616: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 8.229841976s
Nov 25 08:46:37.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 10.224644864s
Nov 25 08:46:39.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 12.226868132s
Nov 25 08:46:41.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 14.227517113s
Nov 25 08:46:43.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 16.22445501s
Nov 25 08:46:45.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 18.224360648s
Nov 25 08:46:47.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 20.224543531s
Nov 25 08:46:49.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 22.225148729s
Nov 25 08:46:51.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 24.225325473s
Nov 25 08:46:53.615: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 26.228749069s
Nov 25 08:46:55.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 28.224458832s
Nov 25 08:46:57.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 30.224646875s
Nov 25 08:46:59.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 32.225030441s
Nov 25 08:47:01.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 34.225669906s
Nov 25 08:47:03.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 36.226156401s
Nov 25 08:47:05.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 38.224586798s
Nov 25 08:47:07.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 40.225585744s
Nov 25 08:47:09.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 42.22429039s
Nov 25 08:47:11.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 44.223986844s
Nov 25 08:47:13.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 46.225656518s
Nov 25 08:47:15.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 48.22488616s
Nov 25 08:47:17.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 50.225150907s
Nov 25 08:47:19.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 52.226019505s
Nov 25 08:47:21.614: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 54.227818405s
Nov 25 08:47:23.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 56.226792191s
Nov 25 08:47:25.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 58.225370652s
Nov 25 08:47:27.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.225317542s
Nov 25 08:47:29.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.22424885s
Nov 25 08:47:31.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.224708537s
Nov 25 08:47:33.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.226395759s
Nov 25 08:47:35.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.224946357s
Nov 25 08:47:37.620: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.23431309s
Nov 25 08:47:39.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.225916192s
Nov 25 08:47:41.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.224963633s
Nov 25 08:47:43.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.224697832s
Nov 25 08:47:45.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.225553536s
Nov 25 08:47:47.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.225098753s
Nov 25 08:47:49.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.225441886s
Nov 25 08:47:51.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.225719234s
Nov 25 08:47:53.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.226982703s
Nov 25 08:47:55.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.225796235s
Nov 25 08:47:57.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.224880046s
Nov 25 08:47:59.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.224991959s
Nov 25 08:48:01.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.225277004s
Nov 25 08:48:03.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.224993381s
Nov 25 08:48:05.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.225606149s
Nov 25 08:48:07.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.224725172s
Nov 25 08:48:09.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.225747336s
Nov 25 08:48:11.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.225684661s
Nov 25 08:48:13.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.224086714s
Nov 25 08:48:15.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.224613729s
Nov 25 08:48:17.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.225939871s
Nov 25 08:48:19.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.224500385s
Nov 25 08:48:21.617: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.230987345s
Nov 25 08:48:23.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.224432988s
Nov 25 08:48:25.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.226956011s
Nov 25 08:48:27.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.224520476s
Nov 25 08:48:29.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.224279623s
Nov 25 08:48:31.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.225314266s
Nov 25 08:48:33.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.224946725s
Nov 25 08:48:35.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.224792561s
Nov 25 08:48:37.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.224527382s
Nov 25 08:48:39.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.224937739s
Nov 25 08:48:41.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.22530448s
Nov 25 08:48:43.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.225314169s
Nov 25 08:48:45.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.225769354s
Nov 25 08:48:47.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.225485771s
Nov 25 08:48:49.614: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.227794284s
Nov 25 08:48:51.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.225270374s
Nov 25 08:48:53.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.224147079s
Nov 25 08:48:55.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.224774397s
Nov 25 08:48:57.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.225617561s
Nov 25 08:48:59.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.22448619s
Nov 25 08:49:01.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.226172818s
Nov 25 08:49:03.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.225516174s
Nov 25 08:49:05.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226449683s
Nov 25 08:49:07.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.224973934s
Nov 25 08:49:09.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.225376488s
Nov 25 08:49:11.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.226447883s
Nov 25 08:49:13.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.225048692s
Nov 25 08:49:15.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.226881893s
Nov 25 08:49:17.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.225522581s
Nov 25 08:49:19.614: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.228026929s
Nov 25 08:49:21.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.225107094s
Nov 25 08:49:23.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.22444192s
Nov 25 08:49:25.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.226071884s
Nov 25 08:49:27.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.224196542s
Nov 25 08:49:29.618: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.232139979s
Nov 25 08:49:31.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.227135404s
Nov 25 08:49:33.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.225875377s
Nov 25 08:49:35.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.22491899s
Nov 25 08:49:37.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.22464817s
Nov 25 08:49:39.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.224210818s
Nov 25 08:49:41.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.225290784s
Nov 25 08:49:43.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.225233832s
Nov 25 08:49:45.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.225068663s
Nov 25 08:49:47.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.224995775s
Nov 25 08:49:49.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.227120943s
Nov 25 08:49:51.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.225478943s
Nov 25 08:49:53.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.225210463s
Nov 25 08:49:55.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.224274388s
Nov 25 08:49:57.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.225311343s
Nov 25 08:49:59.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.224729071s
Nov 25 08:50:01.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.226284545s
Nov 25 08:50:03.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.225154636s
Nov 25 08:50:05.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.22451439s
Nov 25 08:50:07.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.225594805s
Nov 25 08:50:09.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.225479422s
Nov 25 08:50:11.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.224776107s
Nov 25 08:50:13.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.224866025s
Nov 25 08:50:15.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.225121713s
Nov 25 08:50:17.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.225277367s
Nov 25 08:50:19.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.224818067s
Nov 25 08:50:21.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.225464615s
Nov 25 08:50:23.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.224810836s
Nov 25 08:50:25.613: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.22678231s
Nov 25 08:50:27.616: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.230170831s
Nov 25 08:50:29.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.225528895s
Nov 25 08:50:31.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.225693248s
Nov 25 08:50:33.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.22438246s
Nov 25 08:50:35.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.225282669s
Nov 25 08:50:37.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.224932994s
Nov 25 08:50:39.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.224665618s
Nov 25 08:50:41.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.225012042s
Nov 25 08:50:43.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.225020423s
Nov 25 08:50:45.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.225636521s
Nov 25 08:50:47.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.225153977s
Nov 25 08:50:49.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.224412319s
Nov 25 08:50:51.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.224649739s
Nov 25 08:50:53.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.226454389s
Nov 25 08:50:55.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.225927698s
Nov 25 08:50:57.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.224608455s
Nov 25 08:50:59.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.225523317s
Nov 25 08:51:01.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.224638749s
Nov 25 08:51:03.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.225718277s
Nov 25 08:51:05.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.225933178s
Nov 25 08:51:07.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.224739467s
Nov 25 08:51:09.620: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.234274754s
Nov 25 08:51:11.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.224905935s
Nov 25 08:51:13.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.225054578s
Nov 25 08:51:15.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.225079838s
Nov 25 08:51:17.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.224721857s
Nov 25 08:51:19.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.224767881s
Nov 25 08:51:21.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.224649035s
Nov 25 08:51:23.610: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.22474589s
Nov 25 08:51:25.611: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.225117476s
Nov 25 08:51:27.612: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.226616694s
Nov 25 08:51:27.726: INFO: Pod "pod-998afaa4-936d-4f34-b117-8780c74c5778": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.339906699s
Nov 25 08:51:27.726: INFO: Unexpected error:
<*errors.errorString | 0xc000cff0c0>: {
s: "pod \"pod-998afaa4-936d-4f34-b117-8780c74c5778\" is not Running: timed out while waiting for pod fsgroupchangepolicy-2947/pod-998afaa4-936d-4f34-b117-8780c74c5778 to be running",
}
Nov 25 08:51:27.726: FAIL: pod "pod-998afaa4-936d-4f34-b117-8780c74c5778" is not Running: timed out while waiting for pod fsgroupchangepolicy-2947/pod-998afaa4-936d-4f34-b117-8780c74c5778 to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00143a160, 0xc0039c5e30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 08:51:27.726�[0m
Nov 25 08:51:27.837: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comdcbmw"
�[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 08:51:27.95�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:187
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-2947". �[38;5;243m11/25/22 08:51:28.063�[0m
�[1mSTEP:�[0m Found 4 events. �[38;5;243m11/25/22 08:51:28.175�[0m
Nov 25 08:51:28.176: INFO: At 2022-11-25 08:46:27 +0000 UTC - event for ebs.csi.aws.comdcbmw: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Nov 25 08:51:28.176: INFO: At 2022-11-25 08:46:27 +0000 UTC - event for ebs.csi.aws.comdcbmw: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-2947/ebs.csi.aws.comdcbmw"
Nov 25 08:51:28.176: INFO: At 2022-11-25 08:46:27 +0000 UTC - event for ebs.csi.aws.comdcbmw: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Nov 25 08:51:28.176: INFO: At 2022-11-25 08:46:37 +0000 UTC - event for ebs.csi.aws.comdcbmw: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-2947-e2e-sc6jscm": rpc error: code = DeadlineExceeded desc = context deadline exceeded
Nov 25 08:51:28.286: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 25 08:51:28.286: INFO: pod-998afaa4-936d-4f34-b117-8780c74c5778 Pending []
Nov 25 08:51:28.286: INFO:
Nov 25 08:51:28.513: INFO:
Logging node info for node i-0727ab730bff76f5a
Nov 25 08:51:28.625: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 16552 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:49:48 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:51:28.625: INFO:
Logging kubelet events for node i-0727ab730bff76f5a
Nov 25 08:51:28.743: INFO:
Logging pods the kubelet thinks is on node i-0727ab730bff76f5a
Nov 25 08:51:28.877: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:51:28.877: INFO: Container cilium-agent ready: true, restart count 1
Nov 25 08:51:28.877: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container cilium-operator ready: true, restart count 1
Nov 25 08:51:28.877: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:28.877: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:28.877: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:51:28.877: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Nov 25 08:51:28.877: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 08:51:28.877: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 08:51:28.877: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container healthcheck ready: true, restart count 0
Nov 25 08:51:28.877: INFO: Container kube-apiserver ready: true, restart count 1
Nov 25 08:51:28.877: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container kube-controller-manager ready: true, restart count 2
Nov 25 08:51:28.877: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container kube-scheduler ready: true, restart count 0
Nov 25 08:51:28.877: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container kops-controller ready: true, restart count 0
Nov 25 08:51:28.877: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:28.877: INFO: Container dns-controller ready: true, restart count 0
Nov 25 08:51:29.284: INFO:
Latency metrics for node i-0727ab730bff76f5a
Nov 25 08:51:29.284: INFO:
Logging node info for node i-078e7a116b258cef8
Nov 25 08:51:29.395: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 18472 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1304":"csi-mock-csi-mock-volumes-1304","csi-mock-csi-mock-volumes-4185":"csi-mock-csi-mock-volumes-4185","ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:51:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:51:21 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:51:29.395: INFO:
Logging kubelet events for node i-078e7a116b258cef8
Nov 25 08:51:29.511: INFO:
Logging pods the kubelet thinks is on node i-078e7a116b258cef8
Nov 25 08:51:29.749: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:51:29.749: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:29.749: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:51:29.749: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:51:29.749: INFO: csi-mockplugin-0 started at 2022-11-25 08:51:12 +0000 UTC (0+4 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container busybox ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container driver-registrar ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container mock ready: true, restart count 0
Nov 25 08:51:29.749: INFO: pvc-volume-tester-cfmg6 started at 2022-11-25 08:51:21 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container volume-tester ready: true, restart count 0
Nov 25 08:51:29.749: INFO: csi-mockplugin-0 started at 2022-11-25 08:51:08 +0000 UTC (0+4 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container busybox ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container driver-registrar ready: true, restart count 0
Nov 25 08:51:29.749: INFO: Container mock ready: true, restart count 0
Nov 25 08:51:29.749: INFO: netserver-0 started at 2022-11-25 08:51:17 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container webserver ready: false, restart count 0
Nov 25 08:51:29.749: INFO: pvc-volume-tester-k4x2s started at 2022-11-25 08:51:21 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container volume-tester ready: true, restart count 0
Nov 25 08:51:29.749: INFO: startup-b5596d58-69bc-468d-8ed5-43d075c00a19 started at 2022-11-25 08:49:21 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:29.749: INFO: Container busybox ready: false, restart count 0
Nov 25 08:51:30.245: INFO:
Latency metrics for node i-078e7a116b258cef8
Nov 25 08:51:30.245: INFO:
Logging node info for node i-08bdea9de27e461c9
Nov 25 08:51:30.356: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 18440 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:51:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:51:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:51:30.358: INFO:
Logging kubelet events for node i-08bdea9de27e461c9
Nov 25 08:51:30.473: INFO:
Logging pods the kubelet thinks is on node i-08bdea9de27e461c9
Nov 25 08:51:30.593: INFO: netserver-1 started at 2022-11-25 08:51:17 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:30.593: INFO: Container webserver ready: true, restart count 0
Nov 25 08:51:30.593: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:51:30.593: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:51:30.593: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:51:30.593: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:30.594: INFO: Container coredns ready: true, restart count 0
Nov 25 08:51:30.594: INFO: liveness-a412bce0-e9f5-4002-88f8-188e5220629a started at 2022-11-25 08:49:45 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:30.594: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 08:51:30.594: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:51:30.594: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:30.594: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:30.594: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:51:30.594: INFO: ss-0 started at 2022-11-25 08:51:24 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:30.594: INFO: Container webserver ready: true, restart count 0
Nov 25 08:51:31.032: INFO:
Latency metrics for node i-08bdea9de27e461c9
Nov 25 08:51:31.032: INFO:
Logging node info for node i-08ef366c24e606a30
Nov 25 08:51:31.143: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 17980 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:51:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:50:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:50:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:50:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:50:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 08:51:31.144: INFO:
Logging kubelet events for node i-08ef366c24e606a30
Nov 25 08:51:31.275: INFO:
Logging pods the kubelet thinks is on node i-08ef366c24e606a30
Nov 25 08:51:31.403: INFO: hostexec-i-08ef366c24e606a30-xs8s9 started at 2022-11-25 08:50:05 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 08:51:31.403: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:51:31.403: INFO: pod-41fe1fcf-28f3-4275-9106-a0fcf9ed237d started at 2022-11-25 08:50:11 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container write-pod ready: true, restart count 0
Nov 25 08:51:31.403: INFO: netserver-2 started at 2022-11-25 08:51:17 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container webserver ready: true, restart count 0
Nov 25 08:51:31.403: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:51:31.403: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:51:31.403: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container autoscaler ready: true, restart count 0
Nov 25 08:51:31.403: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:31.403: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:31.403: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:31.403: INFO: Container coredns ready: true, restart count 0
Nov 25 08:51:31.812: INFO:
Latency metrics for node i-08ef366c24e606a30
Nov 25 08:51:31.812: INFO:
Logging node info for node i-0eefb921dfa90622c
Nov 25 08:51:31.925: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 18539 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6840":"i-0eefb921dfa90622c","ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 08:51:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-11-25 08:51:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 08:50:51 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 08:50:51 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 08:50:51 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 08:50:51 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6840^55be5be3-6c9e-11ed-909e-de7853ca4820,DevicePath:,},},Config:nil,},}
Nov 25 08:51:31.925: INFO:
Logging kubelet events for node i-0eefb921dfa90622c
Nov 25 08:51:32.041: INFO:
Logging pods the kubelet thinks is on node i-0eefb921dfa90622c
Nov 25 08:51:32.167: INFO: csi-hostpathplugin-0 started at 2022-11-25 08:51:18 +0000 UTC (0+7 container statuses recorded)
Nov 25 08:51:32.167: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container csi-snapshotter ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container hostpath ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:51:32.167: INFO: pod-subpath-test-dynamicpv-k6h2 started at 2022-11-25 08:51:24 +0000 UTC (2+1 container statuses recorded)
Nov 25 08:51:32.167: INFO: Init container init-volume-dynamicpv-k6h2 ready: false, restart count 0
Nov 25 08:51:32.167: INFO: Init container test-init-volume-dynamicpv-k6h2 ready: false, restart count 0
Nov 25 08:51:32.167: INFO: Container test-container-subpath-dynamicpv-k6h2 ready: false, restart count 0
Nov 25 08:51:32.167: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 08:51:32.167: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 08:51:32.167: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 08:51:32.167: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 08:51:32.167: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 08:51:32.167: INFO: hostexec-i-0eefb921dfa90622c-w4snv started at 2022-11-25 08:51:04 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:32.167: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 08:51:32.167: INFO: netserver-3 started at 2022-11-25 08:51:17 +0000 UTC (0+1 container statuses recorded)
Nov 25 08:51:32.167: INFO: Container webserver ready: false, restart count 0
Nov 25 08:51:32.606: INFO:
Latency metrics for node i-0eefb921dfa90622c
Nov 25 08:51:32.606: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-2947" for this suite. �[38;5;243m11/25/22 08:51:32.721�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\svolume\scontents\sownership\schanged\svia\schgrp\sin\sfirst\spod\,\snew\spod\swith\ssame\sfsgroup\sapplied\sto\sthe\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0014b9080, 0xc00483de30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents","completed":12,"skipped":126,"failed":2,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support expansion of pvcs created for ephemeral pvcs","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents"]}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:186
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 09:03:02.88�[0m
Nov 25 09:03:02.881: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m11/25/22 09:03:02.881�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 09:03:03.215�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 09:03:03.435�[0m
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup applied to the volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:216
Nov 25 09:03:03.658: INFO: Creating resource for dynamic PV
Nov 25 09:03:03.658: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-3904-e2e-schv72w �[38;5;243m11/25/22 09:03:03.659�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 09:03:03.774�[0m
Nov 25 09:03:03.774: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-3904 with fsgroup 1000 �[38;5;243m11/25/22 09:03:03.998�[0m
Nov 25 09:03:04.110: INFO: Waiting up to 5m0s for pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15" in namespace "fsgroupchangepolicy-3904" to be "running"
Nov 25 09:03:04.221: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 110.616145ms
Nov 25 09:03:06.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223158527s
Nov 25 09:03:08.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4.222036866s
Nov 25 09:03:10.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 6.222402086s
Nov 25 09:03:12.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 8.221572289s
Nov 25 09:03:14.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 10.222353069s
Nov 25 09:03:16.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 12.221880218s
Nov 25 09:03:18.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 14.22690588s
Nov 25 09:03:20.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 16.222145249s
Nov 25 09:03:22.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 18.221926527s
Nov 25 09:03:24.336: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 20.225620351s
Nov 25 09:03:26.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 22.221531306s
Nov 25 09:03:28.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 24.221911128s
Nov 25 09:03:30.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 26.222152498s
Nov 25 09:03:32.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 28.221617035s
Nov 25 09:03:34.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 30.222164434s
Nov 25 09:03:36.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 32.222429125s
Nov 25 09:03:38.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 34.221527569s
Nov 25 09:03:40.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 36.221944973s
Nov 25 09:03:42.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 38.221854377s
Nov 25 09:03:44.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 40.222597583s
Nov 25 09:03:46.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 42.222314433s
Nov 25 09:03:48.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 44.221938484s
Nov 25 09:03:50.331: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 46.221201883s
Nov 25 09:03:52.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 48.222448409s
Nov 25 09:03:54.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 50.222734761s
Nov 25 09:03:56.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 52.222057802s
Nov 25 09:03:58.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 54.223584468s
Nov 25 09:04:00.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 56.221947225s
Nov 25 09:04:02.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 58.221926397s
Nov 25 09:04:04.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.221656827s
Nov 25 09:04:06.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.222017605s
Nov 25 09:04:08.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.221505234s
Nov 25 09:04:10.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.221847611s
Nov 25 09:04:12.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.221914052s
Nov 25 09:04:14.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.222643574s
Nov 25 09:04:16.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.221461048s
Nov 25 09:04:18.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.22236322s
Nov 25 09:04:20.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.221891666s
Nov 25 09:04:22.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.22158175s
Nov 25 09:04:24.346: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.235562599s
Nov 25 09:04:26.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.221943394s
Nov 25 09:04:28.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.222235915s
Nov 25 09:04:30.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.222382221s
Nov 25 09:04:32.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.222385013s
Nov 25 09:04:34.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.222018068s
Nov 25 09:04:36.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.222600381s
Nov 25 09:04:38.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.222774077s
Nov 25 09:04:40.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.22238918s
Nov 25 09:04:42.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.223791418s
Nov 25 09:04:44.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.221582592s
Nov 25 09:04:46.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.221877184s
Nov 25 09:04:48.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.222428319s
Nov 25 09:04:50.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.222088935s
Nov 25 09:04:52.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.222036002s
Nov 25 09:04:54.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.221762767s
Nov 25 09:04:56.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.222193829s
Nov 25 09:04:58.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.222645085s
Nov 25 09:05:00.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.22320954s
Nov 25 09:05:02.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.222118044s
Nov 25 09:05:04.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.222420544s
Nov 25 09:05:06.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.2251966s
Nov 25 09:05:08.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.221670552s
Nov 25 09:05:10.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.22197044s
Nov 25 09:05:12.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.222150898s
Nov 25 09:05:14.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.222574167s
Nov 25 09:05:16.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.22472457s
Nov 25 09:05:18.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.221837019s
Nov 25 09:05:20.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.221906215s
Nov 25 09:05:22.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.222115058s
Nov 25 09:05:24.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.222305543s
Nov 25 09:05:26.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.223221504s
Nov 25 09:05:28.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.222348424s
Nov 25 09:05:30.331: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.221168015s
Nov 25 09:05:32.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.221903516s
Nov 25 09:05:34.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.222403822s
Nov 25 09:05:36.344: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.233478072s
Nov 25 09:05:38.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.222375534s
Nov 25 09:05:40.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.221797602s
Nov 25 09:05:42.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.22318761s
Nov 25 09:05:44.332: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.221815744s
Nov 25 09:05:46.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.224309468s
Nov 25 09:05:48.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.222389739s
Nov 25 09:05:50.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.223251771s
Nov 25 09:05:52.336: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.225676865s
Nov 25 09:05:54.339: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.22872656s
Nov 25 09:05:56.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.222987323s
Nov 25 09:05:58.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.223689294s
Nov 25 09:06:00.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.222780596s
Nov 25 09:06:02.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.223949087s
Nov 25 09:06:04.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.223509885s
Nov 25 09:06:06.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.223049387s
Nov 25 09:06:08.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.223606842s
Nov 25 09:06:10.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.222818856s
Nov 25 09:06:12.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.223163395s
Nov 25 09:06:14.336: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.225558173s
Nov 25 09:06:16.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.223106846s
Nov 25 09:06:18.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.222526666s
Nov 25 09:06:20.336: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.225572627s
Nov 25 09:06:22.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.222704104s
Nov 25 09:06:24.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.223421713s
Nov 25 09:06:26.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.222559195s
Nov 25 09:06:28.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.223308558s
Nov 25 09:06:30.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.227027605s
Nov 25 09:06:32.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.223253718s
Nov 25 09:06:34.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.223793978s
Nov 25 09:06:36.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.223901343s
Nov 25 09:06:38.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.223267996s
Nov 25 09:06:40.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.223048377s
Nov 25 09:06:42.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.223695575s
Nov 25 09:06:44.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.223524835s
Nov 25 09:06:46.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.22388163s
Nov 25 09:06:48.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.22306816s
Nov 25 09:06:50.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.226608029s
Nov 25 09:06:52.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.222977718s
Nov 25 09:06:54.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.223201624s
Nov 25 09:06:56.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.22427772s
Nov 25 09:06:58.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.224155767s
Nov 25 09:07:00.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.223219252s
Nov 25 09:07:02.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.22401763s
Nov 25 09:07:04.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.22507674s
Nov 25 09:07:06.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.223340918s
Nov 25 09:07:08.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.223253712s
Nov 25 09:07:10.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.223389333s
Nov 25 09:07:12.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.223228777s
Nov 25 09:07:14.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.222770478s
Nov 25 09:07:16.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.224295529s
Nov 25 09:07:18.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.224153188s
Nov 25 09:07:20.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.224986983s
Nov 25 09:07:22.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.223807509s
Nov 25 09:07:24.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.22283924s
Nov 25 09:07:26.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.223442451s
Nov 25 09:07:28.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.223142397s
Nov 25 09:07:30.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.223413788s
Nov 25 09:07:32.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.22340405s
Nov 25 09:07:34.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.223635507s
Nov 25 09:07:36.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.222888148s
Nov 25 09:07:38.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.223380693s
Nov 25 09:07:40.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.222808735s
Nov 25 09:07:42.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.226649175s
Nov 25 09:07:44.335: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.225233766s
Nov 25 09:07:46.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.226390157s
Nov 25 09:07:48.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.223050169s
Nov 25 09:07:50.333: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.223201786s
Nov 25 09:07:52.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.22679018s
Nov 25 09:07:54.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.22397058s
Nov 25 09:07:56.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.223514342s
Nov 25 09:07:58.337: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.226470747s
Nov 25 09:08:00.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.223465161s
Nov 25 09:08:02.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.224030625s
Nov 25 09:08:04.334: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.223734611s
Nov 25 09:08:04.446: INFO: Pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.335664131s
Nov 25 09:08:04.446: INFO: Unexpected error:
<*errors.errorString | 0xc000bf19c0>: {
s: "pod \"pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15\" is not Running: timed out while waiting for pod fsgroupchangepolicy-3904/pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15 to be running",
}
Nov 25 09:08:04.446: FAIL: pod "pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15" is not Running: timed out while waiting for pod fsgroupchangepolicy-3904/pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15 to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0014b9080, 0xc00483de30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 09:08:04.446�[0m
Nov 25 09:08:04.560: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comrnf8j"
�[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 09:08:04.677�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:187
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-3904". �[38;5;243m11/25/22 09:08:04.791�[0m
�[1mSTEP:�[0m Found 5 events. �[38;5;243m11/25/22 09:08:04.903�[0m
Nov 25 09:08:04.904: INFO: At 2022-11-25 09:03:03 +0000 UTC - event for ebs.csi.aws.comrnf8j: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Nov 25 09:08:04.904: INFO: At 2022-11-25 09:03:04 +0000 UTC - event for ebs.csi.aws.comrnf8j: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-3904/ebs.csi.aws.comrnf8j"
Nov 25 09:08:04.904: INFO: At 2022-11-25 09:03:04 +0000 UTC - event for ebs.csi.aws.comrnf8j: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Nov 25 09:08:04.904: INFO: At 2022-11-25 09:03:14 +0000 UTC - event for ebs.csi.aws.comrnf8j: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-3904-e2e-schv72w": rpc error: code = DeadlineExceeded desc = context deadline exceeded
Nov 25 09:08:04.904: INFO: At 2022-11-25 09:05:17 +0000 UTC - event for ebs.csi.aws.comrnf8j: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-3904-e2e-schv72w": rpc error: code = Internal desc = Could not create volume "pvc-55661cef-20c5-4f71-8855-2fa91542a625": could not create volume in EC2: RequestCanceled: request context canceled
caused by: context deadline exceeded
Nov 25 09:08:05.016: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 25 09:08:05.016: INFO: pod-1ac10e19-8931-43cf-8d4c-c6d47fc90b15 Pending []
Nov 25 09:08:05.016: INFO:
Nov 25 09:08:05.241: INFO:
Logging node info for node i-0727ab730bff76f5a
Nov 25 09:08:05.353: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 40159 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:05:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:05:08 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 09:08:05.353: INFO:
Logging kubelet events for node i-0727ab730bff76f5a
Nov 25 09:08:05.477: INFO:
Logging pods the kubelet thinks is on node i-0727ab730bff76f5a
Nov 25 09:08:05.608: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container cilium-operator ready: true, restart count 1
Nov 25 09:08:05.608: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:08:05.608: INFO: Container cilium-agent ready: true, restart count 1
Nov 25 09:08:05.608: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 09:08:05.608: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container healthcheck ready: true, restart count 0
Nov 25 09:08:05.608: INFO: Container kube-apiserver ready: true, restart count 1
Nov 25 09:08:05.608: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container kube-controller-manager ready: true, restart count 2
Nov 25 09:08:05.608: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container kube-scheduler ready: true, restart count 0
Nov 25 09:08:05.608: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container kops-controller ready: true, restart count 0
Nov 25 09:08:05.608: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:05.608: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:05.608: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:05.608: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Nov 25 09:08:05.608: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 09:08:05.608: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:05.608: INFO: Container dns-controller ready: true, restart count 0
Nov 25 09:08:06.009: INFO:
Latency metrics for node i-0727ab730bff76f5a
Nov 25 09:08:06.009: INFO:
Logging node info for node i-078e7a116b258cef8
Nov 25 09:08:06.122: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 44603 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2844":"i-078e7a116b258cef8","ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:07:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:53 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:53 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:53 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:06:53 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 09:08:06.122: INFO:
Logging kubelet events for node i-078e7a116b258cef8
Nov 25 09:08:06.241: INFO:
Logging pods the kubelet thinks is on node i-078e7a116b258cef8
Nov 25 09:08:06.362: INFO: simpletest.rc-ljbdf started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-7cwps started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-m6fpt started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-qpbrp started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-j5p8g started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-5m796 started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-ndxj7 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-zb54k started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-6p7vm started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-7xf24 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-pfb5m started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-5fnk9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-ndgj9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-4c9m6 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-rk6g7 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-svz7r started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 09:08:06.362: INFO: pod-configmaps-a1d1d834-7eb6-4c02-929f-28a5ae86b5a6 started at 2022-11-25 09:07:27 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container agnhost-container ready: true, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-bqr4l started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-82qg4 started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:06.362: INFO: csi-mockplugin-0 started at 2022-11-25 09:07:38 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container driver-registrar ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container mock ready: true, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-dktd5 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-nn5fw started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-fb4l9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-7fpvc started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-zxmpb started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: simpletest.rc-7fstp started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:06.362: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:06.362: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:06.362: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:06.362: INFO: pvc-volume-tester-gmjz2 started at 2022-11-25 09:07:43 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:06.362: INFO: Container volume-tester ready: true, restart count 0
Nov 25 09:08:06.362: INFO: simpletest.rc-c7skw started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.045: INFO:
Latency metrics for node i-078e7a116b258cef8
Nov 25 09:08:07.045: INFO:
Logging node info for node i-08bdea9de27e461c9
Nov 25 09:08:07.157: INFO: Node Info: &Node{ObjectMeta:{i-08bdea9de27e461c9 834c6963-66cf-42fe-b873-2f0234613b72 43375 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08bdea9de27e461c9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08bdea9de27e461c9 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.73 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08bdea9de27e461c9"} io.cilium.network.ipv4-cilium-host:172.20.45.196 io.cilium.network.ipv4-health-ip:172.20.57.3 io.cilium.network.ipv4-pod-cidr:100.96.3.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:06:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08bdea9de27e461c9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:06:48 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.73,},NodeAddress{Type:ExternalIP,Address:3.70.111.228,},NodeAddress{Type:InternalDNS,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08bdea9de27e461c9.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-228.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec272b9e6da1810fed6f3c085c18d9e2,SystemUUID:ec272b9e-6da1-810f-ed6f-3c085c18d9e2,BootID:1b78ee0d-1e3d-4eb1-855c-275b0c59d980,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:21331383,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 09:08:07.158: INFO:
Logging kubelet events for node i-08bdea9de27e461c9
Nov 25 09:08:07.273: INFO:
Logging pods the kubelet thinks is on node i-08bdea9de27e461c9
Nov 25 09:08:07.393: INFO: simpletest.rc-4s52g started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-qq4dd started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-r9m4j started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-xz497 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-d8bq4 started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.393: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:07.393: INFO: simpletest.rc-h6rqz started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-tv5gz started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-pj9d4 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-bgkkc started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-dnx8h started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-n7gx8 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-q879w started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.393: INFO: simpletest.rc-9b6hg started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: simpletest.rc-bz4db started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-v4k6r started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: simpletest.rc-wjwjs started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-7qg2k started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-x6qw7 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: cilium-2r5f4 started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:08:07.394: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 09:08:07.394: INFO: coredns-6c7bddbb75-9fcrr started at 2022-11-25 08:39:52 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container coredns ready: true, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-s9qz9 started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-xs4np started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-s5bqh started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: simpletest.rc-wjbn9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: simpletest.rc-6r9w5 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: simpletest.rc-q29j9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:07.394: INFO: ebs-csi-node-p4v29 started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:07.394: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:07.394: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:07.394: INFO: inline-volume-p5p7r started at 2022-11-25 09:07:46 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:07.394: INFO: Container volume-tester ready: false, restart count 0
Nov 25 09:08:07.394: INFO: simpletest.rc-8gpff started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.027: INFO:
Latency metrics for node i-08bdea9de27e461c9
Nov 25 09:08:08.027: INFO:
Logging node info for node i-08ef366c24e606a30
Nov 25 09:08:08.139: INFO: Node Info: &Node{ObjectMeta:{i-08ef366c24e606a30 c6d45b9b-e507-427d-9b6d-ab37d2ced97d 45013 0 2022-11-25 08:39:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-08ef366c24e606a30 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-08ef366c24e606a30 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.230 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4135":"i-08ef366c24e606a30","csi-hostpath-volume-expand-251":"i-08ef366c24e606a30","csi-mock-csi-mock-volumes-8588":"i-08ef366c24e606a30","ebs.csi.aws.com":"i-08ef366c24e606a30"} io.cilium.network.ipv4-cilium-host:172.20.44.232 io.cilium.network.ipv4-health-ip:172.20.35.43 io.cilium.network.ipv4-pod-cidr:100.96.1.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 09:08:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-25 09:08:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-08ef366c24e606a30,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:00 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:00 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:08:00 +0000 UTC,LastTransitionTime:2022-11-25 08:39:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:08:00 +0000 UTC,LastTransitionTime:2022-11-25 08:39:34 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.230,},NodeAddress{Type:ExternalIP,Address:3.70.111.98,},NodeAddress{Type:InternalDNS,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08ef366c24e606a30.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-70-111-98.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2abf94c63dc02b574ac47850927815,SystemUUID:ec2abf94-c63d-c02b-574a-c47850927815,BootID:8881216a-2a00-4f41-8624-0b9d5450311f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:81430082,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:22614022,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:14179247,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:13423150,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2003505,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-4135^a205966a-6ca0-11ed-9661-ce95fd660336 kubernetes.io/csi/csi-hostpath-ephemeral-4135^a20666f3-6ca0-11ed-9661-ce95fd660336 kubernetes.io/csi/csi-hostpath-volume-expand-251^8475b284-6ca0-11ed-b6fe-46105c09a806],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-251^8475b284-6ca0-11ed-b6fe-46105c09a806,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-4135^a205966a-6ca0-11ed-9661-ce95fd660336,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-4135^a20666f3-6ca0-11ed-9661-ce95fd660336,DevicePath:,},},Config:nil,},}
Nov 25 09:08:08.139: INFO:
Logging kubelet events for node i-08ef366c24e606a30
Nov 25 09:08:08.255: INFO:
Logging pods the kubelet thinks is on node i-08ef366c24e606a30
Nov 25 09:08:08.384: INFO: csi-mockplugin-attacher-0 started at 2022-11-25 09:07:39 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-cpp6s started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-hfggh started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: coredns-autoscaler-db7b97744-wkgfj started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container autoscaler ready: true, restart count 0
Nov 25 09:08:08.384: INFO: ebs-csi-controller-847c4b8bc4-qv6cn started at 2022-11-25 08:39:34 +0000 UTC (0+5 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:08.384: INFO: coredns-6c7bddbb75-rl69v started at 2022-11-25 08:39:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container coredns ready: true, restart count 0
Nov 25 09:08:08.384: INFO: pod-b66cb4f7-4b90-499a-852d-67d92859d659 started at 2022-11-25 09:07:00 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container write-pod ready: true, restart count 0
Nov 25 09:08:08.384: INFO: inline-volume-tester-nm87d started at 2022-11-25 09:07:49 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container csi-volume-tester ready: true, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-758dp started at 2022-11-25 09:08:03 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:08.384: INFO: cilium-76fhq started at 2022-11-25 08:39:15 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 09:08:08.384: INFO: csi-hostpathplugin-0 started at 2022-11-25 09:06:57 +0000 UTC (0+7 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-snapshotter ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container hostpath ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-ktfpc started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-fnrs9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-8kfvh started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:08.384: INFO: csi-hostpathplugin-0 started at 2022-11-25 09:07:45 +0000 UTC (0+7 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container csi-attacher ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-resizer ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container csi-snapshotter ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container hostpath ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-5ff9w started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-xck8k started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-6rrlm started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-gkltc started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-f9t92 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: ebs-csi-node-8srvx started at 2022-11-25 08:39:15 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-958ng started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-9mm7d started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-gs4wp started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-6qrjm started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-srq8h started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-hz5qh started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-qc9pt started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: csi-mockplugin-0 started at 2022-11-25 09:07:39 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container csi-provisioner ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container driver-registrar ready: true, restart count 0
Nov 25 09:08:08.384: INFO: Container mock ready: true, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-cqcwz started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-qbvvv started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:08.384: INFO: simpletest.rc-5gfqd started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-w26vr started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:08.384: INFO: simpletest.rc-pmjsd started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:08.384: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:09.162: INFO:
Latency metrics for node i-08ef366c24e606a30
Nov 25 09:08:09.162: INFO:
Logging node info for node i-0eefb921dfa90622c
Nov 25 09:08:09.274: INFO: Node Info: &Node{ObjectMeta:{i-0eefb921dfa90622c a2a52bc0-0684-4e14-a7ef-930ef6ca6501 43679 0 2022-11-25 08:39:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0eefb921dfa90622c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-0eefb921dfa90622c topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.57.19 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0eefb921dfa90622c"} io.cilium.network.ipv4-cilium-host:172.20.51.17 io.cilium.network.ipv4-health-ip:172.20.38.38 io.cilium.network.ipv4-pod-cidr:100.96.4.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:44 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:07:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0eefb921dfa90622c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198352896 0} {<nil>} 8006204Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093495296 0} {<nil>} 7903804Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:44 +0000 UTC,LastTransitionTime:2022-11-25 08:39:44 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:06:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:06:19 +0000 UTC,LastTransitionTime:2022-11-25 08:39:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.57.19,},NodeAddress{Type:ExternalIP,Address:3.120.36.237,},NodeAddress{Type:InternalDNS,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0eefb921dfa90622c.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-36-237.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b2105192662d38bdbc3c6758e5e2,SystemUUID:ec25b210-5192-662d-38bd-bc3c6758e5e2,BootID:ee4856ad-9970-485d-9730-8de9f2f3a57f,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:116764911,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:18562388,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 09:08:09.275: INFO:
Logging kubelet events for node i-0eefb921dfa90622c
Nov 25 09:08:09.390: INFO:
Logging pods the kubelet thinks is on node i-0eefb921dfa90622c
Nov 25 09:08:09.510: INFO: simpletest.rc-k7f6z started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-b75jj started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: pod-4862cbe3-6f66-40df-927b-b97df6deca45 started at 2022-11-25 09:07:59 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container test-container ready: false, restart count 0
Nov 25 09:08:09.510: INFO: pod-secrets-2d688d20-4b67-4f1a-9944-6d9563699a6b started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-kwzvv started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-gpj9x started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-chm62 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-ptfd6 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-k9msw started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-wnmk6 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: cilium-9bjrj started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:08:09.510: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-ncqvl started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-c748l started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-kqx62 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: busybox-0e99488a-1f9b-421b-afa9-dae09c05973b started at 2022-11-25 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container busybox ready: false, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-nkf9n started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-sg998 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-q97gd started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: pod-csi-inline-volumes started at 2022-11-25 09:07:24 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container pod-csi-inline-volumes ready: false, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-fvfm4 started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-dwsq6 started at 2022-11-25 09:08:02 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container nginx ready: false, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-r6mnr started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-w7rct started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-vb58r started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: ebs-csi-node-cpwxl started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:08:09.510: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:08:09.510: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:08:09.510: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:08:09.510: INFO: simpletest.rc-hhf8z started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-t2wsj started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-c7x2z started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:09.510: INFO: simpletest.rc-84kj9 started at <nil> (0+0 container statuses recorded)
Nov 25 09:08:10.137: INFO:
Latency metrics for node i-0eefb921dfa90622c
Nov 25 09:08:10.137: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-3904" for this suite. �[38;5;243m11/25/22 09:08:10.251�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(OnRootMismatch\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001327600, 0xc0039bfe30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
{"msg":"FAILED External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","completed":20,"skipped":141,"failed":2,"failures":["External Storage [Driver: ebs.csi.aws.com] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should create read/write inline ephemeral volume","External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:186
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m11/25/22 09:09:06.215�[0m
Nov 25 09:09:06.215: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m11/25/22 09:09:06.216�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m11/25/22 09:09:06.555�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m11/25/22 09:09:06.783�[0m
[It] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:216
Nov 25 09:09:07.008: INFO: Creating resource for dynamic PV
Nov 25 09:09:07.008: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-1642-e2e-sc85t9z �[38;5;243m11/25/22 09:09:07.008�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m11/25/22 09:09:07.121�[0m
Nov 25 09:09:07.121: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-1642 with fsgroup 1000 �[38;5;243m11/25/22 09:09:07.348�[0m
Nov 25 09:09:07.462: INFO: Waiting up to 5m0s for pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16" in namespace "fsgroupchangepolicy-1642" to be "running"
Nov 25 09:09:07.575: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 113.024584ms
Nov 25 09:09:09.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226554949s
Nov 25 09:09:11.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226285687s
Nov 25 09:09:13.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 6.22662896s
Nov 25 09:09:15.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 8.226398665s
Nov 25 09:09:17.690: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 10.227732113s
Nov 25 09:09:19.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 12.226618453s
Nov 25 09:09:21.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 14.226637853s
Nov 25 09:09:23.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 16.226561017s
Nov 25 09:09:25.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 18.226699671s
Nov 25 09:09:27.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 20.226373988s
Nov 25 09:09:29.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 22.227245604s
Nov 25 09:09:31.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 24.226624867s
Nov 25 09:09:33.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 26.226729909s
Nov 25 09:09:35.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 28.226513413s
Nov 25 09:09:37.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 30.22617189s
Nov 25 09:09:39.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226643963s
Nov 25 09:09:41.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 34.22681719s
Nov 25 09:09:43.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 36.226352484s
Nov 25 09:09:45.691: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 38.22913606s
Nov 25 09:09:47.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 40.226818109s
Nov 25 09:09:49.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 42.227126877s
Nov 25 09:09:51.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 44.226250568s
Nov 25 09:09:53.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 46.226033257s
Nov 25 09:09:55.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 48.226050743s
Nov 25 09:09:57.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 50.226741276s
Nov 25 09:09:59.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 52.225977488s
Nov 25 09:10:01.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 54.227183352s
Nov 25 09:10:03.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 56.226307626s
Nov 25 09:10:05.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 58.226714567s
Nov 25 09:10:07.690: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.227480745s
Nov 25 09:10:09.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.227031262s
Nov 25 09:10:11.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.226782863s
Nov 25 09:10:13.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.226754611s
Nov 25 09:10:15.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.226703989s
Nov 25 09:10:17.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.226721215s
Nov 25 09:10:19.693: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.230249732s
Nov 25 09:10:21.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.225926429s
Nov 25 09:10:23.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.226633085s
Nov 25 09:10:25.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.226686877s
Nov 25 09:10:27.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.226187796s
Nov 25 09:10:29.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.226323593s
Nov 25 09:10:31.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.226331633s
Nov 25 09:10:33.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.227011882s
Nov 25 09:10:35.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.226712804s
Nov 25 09:10:37.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.226746039s
Nov 25 09:10:39.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.226383012s
Nov 25 09:10:41.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.226709334s
Nov 25 09:10:43.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.226834493s
Nov 25 09:10:45.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.226714367s
Nov 25 09:10:47.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.226576554s
Nov 25 09:10:49.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.226680035s
Nov 25 09:10:51.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.22680117s
Nov 25 09:10:53.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.22649185s
Nov 25 09:10:55.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.226734146s
Nov 25 09:10:57.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.226682485s
Nov 25 09:10:59.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.226534182s
Nov 25 09:11:01.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.226627208s
Nov 25 09:11:03.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.226691403s
Nov 25 09:11:05.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.226797396s
Nov 25 09:11:07.691: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.22849687s
Nov 25 09:11:09.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.226790966s
Nov 25 09:11:11.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226985957s
Nov 25 09:11:13.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.226425309s
Nov 25 09:11:15.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.226347864s
Nov 25 09:11:17.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.22713468s
Nov 25 09:11:19.691: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.228616258s
Nov 25 09:11:21.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.22689374s
Nov 25 09:11:23.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.226884393s
Nov 25 09:11:25.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.226834262s
Nov 25 09:11:27.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.227098918s
Nov 25 09:11:29.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.226583061s
Nov 25 09:11:31.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.226839674s
Nov 25 09:11:33.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.226700772s
Nov 25 09:11:35.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.226644041s
Nov 25 09:11:37.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.227193516s
Nov 25 09:11:39.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.226627802s
Nov 25 09:11:41.690: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.227343627s
Nov 25 09:11:43.690: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.227731738s
Nov 25 09:11:45.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226599792s
Nov 25 09:11:47.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.227005455s
Nov 25 09:11:49.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.22618066s
Nov 25 09:11:51.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.22691921s
Nov 25 09:11:53.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.227075142s
Nov 25 09:11:55.690: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.227284747s
Nov 25 09:11:57.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.226768571s
Nov 25 09:11:59.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.226792199s
Nov 25 09:12:01.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.226821073s
Nov 25 09:12:03.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.22711076s
Nov 25 09:12:05.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.226945307s
Nov 25 09:12:07.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.227121845s
Nov 25 09:12:09.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.22717829s
Nov 25 09:12:11.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.226490396s
Nov 25 09:12:13.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.227111241s
Nov 25 09:12:15.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.22677467s
Nov 25 09:12:17.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.226968948s
Nov 25 09:12:19.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.22716965s
Nov 25 09:12:21.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.226714883s
Nov 25 09:12:23.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.226739989s
Nov 25 09:12:25.692: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.229250089s
Nov 25 09:12:27.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.226894454s
Nov 25 09:12:29.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.226382276s
Nov 25 09:12:31.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.22645597s
Nov 25 09:12:33.691: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.228338826s
Nov 25 09:12:35.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.226860481s
Nov 25 09:12:37.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.22681583s
Nov 25 09:12:39.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.226262338s
Nov 25 09:12:41.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.226388852s
Nov 25 09:12:43.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.226741449s
Nov 25 09:12:45.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.225958682s
Nov 25 09:12:47.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.226641896s
Nov 25 09:12:49.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.226276277s
Nov 25 09:12:51.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.22660387s
Nov 25 09:12:53.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.225900227s
Nov 25 09:12:55.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.225503451s
Nov 25 09:12:57.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.226032993s
Nov 25 09:12:59.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.22570372s
Nov 25 09:13:01.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.226029193s
Nov 25 09:13:03.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.225453787s
Nov 25 09:13:05.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.226056094s
Nov 25 09:13:07.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.225548618s
Nov 25 09:13:09.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.226022926s
Nov 25 09:13:11.687: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.225224865s
Nov 25 09:13:13.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.22568077s
Nov 25 09:13:15.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.225408827s
Nov 25 09:13:17.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.225931753s
Nov 25 09:13:19.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.225869528s
Nov 25 09:13:21.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.225791184s
Nov 25 09:13:23.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.226352967s
Nov 25 09:13:25.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.225827762s
Nov 25 09:13:27.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.226013054s
Nov 25 09:13:29.689: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.226403288s
Nov 25 09:13:31.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.22591083s
Nov 25 09:13:33.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.225946575s
Nov 25 09:13:35.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.225725459s
Nov 25 09:13:37.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.225829567s
Nov 25 09:13:39.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.225862937s
Nov 25 09:13:41.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.225657148s
Nov 25 09:13:43.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.225973521s
Nov 25 09:13:45.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.225948953s
Nov 25 09:13:47.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.225605819s
Nov 25 09:13:49.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.225643369s
Nov 25 09:13:51.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.225910193s
Nov 25 09:13:53.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.225392302s
Nov 25 09:13:55.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.225983957s
Nov 25 09:13:57.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.225735046s
Nov 25 09:13:59.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.225871263s
Nov 25 09:14:01.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.225814057s
Nov 25 09:14:03.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.225806744s
Nov 25 09:14:05.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.22579432s
Nov 25 09:14:07.688: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.22597595s
Nov 25 09:14:07.800: INFO: Pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.337795929s
Nov 25 09:14:07.800: INFO: Unexpected error:
<*errors.errorString | 0xc000cfa460>: {
s: "pod \"pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16\" is not Running: timed out while waiting for pod fsgroupchangepolicy-1642/pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16 to be running",
}
Nov 25 09:14:07.800: FAIL: pod "pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16" is not Running: timed out while waiting for pod fsgroupchangepolicy-1642/pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16 to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001327600, 0xc0039bfe30, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m11/25/22 09:14:07.8�[0m
Nov 25 09:14:07.912: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comsxx67"
�[1mSTEP:�[0m Deleting sc �[38;5;243m11/25/22 09:14:08.025�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/framework.go:187
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-1642". �[38;5;243m11/25/22 09:14:08.139�[0m
�[1mSTEP:�[0m Found 5 events. �[38;5;243m11/25/22 09:14:08.251�[0m
Nov 25 09:14:08.251: INFO: At 2022-11-25 09:09:07 +0000 UTC - event for ebs.csi.aws.comsxx67: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Nov 25 09:14:08.251: INFO: At 2022-11-25 09:09:07 +0000 UTC - event for ebs.csi.aws.comsxx67: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Nov 25 09:14:08.251: INFO: At 2022-11-25 09:09:07 +0000 UTC - event for ebs.csi.aws.comsxx67: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-1642/ebs.csi.aws.comsxx67"
Nov 25 09:14:08.251: INFO: At 2022-11-25 09:09:17 +0000 UTC - event for ebs.csi.aws.comsxx67: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-1642-e2e-sc85t9z": rpc error: code = DeadlineExceeded desc = context deadline exceeded
Nov 25 09:14:08.251: INFO: At 2022-11-25 09:09:40 +0000 UTC - event for ebs.csi.aws.comsxx67: {ebs.csi.aws.com_ebs-csi-controller-847c4b8bc4-gxkj2_69e19bb5-934d-438a-8d5d-f152afa7c31a } ProvisioningFailed: failed to provision volume with StorageClass "fsgroupchangepolicy-1642-e2e-sc85t9z": rpc error: code = Internal desc = Could not create volume "pvc-bd4cb5d9-d050-4902-8714-7c301f3df3e8": could not create volume in EC2: RequestCanceled: request context canceled
caused by: context deadline exceeded
Nov 25 09:14:08.364: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 25 09:14:08.364: INFO: pod-6611b3ce-ee61-4dd3-91d6-7ab75a2b4c16 Pending []
Nov 25 09:14:08.364: INFO:
Nov 25 09:14:08.588: INFO:
Logging node info for node i-0727ab730bff76f5a
Nov 25 09:14:08.701: INFO: Node Info: &Node{ObjectMeta:{i-0727ab730bff76f5a b8714f8b-ff15-4b10-960a-9bed61649af9 48861 0 2022-11-25 08:37:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:c6g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:arm64 kubernetes.io/hostname:i-0727ab730bff76f5a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c6g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.95 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0727ab730bff76f5a"} io.cilium.network.ipv4-cilium-host:172.20.63.224 io.cilium.network.ipv4-health-ip:172.20.39.144 io.cilium.network.ipv4-pod-cidr:100.96.0.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-25 08:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-11-25 08:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:37:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-25 08:37:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {cilium-agent Update v1 2022-11-25 08:39:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:10:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-0727ab730bff76f5a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{4001943552 0} {<nil>} 3908148Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{3897085952 0} {<nil>} 3805748Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:09 +0000 UTC,LastTransitionTime:2022-11-25 08:39:09 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:10:14 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:10:14 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:10:14 +0000 UTC,LastTransitionTime:2022-11-25 08:36:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:10:14 +0000 UTC,LastTransitionTime:2022-11-25 08:37:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.95,},NodeAddress{Type:ExternalIP,Address:18.192.25.177,},NodeAddress{Type:InternalDNS,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0727ab730bff76f5a.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-192-25-177.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2a1bec896a43ab3fbff9f0ee608705,SystemUUID:ec2a1bec-896a-43ab-3fbf-f9f0ee608705,BootID:c777da03-ecd0-462c-ae2f-eabe27682b47,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:a91fdaf9b988943a9c73d422348c2383c08dfc2566d4124a39a1b3d785018720 registry.k8s.io/etcdadm/etcd-manager:v3.0.20220831],SizeBytes:192060250,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-arm64:v1.25.4],SizeBytes:124543443,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-arm64:v1.25.4],SizeBytes:113991993,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-arm64:v1.25.4],SizeBytes:50618680,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.1],SizeBytes:39814386,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.1],SizeBytes:38425953,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[quay.io/cilium/operator@sha256:e2b26376a904190c73498e04bd5c1298a4c5239d50feab024074e4516381890f quay.io/cilium/operator:v1.11.11],SizeBytes:21723798,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:85d3f1e9dacc72531445989bb10999e1e70ebc409d11be57e5baa5f031a893b0 registry.k8s.io/provider-aws/cloud-controller-manager:v1.25.1],SizeBytes:16629305,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.1],SizeBytes:4674257,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 09:14:08.701: INFO:
Logging kubelet events for node i-0727ab730bff76f5a
Nov 25 09:14:08.816: INFO:
Logging pods the kubelet thinks is on node i-0727ab730bff76f5a
Nov 25 09:14:08.934: INFO: kube-controller-manager-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container kube-controller-manager ready: true, restart count 2
Nov 25 09:14:08.934: INFO: kube-scheduler-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container kube-scheduler ready: true, restart count 0
Nov 25 09:14:08.934: INFO: kops-controller-nrmc9 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container kops-controller ready: true, restart count 0
Nov 25 09:14:08.934: INFO: ebs-csi-node-w62bh started at 2022-11-25 08:37:34 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:14:08.934: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:14:08.934: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:14:08.934: INFO: aws-cloud-controller-manager-rmn9n started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Nov 25 09:14:08.934: INFO: etcd-manager-events-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 09:14:08.934: INFO: etcd-manager-main-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container etcd-manager ready: true, restart count 0
Nov 25 09:14:08.934: INFO: kube-apiserver-i-0727ab730bff76f5a started at 2022-11-25 08:36:26 +0000 UTC (0+2 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container healthcheck ready: true, restart count 0
Nov 25 09:14:08.934: INFO: Container kube-apiserver ready: true, restart count 1
Nov 25 09:14:08.934: INFO: dns-controller-89c6d5f67-7wj2p started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container dns-controller ready: true, restart count 0
Nov 25 09:14:08.934: INFO: cilium-9xs94 started at 2022-11-25 08:37:34 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:14:08.934: INFO: Container cilium-agent ready: true, restart count 1
Nov 25 09:14:08.934: INFO: cilium-operator-7f7bcdf787-wbl84 started at 2022-11-25 08:37:34 +0000 UTC (0+1 container statuses recorded)
Nov 25 09:14:08.934: INFO: Container cilium-operator ready: true, restart count 1
Nov 25 09:14:09.324: INFO:
Latency metrics for node i-0727ab730bff76f5a
Nov 25 09:14:09.324: INFO:
Logging node info for node i-078e7a116b258cef8
Nov 25 09:14:09.436: INFO: Node Info: &Node{ObjectMeta:{i-078e7a116b258cef8 d7a6cbe0-aa65-48ab-a6cb-aaccbded7fbb 49639 0 2022-11-25 08:39:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:arm64 beta.kubernetes.io/instance-type:t4g.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:arm64 kubernetes.io/hostname:i-078e7a116b258cef8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t4g.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-078e7a116b258cef8 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.37.127 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-078e7a116b258cef8"} io.cilium.network.ipv4-cilium-host:172.20.34.223 io.cilium.network.ipv4-health-ip:172.20.49.33 io.cilium.network.ipv4-pod-cidr:100.96.2.0/24 node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-25 08:39:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cilium-agent Update v1 2022-11-25 08:39:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:io.cilium.network.ipv4-cilium-host":{},"f:io.cilium.network.ipv4-health-ip":{},"f:io.cilium.network.ipv4-pod-cidr":{}}}} status} {cilium-operator Update v1 2022-11-25 08:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-25 09:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-078e7a116b258cef8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49756430336 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8198356992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44780787229 0} {<nil>} 44780787229 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-32Mi: {{0 0} {<nil>} 0 DecimalSI},hugepages-64Ki: {{0 0} {<nil>} 0 DecimalSI},memory: {{8093499392 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-25 08:39:41 +0000 UTC,LastTransitionTime:2022-11-25 08:39:41 +0000 UTC,Reason:CiliumIsUp,Message:Cilium is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-25 09:10:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-25 09:10:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-25 09:10:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:15 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-25 09:10:37 +0000 UTC,LastTransitionTime:2022-11-25 08:39:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.127,},NodeAddress{Type:ExternalIP,Address:3.120.41.110,},NodeAddress{Type:InternalDNS,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e7a116b258cef8.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-120-41-110.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec247c23f864f8709ba9238f25815078,SystemUUID:ec247c23-f864-f870-9ba9-238f25815078,BootID:26632dd2-320e-4fb0-8f2f-06bed3c7aa81,KernelVersion:5.15.0-1023-aws,OSImage:Ubuntu 22.04.1 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:arm64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:fad1627d1c52ff084c3147bbeba7a7b64c60562db38c5e7a9b37c710a8f1d3c1 quay.io/cilium/cilium:v1.11.11],SizeBytes:152037842,},ContainerImage{Names:[registry.k8s.io/kube-proxy-arm64:v1.25.4],SizeBytes:59581641,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:49338537,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:47953796,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41529241,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40344024,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:21c6eedc2a80bfec5dee669d30d9b5ca83e68cd097f0e210917ae91312e590ff registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.12.0],SizeBytes:27831686,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:21735644,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:21302243,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:20848413,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:20644525,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:20565480,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:20326360,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:20121824,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15082263,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:8502345,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:8501786,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8096502,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:7685305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:6883774,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6860516,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:5025027,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:773367,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:268403,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:253553,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 25 09:14:09.437: INFO:
Logging kubelet events for node i-078e7a116b258cef8
Nov 25 09:14:09.551: INFO:
Logging pods the kubelet thinks is on node i-078e7a116b258cef8
Nov 25 09:14:09.669: INFO: cilium-l6w8x started at 2022-11-25 08:39:16 +0000 UTC (1+1 container statuses recorded)
Nov 25 09:14:09.669: INFO: Init container clean-cilium-state ready: true, restart count 0
Nov 25 09:14:09.669: INFO: Container cilium-agent ready: true, restart count 0
Nov 25 09:14:09.669: INFO: ebs-csi-node-72nqq started at 2022-11-25 08:39:16 +0000 UTC (0+3 container statuses recorded)
Nov 25 09:14:09.669: INFO: Container ebs-plugin ready: true, restart count 0
Nov 25 09:14:09.669: INFO: Container liveness-probe ready: true, restart count 0
Nov 25 09:14:09.669: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 25 09:14:09.669: INFO: ebs-csi-controller-847c4b8bc4-gxkj2 started at 2022-11-25 08:39:37 +0000 UTC (0+5 container statuses recorded)
Nov 25 09:14:09.669